-- Logs begin at Thu 2022-07-28 10:42:02 UTC, end at Thu 2022-07-28 13:20:32 UTC. -- Jul 28 11:14:12.827678 n-d-851368-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 11:14:12.836278 n-d-851368-1 devstack@n-api.service[103911]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 11:14:12 2022] *** Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: nodename: n-d-851368-1 Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: machine: x86_64 Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: clock source: unix Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: pcre jit disabled Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: detected number of CPU cores: 4 Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: current working directory: / Jul 28 11:14:12.838796 n-d-851368-1 devstack@n-api.service[103911]: detected binary path: /usr/bin/uwsgi-core Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: your processes number limit is 47680 Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: your memory page size is 4096 bytes Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: detected max file descriptor number: 2048 Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: lock engine: pthread robust mutexes Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: thunder lock: enabled Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 11:14:12.839534 n-d-851368-1 devstack@n-api.service[103911]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 11:14:12.879864 n-d-851368-1 devstack@n-api.service[103911]: Python main interpreter initialized at 0x55d58e71e9c0 Jul 28 11:14:12.879864 n-d-851368-1 devstack@n-api.service[103911]: python threads support enabled Jul 28 11:14:12.879864 n-d-851368-1 devstack@n-api.service[103911]: your server socket listen backlog is limited to 100 connections Jul 28 11:14:12.879864 n-d-851368-1 devstack@n-api.service[103911]: your mercy for graceful operations on workers is 90 seconds Jul 28 11:14:12.880209 n-d-851368-1 devstack@n-api.service[103911]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 11:14:12.880334 n-d-851368-1 devstack@n-api.service[103911]: *** Operational MODE: preforking *** Jul 28 11:14:12.880567 n-d-851368-1 devstack@n-api.service[103911]: *** uWSGI is running in multiple interpreter mode *** Jul 28 11:14:12.880567 n-d-851368-1 devstack@n-api.service[103911]: spawned uWSGI master process (pid: 103911) Jul 28 11:14:12.880752 n-d-851368-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 11:14:12.881274 n-d-851368-1 devstack@n-api.service[103911]: spawned uWSGI worker 1 (pid: 103912, cores: 1) Jul 28 11:14:12.881606 n-d-851368-1 devstack@n-api.service[103911]: spawned uWSGI worker 2 (pid: 103913, cores: 1) Jul 28 11:14:12.881779 n-d-851368-1 devstack@n-api.service[103911]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 11:14:13.533874 n-d-851368-1 devstack@n-api.service[103912]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 11:14:13.534472 n-d-851368-1 devstack@n-api.service[103913]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 11:14:14.604115 n-d-851368-1 devstack@n-api.service[103912]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:14:14.604115 n-d-851368-1 devstack@n-api.service[103912]: from cryptography.utils import int_from_bytes Jul 28 11:14:14.604738 n-d-851368-1 devstack@n-api.service[103912]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:14:14.604738 n-d-851368-1 devstack@n-api.service[103912]: from cryptography.utils import int_from_bytes Jul 28 11:14:14.604860 n-d-851368-1 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:14:14.604860 n-d-851368-1 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Jul 28 11:14:14.605260 n-d-851368-1 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:14:14.605260 n-d-851368-1 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Jul 28 11:14:17.092794 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:14:17.093339 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:14:17.093553 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:14:17.093902 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:14:17.094149 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:14:17.094524 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.094842 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.095176 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.095336 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:14:17.095686 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.095784 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:14:17.095874 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.096086 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.096184 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:14:17.096395 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.096506 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:14:17.096682 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:14:17.096789 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097009 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097095 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097261 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097374 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097571 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097692 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.097884 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851368-1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098006 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098197 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098331 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098500 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098636 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098784 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.098950 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099107 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099293 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099396 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099615 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099700 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099873 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.099988 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.100184 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.100478 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.100872 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851368-1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.100872 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101113 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101223 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101337 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101441 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101552 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101760 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.101881 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102063 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102190 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102372 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102489 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102701 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.102791 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103000 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103238 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103344 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103545 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103629 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103845 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.103986 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851368-1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104133 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104294 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104469 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104598 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104777 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.104904 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105079 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105308 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105407 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105609 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105702 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105907 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.105994 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106220 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106335 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106528 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106695 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851368-1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106829 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.106955 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107168 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107303 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107486 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107582 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107794 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.107976 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108103 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108282 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108396 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108584 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108693 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108898 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.108996 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109215 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109313 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109518 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109604 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109837 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.109921 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110081 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110177 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110379 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110465 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110690 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.110775 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111000 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111132 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111340 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111438 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111586 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111672 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111830 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.111924 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112138 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112269 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112450 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112550 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112747 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.112841 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113044 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113128 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113340 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113443 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113638 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113724 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.113935 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114028 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114194 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114287 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114441 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114534 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114754 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.114845 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115076 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115164 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115386 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115472 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115687 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115772 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.115988 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116074 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116292 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116418 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116593 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116689 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116892 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.116985 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117187 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117298 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117484 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117574 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117795 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.117894 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118126 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118216 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118436 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118537 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118735 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.118825 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119033 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119154 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119354 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119465 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119652 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119744 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.119962 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120053 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120283 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120384 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120579 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120680 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120825 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.120917 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121117 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121223 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121412 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121512 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121719 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.121811 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122015 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122107 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122312 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122408 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122611 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122713 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122903 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.122995 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123223 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123326 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123486 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123574 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123796 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.123895 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124068 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124155 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124373 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124470 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124669 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124767 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.124967 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125064 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125259 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125348 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125552 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125643 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125853 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.125944 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126153 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126253 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126447 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126537 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126742 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.126833 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127035 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127162 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127354 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127447 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127652 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127752 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.127949 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128049 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128240 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128337 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128548 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128638 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128840 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.128938 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129134 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129226 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129428 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129518 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129722 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.129821 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130016 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130114 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130320 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130416 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130614 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130718 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.130906 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131005 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131238 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131329 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131532 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131646 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131828 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.131918 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132117 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132216 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132442 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132548 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132704 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132796 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.132999 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.133099 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.133289 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.133395 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.133581 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.133673 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.134397 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.134494 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.134705 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.134801 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135003 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135127 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135328 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135422 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135623 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135710 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.135916 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136002 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136212 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136304 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136509 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136604 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.136807 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.136901 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.137102 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.137217 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.137415 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.137501 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.137731 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.137818 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.138032 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.138127 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.138330 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.138416 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.138629 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.138724 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.138941 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:14:17.139040 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139282 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139369 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139586 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139689 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139888 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.139976 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140189 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140274 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140497 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140591 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140804 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.140893 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141123 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141217 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141431 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141530 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141737 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.141830 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142041 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142127 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142341 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142436 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142644 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142742 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.142947 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143034 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143279 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143379 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143582 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143670 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143902 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.143988 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144218 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144305 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144526 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144669 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144835 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.144969 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145140 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145277 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145441 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145583 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145745 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.145872 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146048 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146191 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146351 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146476 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146672 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146799 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.146975 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147146 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147309 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147438 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147617 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147753 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.147920 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148056 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148222 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148350 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148525 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148652 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148827 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.148955 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.149139 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.149274 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150031 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150168 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150327 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150457 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150670 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150799 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.150979 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151132 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151316 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151451 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151617 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151744 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.151921 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152060 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152217 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152346 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152515 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152669 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152813 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.152941 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153114 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153243 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153412 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153540 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153723 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.153860 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154033 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154160 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154329 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154464 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154632 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154771 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.154933 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155061 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155256 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155379 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155546 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155683 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155848 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.155982 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.156146 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.156275 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.156449 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.156588 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.156966 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157096 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157209 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157315 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157430 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157537 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157661 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157784 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.157928 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158056 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158242 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158369 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158539 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158666 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158835 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.158976 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159162 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159290 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159466 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159600 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159768 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.159893 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160071 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160198 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160374 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160510 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160675 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160811 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.160981 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161116 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161280 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161407 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161582 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161718 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.161892 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162020 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162198 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162334 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162506 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162655 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162814 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.162943 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163140 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163273 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163439 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163580 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163742 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.163871 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164038 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164166 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164336 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164466 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164634 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164762 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.164961 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165091 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165270 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165399 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165569 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165707 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165867 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.165996 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166162 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166292 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166458 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166586 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166771 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.166900 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167101 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167233 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167395 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167535 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167696 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167832 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.167992 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168135 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168291 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168418 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168591 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168733 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.168891 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169020 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169192 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169320 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169510 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169648 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169814 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.169943 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170116 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170246 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170415 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170553 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170713 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.170840 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171016 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171246 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171387 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171521 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171652 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171777 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.171931 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172059 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172235 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172366 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172545 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172683 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172846 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.172966 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173170 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173299 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173448 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173577 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173756 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.173884 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174053 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174183 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174359 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174489 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174671 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174805 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.174977 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175142 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175313 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175443 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175619 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175756 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.175921 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176048 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176228 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176354 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176527 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176676 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176828 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.176946 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177126 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177253 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177432 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177572 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177743 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.177871 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178045 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178173 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178356 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178498 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178656 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178784 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.178963 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179146 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179287 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179419 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179585 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179726 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.179883 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180018 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180184 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180321 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180494 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180628 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.180840 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181003 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181140 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181324 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181461 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181632 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181762 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.181951 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182088 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182258 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182426 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182574 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182714 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.182876 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183013 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183195 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183335 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183497 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183627 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183802 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.183932 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184103 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184232 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184406 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184534 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184702 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.184831 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185008 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185143 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185310 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185436 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185605 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185740 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.185901 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186030 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186199 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186334 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186506 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186641 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186807 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.186933 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187135 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187278 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187446 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187574 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187741 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.187867 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188039 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188176 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188342 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188468 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188640 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188795 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.188920 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189073 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189220 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189349 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189517 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189653 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189827 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.189962 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190140 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190267 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190437 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190566 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190742 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.190868 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191043 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191191 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191368 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191507 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191674 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191809 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.191974 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192102 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192274 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192401 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192573 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192708 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.192878 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193005 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193180 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193309 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193486 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193615 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193790 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.193918 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194092 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194233 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194396 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194533 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194711 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.194839 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195014 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195181 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195342 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195479 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195646 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195775 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.195945 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.196084 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.196774 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.196903 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197084 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197212 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197394 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197643 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197772 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.197977 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198105 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198287 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198423 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198590 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198724 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.198896 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.199031 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.199487 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.199629 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.199790 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.199919 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200095 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200224 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200409 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200547 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200721 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.200969 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201098 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201297 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201425 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201596 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201732 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.201898 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202027 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202198 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202327 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202497 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202642 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202794 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.202923 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203109 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203241 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203411 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203548 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203708 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.203847 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204004 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204132 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204302 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204430 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204607 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204736 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.204906 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205027 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205208 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205345 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205504 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205632 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205804 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.205944 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206105 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206241 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206400 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206528 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206696 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206832 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.206991 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207178 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207306 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207428 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207609 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207737 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.207912 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208269 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208404 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208528 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208653 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208777 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.208910 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209036 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209160 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209283 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209407 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209531 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209664 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209789 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.209965 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210102 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210303 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210432 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210606 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210747 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.210929 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211061 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211250 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211393 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211556 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211685 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.211912 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.212544 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.212708 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.212846 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213009 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213139 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213306 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213426 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213607 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213745 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.213906 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214041 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214209 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214337 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214511 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214653 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214801 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.214939 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215107 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215249 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215408 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215546 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215708 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.215845 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216003 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216143 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216301 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216430 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216593 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216719 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.216893 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217028 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217187 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217339 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217465 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217590 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217811 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.217946 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218088 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218220 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218337 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218478 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218638 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218776 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.218938 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219100 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219262 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219389 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219560 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219700 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219855 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.219991 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220156 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220285 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220452 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220621 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220758 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.220890 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221015 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221140 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221370 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221521 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221663 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221789 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.221913 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222036 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222171 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222308 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222472 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222614 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222769 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.222898 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223098 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223231 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223366 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223494 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223669 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223796 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.223964 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224101 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224258 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224395 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224554 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224683 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224850 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.224979 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225151 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225269 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225449 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225575 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225745 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.225871 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226028 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226155 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226321 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226462 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226616 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226742 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.226913 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227041 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227239 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227377 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227565 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227694 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227864 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.227999 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228182 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228321 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228484 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228612 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228784 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.228924 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229082 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229226 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229375 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229502 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229681 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229809 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.229982 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230111 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230286 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230415 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230581 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230709 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.230878 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231009 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231213 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231343 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231516 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231656 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231818 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.231954 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232127 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232254 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232428 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232558 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232760 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.232887 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233011 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233134 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233309 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233451 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233611 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233741 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.233908 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234035 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234209 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234351 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234510 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234639 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234813 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.234942 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235127 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235270 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235431 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235567 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235733 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.235862 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236034 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236171 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236330 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236458 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236628 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236755 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.236929 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237055 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237222 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237350 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237523 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237657 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237822 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.237949 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238123 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238251 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238421 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238558 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238717 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.238846 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239018 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239169 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239340 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239484 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239686 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239811 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.239942 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240066 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240218 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240355 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240535 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240664 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240839 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.240974 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241140 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241276 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241444 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241581 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241746 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.241881 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242048 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242183 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242347 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242473 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242743 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.242870 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243062 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243247 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243377 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243501 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243675 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243804 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.243970 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244099 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244273 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244405 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244587 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244728 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.244887 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245017 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245182 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245310 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245477 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245612 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245787 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.245916 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246083 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246211 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246393 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246522 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246752 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.246883 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247053 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247216 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247379 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247520 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247700 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.247828 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248000 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248135 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248299 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248436 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248599 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248726 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.248914 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249049 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249215 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249352 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249531 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249673 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.249833 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250011 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250139 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250272 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250431 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250571 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250743 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.250916 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251055 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251237 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251376 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251537 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251667 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251857 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.251994 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252175 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252313 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252492 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252621 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252792 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.252922 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253102 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253241 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253405 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253553 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253728 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.253849 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254047 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254185 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254354 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254485 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254662 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254791 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.254960 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255161 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255290 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255413 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255569 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255698 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.255867 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256006 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256183 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256313 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256481 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256611 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256784 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.256913 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257086 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257216 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257387 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257515 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257683 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257813 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.257985 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.258116 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.258298 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.258435 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.258597 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.259271 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.259472 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.259615 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.259781 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.259924 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260098 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260234 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260394 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260521 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260692 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260829 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.260995 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261123 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261295 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261424 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261592 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261732 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.261885 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262013 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262181 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262310 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262485 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262622 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262797 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.262932 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263129 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263271 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263451 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263581 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263768 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.263897 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264071 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264198 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264385 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264513 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264689 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264819 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.264985 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265124 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265260 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265386 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265560 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265690 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.265873 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266001 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266170 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266300 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266470 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266599 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266766 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.266904 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267062 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267262 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267386 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267510 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267677 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267819 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.267944 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268069 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268228 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268359 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268528 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268667 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268840 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.268968 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269136 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269265 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269449 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269586 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269748 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.269889 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270028 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270153 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270329 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270459 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270623 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270752 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.270931 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271058 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271262 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271390 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271540 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271669 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271840 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.271973 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272156 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272286 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272456 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272585 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272763 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.272890 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273064 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273191 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273362 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273498 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273660 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273797 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.273955 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.274084 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.274258 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.274931 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275149 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275291 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275477 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275604 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275785 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.275912 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276086 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276222 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276395 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276532 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276702 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.276832 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277010 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277147 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277318 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277520 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277649 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277841 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.277972 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278148 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278285 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278458 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278586 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278762 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.278941 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279122 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279262 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279388 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279513 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279673 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279811 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.279977 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280104 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280280 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280409 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280581 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280797 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.280927 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281124 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281253 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281438 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281592 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281748 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.281876 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282057 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282185 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282365 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282550 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282687 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282820 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.282968 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283121 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283298 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283441 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283605 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283734 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.283912 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284041 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284216 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284351 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284526 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284655 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284832 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.284961 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285138 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285268 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285439 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285569 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285744 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.285942 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286070 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286195 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286318 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286443 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286623 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286762 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.286929 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287064 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287268 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287407 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287584 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287712 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.287894 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288023 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288202 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288329 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288504 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288632 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288807 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.288936 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289113 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289241 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289420 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289620 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289749 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.289945 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290077 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290272 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290410 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290589 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290719 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.290904 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291034 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291238 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291369 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291547 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291676 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291863 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.291992 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292161 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292291 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292457 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292586 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292760 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.292965 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293171 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293298 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293422 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293587 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293709 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.293907 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294036 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294216 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294343 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294526 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294662 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294826 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.294965 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.295164 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.295377 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.295506 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.295722 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.295867 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296036 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296165 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296337 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296465 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296638 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296775 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.296955 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297098 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297253 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297380 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297551 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297678 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297857 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.297993 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.298156 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.298291 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.298467 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.298683 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.298819 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299023 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299221 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299348 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299481 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299657 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299784 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.299959 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300089 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300258 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300403 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300558 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300687 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300856 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.300992 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301163 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301291 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301459 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301586 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301758 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.301887 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302056 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302185 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302353 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302480 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302648 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302775 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.302945 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303098 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303269 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303399 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303566 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303692 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.303867 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304002 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304164 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304301 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304464 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304601 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304759 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.304887 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.305054 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.305181 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.305348 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.305490 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306172 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306301 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306469 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306605 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306771 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.306918 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307090 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307222 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307392 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307522 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307699 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307841 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.307998 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308127 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308300 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308428 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308599 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308738 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.308904 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309032 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309204 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309333 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309506 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309643 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.309852 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310040 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310169 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310364 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310505 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310680 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.310811 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311004 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311151 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311347 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311491 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311647 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311775 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.311945 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312081 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312242 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312372 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312557 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312686 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312860 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.312989 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.313163 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.313385 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.313514 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.313719 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.313848 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314037 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314175 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314334 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314463 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314636 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314773 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.314938 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315136 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315264 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315389 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315552 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315682 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315853 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.315992 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316153 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316282 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316454 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316590 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316755 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.316885 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317060 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317187 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317365 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317497 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317673 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317804 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.317981 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318111 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318286 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318423 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318592 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318719 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.318893 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319020 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319219 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319356 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319520 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319647 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319820 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.319948 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320121 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320257 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320430 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320559 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320731 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.320860 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.321028 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.321177 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.321923 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322052 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322237 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322368 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322567 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322695 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322846 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.322982 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323186 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323318 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323493 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323630 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323797 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.323925 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.324108 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.324496 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.324681 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.324808 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.324985 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325114 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325265 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325402 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325622 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325750 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.325943 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326071 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326258 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326396 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326556 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326685 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326852 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.326981 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327164 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327292 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327461 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327599 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327770 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.327907 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328071 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328208 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328369 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328498 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328656 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328783 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.328958 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329096 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329255 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329385 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329551 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329681 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329846 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.329976 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330142 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330272 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330443 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330581 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330741 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.330869 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331037 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331186 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331358 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331499 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331655 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331786 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.331950 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332079 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332245 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332388 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332543 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332671 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332837 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.332964 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333134 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333264 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333429 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333558 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333725 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.333854 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334021 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334149 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334322 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334451 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334626 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334755 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.334926 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335055 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335250 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335387 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335550 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335679 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335854 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.335984 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336152 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336280 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336451 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336592 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336747 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.336896 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337070 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337206 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337368 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337505 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337690 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337818 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.337997 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338133 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338299 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338437 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338603 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338732 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.338908 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339036 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339242 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339382 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339546 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339676 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339859 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.339985 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340174 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340310 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340473 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340610 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340775 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.340902 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341089 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341225 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341394 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341528 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341701 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.341831 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342003 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342132 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342305 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342449 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342612 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342750 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.342913 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343040 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343243 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343383 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343549 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343691 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343852 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.343988 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344158 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344287 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344462 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344600 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344765 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.344894 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345073 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345203 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345376 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345504 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345692 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345819 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.345998 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346125 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346299 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346427 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346603 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346730 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.346911 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347039 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347247 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347387 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347558 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347694 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.347863 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348000 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348170 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348300 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348481 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348610 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348783 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.348933 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.349088 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.349218 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.349341 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:14:17.349467 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.349700 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.350020 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.350341 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.350683 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.350991 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.351355 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.351682 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.351995 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.352301 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.352629 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:14:17.352871 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:14:17.502735 n-d-851368-1 devstack@n-api.service[103912]: INFO dbcounter [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Registered counter for database nova_api Jul 28 11:14:17.505854 n-d-851368-1 devstack@n-api.service[103913]: INFO dbcounter [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Registered counter for database nova_api Jul 28 11:14:17.522488 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.525624 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.529744 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writer thread running {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.532172 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.585748 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.context [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=103912) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 11:14:17.587582 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.context [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=103913) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 11:14:17.590250 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_concurrency.lockutils [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:14:17.591502 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:14:17.591966 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_concurrency.lockutils [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:14:17.592755 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_concurrency.lockutils [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:14:17.593061 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:14:17.593854 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:14:17.594718 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_concurrency.lockutils [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:14:17.595848 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:14:17.596783 n-d-851368-1 devstack@n-api.service[103912]: INFO dbcounter [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Registered counter for database nova_cell0 Jul 28 11:14:17.597800 n-d-851368-1 devstack@n-api.service[103913]: INFO dbcounter [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Registered counter for database nova_cell0 Jul 28 11:14:17.602264 n-d-851368-1 devstack@n-api.service[103912]: INFO dbcounter [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Registered counter for database nova_cell1 Jul 28 11:14:17.603713 n-d-851368-1 devstack@n-api.service[103913]: INFO dbcounter [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Registered counter for database nova_cell1 Jul 28 11:14:17.610081 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.611699 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.614722 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.614882 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writer thread running {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.621243 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.621587 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.753932 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.759804 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writer thread running {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.766107 n-d-851368-1 devstack@n-api.service[103913]: INFO dbcounter [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Registered counter for database nova_cell0 Jul 28 11:14:17.768616 n-d-851368-1 devstack@n-api.service[103912]: INFO dbcounter [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Registered counter for database nova_cell0 Jul 28 11:14:17.774909 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.778425 n-d-851368-1 devstack@n-api.service[103912]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:14:17.779352 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:17.783275 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writer thread running {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:14:18.117021 n-d-851368-1 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:14:18.118736 n-d-851368-1 devstack@n-api.service[103912]: WARNING keystonemiddleware.auth_token [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:14:18.124201 n-d-851368-1 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:14:18.127861 n-d-851368-1 devstack@n-api.service[103912]: WARNING keystonemiddleware.auth_token [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:14:18.466883 n-d-851368-1 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:14:18.472855 n-d-851368-1 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:14:18.478117 n-d-851368-1 devstack@n-api.service[103913]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d58e71e9c0 pid: 103913 (default app) Jul 28 11:14:18.479191 n-d-851368-1 devstack@n-api.service[103912]: WARNING keystonemiddleware.auth_token [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:14:18.480233 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:14:18.481402 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jul 28 11:14:18.487340 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Thu Jul 28 11:14:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:14:18.487472 n-d-851368-1 devstack@n-api.service[103912]: WARNING keystonemiddleware.auth_token [None req-7fa17bca-54be-4742-bdfa-0258d8a158a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:14:18.490471 n-d-851368-1 devstack@n-api.service[103912]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d58e71e9c0 pid: 103912 (default app) Jul 28 11:15:33.722894 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:33.723927 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 11:15:33.725686 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:33.739865 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_api:SELECT=3 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:33.741082 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_cell1:SELECT=3 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:33.742460 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_cell0:SELECT=3 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:33.743293 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:34.603986 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-a66f67da-5d94-4672-a824-24fa3e6e948a admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:34.635896 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-a66f67da-5d94-4672-a824-24fa3e6e948a admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904907 Jul 28 11:15:34.638190 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 1/3] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 28 11:15:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:15:36.878298 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:36.879718 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-9eba2001-5b54-4926-a332-f71817d2e196 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jul 28 11:15:36.880920 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 3/4] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:37.377625 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-06e66c79-4ec7-40cc-b5a5-38491689e220 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:37.399591 n-d-851368-1 devstack@n-api.service[103912]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:37.399591 n-d-851368-1 devstack@n-api.service[103912]: warnings.warn(msg) Jul 28 11:15:37.436628 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-06e66c79-4ec7-40cc-b5a5-38491689e220 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.550133 Jul 28 11:15:37.437341 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 2/5] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:15:37.653653 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-773b3a7c-be3c-4b31-8ff0-3437f8a721ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:37.658288 n-d-851368-1 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:37.658288 n-d-851368-1 devstack@n-api.service[103913]: warnings.warn(msg) Jul 28 11:15:37.661402 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:37.662279 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:37.663481 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell1:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:37.664257 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:37.731258 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-773b3a7c-be3c-4b31-8ff0-3437f8a721ee admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285081 Jul 28 11:15:37.741082 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 4/6] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 28 11:15:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:15:39.942223 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-06e66c79-4ec7-40cc-b5a5-38491689e220 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:39.943846 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-06e66c79-4ec7-40cc-b5a5-38491689e220 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Jul 28 11:15:39.945611 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 3/7] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:40.730126 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ad43f09c-caa9-48ed-8c7a-3d5c8f2fb48b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:40.750031 n-d-851368-1 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:40.750031 n-d-851368-1 devstack@n-api.service[103913]: warnings.warn(msg) Jul 28 11:15:40.767968 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ad43f09c-caa9-48ed-8c7a-3d5c8f2fb48b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.817262 Jul 28 11:15:40.768757 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 5/8] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:15:40.780149 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-0aa73039-11f3-4410-9d1b-5d82405b206f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:40.782923 n-d-851368-1 devstack@n-api.service[103912]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:40.782923 n-d-851368-1 devstack@n-api.service[103912]: warnings.warn(msg) Jul 28 11:15:40.818403 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-0aa73039-11f3-4410-9d1b-5d82405b206f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041881 Jul 28 11:15:40.818976 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 4/9] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 28 11:15:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:15:43.387401 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ad43f09c-caa9-48ed-8c7a-3d5c8f2fb48b admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:43.388406 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ad43f09c-caa9-48ed-8c7a-3d5c8f2fb48b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 28 11:15:43.389246 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:43.858287 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-ae3ca967-dd3d-4f11-8f34-700477da4f4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:43.879154 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-ae3ca967-dd3d-4f11-8f34-700477da4f4d admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482353 Jul 28 11:15:43.887842 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 5/11] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:15:43.893323 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-887b23ab-72a6-4073-9b51-b9b1e965187a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:43.921949 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-887b23ab-72a6-4073-9b51-b9b1e965187a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032377 Jul 28 11:15:43.930671 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 7/12] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 28 11:15:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:15:46.257434 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-ae3ca967-dd3d-4f11-8f34-700477da4f4d admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:46.259419 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-ae3ca967-dd3d-4f11-8f34-700477da4f4d admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002910 Jul 28 11:15:46.259907 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 6/13] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:46.671165 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-4900e6b6-8b59-4c57-b7a2-4cbc29f263dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:46.692063 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-4900e6b6-8b59-4c57-b7a2-4cbc29f263dc admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425942 Jul 28 11:15:46.692984 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 8/14] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:15:46.705219 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-545a5399-350c-433b-a141-067ebdddfa42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:46.732510 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-545a5399-350c-433b-a141-067ebdddfa42 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030949 Jul 28 11:15:46.733865 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 7/15] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 28 11:15:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:15:49.163047 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-4900e6b6-8b59-4c57-b7a2-4cbc29f263dc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:49.164124 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-4900e6b6-8b59-4c57-b7a2-4cbc29f263dc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 28 11:15:49.164515 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 9/16] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:49.652494 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "swap": 0}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:49.673366 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502848 Jul 28 11:15:49.674210 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 8/17] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:15:49.687276 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-e99fbc3a-1dab-4cf3-ba8a-4917dd77a9ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:49.714437 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-e99fbc3a-1dab-4cf3-ba8a-4917dd77a9ff admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030938 Jul 28 11:15:49.715888 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 10/18] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 28 11:15:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:15:52.062680 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:52.063828 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 28 11:15:52.070635 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 9/19] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:52.558279 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-00f3105d-f2db-45ba-9bb5-8da1cd9884f0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:52.588283 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-00f3105d-f2db-45ba-9bb5-8da1cd9884f0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.516334 Jul 28 11:15:52.589580 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 11/20] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 28 11:15:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:15:54.830911 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:54.832003 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-e8c586cd-6b1f-4a03-b236-497758cdd18f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 28 11:15:54.832413 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 10/21] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:55.269274 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-e2e96fb1-b549-4f79-bd41-406a09c4aade admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:55.288961 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-e2e96fb1-b549-4f79-bd41-406a09c4aade admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450447 Jul 28 11:15:55.289523 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 12/22] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:15:55.301516 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-a26c7e90-99e9-4c53-87f7-249c8fd61fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:55.326614 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-a26c7e90-99e9-4c53-87f7-249c8fd61fbb admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028962 Jul 28 11:15:55.327238 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 11/23] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 28 11:15:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:15:57.538468 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-e2e96fb1-b549-4f79-bd41-406a09c4aade admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:15:57.539559 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-e2e96fb1-b549-4f79-bd41-406a09c4aade admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 28 11:15:57.539965 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:15:58.031509 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-768c017b-1e88-4537-9c19-948934227f54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:58.052075 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-768c017b-1e88-4537-9c19-948934227f54 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506135 Jul 28 11:15:58.052733 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 12/25] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:15:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:15:58.065218 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-63dd4eda-b23c-4556-85ba-3643815ea1d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:15:58.089032 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-63dd4eda-b23c-4556-85ba-3643815ea1d5 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027433 Jul 28 11:15:58.089603 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 14/26] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 28 11:15:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:16:00.302708 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-768c017b-1e88-4537-9c19-948934227f54 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:00.303959 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-768c017b-1e88-4537-9c19-948934227f54 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Jul 28 11:16:00.304369 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:00.692439 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f3cffd46-056b-4d55-94af-4e8582d4d8f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:00.713265 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f3cffd46-056b-4d55-94af-4e8582d4d8f6 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.402832 Jul 28 11:16:00.713737 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 15/28] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:16:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:16:00.725957 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-705d8694-b12a-4f7a-a546-d88d3ad12a5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:00.750401 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-705d8694-b12a-4f7a-a546-d88d3ad12a5e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028150 Jul 28 11:16:00.750983 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 14/29] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 28 11:16:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:16:02.932971 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f3cffd46-056b-4d55-94af-4e8582d4d8f6 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:02.934017 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f3cffd46-056b-4d55-94af-4e8582d4d8f6 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 28 11:16:02.934424 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 16/30] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:03.357996 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-27800dec-2a09-4f40-9d06-9dbbc6d08c60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:03.377354 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-27800dec-2a09-4f40-9d06-9dbbc6d08c60 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.436086 Jul 28 11:16:03.377950 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 15/31] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:16:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:16:03.389826 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-972d88fe-042f-424e-a639-c43b3fc4032a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:03.414743 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-972d88fe-042f-424e-a639-c43b3fc4032a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028584 Jul 28 11:16:03.415912 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 17/32] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 28 11:16:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:16:05.681736 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-27800dec-2a09-4f40-9d06-9dbbc6d08c60 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:05.682671 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-27800dec-2a09-4f40-9d06-9dbbc6d08c60 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 28 11:16:05.683087 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 16/33] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:16:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:06.124638 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:06.148268 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459343 Jul 28 11:16:06.149076 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 18/34] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 28 11:16:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:16:06.160981 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-aeee1a90-fe72-459c-9d6d-8dc31f49f155 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:06.166669 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:06.190274 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-aeee1a90-fe72-459c-9d6d-8dc31f49f155 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032980 Jul 28 11:16:06.204231 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 17/35] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 28 11:16:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:16:30.182505 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:30.183536 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 28 11:16:30.183934 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:30.194131 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:30.587418 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-3079e794-a844-4ac1-b906-21354002b847 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:30.606645 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-3079e794-a844-4ac1-b906-21354002b847 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.416933 Jul 28 11:16:30.607193 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 18/37] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 28 11:16:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:16:31.673839 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:31.674830 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6bc3556f-1d7b-4d31-aac4-f83f0b71292c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 28 11:16:31.675252 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 20/38] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:32.232398 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-b4db2e9b-2b00-4c01-9c25-9279bf5e7c4c admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:32.237932 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.wsgi [None req-b4db2e9b-2b00-4c01-9c25-9279bf5e7c4c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-b4db2e9b-2b00-4c01-9c25-9279bf5e7c4c admin admin] Request method failure captured: Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Accept: application/json Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Accept-Encoding: gzip, deflate Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Connection: keep-alive Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Content-Length: 0 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Host: 10.222.0.93 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: Openstack-System-Scope: None Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: User-Agent: python-novaclient Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Auth-Token: gAAAAABi4nAPckQBW4RvbG36fAYYiB5znOAmggFA8oUmcNieZL92019hkVAvzt4WR_Ww858XqNBgSc5uAYf5KUCMuIOGEDB5luIeo8EfF6fZWrbGGLtevMsYg8KdtdF3-NDMwB82VvhgbTiTgdYbvqyDrf6QreJGV5XV9eYk2_2uCIxOqP3h954 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Id: None Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Name: None Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Identity-Status: Confirmed Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Is-Admin-Project: True Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Id: default Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Name: Default Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Name: admin Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Role: admin,reader,member Jul 28 11:16:32.241715 n-d-851368-1 devstack@n-api.service[103912]: X-Roles: admin,reader,member Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant: admin Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Name: admin Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-User: admin Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Id: default Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Name: Default Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: X-User-Name: admin Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: method: > Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: exception: Flavor 42 could not be found. Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: action_args: {'id': '42'} Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:32.243425 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:32.244335 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.245899 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-b4db2e9b-2b00-4c01-9c25-9279bf5e7c4c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:32.247183 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-b4db2e9b-2b00-4c01-9c25-9279bf5e7c4c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405739 Jul 28 11:16:32.247183 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 19/39] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 28 11:16:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:32.252661 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-1cc9444b-5e00-4035-8172-6fa4d0fe57bc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:32.257309 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:32.276478 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-1cc9444b-5e00-4035-8172-6fa4d0fe57bc admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027371 Jul 28 11:16:32.277011 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 21/40] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:32.292038 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-fc2a695f-fced-45b6-b72e-e921fd6499fe admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:32.315825 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-fc2a695f-fced-45b6-b72e-e921fd6499fe admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027578 Jul 28 11:16:32.316350 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:32.325484 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3c7d11d8-e7db-4e42-948a-dd30165440f7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:32.331903 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-3c7d11d8-e7db-4e42-948a-dd30165440f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3c7d11d8-e7db-4e42-948a-dd30165440f7 admin admin] Request method failure captured: Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Accept: application/json Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Connection: keep-alive Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Content-Length: 0 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Host: 10.222.0.93 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: Openstack-System-Scope: None Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: User-Agent: python-novaclient Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi4nAPckQBW4RvbG36fAYYiB5znOAmggFA8oUmcNieZL92019hkVAvzt4WR_Ww858XqNBgSc5uAYf5KUCMuIOGEDB5luIeo8EfF6fZWrbGGLtevMsYg8KdtdF3-NDMwB82VvhgbTiTgdYbvqyDrf6QreJGV5XV9eYk2_2uCIxOqP3h954 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Id: None Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Name: None Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Is-Admin-Project: True Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Id: default Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Name: admin Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Role: admin,reader,member Jul 28 11:16:32.335140 n-d-851368-1 devstack@n-api.service[103913]: X-Roles: admin,reader,member Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant: admin Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Name: admin Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-User: admin Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Id: default Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Name: Default Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: X-User-Name: admin Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: method: > Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: exception: Flavor 42 could not be found. Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: action_args: {'id': '42'} Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:32.336658 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:32.337550 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:32.338767 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3c7d11d8-e7db-4e42-948a-dd30165440f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:32.340172 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-3c7d11d8-e7db-4e42-948a-dd30165440f7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014521 Jul 28 11:16:32.340172 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 28 11:16:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:33.300247 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-fc2a695f-fced-45b6-b72e-e921fd6499fe admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:33.301378 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-fc2a695f-fced-45b6-b72e-e921fd6499fe admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 28 11:16:33.301873 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 21/43] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:33.822579 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6867e26d-7fcf-40da-b8f5-9c37ec119684 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:33.828068 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-6867e26d-7fcf-40da-b8f5-9c37ec119684 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6867e26d-7fcf-40da-b8f5-9c37ec119684 admin admin] Request method failure captured: Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Accept: application/json Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Connection: keep-alive Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Content-Length: 0 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Host: 10.222.0.93 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: Openstack-System-Scope: None Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: User-Agent: python-novaclient Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi4nAR194udy1dq3BvP4tuWtiB-Wv0__lFo6k07giPgXo-WQxlVDH9S0p3qm35Yc9hq_WR3JR1lWrJEkiqZaLzRomplWCdzfD2i7clgdZLwROyiDXd3oIicuR8nqRyhV2486B9sCTEjOuzhM99nZ6NxEW7NtIvqRMymB9LAKGAMuKKSko Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Id: None Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Name: None Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Is-Admin-Project: True Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Id: default Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Name: admin Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Role: admin,reader,member Jul 28 11:16:33.829554 n-d-851368-1 devstack@n-api.service[103913]: X-Roles: admin,reader,member Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant: admin Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Name: admin Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-User: admin Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Id: default Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Name: Default Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: X-User-Name: admin Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: method: > Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: exception: Flavor 84 could not be found. Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: action_args: {'id': '84'} Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:33.831094 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:33.832055 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.833342 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6867e26d-7fcf-40da-b8f5-9c37ec119684 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:33.835251 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6867e26d-7fcf-40da-b8f5-9c37ec119684 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391859 Jul 28 11:16:33.835251 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 28 11:16:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:33.840954 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-217d3bb8-1ab7-47ec-92fa-1adcbecb2912 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:33.855651 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-217d3bb8-1ab7-47ec-92fa-1adcbecb2912 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018133 Jul 28 11:16:33.856137 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:33.865229 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3bf8e051-4bd7-4c36-9871-6a3fe649ad76 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:33.882007 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-3bf8e051-4bd7-4c36-9871-6a3fe649ad76 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020247 Jul 28 11:16:33.882554 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 24/46] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:33.891639 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-3cca4be4-46e2-430e-9913-d1d2dc1c455b admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:33.897528 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.wsgi [None req-3cca4be4-46e2-430e-9913-d1d2dc1c455b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-3cca4be4-46e2-430e-9913-d1d2dc1c455b admin admin] Request method failure captured: Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Accept: application/json Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Accept-Encoding: gzip, deflate Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Connection: keep-alive Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Content-Length: 0 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Host: 10.222.0.93 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: Openstack-System-Scope: None Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: User-Agent: python-novaclient Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Auth-Token: gAAAAABi4nAR194udy1dq3BvP4tuWtiB-Wv0__lFo6k07giPgXo-WQxlVDH9S0p3qm35Yc9hq_WR3JR1lWrJEkiqZaLzRomplWCdzfD2i7clgdZLwROyiDXd3oIicuR8nqRyhV2486B9sCTEjOuzhM99nZ6NxEW7NtIvqRMymB9LAKGAMuKKSko Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Id: None Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Name: None Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Identity-Status: Confirmed Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Is-Admin-Project: True Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Id: default Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Name: Default Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Name: admin Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Role: admin,reader,member Jul 28 11:16:33.899025 n-d-851368-1 devstack@n-api.service[103912]: X-Roles: admin,reader,member Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant: admin Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Name: admin Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-User: admin Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Id: default Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Name: Default Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: X-User-Name: admin Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: method: > Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: exception: Flavor 84 could not be found. Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: action_args: {'id': '84'} Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:33.900589 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:33.901729 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:33.903017 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-3cca4be4-46e2-430e-9913-d1d2dc1c455b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:33.904314 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-3cca4be4-46e2-430e-9913-d1d2dc1c455b admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012230 Jul 28 11:16:33.904314 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 28 11:16:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:34.858795 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3bf8e051-4bd7-4c36-9871-6a3fe649ad76 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:34.859883 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-3bf8e051-4bd7-4c36-9871-6a3fe649ad76 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 28 11:16:34.860279 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 25/48] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:35.379043 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-a88396c2-6be4-4170-8354-749797a13428 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:35.385235 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.wsgi [None req-a88396c2-6be4-4170-8354-749797a13428 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-a88396c2-6be4-4170-8354-749797a13428 admin admin] Request method failure captured: Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Accept: application/json Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Accept-Encoding: gzip, deflate Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Connection: keep-alive Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Content-Length: 0 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Host: 10.222.0.93 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: Openstack-System-Scope: None Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: User-Agent: python-novaclient Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Auth-Token: gAAAAABi4nASs9Xd2UjvtOVnaO_zBpGN79CyUL-Klx9lAWRB5inSDseY49CrGr4RW76sVaXH8NBYzyFmOZ7gBir2Je5OdR-pnNikiqFb7CIUPW5oZ1ej5BF7rnGFj4GRFg7tVaufe68qjid9OvMSEatN47HCAOnCs2TZ9oNvvEre1Lav5ncf4Ls Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Id: None Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Domain-Name: None Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Identity-Status: Confirmed Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Is-Admin-Project: True Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Id: default Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Domain-Name: Default Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Project-Name: admin Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Role: admin,reader,member Jul 28 11:16:35.386717 n-d-851368-1 devstack@n-api.service[103912]: X-Roles: admin,reader,member Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant: admin Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-Tenant-Name: admin Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-User: admin Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Id: default Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-User-Domain-Name: Default Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: X-User-Name: admin Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: method: > Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: exception: Flavor 451 could not be found. Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: action_args: {'id': '451'} Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:35.388270 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:35.389311 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.390709 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-a88396c2-6be4-4170-8354-749797a13428 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:35.392040 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-a88396c2-6be4-4170-8354-749797a13428 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391291 Jul 28 11:16:35.392040 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:16:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:35.398421 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6c738ff4-7b13-4558-b28f-132d4b8f98e9 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:35.413062 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6c738ff4-7b13-4558-b28f-132d4b8f98e9 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019024 Jul 28 11:16:35.413585 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 26/50] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:35.422941 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:35.437790 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018249 Jul 28 11:16:35.438949 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 25/51] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 28 11:16:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:16:35.453738 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-763db378-a24a-4a59-ac91-ab430eec421c admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:35.460412 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-763db378-a24a-4a59-ac91-ab430eec421c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-763db378-a24a-4a59-ac91-ab430eec421c admin admin] Request method failure captured: Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Accept: application/json Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Connection: keep-alive Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Content-Length: 0 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Host: 10.222.0.93 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: Openstack-System-Scope: None Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: User-Agent: python-novaclient Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi4nASs9Xd2UjvtOVnaO_zBpGN79CyUL-Klx9lAWRB5inSDseY49CrGr4RW76sVaXH8NBYzyFmOZ7gBir2Je5OdR-pnNikiqFb7CIUPW5oZ1ej5BF7rnGFj4GRFg7tVaufe68qjid9OvMSEatN47HCAOnCs2TZ9oNvvEre1Lav5ncf4Ls Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Id: None Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Domain-Name: None Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Is-Admin-Project: True Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Id: default Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Project-Name: admin Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Role: admin,reader,member Jul 28 11:16:35.461926 n-d-851368-1 devstack@n-api.service[103913]: X-Roles: admin,reader,member Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfd63bb43c3948b0846b0cbc13047f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfd63bb43c3948b0846b0cbc13047f31"}]}] Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant: admin Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Id: cfd63bb43c3948b0846b0cbc13047f31 Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-Tenant-Name: admin Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-User: admin Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Id: default Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-User-Domain-Name: Default Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-User-Id: 196dd1b6251747009913bdecb20a28a5 Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: X-User-Name: admin Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: method: > Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: exception: Flavor 451 could not be found. Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: action_args: {'id': '451'} Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:16:35.463445 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:35.464293 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Jul 28 11:16:35.465620 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-763db378-a24a-4a59-ac91-ab430eec421c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:16:35.466707 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-763db378-a24a-4a59-ac91-ab430eec421c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014985 Jul 28 11:16:35.466707 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 27/52] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:16:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:36.430552 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:36.431599 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 28 11:16:36.432004 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:16:36.956983 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5e861f40-ecea-4f67-a403-8fdca310dd84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:36.976502 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5e861f40-ecea-4f67-a403-8fdca310dd84 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408079 Jul 28 11:16:36.977066 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 28/54] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 28 11:16:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:16:37.938479 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:37.939523 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 28 11:16:37.939928 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:38.469453 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-de712fb7-4a20-4389-9425-0e186df051ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:38.487378 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-de712fb7-4a20-4389-9425-0e186df051ab admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410251 Jul 28 11:16:38.487840 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 29/56] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 28 11:16:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:16:39.501704 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:39.502752 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 28 11:16:39.503203 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 28/57] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:40.019879 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-63512901-11f9-4198-b2cb-06502363bf97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:40.039033 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-63512901-11f9-4198-b2cb-06502363bf97 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400708 Jul 28 11:16:40.039599 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 30/58] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 28 11:16:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:16:40.996430 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:40.997457 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 28 11:16:40.997845 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 29/59] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:41.523830 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-a8d80a0b-7c61-4879-8119-2e4847f77e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:16:41.541869 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-a8d80a0b-7c61-4879-8119-2e4847f77e10 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401447 Jul 28 11:16:41.542414 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 31/60] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 28 11:16:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:16:42.501452 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:42.502470 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 28 11:16:42.502870 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 30/61] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:16:43.019739 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-42e9f23f-85a5-4f1d-99b9-0efafcf37d93 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:16:43.040403 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-42e9f23f-85a5-4f1d-99b9-0efafcf37d93 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401755 Jul 28 11:16:43.040939 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 32/62] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Jul 28 11:16:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:17:34.914270 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:34.915301 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-35166d72-95d3-4ddb-aa81-5e87719cc352 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 11:17:34.915701 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 31/63] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 28 11:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:17:34.926456 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:17:35.305546 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3ce03716-678c-4087-ac9a-9f13aeb638d6 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:35.326811 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-3ce03716-678c-4087-ac9a-9f13aeb638d6 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405379 Jul 28 11:17:35.327375 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 33/64] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 28 11:17:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:17:35.350584 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-e437d3bd-ee51-4959-9881-461f8ba3c5ee admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:35.354013 n-d-851368-1 devstack@n-api.service[103912]: DEBUG dbcounter [-] [103912] Writing DB stats nova_api:SELECT=14 {{(pid=103912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:17:35.359717 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-e437d3bd-ee51-4959-9881-461f8ba3c5ee admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013187 Jul 28 11:17:35.360259 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 32/65] 10.222.0.93 () {60 vars in 1282 bytes} [Thu Jul 28 11:17:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:17:35.372197 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-c9c4c7fb-e47f-4f15-a557-bad2143736b9 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:35.379691 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-c9c4c7fb-e47f-4f15-a557-bad2143736b9 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010993 Jul 28 11:17:35.380199 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 34/66] 10.222.0.93 () {60 vars in 1285 bytes} [Thu Jul 28 11:17:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:17:35.390965 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:35.398424 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010816 Jul 28 11:17:35.398926 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1285 bytes} [Thu Jul 28 11:17:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:17:35.410059 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-01125172-399c-41e3-8de3-c69638b3149d admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:17:35.417368 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-01125172-399c-41e3-8de3-c69638b3149d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011192 Jul 28 11:17:35.417875 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 35/68] 10.222.0.93 () {60 vars in 1282 bytes} [Thu Jul 28 11:17:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:23:06.870286 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:23:06.871329 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 11:23:06.871719 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:23:07.013263 n-d-851368-1 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=6 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:23:07.150993 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:23:07.153406 n-d-851368-1 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:23:07.153406 n-d-851368-1 devstack@n-api.service[103913]: warnings.warn(msg) Jul 28 11:23:07.154608 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:07.155045 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:07.155868 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:07.156287 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:07.196052 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-93cf6a12-c0be-4a01-a5e3-a1063908b945 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.184227 Jul 28 11:23:07.196599 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:23:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:23:08.020383 n-d-851368-1 devstack@n-api.service[103912]: DEBUG nova.api.openstack.wsgi [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] Calling method '>' {{(pid=103912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:23:08.021389 n-d-851368-1 devstack@n-api.service[103912]: INFO nova.api.openstack.requestlog [None req-794d5de3-a9fe-4745-82e3-0a6938778881 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 28 11:23:08.021782 n-d-851368-1 devstack@n-api.service[103912]: [pid: 103912|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 28 11:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:23:08.211920 n-d-851368-1 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:23:08.214273 n-d-851368-1 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:23:08.214273 n-d-851368-1 devstack@n-api.service[103913]: warnings.warn(msg) Jul 28 11:23:08.215496 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:08.215933 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:08.217227 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:08.217663 n-d-851368-1 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:08.239495 n-d-851368-1 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-cd32eedd-c812-4b78-bc4f-ef18d45ca35f admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.079205 Jul 28 11:23:08.240035 n-d-851368-1 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:23:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:23:53.433497 n-d-851368-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 11:23:53.434319 n-d-851368-1 devstack@n-api.service[103911]: Thu Jul 28 11:23:53 2022 - graceful shutdown triggered... Jul 28 11:23:53.434841 n-d-851368-1 devstack@n-api.service[103912]: Gracefully killing worker 1 (pid: 103912)... Jul 28 11:23:53.435255 n-d-851368-1 devstack@n-api.service[103913]: Gracefully killing worker 2 (pid: 103913)... Jul 28 11:23:54.435185 n-d-851368-1 devstack@n-api.service[103911]: worker 1 buried after 1 seconds Jul 28 11:23:54.435185 n-d-851368-1 devstack@n-api.service[103911]: worker 2 buried after 1 seconds Jul 28 11:23:54.435846 n-d-851368-1 devstack@n-api.service[103911]: goodbye to uWSGI. Jul 28 11:23:54.436763 n-d-851368-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 28 11:23:54.437364 n-d-851368-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 11:23:54.440166 n-d-851368-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 11:23:54.473967 n-d-851368-1 devstack@n-api.service[119228]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 11:23:54 2022] *** Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: nodename: n-d-851368-1 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: machine: x86_64 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: clock source: unix Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: pcre jit disabled Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: detected number of CPU cores: 4 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: current working directory: / Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: detected binary path: /usr/bin/uwsgi-core Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: your processes number limit is 47680 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: your memory page size is 4096 bytes Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: detected max file descriptor number: 2048 Jul 28 11:23:54.578671 n-d-851368-1 devstack@n-api.service[119228]: lock engine: pthread robust mutexes Jul 28 11:23:54.579810 n-d-851368-1 devstack@n-api.service[119228]: thunder lock: enabled Jul 28 11:23:54.579810 n-d-851368-1 devstack@n-api.service[119228]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 11:23:54.579810 n-d-851368-1 devstack@n-api.service[119228]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 11:23:54.617913 n-d-851368-1 devstack@n-api.service[119228]: Python main interpreter initialized at 0x55ca94bcf9c0 Jul 28 11:23:54.617913 n-d-851368-1 devstack@n-api.service[119228]: python threads support enabled Jul 28 11:23:54.617913 n-d-851368-1 devstack@n-api.service[119228]: your server socket listen backlog is limited to 100 connections Jul 28 11:23:54.617913 n-d-851368-1 devstack@n-api.service[119228]: your mercy for graceful operations on workers is 90 seconds Jul 28 11:23:54.618301 n-d-851368-1 devstack@n-api.service[119228]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 11:23:54.618301 n-d-851368-1 devstack@n-api.service[119228]: *** Operational MODE: preforking *** Jul 28 11:23:54.618572 n-d-851368-1 devstack@n-api.service[119228]: *** uWSGI is running in multiple interpreter mode *** Jul 28 11:23:54.618572 n-d-851368-1 devstack@n-api.service[119228]: spawned uWSGI master process (pid: 119228) Jul 28 11:23:54.618784 n-d-851368-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 11:23:54.619509 n-d-851368-1 devstack@n-api.service[119228]: spawned uWSGI worker 1 (pid: 119235, cores: 1) Jul 28 11:23:54.620280 n-d-851368-1 devstack@n-api.service[119228]: spawned uWSGI worker 2 (pid: 119236, cores: 1) Jul 28 11:23:54.620280 n-d-851368-1 devstack@n-api.service[119228]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 11:23:55.271810 n-d-851368-1 devstack@n-api.service[119235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 11:23:55.278833 n-d-851368-1 devstack@n-api.service[119236]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 11:23:56.418156 n-d-851368-1 devstack@n-api.service[119235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:23:56.418156 n-d-851368-1 devstack@n-api.service[119235]: from cryptography.utils import int_from_bytes Jul 28 11:23:56.418797 n-d-851368-1 devstack@n-api.service[119235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:23:56.418797 n-d-851368-1 devstack@n-api.service[119235]: from cryptography.utils import int_from_bytes Jul 28 11:23:56.438342 n-d-851368-1 devstack@n-api.service[119236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:23:56.438342 n-d-851368-1 devstack@n-api.service[119236]: from cryptography.utils import int_from_bytes Jul 28 11:23:56.438856 n-d-851368-1 devstack@n-api.service[119236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:23:56.438856 n-d-851368-1 devstack@n-api.service[119236]: from cryptography.utils import int_from_bytes Jul 28 11:23:58.780125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:23:58.781368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:23:58.781368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:23:58.781756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:23:58.782008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:23:58.782423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.782736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.783061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.783407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.783745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.784065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.784614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.784736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.785024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.785289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.785628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.785935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851368-1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.786260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.786766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.787065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.787414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.787723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.788049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.788372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.788983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.789618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.789931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.790250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.790597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.790921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.791269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.791608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.791934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.792231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.792548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.792973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851368-1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.793299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.793608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.793915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.794348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.794724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.795010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.795336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.795691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.795979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.796405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.796735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.797058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.797382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.797686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.798003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.798518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.798690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.798924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.799255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.799513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.799862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.800141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.800467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.800801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.801050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.801324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.801625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.801972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.802275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.802573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.802883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.803300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.803612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.803922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.804235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.804542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.804865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.805186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.805512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.805820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.806141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.806552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.806805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.807150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.807499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.807820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.808133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.808454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.808775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.809086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.809396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.809706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.810025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.810364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.810673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.810944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.811275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.811582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.812794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.813127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.813442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.813756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.814063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.814374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.814684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.814995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.815336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.815650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.815961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.816271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.816582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.816891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.817218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.817545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.817856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.818169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.818481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.818796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.819138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.819452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.819764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.820093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.820402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.820709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.821033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.821343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.821658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.821980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.822285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.822594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.822916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.823246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.823556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.823860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.824165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.824471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.824777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.825081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.825385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.825719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.826131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.826454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.826773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.827103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.827416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.828379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.828726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.829060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.829409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.829730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.830069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.830406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.830728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.831046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.831395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.831734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.832054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.832375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.832692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.833016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.833341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.833676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.833997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.834318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.834642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.834957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.835302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.835636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.835967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.836280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.836625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.836972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.837289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.837616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.837946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.838263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.838583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.838897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.839245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.839581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.839897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.840224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.840542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.840857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.841172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.841491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.841812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.842151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.842471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.842791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.843147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.843484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.843643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:23:58.844126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.844283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:23:58.844428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.844582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:23:58.844737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.844883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:23:58.845027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.845192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:23:58.845339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.845494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.845667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.845667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.845962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.846216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.846368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.846527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.846675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.846820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.846978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.847173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.847336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.847506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.847660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.847829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.847977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.848136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.848300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.848453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.848625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.848844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.848996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.849140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.849317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851368-1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.849479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.849633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.849785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.849939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.850093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.850247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.850399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.850563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.850789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.850949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.851154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.851308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.851477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.851623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.851775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.851775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.852062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.852234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.852380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.852531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.852678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.852837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.852991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.853148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.853302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.853447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.853599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.853753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.853906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.854052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.854205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.854351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.854506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.854660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.854830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.854987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.855183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.855334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.855496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851368-1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.855643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.855795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.855939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.856083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.856269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.856429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.856582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.856582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.856859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.857013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.857168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.857324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.857477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.857630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.857775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.857920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.858075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.858239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.858394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.858550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.858696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.858864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.859148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.859305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.859452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.859597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.859748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.859903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.860057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.860211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.860356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.860509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.860655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.860827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.861056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.861226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.861372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.861529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.861676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.861830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.861985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.862139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.862285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.862437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.862592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.862738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.862883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.863045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.863232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.863383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.863612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.863762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.863917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.864074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.864219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.864365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.864510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.864667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.864821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.864984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.865129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.865273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.865427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.865581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.865729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.865887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.866040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.866193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.866352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.866498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.866651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.866797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.866960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.867150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.867916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.868073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.868239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.868395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.868549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.868696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.868857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.869003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.869243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.869396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.869561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.869718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.869881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.870027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.870172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.870367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.870518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.870679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.870834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.870987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.871183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.871331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.871477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.871648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.871803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.871958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.872104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.872256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.872410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.872564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.872711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.872863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.873010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.873181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.873337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.873522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.873691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.873851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.874002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.874148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.874319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.874966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.875175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.875328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.875484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.875484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.875775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.875930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.876099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.876256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.876418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.876564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.876718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.876883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.877043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.877199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.877346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.877490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.877644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.877796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.877941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.878099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.878270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.878417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.878576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.878722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.878866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.879011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.879238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.879475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.879636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.879636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.879937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.880096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.880276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.880450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.880598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.880757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.880903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.881047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.881191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.881354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.881553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.881718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.881884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.882059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.882216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.882395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.882549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.882709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.882895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.883413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.883592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.883747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.883900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.884052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.884219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.884381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.884603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.884768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.884940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.885103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.885257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.885409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.885570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.885722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.885874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.886050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.886215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.886389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.886562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.886716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.886893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.887087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.887261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.887261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.887580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.887732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.887884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.888048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.888220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.888381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.888539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.888707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.888885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.889042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.889219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.889384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.889620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.889781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.889942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.890727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.890899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.891052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.891253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.891421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.891588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.891761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:23:58.891927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.891927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.892225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.892397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.892645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.892817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.892992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.893949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.894258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.894426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.894587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.894748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.894908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.895889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.896853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.897947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.898914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.899983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.900948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.901886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.902866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.903876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.904973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.905952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.906912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.907884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.908871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.909842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.910731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.911861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.912966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.913886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.914840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.915992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.916956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.917894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.918876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.919860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.920257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.920416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.920576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.920737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.920900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.921975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.922936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.923941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.924101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.924253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.924412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.924571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.924723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.925423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.925423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.925749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.925917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.926850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.927929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.928932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.929944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.930995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.931993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.932952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.933932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.934980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.935989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.936216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.936400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.936570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.936734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.937424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.937612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.937786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.937939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.938925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.939915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.940231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.940495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.940663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.940825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.941841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.942993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.943226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.943393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.943546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.943715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.943892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.944855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.945993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.946188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.946921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.947951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.948902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.949940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.950928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.951897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.952078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.952206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.952436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.953924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.954874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.955983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.956172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.956396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.956539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.956640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.959950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.960935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.961986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.962906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.963140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.963368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.963544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.963781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.963781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.964762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.965960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.966118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.966285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.966458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.966757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.966944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.967236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.967421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.967576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.967736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.967896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.968048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.968230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.968399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.968562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.969301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.969462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.969636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.969805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.969959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.970914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.971897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.972833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.973994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.974941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.975936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.976088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.976257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.976409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.976568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.976867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.977115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.977457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.977629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.977800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.977954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.978941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.979940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.980891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.981994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.982945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.983226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.983390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.983553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.983715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.983897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.984957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.985889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.986947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.987132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.987292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.987531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.987691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.987855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.988965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.989911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.990906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.991937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.992935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.993102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.993361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.993523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.993685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.993839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.994878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.995871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.996968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.997135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.997289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.997459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.997711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.997887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.998992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.999165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:58.999349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.000840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.001939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.002907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.003997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.004159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.004396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.004573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.004741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.004894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.005846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.006971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.007167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.007337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.007497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.007653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.007908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.008939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.009869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.010974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.011987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.012937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.013983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.014136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.014296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.014547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.014708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.014870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.015101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.015750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.015916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.016862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.017817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.018886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.019997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.020292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.020445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.020596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.020756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.020909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.021864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.022983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.023263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.023422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.023583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.023988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.024144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.024304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.024457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.024707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.024868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.025979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.026933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.027939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.028222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.028392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.028564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.028719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.028871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.029839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.030139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.030304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.030467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.030667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.031366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.031532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.031694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.031855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.032020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.032181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.032343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.032495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.032655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.033167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.033335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.033490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.033643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.033803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.034989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.035179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.035375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.035532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.035695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.035857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.036927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.037150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.037384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.037622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.037847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.038072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.038397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.038613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.038849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.039063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.039315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.039543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.039757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.039967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.040194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.040424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.040424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.040856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.041089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.041305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.041529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.041742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.041962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.042176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.042394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.042722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.042951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.043244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.043485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.043709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.043948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.044303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.044520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.044746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.045053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.045259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.045462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.045695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.045929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.046157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.046946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.047196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.047433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.047671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.047895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.048119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.048485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.048708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.048942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.049171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.049388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.049644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.049858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.050111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.050336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.050336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.050823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.051050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.051315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.051546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.051816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.052030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.052251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.052465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.052677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.052902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.053126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.053354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.053577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.053577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.053997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.054228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.054539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.054761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.054976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.055303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.055540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.055766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.055981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.056209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.084745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.085821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.086958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.087915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.088709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.089786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.090867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.091333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.091333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.091333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.091333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.091624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.092218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.095241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.095241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.095241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.095241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.096302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.096302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.096429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.096671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.097001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.097374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.097648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.098010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.098287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.098611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.098936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.099321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.099772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.100651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.100651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.101084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.101574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.102540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.102540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.102540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.102876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.103239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.103591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.103924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.104275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.104610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.104980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.105264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.105617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.105944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.106283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.106606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.106932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.107287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.107611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.108176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.108380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.108775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.109644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.110022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.110392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.110831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.111201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.111552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.111885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.112218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.112591 n-d-851368-1 devstack@n-api.service[119235]: INFO dbcounter [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Registered counter for database nova_api Jul 28 11:23:59.112952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.112952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.113228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.113487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.113811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.114137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.114469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.114800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.115167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.115513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.115838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.116176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.116517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.116884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.117211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.117571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.117910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.118238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.118564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.119355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:23:59.119355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:23:59.134294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_db.sqlalchemy.engines [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.140970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writer thread running {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.181016 n-d-851368-1 devstack@n-api.service[119236]: INFO dbcounter [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Registered counter for database nova_api Jul 28 11:23:59.197206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.context [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119235) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 11:23:59.201392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:59.201684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_db.sqlalchemy.engines [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.203806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:59.204617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:59.206755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:59.208820 n-d-851368-1 devstack@n-api.service[119235]: INFO dbcounter [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Registered counter for database nova_cell0 Jul 28 11:23:59.209168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writer thread running {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.213067 n-d-851368-1 devstack@n-api.service[119235]: INFO dbcounter [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Registered counter for database nova_cell1 Jul 28 11:23:59.222737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_db.sqlalchemy.engines [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.223954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_db.sqlalchemy.engines [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.230799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writer thread running {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.232387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writer thread running {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.268261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.context [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119236) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 11:23:59.272422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:59.274008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:59.274821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:23:59.277046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:23:59.279144 n-d-851368-1 devstack@n-api.service[119236]: INFO dbcounter [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Registered counter for database nova_cell0 Jul 28 11:23:59.283778 n-d-851368-1 devstack@n-api.service[119236]: INFO dbcounter [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Registered counter for database nova_cell1 Jul 28 11:23:59.295111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_db.sqlalchemy.engines [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.295762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writer thread running {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.296401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_db.sqlalchemy.engines [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.379061 n-d-851368-1 devstack@n-api.service[119235]: INFO dbcounter [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Registered counter for database nova_cell0 Jul 28 11:23:59.386385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_db.sqlalchemy.engines [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.391641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writer thread running {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.447620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writer thread running {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.457510 n-d-851368-1 devstack@n-api.service[119236]: INFO dbcounter [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Registered counter for database nova_cell0 Jul 28 11:23:59.466190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_db.sqlalchemy.engines [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:23:59.471485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writer thread running {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:23:59.715530 n-d-851368-1 devstack@n-api.service[119235]: WARNING keystonemiddleware.auth_token [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:23:59.722843 n-d-851368-1 devstack@n-api.service[119235]: WARNING keystonemiddleware.auth_token [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:23:59.794287 n-d-851368-1 devstack@n-api.service[119236]: WARNING keystonemiddleware.auth_token [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:23:59.801667 n-d-851368-1 devstack@n-api.service[119236]: WARNING keystonemiddleware.auth_token [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:24:00.064867 n-d-851368-1 devstack@n-api.service[119235]: WARNING keystonemiddleware.auth_token [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:24:00.071178 n-d-851368-1 devstack@n-api.service[119235]: WARNING keystonemiddleware.auth_token [None req-6a303242-9b80-4044-bf28-d63d7a68ae1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:24:00.076566 n-d-851368-1 devstack@n-api.service[119235]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca94bcf9c0 pid: 119235 (default app) Jul 28 11:24:00.142639 n-d-851368-1 devstack@n-api.service[119236]: WARNING keystonemiddleware.auth_token [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 11:24:00.148763 n-d-851368-1 devstack@n-api.service[119236]: WARNING keystonemiddleware.auth_token [None req-24dedf6e-6800-4e7a-aba3-ea2fdb240ec2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 11:24:00.154080 n-d-851368-1 devstack@n-api.service[119236]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca94bcf9c0 pid: 119236 (default app) Jul 28 11:24:48.407874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.421926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.422866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.425624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.698113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.706622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.709171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:48.710918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:49.960597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:49.962807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:49.963357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:49.964860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:49.965639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.057881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79f5eb37-3ff5-41dd-a7d7-d01545ff78b7 tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.686111 Jul 28 11:24:50.067939 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1/1] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Jul 28 11:24:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:24:50.186048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '.version_select at 0x7f2eb977cca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:50.188854 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:50.188854 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:24:50.196901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119236) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 11:24:50.198142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.198730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.254789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.255452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.295958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.296714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.306645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef2ce0bf-2998-46f3-b2f4-b25d20911bd7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.626557 Jul 28 11:24:50.308446 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1/2] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:24:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:50.594755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Calling method '.version_select at 0x7f2eb977ee50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:50.599150 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:50.599150 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:50.612631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119235) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 11:24:50.618271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.618885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.661572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:50.667760 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:50.667760 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:24:50.673031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.673858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.677939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.678966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.684051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.684661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.689875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:50.690630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:50.698043 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c901144-e38b-4976-a019-7a39d292e422 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.617130 Jul 28 11:24:50.698959 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2/3] 10.222.0.93 () {60 vars in 1208 bytes} [Thu Jul 28 11:24:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:24:50.857207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-77f80115-d30b-49db-9faf-f87288d4b4b3 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.541205 Jul 28 11:24:50.860782 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:24:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:51.147854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-239f2fce-831a-449f-b73f-d69f1b0b8621 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1352140146", "id": 187772378, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:51.165567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-429214731", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:51.192212 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:51.192212 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:51.265008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-239f2fce-831a-449f-b73f-d69f1b0b8621 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.563935 Jul 28 11:24:51.274298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3/5] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:24:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:51.274298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:51.275546 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:51.275546 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:51.278011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:51.279456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:51.281088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:51.281976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:51.314706 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a60abf0f-0b91-41a0-9ef4-e8523be9f97c tempest-AZAdminV2TestJSON-1334218586 tempest-AZAdminV2TestJSON-1334218586-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.047313 Jul 28 11:24:51.323630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 4/6] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:24:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:51.333442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-16007c18-e2dc-4897-8850-ddca1a3483b9 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1659486161", "name": "tempest-test_aggregate-1880520697"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:51.391100 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:51.391100 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:51.394523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-16007c18-e2dc-4897-8850-ddca1a3483b9 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid 94cc28cd-953d-4ebb-80b2-3621bb1583d1 for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:24:51.572895 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-16007c18-e2dc-4897-8850-ddca1a3483b9 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.244578 Jul 28 11:24:51.573526 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 5/7] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Jul 28 11:24:51 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:51.581174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fea6a62e-b0a8-4702-ac94-7822baadb77e tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c45efc61960e4559a9fc955bfe4c509e"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:51.587391 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:51.587391 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:51.896210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:24:52.403547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fea6a62e-b0a8-4702-ac94-7822baadb77e tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/187772378/action" status: 200 len: 96 microversion: 2.1 time: 0.827605 Jul 28 11:24:52.410169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 6/8] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Jul 28 11:24:51 2022] POST /compute/v2.1/flavors/187772378/action => generated 96 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:24:52.414887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7974ae9-ce9e-4c90-b95a-91fd22bca834 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:52.415682 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:52.415682 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:52.453970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7974ae9-ce9e-4c90-b95a-91fd22bca834 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.042339 Jul 28 11:24:52.455160 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 7/9] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:24:52 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:52.678115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ac8c679-e917-43b8-aeb0-201541313645 tempest-FlavorsAccessTestJSON-22745501 tempest-FlavorsAccessTestJSON-22745501-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:52.725252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ac8c679-e917-43b8-aeb0-201541313645 tempest-FlavorsAccessTestJSON-22745501 tempest-FlavorsAccessTestJSON-22745501-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.268838 Jul 28 11:24:52.744068 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 8/10] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:24:52 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:52.750811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-40e60be6-0ebf-4c84-a142-124f49e0a64b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:52.754325 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:52.754325 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:52.766118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40e60be6-0ebf-4c84-a142-124f49e0a64b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:52.766923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40e60be6-0ebf-4c84-a142-124f49e0a64b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:53.137610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:24:53.138614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:24:53.139420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:24:53.139982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:24:53.140540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:24:53.174694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:53.175110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:53.175943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:53.176571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:53.262418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Getting quotas for project 175fd7cb8b284562bf2f7d9ff09e06ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:24:53.306395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Getting quotas for user d1bf5f1e1d2948b88e16555f16e34b85 and project 175fd7cb8b284562bf2f7d9ff09e06ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:24:53.332966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:24:53.348755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:24:53.484745 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-40e60be6-0ebf-4c84-a142-124f49e0a64b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.738384 Jul 28 11:24:53.485910 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 9/11] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:24:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:53.537553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85c02bdb-53ca-40a0-9543-735f8c7d2701 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c45efc61960e4559a9fc955bfe4c509e"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:53.540995 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f833757a-6999-4103-95d7-1aa5b6292ad2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678170 Jul 28 11:24:53.541777 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3/12] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:24:53.553672 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:53.553672 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:53.555407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a68a8518-8415-4ee0-9cc3-f91a0278a26d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:53.556150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a68a8518-8415-4ee0-9cc3-f91a0278a26d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:53.754231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a68a8518-8415-4ee0-9cc3-f91a0278a26d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:53.783955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a68a8518-8415-4ee0-9cc3-f91a0278a26d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1219 microversion: 2.1 time: 0.233247 Jul 28 11:24:53.784749 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 4/13] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:53 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:54.351644 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85c02bdb-53ca-40a0-9543-735f8c7d2701 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/187772378/action" status: 200 len: 21 microversion: 2.1 time: 0.863474 Jul 28 11:24:54.352262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 10/14] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Jul 28 11:24:53 2022] POST /compute/v2.1/flavors/187772378/action => generated 21 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:24:54.384180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf56c442-2de3-4882-a4ea-2dbfee6b4e72 tempest-FlavorsAccessTestJSON-22745501 tempest-FlavorsAccessTestJSON-22745501-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:54.393880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1932083268", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "availability_zone": "tempest-test_az-1659486161"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:54.421413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf56c442-2de3-4882-a4ea-2dbfee6b4e72 tempest-FlavorsAccessTestJSON-22745501 tempest-FlavorsAccessTestJSON-22745501-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052830 Jul 28 11:24:54.424079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:54.424564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:54.425362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:54.428869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:54.434839 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 11/15] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:24:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:54.456745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8adc1576-21b3-4dbf-9296-285e2ae1d575 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:54.466062 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:54.466062 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:54.574383 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8adc1576-21b3-4dbf-9296-285e2ae1d575 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/187772378" status: 202 len: 0 microversion: 2.1 time: 0.123155 Jul 28 11:24:54.575536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 12/16] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:24:54 2022] DELETE /compute/v2.1/flavors/187772378 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:24:54.594300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6fe03e9b-da9e-4589-ac03-9c75ac8ab38d tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:54.600776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:24:54.661537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6fe03e9b-da9e-4589-ac03-9c75ac8ab38d tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079158 Jul 28 11:24:54.662138 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 13/17] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:24:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:54.701817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4af15738-2d74-4224-976c-b4315d028e45 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-202630085", "id": 1611180188, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:24:54.706622 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:54.706622 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:54.743294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4af15738-2d74-4224-976c-b4315d028e45 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.052746 Jul 28 11:24:54.752411 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 14/18] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:24:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:24:54.778615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4646033-097a-4afc-8254-57492dcefd57 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:54.780079 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:54.780079 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:24:54.821078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4646033-097a-4afc-8254-57492dcefd57 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/1611180188/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.063959 Jul 28 11:24:54.826627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 15/19] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Jul 28 11:24:54 2022] GET /compute/v2.1/flavors/1611180188/os-flavor-access => generated 21 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:24:54.840307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-346d777f-1fcb-4c28-979c-42d81a60959a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:54.841176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-346d777f-1fcb-4c28-979c-42d81a60959a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:55.147061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:24:55.148276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:24:55.149015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:24:55.149840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:24:55.150513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:24:55.175809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:55.176512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:55.177529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:55.179628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:55.232560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Getting quotas for project 056430504120421397e6d36dc5e59f83. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:24:55.241732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Getting quotas for user 164fa3f2feb7406aa38d31c856bf8e89 and project 056430504120421397e6d36dc5e59f83. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:24:55.265770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:24:55.272721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:24:55.367651 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05d78b80-5ae4-42b7-8ea2-07d0ff85dbbc tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575477 Jul 28 11:24:55.372725 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 5/20] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:24:55.395924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c341c8d-ca1a-499d-8110-401f737afc14 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:55.396802 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:55.396802 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:24:55.473693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c341c8d-ca1a-499d-8110-401f737afc14 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1611180188" status: 202 len: 0 microversion: 2.1 time: 0.099426 Jul 28 11:24:55.478628 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 6/21] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:24:55 2022] DELETE /compute/v2.1/flavors/1611180188 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:24:55.496763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c8e36a25-3f2a-4f18-b8eb-b2f2114ec77d tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:55.497313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c8e36a25-3f2a-4f18-b8eb-b2f2114ec77d tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:55.602253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c8e36a25-3f2a-4f18-b8eb-b2f2114ec77d tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:55.611987 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c8e36a25-3f2a-4f18-b8eb-b2f2114ec77d tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1243 microversion: 2.1 time: 0.132210 Jul 28 11:24:55.612566 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 7/22] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:55 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1243 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:55.632024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-085a474e-0985-4053-ac0e-b0f52855a3d9 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:55.699767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-085a474e-0985-4053-ac0e-b0f52855a3d9 tempest-FlavorsAccessTestJSON-1173791603 tempest-FlavorsAccessTestJSON-1173791603-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082638 Jul 28 11:24:55.717282 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 8/23] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:24:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:55.854655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-346d777f-1fcb-4c28-979c-42d81a60959a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:55.886007 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-346d777f-1fcb-4c28-979c-42d81a60959a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1219 microversion: 2.1 time: 1.058140 Jul 28 11:24:55.891538 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 16/24] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:54 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1219 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:56.639996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f9b3e8e-e201-4a84-8fad-2dcfe04f8441 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:56.640630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f9b3e8e-e201-4a84-8fad-2dcfe04f8441 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:56.909639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:56.910861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:56.941396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:56.941902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:56.942723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:56.949242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:57.096902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5f9b3e8e-e201-4a84-8fad-2dcfe04f8441 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:57.107913 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f9b3e8e-e201-4a84-8fad-2dcfe04f8441 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1243 microversion: 2.1 time: 0.475747 Jul 28 11:24:57.111161 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 9/25] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:56 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1243 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:57.552679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:57.580771 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02494029-fa34-4a20-8bb5-6a1a8f632197 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1279 microversion: 2.1 time: 0.676450 Jul 28 11:24:57.590929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 17/26] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:56 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1279 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:24:58.138561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:58.144723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:58.151737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:58.152433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:58.158739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:58.160008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:58.547090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:58.555246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9719265c-54ed-46bb-9dad-2bb5d2cfefbf tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1291 microversion: 2.1 time: 0.424553 Jul 28 11:24:58.562270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 18/27] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:58 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1291 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:58.612916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:58.613274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:58.635650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:58.637606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:58.640181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:58.641592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:58.656126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4412b03c-859a-4712-b312-084b6fb1f66e tempest-AZAdminNegativeTestJSON-670882246 tempest-AZAdminNegativeTestJSON-670882246-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:58.657090 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:24:58.657090 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:24:58.658096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4412b03c-859a-4712-b312-084b6fb1f66e tempest-AZAdminNegativeTestJSON-670882246 tempest-AZAdminNegativeTestJSON-670882246-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '057b08de695e40f1bbf4c1e447ac64df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecac33808524dc9866d45857651eac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4412b03c-859a-4712-b312-084b6fb1f66e tempest-AZAdminNegativeTestJSON-670882246 tempest-AZAdminNegativeTestJSON-670882246-project] Request method failure captured: Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIIyHSQqCM8WpuWxjJNBIS6ed3mOQSjyUP479ZBwJhEK_uHY5ShzZmIqI236jxlaUMB8x4AsnK49cSbG-IiPBdzYLopuurz-cWtORqbVpJubzuLzf_pCFC_oV3FDSZ8LGc1c2yeFuTpqlf0s7Zcjt-CPFQ1eBq6GzfM4EeuYfdNaFM Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 6ecac33808524dc9866d45857651eac2 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AZAdminNegativeTestJSON-670882246 Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:24:58.669501 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6ecac33808524dc9866d45857651eac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6ecac33808524dc9866d45857651eac2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6ecac33808524dc9866d45857651eac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6ecac33808524dc9866d45857651eac2"}]}] Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AZAdminNegativeTestJSON-670882246 Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 6ecac33808524dc9866d45857651eac2 Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-670882246 Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AZAdminNegativeTestJSON-670882246-project Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 057b08de695e40f1bbf4c1e447ac64df Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AZAdminNegativeTestJSON-670882246-project Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 11:24:58.670838 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:24:58.671638 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:24:58.672838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4412b03c-859a-4712-b312-084b6fb1f66e tempest-AZAdminNegativeTestJSON-670882246 tempest-AZAdminNegativeTestJSON-670882246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:24:58.673899 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4412b03c-859a-4712-b312-084b6fb1f66e tempest-AZAdminNegativeTestJSON-670882246 tempest-AZAdminNegativeTestJSON-670882246-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.608943 Jul 28 11:24:58.674434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 10/28] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:24:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 610 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:24:58.851091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:24:58.864916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5255ccbc-8498-4037-87fb-50688d309dc1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1277 microversion: 2.1 time: 0.254555 Jul 28 11:24:58.867444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 19/29] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:58 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:24:59.583764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:59.584556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:59.605581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:59.610247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:59.611276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:59.616113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:59.890174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:24:59.890814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:24:59.900314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:59.901275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:24:59.905315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:24:59.906020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:00.282281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:00.323759 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd999fcf-60b7-49a3-9195-a587e2643579 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1297 microversion: 2.1 time: 0.745272 Jul 28 11:25:00.331421 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 11/30] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:59 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1297 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:00.408208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:00.422629 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77ce35ba-66e3-4a20-b5a4-cee2872d44e8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1277 microversion: 2.1 time: 0.536634 Jul 28 11:25:00.442891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 20/31] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:24:59 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1277 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:01.359559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:01.360844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:01.377730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:01.380035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:01.381023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:01.385132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:01.452382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:01.453006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:01.455364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:01.472705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:01.473592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:01.488782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:01.491217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:01.753896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:01.782710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af48963f-6e2d-4458-a8db-14ceed2349eb tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1297 microversion: 2.1 time: 0.429682 Jul 28 11:25:01.788232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 12/32] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:01 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1297 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:01.863468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:01.875634 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aba91f02-ef2d-4c08-8a16-bbf619e89849 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1277 microversion: 2.1 time: 0.427312 Jul 28 11:25:01.879423 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 21/33] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:01 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1277 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:02.817917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:02.818568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:02.838161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:02.847931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:02.852985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:02.855400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:02.906707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:02.907957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:02.969445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:02.984508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:02.988675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:02.991877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:03.898293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:03.909043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1ab91dcb-bac6-414e-b804-b7381b510ae9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1297 microversion: 2.1 time: 1.104771 Jul 28 11:25:03.915886 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 13/34] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:02 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1297 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:04.739181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:04.753308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6128a6bf-63bf-48c9-92a6-563d31d44688 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 1.857653 Jul 28 11:25:04.771889 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 22/35] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:02 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:04.938025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:04.938723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:04.955761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:04.956215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:04.957076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:04.957446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:05.204288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:05.769836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:05.781403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:05.782192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:05.789440 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c398b35-b6db-4451-b8b7-7605af1a3d85 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1297 microversion: 2.1 time: 0.855253 Jul 28 11:25:05.793478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:05.811214 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 14/36] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:04 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1297 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:05.811494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:05.812648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:05.813626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:05.923206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:06.832629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:06.833265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:06.846642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:06.847121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:06.861706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:06.866384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:07.102503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:07.950835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:07.961186 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-956dcf45-249d-4eef-8dd9-2a35f1c9d329 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 2.183840 Jul 28 11:25:07.971428 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 23/37] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:05 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:08.478975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:08.491244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-554f8eb2-243a-4e60-a6ce-844e55852d56 req-3bacff1c-0478-4e94-aa7e-e0f255119507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69cd6b85-26e6-4f56-acf8-33c7fa925475", "tag": "d5449359-8b81-4699-afb9-b51e335fbd44"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:08.492800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00be19b6-b598-4ed7-a42b-d0077c297f78 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 1.659553 Jul 28 11:25:08.502271 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 15/38] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:06 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:08.549051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-554f8eb2-243a-4e60-a6ce-844e55852d56 req-3bacff1c-0478-4e94-aa7e-e0f255119507 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:08.549500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-554f8eb2-243a-4e60-a6ce-844e55852d56 req-3bacff1c-0478-4e94-aa7e-e0f255119507 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:08.615157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-554f8eb2-243a-4e60-a6ce-844e55852d56 req-3bacff1c-0478-4e94-aa7e-e0f255119507 service nova] Creating event network-changed:d5449359-8b81-4699-afb9-b51e335fbd44 for instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 on n-h1-851368-1 Jul 28 11:25:08.615692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-554f8eb2-243a-4e60-a6ce-844e55852d56 req-3bacff1c-0478-4e94-aa7e-e0f255119507 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:25:08.624510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:08.628858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:08.631336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:08.632746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:08.655461 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.rpcapi [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 11:25:08.658550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] Releasing lock "compute-rpcapi-router" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:25:08.708137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd79d7fd-5897-4c4c-ba72-24ed4a23ecfc None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.734485 Jul 28 11:25:08.709284 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 24/39] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:08.984110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:08.985570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:09.017017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:09.017832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:09.018706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:09.019200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:09.202118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fdab365-8294-4c05-89c3-213524b38922 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-690736063", "id": 1011289077, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:09.205367 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:09.205367 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:09.315563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fdab365-8294-4c05-89c3-213524b38922 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.433661 Jul 28 11:25:09.325509 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 16/40] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:25:08 2022] POST /compute/v2.1/flavors => generated 467 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:09.583063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29ea7e6f-95c6-48e5-957e-09fa6d37e8f3 tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:09.599278 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29ea7e6f-95c6-48e5-957e-09fa6d37e8f3 tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] 10.222.0.93 "GET /compute/v2.1/flavors/1011289077" status: 200 len: 467 microversion: 2.61 time: 0.273770 Jul 28 11:25:09.610512 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 17/41] 10.222.0.93 () {60 vars in 1199 bytes} [Thu Jul 28 11:25:09 2022] GET /compute/v2.1/flavors/1011289077 => generated 467 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:09.616531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:09.617447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:09.630183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:09.634199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:09.635230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:09.635871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:10.363203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:10.372962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-657597af-63ec-4e03-abb8-1219fca4b56c tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.760176 Jul 28 11:25:10.388636 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 18/42] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:09 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:10.413823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5ea288b-a5e9-4dbd-9f5a-d7af4079b811 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb9b3eaf0>, body: {"flavor": {"description": "new"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:10.438390 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:10.438390 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:10.531769 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5ea288b-a5e9-4dbd-9f5a-d7af4079b811 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1011289077" status: 200 len: 468 microversion: 2.61 time: 0.140186 Jul 28 11:25:10.553039 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 19/43] 10.222.0.93 () {62 vars in 1219 bytes} [Thu Jul 28 11:25:10 2022] PUT /compute/v2.1/flavors/1011289077 => generated 468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:10.563315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41b8831c-b164-479e-97d7-e28317dfe7ff tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:10.672532 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41b8831c-b164-479e-97d7-e28317dfe7ff tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.117849 Jul 28 11:25:10.673257 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 20/44] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:25:10 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:25:10.695896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2afc7fb1-9179-420b-a98e-4f5038f65447 tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:10.754547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2afc7fb1-9179-420b-a98e-4f5038f65447 tempest-FlavorsV261TestJSON-336788353 tempest-FlavorsV261TestJSON-336788353-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.062851 Jul 28 11:25:10.755535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 21/45] 10.222.0.93 () {60 vars in 1166 bytes} [Thu Jul 28 11:25:10 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:25:10.776919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef3b3288-d29f-4492-904a-f273afbb375c tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:10.777697 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:10.777697 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:10.808633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:10.812625 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef3b3288-d29f-4492-904a-f273afbb375c tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1011289077" status: 202 len: 0 microversion: 2.61 time: 0.040215 Jul 28 11:25:10.815041 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 22/46] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Jul 28 11:25:10 2022] DELETE /compute/v2.1/flavors/1011289077 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:25:10.824530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad6d6ec2-599d-41ad-8c06-e80f13cb2a65 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:10.880488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad6d6ec2-599d-41ad-8c06-e80f13cb2a65 tempest-FlavorsV261TestJSON-1113801213 tempest-FlavorsV261TestJSON-1113801213-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.059948 Jul 28 11:25:10.882426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:25:10 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:25:11.259344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Calling method '.version_select at 0x7f2eb955b5e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:11.275308 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:11.275308 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:11.278938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.282796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.320082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:11.361203 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b6f5632-9e3c-4e9a-86b3-4194524cea35 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 2.378572 Jul 28 11:25:11.366770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 25/48] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:08 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:11.367371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.368082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.407576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:11.408220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:11.417589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.423093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.428640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.430979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.433898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.437991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.453986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-529bdbaa-08ae-43f6-b3e2-dc5d03f18292 tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.503274 Jul 28 11:25:11.464126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:25:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:25:11.490519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Calling method '.version_select at 0x7f2eb83b4b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:11.494409 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:11.494409 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:11.502055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.505547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.602444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:11.611201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:11.641071 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29ca8b5d-faf9-4e1d-9c75-93ce22f9a14a tempest-HypervisorAdminV228Test-1760110071 tempest-HypervisorAdminV228Test-1760110071-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.169218 Jul 28 11:25:11.645608 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 25/50] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:25:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:12.391613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:12.392310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:12.400836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:12.403090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:12.414667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:12.415391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:13.698561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:13.709174 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ad82168-0320-45bf-898f-74ee0260765f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 2.307470 Jul 28 11:25:13.717628 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 26/51] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:11 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:14.320172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-63cc6a7f-ba69-49cd-86b7-43f7d0686870 req-8dc0a0f0-4858-4ad3-a65d-181f77810b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbbac52-657b-4784-a778-a2f97d691637", "tag": "d9d53151-eb2e-40a2-a32e-8be9e32afaeb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:14.358180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-63cc6a7f-ba69-49cd-86b7-43f7d0686870 req-8dc0a0f0-4858-4ad3-a65d-181f77810b7a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:14.362428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-63cc6a7f-ba69-49cd-86b7-43f7d0686870 req-8dc0a0f0-4858-4ad3-a65d-181f77810b7a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:14.396516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-63cc6a7f-ba69-49cd-86b7-43f7d0686870 req-8dc0a0f0-4858-4ad3-a65d-181f77810b7a service nova] Creating event network-changed:d9d53151-eb2e-40a2-a32e-8be9e32afaeb for instance cbbbac52-657b-4784-a778-a2f97d691637 on n-h2-851368-1 Jul 28 11:25:14.417383 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-63cc6a7f-ba69-49cd-86b7-43f7d0686870 req-8dc0a0f0-4858-4ad3-a65d-181f77810b7a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565835 Jul 28 11:25:14.421382 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 27/52] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:14.744654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:14.745559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:14.746792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:14.752001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:14.764582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:14.765045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:14.766796 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d67317d0-9a72-4029-9814-802249ffd932 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 2.379206 Jul 28 11:25:14.767652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:14.768114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:14.775532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 26/53] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:12 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:15.591472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:15.623432 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28d50de7-2b96-48e0-9895-67c5c697ed11 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.874055 Jul 28 11:25:15.624850 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 28/54] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:14 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:15.798051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:15.798818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:15.809640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:15.811431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:15.815400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:15.818900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:16.654440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:16.656700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:16.672502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:16.679507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:16.684462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:16.685635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:17.380217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:17.417574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 1.619915 Jul 28 11:25:17.424435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 27/55] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:15 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:17.607703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:17.609718 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2023bcf4-96be-492e-aeb2-0bfeada6e872 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003115 Jul 28 11:25:17.610599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 28/56] 10.222.0.93 () {56 vars in 886 bytes} [Thu Jul 28 11:25:17 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 11:25:18.452176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:18.454305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:18.475448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:18.476012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:18.476837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:18.480398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:18.538176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:18.550637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=85 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:18.553699 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-01ec7690-21cc-4c27-8aca-f5d6315f5408 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 1.903601 Jul 28 11:25:18.563823 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 29/57] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:16 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:19.147485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:19.149981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=77 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:19.166175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca3ac2a4-10ec-4052-be54-7fcd2858f769 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.720092 Jul 28 11:25:19.181513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 29/58] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:18 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:19.579703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:19.582896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:19.588508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:19.608896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:19.611330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:19.613162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:19.618596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:20.283379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-451677522", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:20.410106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:25:20.933787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:20.955100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53182452-2da6-4789-92e7-2501546c6a40 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 1.382398 Jul 28 11:25:20.958366 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 30/59] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:19 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:20.965706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:20.970797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:20.982709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:20.983622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:20.984577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:20.985022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:21.319189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:25:21.319703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:25:21.320314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:25:21.320854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:25:21.321398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:25:21.333738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:21.334663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:21.335667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:21.336207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:21.362653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:25:21.366946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:25:21.378963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:25:21.381312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:25:21.446639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f6a9684-9df7-4168-88b2-e2e8b921d2f1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773106 Jul 28 11:25:21.455521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 30/60] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:25:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:25:21.480756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc61b55d-b3b6-4001-8696-fbb0eef01006 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:21.480947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc61b55d-b3b6-4001-8696-fbb0eef01006 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:21.486485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:21.495451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1faa6300-2ac7-400b-821a-e1d560403e30 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.536660 Jul 28 11:25:21.499995 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 31/61] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:20 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:21.705883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc61b55d-b3b6-4001-8696-fbb0eef01006 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:21.714131 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc61b55d-b3b6-4001-8696-fbb0eef01006 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1212 microversion: 2.1 time: 0.256193 Jul 28 11:25:21.723469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 31/62] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:21 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1212 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:21.980612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:21.982171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:22.021337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.021898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.027063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.032109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.517987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:22.519271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:22.526908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.528213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.529201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.529787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.689622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:22.697292 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9bc2d024-502f-43bb-baeb-c18f8a9eaace tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.723206 Jul 28 11:25:22.698473 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 32/63] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:21 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:22.737046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:22.737817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:22.751580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.752227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.761162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:22.763371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:22.849305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:22.878372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:22.886456 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a3111c35-a2b0-4763-a44f-dd3b5a45a685 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1264 microversion: 2.1 time: 0.154527 Jul 28 11:25:22.887452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 33/64] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:22 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:22.893081 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eae808a0-bfbf-43cb-876a-75e269e94ddb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.370864 Jul 28 11:25:22.927627 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 32/65] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:22 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:23.447743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b09678db-c5b7-4583-aae8-c62a2075c5c2 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:23.472863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b09678db-c5b7-4583-aae8-c62a2075c5c2 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.301243 Jul 28 11:25:23.476214 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 34/66] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:25:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:23.720919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:23.721699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:23.724425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4854205f-fc40-4b3b-a884-cd676ae02e24 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-749024642", "id": 1385482101, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:23.727830 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:23.727830 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:23.732694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:23.736842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:23.737796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:23.741136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:23.759399 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4854205f-fc40-4b3b-a884-cd676ae02e24 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.270966 Jul 28 11:25:23.766802 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:25:23 2022] POST /compute/v2.1/flavors => generated 424 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:23.780897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee0e769c-3072-4fca-92af-11ebe712fa30 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:23.799410 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee0e769c-3072-4fca-92af-11ebe712fa30 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027983 Jul 28 11:25:23.799987 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 34/68] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Jul 28 11:25:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:25:23.815861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-736e84af-142e-4503-b8fa-14e99cefd2eb tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1950607343", "id": 1477067090, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:23.855879 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-736e84af-142e-4503-b8fa-14e99cefd2eb tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.047136 Jul 28 11:25:23.859135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 35/69] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:25:23 2022] POST /compute/v2.1/flavors => generated 425 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:23.876903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97563264-b421-449e-85f9-d23cf9db5924 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:23.899063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97563264-b421-449e-85f9-d23cf9db5924 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032031 Jul 28 11:25:23.926197 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 36/70] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Jul 28 11:25:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:25:23.940658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:23.944269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:23.960891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:23.961530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:23.963993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:23.964745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:24.112582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:24.123156 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-096981c9-83e9-49ff-8cc9-35dc0d17f7cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1264 microversion: 2.1 time: 0.195714 Jul 28 11:25:24.136867 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 37/71] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:23 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:24.141430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:24.142724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:24.155262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:24.167008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:24.168750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:24.174818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:24.630490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:24.637948 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d75ee94-a6fd-450b-9fd8-ef8174024d16 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.921888 Jul 28 11:25:24.651609 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 35/72] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:23 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:24.657442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b182ead-a4f2-451f-914f-ffc5d5f4c06e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Action: 'create', calling method: .version_select at 0x7f2eb82e7f70>, body: {"keypair": {"name": "tempest-keypair-1723843283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuBy7a8zgxAzMvxDZN60xgkHlFJ/d/DsmdadhQTUBcox+0lMi1bsIqVUUO5NSWhyQ1h/mD76E8XcO7V3jI3Mehi5aRe6fdZuKarF7gJcHin5iyL3JaxVzNou6zaBFe3tQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:24.692908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6b182ead-a4f2-451f-914f-ffc5d5f4c06e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:25:24.703366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6b182ead-a4f2-451f-914f-ffc5d5f4c06e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for user 54e94603a7ad4df4a79f38b48c063ab6 and project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:25:24.750970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b182ead-a4f2-451f-914f-ffc5d5f4c06e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097682 Jul 28 11:25:24.754761 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 36/73] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:24.820573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:24.837742 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee7d23da-81fb-4dbb-90e8-c00ac8d438a8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.709442 Jul 28 11:25:24.842509 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 38/74] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:24 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:24.947676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-13307294-599c-4468-a475-867ce35e05b0 req-79e35f37-ec41-4af6-ba91-cade290b0690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbbac52-657b-4784-a778-a2f97d691637", "name": "network-vif-plugged", "status": "completed", "tag": "d9d53151-eb2e-40a2-a32e-8be9e32afaeb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:24.960459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-13307294-599c-4468-a475-867ce35e05b0 req-79e35f37-ec41-4af6-ba91-cade290b0690 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:24.972071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-13307294-599c-4468-a475-867ce35e05b0 req-79e35f37-ec41-4af6-ba91-cade290b0690 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:24.986350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-13307294-599c-4468-a475-867ce35e05b0 req-79e35f37-ec41-4af6-ba91-cade290b0690 service nova] Creating event network-vif-plugged:d9d53151-eb2e-40a2-a32e-8be9e32afaeb for instance cbbbac52-657b-4784-a778-a2f97d691637 on n-h2-851368-1 Jul 28 11:25:24.992520 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-13307294-599c-4468-a475-867ce35e05b0 req-79e35f37-ec41-4af6-ba91-cade290b0690 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234832 Jul 28 11:25:24.997318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 37/75] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.105705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb83be310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.106993 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.106993 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.109963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.110673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.137395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.138217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.151918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.152723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.155991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.158295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:25.160682 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d80b058a-8388-461a-ad12-7aa4c69cf124 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.316976 Jul 28 11:25:25.162004 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 39/76] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.179479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb84b39d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.185563 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.185563 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.187052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.187622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.187840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.188583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.189408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.191704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.210732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.211336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.224437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.226678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.245145 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-daffb583-1eb3-4753-a6d4-68c81bf48c78 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.068554 Jul 28 11:25:25.247935 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 40/77] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:25.266571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb8402a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.267621 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.267621 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.269284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.271643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.289525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.290067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.305926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.306516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.314649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1477e2ce-175c-49ff-abde-f414727026ee tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052783 Jul 28 11:25:25.321712 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 41/78] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:25.335819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb84028b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.337737 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.337737 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.339276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.339734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.358390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.359238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.369831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63ddf039-27e4-481c-ac7c-8842f6723ee1 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042658 Jul 28 11:25:25.379480 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 42/79] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.397720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5332f43-9a64-4788-b184-0a75d6b73ace tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb84b3550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.397869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:25.397964 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.397964 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.399038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5332f43-9a64-4788-b184-0a75d6b73ace tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.399510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5332f43-9a64-4788-b184-0a75d6b73ace tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.412650 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70c30448-f41b-4e79-8393-b681001b49ee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1264 microversion: 2.1 time: 0.270019 Jul 28 11:25:25.413712 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 38/80] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:25.431660 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5332f43-9a64-4788-b184-0a75d6b73ace tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.039188 Jul 28 11:25:25.432469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 43/81] 10.222.0.93 () {58 vars in 1179 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.444665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb824bb80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.445557 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.445557 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:25.446966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.447612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.466356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.467349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.478447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.479191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.486903 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebcbf19f-f76d-416d-aafd-9f689072843b tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045575 Jul 28 11:25:25.488218 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 39/82] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.501971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb84b3430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.503053 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.503053 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.504432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.505033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.522609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.526404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.545465 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd47ebd9-18c1-4800-a428-6b5b5be96593 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043347 Jul 28 11:25:25.546262 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 44/83] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.561340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb824b4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.562409 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.562409 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:25.563875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.564508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.613534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.614082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.625184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4902f11e-f59b-45c4-8106-3c3d50885065 tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.067127 Jul 28 11:25:25.626428 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 40/84] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.643407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Calling method '.version_select at 0x7f2eb8415430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.645851 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:25.645851 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:25.647674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.648339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.664252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.665351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:25.666291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.667006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.683619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.684078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.691820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.692870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.694681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.695448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.705262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7734eb9e-3553-44ca-8ed4-465fc629f02a tempest-HypervisorAdminTestJSON-552789868 tempest-HypervisorAdminTestJSON-552789868-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:25:25.708379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.712257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.713577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.714249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.749462 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.rpcapi [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 11:25:25.753697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] Releasing lock "compute-rpcapi-router" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:25:25.804103 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c93df3e-eb0f-435c-8fd8-28400606efd8 None None] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.166682 Jul 28 11:25:25.805298 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 45/85] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:25.862864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:25.863705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:25.878424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.879005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:25.882187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:25.882971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:26.129809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:26.140958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c00dd241-1020-497e-96e8-168e500d8a5f tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.481334 Jul 28 11:25:26.140958 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 41/86] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:26.356851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:26.374629 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41994f57-4a8f-45fa-9bf8-408b8aa30de2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.515820 Jul 28 11:25:26.375581 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 46/87] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:25 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:26.434161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:26.434839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:26.445992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:26.446442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:26.455663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:26.456415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:26.583768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:26.593161 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a3be107c-2da4-4f62-a72d-dd5068705e35 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1270 microversion: 2.1 time: 0.163079 Jul 28 11:25:26.603889 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 42/88] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:26 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:27.163698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:27.164318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:27.172274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.173064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.174294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.174944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.396455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:27.397714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:27.407119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.412831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.414517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.415425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.464929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:27.473635 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46e2613d-e9b8-45e1-b4ee-dcc7d3f4afb8 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1339 microversion: 2.1 time: 0.313695 Jul 28 11:25:27.474147 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 47/89] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:27 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1339 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:27.616902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:27.617518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:27.629040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.629774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.630826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:27.631489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:27.846894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:27.856724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-959129f1-cda3-4636-8e27-21fa5df36feb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.464227 Jul 28 11:25:27.859328 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 43/90] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:27 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:27.995923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-792381647", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "1477067090", "adminPass": "***", "networks": [{"uuid": "c6e066f9-62be-4561-bf81-78745fae59fd"}], "security_groups": [{"name": "tempest-securitygroup--1975633822"}], "key_name": "tempest-keypair-1723843283", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:28.150695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:28.168307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a5ef82d-6cad-4bbe-b3b4-dd7626cf8231 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.555119 Jul 28 11:25:28.168939 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 48/91] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:27 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:28.366177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] validate_networks() for [('c6e066f9-62be-4561-bf81-78745fae59fd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:25:28.494283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:28.494905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:28.505522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:28.505969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:28.506749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:28.507223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:28.816511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:28.825881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa0d095e-c4aa-4c55-b9a7-08021c4bf329 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1489 microversion: 2.1 time: 0.335470 Jul 28 11:25:28.832244 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 49/92] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:28 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1489 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:28.853718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:28.854568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:28.863064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:28.864540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:28.865488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:28.866080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.627754 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4751a40-1477-4e59-9e12-bc609ed5768e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1640 microversion: 2.1 time: 0.776965 Jul 28 11:25:29.629661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 50/93] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:28 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1640 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:29.640296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:29.641433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:29.655350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:25:29.656714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:25:29.657379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:25:29.657659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.658101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:25:29.658216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.658878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.659151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:25:29.659345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.694193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.695266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.696457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.697386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.763392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:25:29.769890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for user 54e94603a7ad4df4a79f38b48c063ab6 and project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:25:29.784186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:25:29.787612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:25:29.833452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:29.851346 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9031694-8313-4e96-9c8c-096c79e9b8b9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.220174 Jul 28 11:25:29.851996 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 51/94] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:29 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:29.870582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-af05033a-4747-4277-8f9f-4b0767ec8219 req-c35c8308-2f94-4105-848f-e74f2ed7106f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:29.872869 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19fe2a74-7af8-4b3e-8f54-148cade0720c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.882061 Jul 28 11:25:29.881616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 44/95] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:25:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:25:29.885108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-af05033a-4747-4277-8f9f-4b0767ec8219 req-c35c8308-2f94-4105-848f-e74f2ed7106f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.885945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-af05033a-4747-4277-8f9f-4b0767ec8219 req-c35c8308-2f94-4105-848f-e74f2ed7106f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.888607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:29.889308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:29.897008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.898351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.899345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.899938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.909228 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-af05033a-4747-4277-8f9f-4b0767ec8219 req-c35c8308-2f94-4105-848f-e74f2ed7106f service nova] Creating event network-changed:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h1-851368-1 Jul 28 11:25:29.923272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-af05033a-4747-4277-8f9f-4b0767ec8219 req-c35c8308-2f94-4105-848f-e74f2ed7106f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049587 Jul 28 11:25:29.923932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 52/96] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:29.930051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:29.930510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:29.947332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.949545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:29.954390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:29.955003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:30.022866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:25:30.051272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:30.187928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:30.196099 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34ab2dfb-516b-4c9b-8110-3401e3a8aeb5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.312928 Jul 28 11:25:30.196653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 45/97] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:29 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:30.219620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05a30b48-d0b0-4bf2-b772-014e634e6a5d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:30.220388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05a30b48-d0b0-4bf2-b772-014e634e6a5d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:30.261009 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-172ed644-506a-443e-a190-365d49a8d6f6 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 204 len: 0 microversion: 2.1 time: 0.335150 Jul 28 11:25:30.267327 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 53/98] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:25:29 2022] DELETE /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:25:30.276508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:30.277304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:30.286402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:30.287108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:30.288507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:30.289045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:30.302092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-05a30b48-d0b0-4bf2-b772-014e634e6a5d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:30.311859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05a30b48-d0b0-4bf2-b772-014e634e6a5d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1264 microversion: 2.1 time: 0.103913 Jul 28 11:25:30.313392 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 46/99] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:30 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1264 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:30.488711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:30.498354 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-915963b9-4cab-40e5-b5df-61d209559f29 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1495 microversion: 2.1 time: 0.228583 Jul 28 11:25:30.499019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 54/100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:30 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1495 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:30.872190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:30.873504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:30.880184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:30.880929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:30.881949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:30.882579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:30.985566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0e8fac39-e18b-49c8-b9fb-e512561babd9 req-91ab3a57-0d0c-49ff-8fdf-f90821025f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cd6b85-26e6-4f56-acf8-33c7fa925475", "name": "network-vif-plugged", "status": "completed", "tag": "d5449359-8b81-4699-afb9-b51e335fbd44"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:30.995435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:31.006755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0e8fac39-e18b-49c8-b9fb-e512561babd9 req-91ab3a57-0d0c-49ff-8fdf-f90821025f29 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.007634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0e8fac39-e18b-49c8-b9fb-e512561babd9 req-91ab3a57-0d0c-49ff-8fdf-f90821025f29 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.023388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0e8fac39-e18b-49c8-b9fb-e512561babd9 req-91ab3a57-0d0c-49ff-8fdf-f90821025f29 service nova] Creating event network-vif-plugged:d5449359-8b81-4699-afb9-b51e335fbd44 for instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 on n-h1-851368-1 Jul 28 11:25:31.029328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0e8fac39-e18b-49c8-b9fb-e512561babd9 req-91ab3a57-0d0c-49ff-8fdf-f90821025f29 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049820 Jul 28 11:25:31.030567 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 55/101] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:31.087392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:31.096957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ba59187-5129-4cd5-9e2f-cbc2633eecf2 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.228679 Jul 28 11:25:31.098106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 47/102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:30 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:31.217989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.219278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:31.226599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.227046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.228016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.228626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.241206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Calling method '.version_select at 0x7f2eb8415430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.242137 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:31.242137 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:31.243716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.244212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.260377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.260827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.272278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.273084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.279338 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83d09b05-bc1f-4b48-88f8-1d7edae8bcb6 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.160443 Jul 28 11:25:31.280025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 56/103] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:31.293297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Calling method '.version_select at 0x7f2eb82c9c10>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.294160 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:31.294160 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:31.295582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.296210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.315634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.316082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.352922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.353376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.359615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c69459c3-f28a-40cd-942b-380e092eb549 tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-851368-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.073007 Jul 28 11:25:31.360182 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 57/104] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-851368-1/servers => generated 196 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:31.364742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.366664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:31.371567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.372677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.373459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.374047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.374708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:31.383414 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5a86d17d-8dc0-4afa-98a5-e3d018e4e261 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.169715 Jul 28 11:25:31.393932 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 48/105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:31.399581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Calling method '.version_select at 0x7f2eb8194820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.400799 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:31.400799 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:31.402290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.403617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.417965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.418511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.429928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.430482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.439474 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46008db7-b50b-4098-856f-85b9865bd5eb tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043633 Jul 28 11:25:31.439474 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 49/106] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:31.443191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:31.453455 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db5148f8-7847-4a1d-8e1e-6fcce046641e tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1290 microversion: 2.1 time: 0.092037 Jul 28 11:25:31.457875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Calling method '.version_select at 0x7f2eb8194dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.458690 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:31.458690 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:31.459543 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 58/107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:31.460338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.460791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.495259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.495720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.505790 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8783e0a7-9825-4fb7-8ae9-7eebed5dba7c tempest-HypervisorAdminUnderV252Test-700174918 tempest-HypervisorAdminUnderV252Test-700174918-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-851368-1/search" status: 200 len: 104 microversion: 2.1 time: 0.059777 Jul 28 11:25:31.506723 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 50/108] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-851368-1/search => generated 104 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:31.521265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:31.522064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:31.529136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.529838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.530673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:31.531295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:31.697210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:31.705657 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd4f06f9-7132-4470-ab37-3aaa70bda771 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1495 microversion: 2.1 time: 0.188442 Jul 28 11:25:31.706149 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 59/109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:31 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1495 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:32.118201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:32.118836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:32.125764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:32.126219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:32.126998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:32.127831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:32.148342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:32.405955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:32.407547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:32.411210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:32.421902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:32.422728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:32.423810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:32.424395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:33.342602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:33.358536 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b04cf689-c3fe-4342-9034-e357159d2d9e tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 1.242213 Jul 28 11:25:33.359839 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 51/110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:32 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:33.369098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:33.371764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:33.384466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:33.385602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:33.387185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:33.388177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:33.399790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:33.432673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2dfbc3f8-2235-4120-9d74-a96a5e422502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 1.031338 Jul 28 11:25:33.434072 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 60/111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:32 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:33.441678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:33.442888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:33.454543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:33.455428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:33.456410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:33.457093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:33.533771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:33.543932 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffa6b634-079a-4c53-8d62-49de0141d585 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1344 microversion: 2.1 time: 0.182687 Jul 28 11:25:33.544563 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 52/112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:33 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:33.732305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ac4989b-d85d-47a0-99af-dd8c41fdf5cd tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] Action: 'create', calling method: .version_select at 0x7f2eb8209700>, body: {"security_group": {"name": "tempest-securitygroup-1955201526", "description": "tempest-description-731479731"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:33.884993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164fa3f2feb7406aa38d31c856bf8e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056430504120421397e6d36dc5e59f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:33.892907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-246f0301-cc9f-4fe3-846b-12c83808d3a9 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 200 len: 1495 microversion: 2.1 time: 0.456860 Jul 28 11:25:33.893479 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 61/113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:33 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 1495 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:34.266243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-da9f1b8d-dc18-487a-a61b-ecd15eb1d8db req-7d1cfecc-3f31-466c-af3a-25e7359a8435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbbac52-657b-4784-a778-a2f97d691637", "name": "network-vif-deleted", "tag": "d9d53151-eb2e-40a2-a32e-8be9e32afaeb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:34.279889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-da9f1b8d-dc18-487a-a61b-ecd15eb1d8db req-7d1cfecc-3f31-466c-af3a-25e7359a8435 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.280751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-da9f1b8d-dc18-487a-a61b-ecd15eb1d8db req-7d1cfecc-3f31-466c-af3a-25e7359a8435 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.295326 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-da9f1b8d-dc18-487a-a61b-ecd15eb1d8db req-7d1cfecc-3f31-466c-af3a-25e7359a8435 service nova] Creating event network-vif-deleted:d9d53151-eb2e-40a2-a32e-8be9e32afaeb for instance cbbbac52-657b-4784-a778-a2f97d691637 on n-h2-851368-1 Jul 28 11:25:34.301813 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-da9f1b8d-dc18-487a-a61b-ecd15eb1d8db req-7d1cfecc-3f31-466c-af3a-25e7359a8435 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038829 Jul 28 11:25:34.303457 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 62/114] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:34.381067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:34.381760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:34.389986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.390731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.392585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.393431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.666434 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ac4989b-d85d-47a0-99af-dd8c41fdf5cd tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.120800 Jul 28 11:25:34.667292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 53/115] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:25:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:34.690089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:34.692670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:34.694151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:34.702384 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a26b3f34-22df-47fc-b69e-2c9dfff9f867 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1319 microversion: 2.1 time: 0.325403 Jul 28 11:25:34.702968 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 63/116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:34 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:34.704554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.705163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.705945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.706376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.716263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:34.717390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:34.727262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.728063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:34.742925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:34.743478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:35.040899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:35.052519 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-17568fa1-0e01-4584-8afe-89ba8d01c33d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.383872 Jul 28 11:25:35.055549 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 54/117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:34 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:35.074206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-adcc150e-8e26-4f1d-900c-84b0e9247648 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] Action: 'create', calling method: .version_select at 0x7f2eb8194c10>, body: {"security_group": {"name": "tempest-securitygroup-2047591432", "description": "tempest-description-70323870"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:35.155625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:35.163767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8042ea16-84a1-4c52-971c-50e1d80350a3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1412 microversion: 2.1 time: 0.459765 Jul 28 11:25:35.164551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 64/118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:34 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1412 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:35.182304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:35.183164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:35.199678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:35.201066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:35.201888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:35.202321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:35.236376 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] HTTP exception thrown: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Request method failure captured: Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 HTTP/1.1 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH82cuCqIZUG3UWIXx1nwC4E6IYjmGMY14NeGCKDYJiqnfvBx-7dXQ4mKYntmY6V25_zXTIjRgMHYvk_Sn4BTcawPWNbEttKU2yn_F981JgoqiNJFzTuTfCFRPgMqjVEEI7GSWvYU2S86LjgatmcI9PGeE--YKfYPzJoeDQAXjHFpY Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:35.253111 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/056430504120421397e6d36dc5e59f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_056430504120421397e6d36dc5e59f83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}] Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 164fa3f2feb7406aa38d31c856bf8e89 Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:35.254596 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cbbbac52-657b-4784-a778-a2f97d691637'} Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:35.255332 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:35.256379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:35.258830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Returning 404 to user: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:35.259923 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5a71ec0-8355-4252-a100-264bea26b4ce tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 404 len: 111 microversion: 2.1 time: 0.094213 Jul 28 11:25:35.260991 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 65/119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:35 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:35.267297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0694fec9-c2d0-4e50-b282-b211406169b9 req-e8f6f6dc-fa95-4cd0-bba9-e817e85a8c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "name": "network-vif-plugged", "status": "completed", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:35.280281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0694fec9-c2d0-4e50-b282-b211406169b9 req-e8f6f6dc-fa95-4cd0-bba9-e817e85a8c1f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:35.281598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0694fec9-c2d0-4e50-b282-b211406169b9 req-e8f6f6dc-fa95-4cd0-bba9-e817e85a8c1f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:35.294756 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0694fec9-c2d0-4e50-b282-b211406169b9 req-e8f6f6dc-fa95-4cd0-bba9-e817e85a8c1f service nova] Creating event network-vif-plugged:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h1-851368-1 Jul 28 11:25:35.300276 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0694fec9-c2d0-4e50-b282-b211406169b9 req-e8f6f6dc-fa95-4cd0-bba9-e817e85a8c1f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037642 Jul 28 11:25:35.301165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 66/120] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:35.306689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ca2ad2f-58ee-425b-b56e-a66570b7215b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:35.310188 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:35.310188 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:35.340080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca2ad2f-58ee-425b-b56e-a66570b7215b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:35.341509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca2ad2f-58ee-425b-b56e-a66570b7215b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:35.428418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-adcc150e-8e26-4f1d-900c-84b0e9247648 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.371317 Jul 28 11:25:35.429020 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 55/121] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:25:35 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:35.742927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:35.743520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fac2f8f7-1fff-47de-beb4-39438fe63146 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] Action: 'create', calling method: .version_select at 0x7f2eb82521f0>, body: {"security_group": {"name": "tempest-securitygroup-23798131", "description": "tempest-description-615376908"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:35.983775 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ca2ad2f-58ee-425b-b56e-a66570b7215b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.680886 Jul 28 11:25:35.984583 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 67/122] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:35.991481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:35.992387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:36.000922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.001569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.002973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.003779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.279444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:36.286920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81acae0e-39d8-420d-ae13-667cccc4ec07 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1469 microversion: 2.1 time: 0.301142 Jul 28 11:25:36.287520 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 68/123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:35 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:36.291935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eecd7edc-d0a2-4431-9a4e-305eeeb46b06 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:36.292775 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:36.292775 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:36.315234 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eecd7edc-d0a2-4431-9a4e-305eeeb46b06 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.026479 Jul 28 11:25:36.316395 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 69/124] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:36 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:36.321800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:36.322641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:36.332095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.332624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.333471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.333976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.555528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fac2f8f7-1fff-47de-beb4-39438fe63146 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.117997 Jul 28 11:25:36.556119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 56/125] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:25:35 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:36.657829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:36.666086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-651190fb-f807-4711-af44-6b182e31eb24 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.348490 Jul 28 11:25:36.673913 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 70/126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:36 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:36.673913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:36.673913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:36.681006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Calling method '.version_select at 0x7f2eb8252d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:36.681800 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:36.681800 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:36.682953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.683417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.684010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.684512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.685662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.686116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.699823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.700794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.711390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.711835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.718419 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e2a29d3-ec73-432a-90ee-c3a8d919f282 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.161115 Jul 28 11:25:36.719234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 57/127] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:36.834463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:36.835099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:36.841627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.842068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.842826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:36.843296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:36.903880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:36.906846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:25:36.913994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed06f13e-1251-4b2b-a80d-7a3934055720 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1390 microversion: 2.1 time: 0.245928 Jul 28 11:25:36.914925 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 71/128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:36 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1390 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:36.935247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c41acabe-ed0f-4233-b184-df2167be13c9 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-798933562"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:36.938579 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:36.938579 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:36.940069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-c41acabe-ed0f-4233-b184-df2167be13c9 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 65478736-3cd8-4478-a655-9c01aa51ab83 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:37.060651 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86911e8a-d6b3-46c2-992a-2efa9c5fe81b tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 204 len: 0 microversion: 2.1 time: 0.340019 Jul 28 11:25:37.061355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 58/129] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:25:36 2022] DELETE /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:25:37.069535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-07c1f078-dbb4-4449-8c81-74613199351d req-28cd828e-2e5f-41c1-a204-fa9ba88e0090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5591b2a9-3128-4b07-8a65-50f2690e9064", "tag": "2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:37.082643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-07c1f078-dbb4-4449-8c81-74613199351d req-28cd828e-2e5f-41c1-a204-fa9ba88e0090 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.083110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-07c1f078-dbb4-4449-8c81-74613199351d req-28cd828e-2e5f-41c1-a204-fa9ba88e0090 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.094554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-07c1f078-dbb4-4449-8c81-74613199351d req-28cd828e-2e5f-41c1-a204-fa9ba88e0090 service nova] Creating event network-changed:2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a for instance 5591b2a9-3128-4b07-8a65-50f2690e9064 on n-h2-851368-1 Jul 28 11:25:37.099828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-07c1f078-dbb4-4449-8c81-74613199351d req-28cd828e-2e5f-41c1-a204-fa9ba88e0090 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Jul 28 11:25:37.100420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 59/130] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.106079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e988cc9c-00a3-40cd-b4b6-47ca3c4c27c4 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] Action: 'create', calling method: .version_select at 0x7f2eb8268040>, body: {"security_group": {"name": "tempest-securitygroup-1855987924", "description": "tempest-description-2083004660"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:37.126737 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c41acabe-ed0f-4233-b184-df2167be13c9 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.210312 Jul 28 11:25:37.127680 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 72/131] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.240535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5076655a-ae00-4c8a-a676-0bf8a2da1006 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Calling method '.version_select at 0x7f2eb8126040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.241331 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.241331 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.242412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5076655a-ae00-4c8a-a676-0bf8a2da1006 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'bff003fa481d42bdb31e9cbbb236b784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62586e58179401fb8b464955fe63273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5076655a-ae00-4c8a-a676-0bf8a2da1006 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Request method failure captured: Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/n-h2-851368-1/search HTTP/1.1 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIumhcO9HjPnoe-R7TM1SbLPP--wbdnTgNi9xIE8maLv46CnPxrVHxdyMSeAThGHX5zspEWlqcugyBCL_OS1xhRZk_wxNlJHeMYuCyzodEfGQCUkJhl6hw3q8A06rj0R18fnwvqxgHq2TeZrgg6cKBxyn_7wBpTSxa7e9VAAaS9xUM Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: b62586e58179401fb8b464955fe63273 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:37.244592 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b62586e58179401fb8b464955fe63273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b62586e58179401fb8b464955fe63273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b62586e58179401fb8b464955fe63273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b62586e58179401fb8b464955fe63273"}]}] Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: b62586e58179401fb8b464955fe63273 Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-69694853-project Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: bff003fa481d42bdb31e9cbbb236b784 Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853-project Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 11:25:37.245927 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-h2-851368-1'} Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:37.251480 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 11:25:37.252475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.253559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5076655a-ae00-4c8a-a676-0bf8a2da1006 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:37.253559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5076655a-ae00-4c8a-a676-0bf8a2da1006 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-851368-1/search" status: 403 len: 117 microversion: 2.1 time: 0.117280 Jul 28 11:25:37.253559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 73/132] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-hypervisors/n-h2-851368-1/search => generated 117 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:37.253738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e988cc9c-00a3-40cd-b4b6-47ca3c4c27c4 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.151671 Jul 28 11:25:37.254257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 60/133] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:25:37 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.259278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.260024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:37.264673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d10be17-3c47-4490-bbe2-7966f0896ebb tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:37.268676 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.268676 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:37.272196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.272647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.273421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.273849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.277879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d10be17-3c47-4490-bbe2-7966f0896ebb tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.278557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d10be17-3c47-4490-bbe2-7966f0896ebb tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.286178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:37.289290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:37.398821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d10be17-3c47-4490-bbe2-7966f0896ebb tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.143502 Jul 28 11:25:37.405627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 61/134] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.405627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Calling method '.version_select at 0x7f2eb81b9820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.405627 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.405627 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:37.405627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.406100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.410534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:37.412724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Request method failure captured: Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIw-THp23arN1n4MxW22N5G7j-Nw-zmepPd2FAP6Te7oE3ik4hGe3guYher7s6v7fH5nJ1mJi_Gvwy8s8orVFXGXSNs-2VlrRZHaaSWNom33W6jw5CUpmAUtfWr0YqGtXzuH_pJdE-tGED_3VQyRthBStXjZejt_sCStQA8Z6uZS14 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5b0ec2d6a9264915b7cedea29ddd671e Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:37.414873 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b0ec2d6a9264915b7cedea29ddd671e"}]}] Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5b0ec2d6a9264915b7cedea29ddd671e Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cd81a23428e54b01ad0456f2b949c71b Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 11:25:37.416231 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.417005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd2e46da-5c0e-47bd-b985-339bec7cfdaf tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.015945 Jul 28 11:25:37.418082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 62/135] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:37.422572 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8eb4c6d8-82e8-4788-95df-13630a197786 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1475 microversion: 2.1 time: 0.174454 Jul 28 11:25:37.423279 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 74/136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:37.428467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:37.431498 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.431498 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.444621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.445101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.475089 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-851368-1. Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 39 Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:25:37.513134 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: {"add_host": {"host": "n-h2-851368-1"}} Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:37.514767 n-d-851368-1 devstack@n-api.service[119236]: exception: Aggregate 2 already has host n-h2-851368-1. Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-851368-1'}}} Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:25:37.515712 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851368-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 11:25:37.516981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 11:25:37.518047 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:25:37.519306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851368-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 11, 25, 37, 463814), 'updated_at': None, 'host': 'n-h2-851368-1', 'aggregate_id': 2}] Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.520302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6595, in add_host_to_aggregate Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-851368-1. Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.521394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-851368-1. Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:37.522710 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-851368-1. Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-851368-1. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f78fc04-88a6-4d56-9624-39737b5a3028 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.090446 Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 75/137] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Calling method '.version_select at 0x7f2eb35ee820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.525074 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.525636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.525636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.538246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.538698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.549801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.550247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.556528 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b43608b1-1f8f-437d-9aad-40bd9a0007d7 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039819 Jul 28 11:25:37.557120 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 76/138] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.562179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6bfea84-c6fa-4b06-9f47-e10da39ec4fc tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:37.563369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfe5bbad-6e9e-4703-8698-4e674a4b6acd tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] Calling method '.version_select at 0x7f2eb81b9dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.564693 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.564693 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.572656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6bfea84-c6fa-4b06-9f47-e10da39ec4fc tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.573211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6bfea84-c6fa-4b06-9f47-e10da39ec4fc tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.683006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6bfea84-c6fa-4b06-9f47-e10da39ec4fc tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.124787 Jul 28 11:25:37.683988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 77/139] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:37.689302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfc7d7c5-2111-4c97-9602-55c220a01541 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Calling method '.version_select at 0x7f2eb35833a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.690084 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.690084 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.691185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfc7d7c5-2111-4c97-9602-55c220a01541 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'bff003fa481d42bdb31e9cbbb236b784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62586e58179401fb8b464955fe63273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfc7d7c5-2111-4c97-9602-55c220a01541 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Request method failure captured: Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIumhcO9HjPnoe-R7TM1SbLPP--wbdnTgNi9xIE8maLv46CnPxrVHxdyMSeAThGHX5zspEWlqcugyBCL_OS1xhRZk_wxNlJHeMYuCyzodEfGQCUkJhl6hw3q8A06rj0R18fnwvqxgHq2TeZrgg6cKBxyn_7wBpTSxa7e9VAAaS9xUM Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: b62586e58179401fb8b464955fe63273 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:37.692745 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b62586e58179401fb8b464955fe63273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b62586e58179401fb8b464955fe63273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b62586e58179401fb8b464955fe63273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b62586e58179401fb8b464955fe63273"}]}] Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: b62586e58179401fb8b464955fe63273 Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853 Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-69694853-project Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: bff003fa481d42bdb31e9cbbb236b784 Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-69694853-project Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1'} Jul 28 11:25:37.694143 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:37.695633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 11:25:37.696858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.697949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfc7d7c5-2111-4c97-9602-55c220a01541 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:37.697949 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfc7d7c5-2111-4c97-9602-55c220a01541 tempest-HypervisorAdminNegativeUnderV252Test-69694853 tempest-HypervisorAdminNegativeUnderV252Test-69694853-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008560 Jul 28 11:25:37.697949 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 78/140] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:37.699624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.700278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:37.706431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.706875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.707676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.708111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.907707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:37.915431 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e031e9f2-844a-466a-bda1-6fccdedc5166 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1312 microversion: 2.1 time: 0.219611 Jul 28 11:25:37.916101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 79/141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:37.920740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f1301d1-f6f2-450b-9662-7dec2218d9d2 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.921949 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.921949 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.960391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f1301d1-f6f2-450b-9662-7dec2218d9d2 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.043049 Jul 28 11:25:37.961457 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 80/142] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:37 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:37.967322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Calling method '.version_select at 0x7f2eb8140700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.968522 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:37.968522 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:37.969925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:37.972378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:37.978508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] HTTP exception thrown: No hypervisor matching '7916c448-830f-4502-a3c5-de8ff2256add' could be found. Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Request method failure captured: Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/7916c448-830f-4502-a3c5-de8ff2256add/servers HTTP/1.1 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIw-THp23arN1n4MxW22N5G7j-Nw-zmepPd2FAP6Te7oE3ik4hGe3guYher7s6v7fH5nJ1mJi_Gvwy8s8orVFXGXSNs-2VlrRZHaaSWNom33W6jw5CUpmAUtfWr0YqGtXzuH_pJdE-tGED_3VQyRthBStXjZejt_sCStQA8Z6uZS14 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5b0ec2d6a9264915b7cedea29ddd671e Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:25:37.979967 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5b0ec2d6a9264915b7cedea29ddd671e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b0ec2d6a9264915b7cedea29ddd671e"}]}] Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5b0ec2d6a9264915b7cedea29ddd671e Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171 Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: cd81a23428e54b01ad0456f2b949c71b Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: exception: No hypervisor matching '7916c448-830f-4502-a3c5-de8ff2256add' could be found. Jul 28 11:25:37.981512 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7916c448-830f-4502-a3c5-de8ff2256add'} Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7916c448-830f-4502-a3c5-de8ff2256add' could be found. Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.982268 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7916c448-830f-4502-a3c5-de8ff2256add' could be found. Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] Returning 404 to user: No hypervisor matching '7916c448-830f-4502-a3c5-de8ff2256add' could be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3fedc34-5dca-465c-bf50-17c4a38b59d4 tempest-HypervisorAdminNegativeUnderV252Test-458015171 tempest-HypervisorAdminNegativeUnderV252Test-458015171-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/7916c448-830f-4502-a3c5-de8ff2256add/servers" status: 404 len: 123 microversion: 2.1 time: 0.018599 Jul 28 11:25:37.983318 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 81/143] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-hypervisors/7916c448-830f-4502-a3c5-de8ff2256add/servers => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:37.990618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:37.991305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:38.003340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:38.003790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:38.004569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:38.005006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:38.275707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:38.283804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfa49b96-42ea-4474-8f83-1ffcf3717bb3 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1390 microversion: 2.1 time: 0.300384 Jul 28 11:25:38.284575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 82/144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1390 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:38.298423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08b8dd48-fa15-4243-8340-6fafe1da83da tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-313130203"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:38.302754 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:38.302754 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:38.304140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-08b8dd48-fa15-4243-8340-6fafe1da83da tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 503cfd23-b00c-45d3-900d-ce7ea2f41f41 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:38.327647 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08b8dd48-fa15-4243-8340-6fafe1da83da tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041791 Jul 28 11:25:38.335139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 83/145] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:38.339840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e8bdec9-282d-4a54-b335-817be8eaf98d tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-827160180"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:38.342343 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:38.342343 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:38.343274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-9e8bdec9-282d-4a54-b335-817be8eaf98d tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Generated uuid 8a0cc63b-227c-4279-9e6b-420258dadcd6 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:38.366520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e8bdec9-282d-4a54-b335-817be8eaf98d tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.030267 Jul 28 11:25:38.378835 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 84/146] 10.222.0.93 () {62 vars in 1205 bytes} [Thu Jul 28 11:25:38 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:38.643480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ae62b0a-45f2-416f-afd3-e8db511212e9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:38.646340 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:38.646340 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:38.647927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ae62b0a-45f2-416f-afd3-e8db511212e9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ae62b0a-45f2-416f-afd3-e8db511212e9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 39 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:38.650496 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: {"add_host": {"host": "n-h2-851368-1"}} Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:38.651718 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-851368-1'}}} Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:38.652909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 11:25:38.656958 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:38.659505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ae62b0a-45f2-416f-afd3-e8db511212e9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:38.659505 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ae62b0a-45f2-416f-afd3-e8db511212e9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.271731 Jul 28 11:25:38.659505 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 85/147] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:38.663161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7d2360d-61af-4b23-94b0-8e3aa1ea6bf3 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1956039349"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:38.748354 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:38.748354 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:38.763822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:38.786642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7d2360d-61af-4b23-94b0-8e3aa1ea6bf3 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/4" status: 200 len: 299 microversion: 2.41 time: 0.128179 Jul 28 11:25:38.787849 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 86/148] 10.222.0.93 () {62 vars in 1210 bytes} [Thu Jul 28 11:25:38 2022] PUT /compute/v2.1/os-aggregates/4 => generated 299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:38.801867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:38.802710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:38.810672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:38.811331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:38.812435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:38.812940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.024200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:39.032932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-52fe7f75-0bcd-4f37-b294-26620349aa00 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 200 len: 1475 microversion: 2.1 time: 0.243731 Jul 28 11:25:39.048390 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 87/149] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:38 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:39.053189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1af5090-a363-4b3d-a6ca-3249241e8b6a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:39.053960 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:39.053960 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:39.089172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1af5090-a363-4b3d-a6ca-3249241e8b6a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039428 Jul 28 11:25:39.089945 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 88/150] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:39 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:39.099214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eb679613-6c71-441d-9e3f-cfd78cff637b tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:39.099985 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:39.099985 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:39.110105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eb679613-6c71-441d-9e3f-cfd78cff637b tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/4" status: 200 len: 299 microversion: 2.41 time: 0.019264 Jul 28 11:25:39.110851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 89/151] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 28 11:25:39 2022] GET /compute/v2.1/os-aggregates/4 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:39.122452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:39.123352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:39.130270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.130726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.131553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.131987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.376795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:39.384789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a38fa8a4-0a31-48d1-8990-548f4f0caa54 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1462 microversion: 2.1 time: 0.272563 Jul 28 11:25:39.395285 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 90/152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:39 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1462 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:39.395285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db535e67-6a06-46ce-b14a-07e772f763c4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1353651782"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:39.395285 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:39.395285 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:39.395285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-db535e67-6a06-46ce-b14a-07e772f763c4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 2238c177-a105-410e-a401-ffcd415ab933 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:39.439400 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db535e67-6a06-46ce-b14a-07e772f763c4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037719 Jul 28 11:25:39.442576 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 91/153] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:39.451771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36d9a637-e9d7-4b50-9867-2238393c537e tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:39.461956 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:39.461956 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:39.474995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36d9a637-e9d7-4b50-9867-2238393c537e tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.476468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36d9a637-e9d7-4b50-9867-2238393c537e tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.621869 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36d9a637-e9d7-4b50-9867-2238393c537e tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 314 microversion: 2.41 time: 0.177216 Jul 28 11:25:39.623190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 92/154] 10.222.0.93 () {62 vars in 1232 bytes} [Thu Jul 28 11:25:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:39.628319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:39.629364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:39.637981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.638710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.639994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.640597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.737539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:39.873731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:39.882021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a472c5f3-c105-4639-99e8-9b3bb6c8c17f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1390 microversion: 2.1 time: 0.257605 Jul 28 11:25:39.882922 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 93/155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:39 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1390 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:39.931044 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfe5bbad-6e9e-4703-8698-4e674a4b6acd tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8994 microversion: 2.1 time: 2.371389 Jul 28 11:25:39.931707 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 63/156] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Jul 28 11:25:37 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8994 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:39.937092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2033379163"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:39.939387 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:39.939387 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:39.977490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.978158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:39.990255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:39.990633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.003954 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2033379163 could not be found. Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 58 Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:40.011633 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: {"add_host": {"host": "tempest-nonexist_host-2033379163"}} Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:40.013364 n-d-851368-1 devstack@n-api.service[119235]: exception: Compute host tempest-nonexist_host-2033379163 could not be found. Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-2033379163'}}} Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5950, in _get_service_in_cell_by_host Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2033379163' is not mapped to any cell Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.014061 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5956, in _get_service_in_cell_by_host Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6575, in add_host_to_aggregate Jul 28 11:25:40.015043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5958, in _get_service_in_cell_by_host Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2033379163 could not be found. Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2033379163 could not be found. Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.016561 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2033379163 could not be found. Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2033379163 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:40.018924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27c3e3ad-39e0-4027-8af4-9f8ec69d79a5 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.084776 Jul 28 11:25:40.022335 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 64/157] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:39 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:40.031642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0e2243da-7e3e-41ef-8b9e-7279ae517246 req-722be5d9-95f7-4257-b257-d38ea096941d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69cd6b85-26e6-4f56-acf8-33c7fa925475", "name": "network-vif-deleted", "tag": "d5449359-8b81-4699-afb9-b51e335fbd44"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.044590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0e2243da-7e3e-41ef-8b9e-7279ae517246 req-722be5d9-95f7-4257-b257-d38ea096941d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.045193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0e2243da-7e3e-41ef-8b9e-7279ae517246 req-722be5d9-95f7-4257-b257-d38ea096941d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.057400 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0e2243da-7e3e-41ef-8b9e-7279ae517246 req-722be5d9-95f7-4257-b257-d38ea096941d service nova] Creating event network-vif-deleted:d5449359-8b81-4699-afb9-b51e335fbd44 for instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 on n-h1-851368-1 Jul 28 11:25:40.064258 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0e2243da-7e3e-41ef-8b9e-7279ae517246 req-722be5d9-95f7-4257-b257-d38ea096941d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Jul 28 11:25:40.065483 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 65/158] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:40.071480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-429227d8-83fd-47b2-9f31-e3da05ff8a72 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.074441 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:40.074441 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:40.092628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-429227d8-83fd-47b2-9f31-e3da05ff8a72 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.093193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-429227d8-83fd-47b2-9f31-e3da05ff8a72 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.217291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.221784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:40.239022 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-429227d8-83fd-47b2-9f31-e3da05ff8a72 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 299 microversion: 2.41 time: 0.172026 Jul 28 11:25:40.241139 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 66/159] 10.222.0.93 () {62 vars in 1232 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/os-aggregates/4/action => generated 299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:25:40.247739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ebfcc9d-84a8-41fd-a5fa-8c8c2591287e tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] Calling method '.version_select at 0x7f2eb37ea160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.249036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.249504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.250333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.250775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.310324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:40.615842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ebfcc9d-84a8-41fd-a5fa-8c8c2591287e tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.373657 Jul 28 11:25:40.617293 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 67/160] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Jul 28 11:25:40 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:40.624225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8591a62d-37b7-4bcb-afca-6324997ff1bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.624992 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:40.624992 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:40.640914 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-372cf912-2b79-495a-9342-94d60cdd056e tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1613 microversion: 2.1 time: 0.756591 Jul 28 11:25:40.641839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 94/161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:39 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1613 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:40.646803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.650942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:40.651987 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8591a62d-37b7-4bcb-afca-6324997ff1bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.033040 Jul 28 11:25:40.653004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 68/162] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:40 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:40.662010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.662253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56062f49-7ceb-44b7-b141-be1862e90356 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.662846 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:40.662846 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:40.663050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.663907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.664412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.679689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 HTTP/1.1 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:40.681671 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:25:40.682841 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '69cd6b85-26e6-4f56-acf8-33c7fa925475'} Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:40.683527 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:25:40.685141 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.687194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:40.688210 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7cd694f-516e-4014-b19a-95ad10685964 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 404 len: 111 microversion: 2.1 time: 0.045428 Jul 28 11:25:40.689210 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56062f49-7ceb-44b7-b141-be1862e90356 tempest-AggregatesAdminTestV241-558183505 tempest-AggregatesAdminTestV241-558183505-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.41 time: 0.034854 Jul 28 11:25:40.689395 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 95/163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:40 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:40.689836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 69/164] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:25:40 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:40.699192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-293a98ce-6236-4ce1-9537-d8d102246bd8 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] Calling method '.version_select at 0x7f2eb8140280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:40.704214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd3d1066-5125-4191-98d1-c70deb4d8024 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd3d1066-5125-4191-98d1-c70deb4d8024 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 283 Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:40.714901 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:25:40.716243 n-d-851368-1 devstack@n-api.service[119235]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:25:40.716837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:25:40.717432 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:25:40.718431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:25:40.719157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:25:40.719157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.719157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd3d1066-5125-4191-98d1-c70deb4d8024 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:40.719157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd3d1066-5125-4191-98d1-c70deb4d8024 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.025724 Jul 28 11:25:40.721527 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 70/165] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:25:40.726134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.726824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:40.734295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.734744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.735546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:40.736157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:40.852024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a9dff9b8c214fe88a7fdbf14fc954cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38e0f11dd884d94b75382e2f88ff6a6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:40.852662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] flavor_id is None. Assuming migration. {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4145}} Jul 28 11:25:40.854984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 11:25:40.924033 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-293a98ce-6236-4ce1-9537-d8d102246bd8 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/37ebbb26-14e8-4f57-8c9e-0bfaea56073e" status: 202 len: 0 microversion: 2.1 time: 0.233089 Jul 28 11:25:40.924608 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 96/166] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:25:40 2022] DELETE /compute/v2.1/os-security-groups/37ebbb26-14e8-4f57-8c9e-0bfaea56073e => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:25:40.933046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8544e841-8fb6-4b6d-85b6-8acae7393fd4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8544e841-8fb6-4b6d-85b6-8acae7393fd4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 27 Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:25:40.941749 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: {"aggregate": {"name": ""}} Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:40.942907 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '' Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:40.943689 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:25:40.944874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:40.945997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8544e841-8fb6-4b6d-85b6-8acae7393fd4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:40.945997 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8544e841-8fb6-4b6d-85b6-8acae7393fd4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014519 Jul 28 11:25:40.948770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 97/167] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:25:40.967702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c90fd31-5aea-4906-8066-827d6813d1cb tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1803402087"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:40.970240 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:40.970240 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:40.971454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-6c90fd31-5aea-4906-8066-827d6813d1cb tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid 6f1d03ba-36e5-41fb-b8ce-8f344984fccb for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:40.999421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c90fd31-5aea-4906-8066-827d6813d1cb tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049484 Jul 28 11:25:41.000304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 98/168] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:41.005002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1369937144", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:41.074260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:25:41.395915 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb08248e-daab-402e-b574-77b4f572c0d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f/action" status: 202 len: 0 microversion: 2.1 time: 0.670978 Jul 28 11:25:41.400219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 71/169] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:25:40 2022] POST /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:25:41.403988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:41.404791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:41.412476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.412935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.413727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.414722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.428392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:25:41.428929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:25:41.429643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:25:41.430072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:25:41.430486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:25:41.447029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.448821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.450249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.450688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.480357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Getting quotas for project 175fd7cb8b284562bf2f7d9ff09e06ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:25:41.485127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Getting quotas for user d1bf5f1e1d2948b88e16555f16e34b85 and project 175fd7cb8b284562bf2f7d9ff09e06ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:25:41.509504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:25:41.513570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:25:41.592275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a14b0dd-d00f-4eb9-b8ea-497f8b8b99d8 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590837 Jul 28 11:25:41.592917 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 99/170] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:25:41.604648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f42e645e-e1af-48a0-83de-eb94b438d174 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] Calling method '.version_select at 0x7f2eb35831f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:41.665404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:41.673246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab94536f-6c5d-4aeb-83d8-55e504a15019 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1390 microversion: 2.1 time: 0.274595 Jul 28 11:25:41.688767 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 72/171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:41 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:41.693986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-081cf32b-d28f-4244-8af1-8bfcc093e378 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1381130144"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:41.700579 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:41.700579 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:41.701999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-081cf32b-d28f-4244-8af1-8bfcc093e378 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-081cf32b-d28f-4244-8af1-8bfcc093e378 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 60 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:25:41.705361 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: {"aggregate": {"name": "tempest-test_aggregate-1381130144"}} Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:41.706427 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1381130144'}}} Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:41.707137 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:41.708135 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 11:25:41.709175 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:41.709175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-081cf32b-d28f-4244-8af1-8bfcc093e378 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:41.709175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-081cf32b-d28f-4244-8af1-8bfcc093e378 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016910 Jul 28 11:25:41.709175 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 73/172] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:41 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:41.715228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e29fa454-9135-4fea-b226-7836daafd8d8 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:41.718149 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:41.718149 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:41.731409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e29fa454-9135-4fea-b226-7836daafd8d8 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.731553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e29fa454-9135-4fea-b226-7836daafd8d8 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.842927 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f42e645e-e1af-48a0-83de-eb94b438d174 tempest-SecurityGroupsTestAdminJSON-1647700698 tempest-SecurityGroupsTestAdminJSON-1647700698-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/c97af40f-7ecf-452c-899b-8f0f58b3f46d" status: 202 len: 0 microversion: 2.1 time: 0.248627 Jul 28 11:25:41.844078 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 100/173] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:25:41 2022] DELETE /compute/v2.1/os-security-groups/c97af40f-7ecf-452c-899b-8f0f58b3f46d => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:25:41.850790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:41.851814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:41.862401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.863290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.865537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:41.866781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:41.901068 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e29fa454-9135-4fea-b226-7836daafd8d8 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.192237 Jul 28 11:25:41.902200 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 74/174] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:41 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:41.907269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-769e86c4-7a38-41db-beef-07c076bb5de9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:41.907970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-769e86c4-7a38-41db-beef-07c076bb5de9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:41.989341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-769e86c4-7a38-41db-beef-07c076bb5de9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:42.006752 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-769e86c4-7a38-41db-beef-07c076bb5de9 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1220 microversion: 2.1 time: 0.103406 Jul 28 11:25:42.007386 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 75/175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:41 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:42.020411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c5471f7-1fbd-4ea3-a9ac-130dc2c8ea06 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-704932844"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:42.029954 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.029954 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:42.031354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-8c5471f7-1fbd-4ea3-a9ac-130dc2c8ea06 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid e7fb79a8-6b42-45ba-8bad-f9e512d0e113 for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:42.080176 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c5471f7-1fbd-4ea3-a9ac-130dc2c8ea06 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071149 Jul 28 11:25:42.091843 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 76/176] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:42.105457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4543e67-2c6e-4c5b-bf6b-355ad8cb08c4 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] Calling method '.version_select at 0x7f2eb37ea310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:42.218189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:42.227131 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4e4a692-2524-4805-9ebd-9c275cf4ab84 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1471 microversion: 2.1 time: 0.381714 Jul 28 11:25:42.230822 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 101/177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:41 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:42.237841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c27863bb-7e09-4f1f-958b-bb5ab1494900 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:42.238891 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.238891 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:42.259762 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c27863bb-7e09-4f1f-958b-bb5ab1494900 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 242 microversion: 2.1 time: 0.027101 Jul 28 11:25:42.261157 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 102/178] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:25:42 2022] GET /compute/v2.1/os-aggregates/6 => generated 242 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:42.267799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-704932844"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:42.270895 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.270895 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:42.272823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 09c37a67-4a9f-4b40-b00f-1067c0205395 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:42.303195 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-704932844 already exists. Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 59 Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:25:42.320831 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: {"aggregate": {"name": "tempest-test_aggregate-704932844"}} Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:42.322042 n-d-851368-1 devstack@n-api.service[119236]: exception: Aggregate tempest-test_aggregate-704932844 already exists. Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-704932844'}}} Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6412, in create_aggregate Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 28 11:25:42.322825 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-704932844 already exists. Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:42.323885 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-704932844 already exists. Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-704932844 already exists. Jul 28 11:25:42.325585 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:42.328512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-704932844 already exists. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:42.331811 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae2927b4-d108-4d43-a6b7-312298dd586a tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.068193 Jul 28 11:25:42.334967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 103/179] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:42 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:42.361293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e6a5f9b-e79b-4c90-811f-cc09426de9ab tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:42.365096 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.365096 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:42.393914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6a5f9b-e79b-4c90-811f-cc09426de9ab tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:42.396581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6a5f9b-e79b-4c90-811f-cc09426de9ab tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:42.422589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4543e67-2c6e-4c5b-bf6b-355ad8cb08c4 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/e8819fda-f31d-4edb-9c9e-ce22579352bd" status: 202 len: 0 microversion: 2.1 time: 0.325666 Jul 28 11:25:42.423541 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 77/180] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:25:42 2022] DELETE /compute/v2.1/os-security-groups/e8819fda-f31d-4edb-9c9e-ce22579352bd => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:25:42.431126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9e25050f-de5f-4d67-9548-f1030d63ff89 req-1a1f1f36-a88d-43c6-aa40-585d41a210a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5591b2a9-3128-4b07-8a65-50f2690e9064", "name": "network-vif-plugged", "status": "completed", "tag": "2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:42.479021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e25050f-de5f-4d67-9548-f1030d63ff89 req-1a1f1f36-a88d-43c6-aa40-585d41a210a5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:42.479643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e25050f-de5f-4d67-9548-f1030d63ff89 req-1a1f1f36-a88d-43c6-aa40-585d41a210a5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:42.510823 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e25050f-de5f-4d67-9548-f1030d63ff89 req-1a1f1f36-a88d-43c6-aa40-585d41a210a5 service nova] Creating event network-vif-plugged:2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a for instance 5591b2a9-3128-4b07-8a65-50f2690e9064 on n-h2-851368-1 Jul 28 11:25:42.519103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9e25050f-de5f-4d67-9548-f1030d63ff89 req-1a1f1f36-a88d-43c6-aa40-585d41a210a5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093780 Jul 28 11:25:42.533098 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 78/181] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:42.541692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d24741c2-138f-4abc-b857-8fae296afb06 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:42.542705 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.542705 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:42.603695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d24741c2-138f-4abc-b857-8fae296afb06 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.068232 Jul 28 11:25:42.611176 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 79/182] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:42.620206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31e58e43-a0b4-44c0-ba7a-af3e87e43640 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] Calling method '.version_select at 0x7f2eb374faf0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:42.728630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e6a5f9b-e79b-4c90-811f-cc09426de9ab tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.392214 Jul 28 11:25:42.729494 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 104/183] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:42 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:42.770456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a00340e-f127-412e-a3de-1aed26892366 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-261158686"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:42.773205 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:42.773205 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:42.774141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-2a00340e-f127-412e-a3de-1aed26892366 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 395983fc-4ae0-468a-9e04-a2dc2537a584 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:42.834416 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a00340e-f127-412e-a3de-1aed26892366 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.101568 Jul 28 11:25:42.839847 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 105/184] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:42.856704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:42.864282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:42.875989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:42.876774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:42.877742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:42.878357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.112898 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31e58e43-a0b4-44c0-ba7a-af3e87e43640 tempest-SecurityGroupsTestAdminJSON-812069263 tempest-SecurityGroupsTestAdminJSON-812069263-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/46800816-0e1a-4d13-ac9f-744f0439ac5f" status: 202 len: 0 microversion: 2.1 time: 0.503745 Jul 28 11:25:43.114130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 80/185] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:25:42 2022] DELETE /compute/v2.1/os-security-groups/46800816-0e1a-4d13-ac9f-744f0439ac5f => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:25:43.123219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-acdf1efe-e44b-408d-8a47-bee6b26a46e7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.124437 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.124437 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.178196 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-acdf1efe-e44b-408d-8a47-bee6b26a46e7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.062600 Jul 28 11:25:43.183006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 81/186] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:43 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:43.199582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-883146c8-94cb-4a2c-adf1-49461d8d9428 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.207387 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.207387 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.209561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-883146c8-94cb-4a2c-adf1-49461d8d9428 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-883146c8-94cb-4a2c-adf1-49461d8d9428 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:25:43.213912 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 11:25:43.215394 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '8'} Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:43.216064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 11:25:43.217116 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.218148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-883146c8-94cb-4a2c-adf1-49461d8d9428 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:43.220815 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-883146c8-94cb-4a2c-adf1-49461d8d9428 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/8" status: 403 len: 116 microversion: 2.1 time: 0.033577 Jul 28 11:25:43.221581 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 82/187] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:43 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:43.234362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.238625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:43.245588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:43.255953 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b7c62b1-c58e-440f-bdb8-c3950bd88b47 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1390 microversion: 2.1 time: 0.413727 Jul 28 11:25:43.259881 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 106/188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:42 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1390 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:43.273995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:43.278345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.279960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2904b723-76be-441c-88cd-1913dd2e7106 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-910127449"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:43.280087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:43.280560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.305948 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.305948 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:43.312392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-2904b723-76be-441c-88cd-1913dd2e7106 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid dba6d7d9-8557-47ff-a7bf-1e1857bf9b00 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:43.392227 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2904b723-76be-441c-88cd-1913dd2e7106 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.124179 Jul 28 11:25:43.394782 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 107/189] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:43.404495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63d776b5-3014-4db9-90c3-a9e05984b1c6 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.407713 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.407713 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:43.459573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63d776b5-3014-4db9-90c3-a9e05984b1c6 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061507 Jul 28 11:25:43.461161 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 108/190] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:43 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:43.471661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:43.481476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.483923 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecba090a-f51a-48b8-b716-c18c52e0bbcb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1272 microversion: 2.1 time: 0.258183 Jul 28 11:25:43.487464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:43.501574 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 83/191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:43 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:43.503086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:43.503724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.504710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:43.505318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.512732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfdd4104-22f1-4ed8-b265-ced87269d3d7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:43.521851 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.521851 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.535695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfdd4104-22f1-4ed8-b265-ced87269d3d7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:43.538505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfdd4104-22f1-4ed8-b265-ced87269d3d7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:43.787943 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfdd4104-22f1-4ed8-b265-ced87269d3d7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.285163 Jul 28 11:25:43.789500 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 84/192] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:43 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:43.801446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db5af7d3-4e8f-4280-bbea-6c4e785daa67 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.803285 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.803285 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.821614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-db5af7d3-4e8f-4280-bbea-6c4e785daa67 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db5af7d3-4e8f-4280-bbea-6c4e785daa67 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:43.826148 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: exception: Aggregate -1 could not be found. Jul 28 11:25:43.827379 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '-1'} Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:43.828181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.829429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db5af7d3-4e8f-4280-bbea-6c4e785daa67 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db5af7d3-4e8f-4280-bbea-6c4e785daa67 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031973 Jul 28 11:25:43.830564 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 85/193] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:43 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:43.836829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-506720fd-15bf-4dca-8c78-1283a4f7d772 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:43.838527 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.838527 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.848556 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-506720fd-15bf-4dca-8c78-1283a4f7d772 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.016732 Jul 28 11:25:43.849451 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 86/194] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:25:43 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:43.876264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b07b8dce-787a-438b-b0fe-5212eb4c16d4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1773374344"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:43.884270 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:43.884270 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:43.885346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-b07b8dce-787a-438b-b0fe-5212eb4c16d4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid 42d12b8f-11ea-4cc4-b918-e58f168e9d05 for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:43.970065 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b07b8dce-787a-438b-b0fe-5212eb4c16d4 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.119184 Jul 28 11:25:43.977006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 87/195] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:43.997874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a75f3b68-2fba-4c3e-96ef-5ba226256352 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:44.005761 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.005761 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.034507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75f3b68-2fba-4c3e-96ef-5ba226256352 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.036099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75f3b68-2fba-4c3e-96ef-5ba226256352 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.206864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:44.225298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46590a31-f61d-4ca6-ab25-9249ee4424dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1471 microversion: 2.1 time: 0.761534 Jul 28 11:25:44.226348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 109/196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:43 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1471 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:44.231765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9900ac4c-b924-4408-a20d-647789d9d8b0 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.236039 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.236039 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:44.237227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9900ac4c-b924-4408-a20d-647789d9d8b0 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9900ac4c-b924-4408-a20d-647789d9d8b0 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:44.238926 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 11:25:44.240290 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '10'} Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:44.241022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 11:25:44.242199 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.244122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9900ac4c-b924-4408-a20d-647789d9d8b0 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:44.245274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9900ac4c-b924-4408-a20d-647789d9d8b0 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.017561 Jul 28 11:25:44.246114 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 110/197] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:44.254649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23c1158a-f419-4431-82a8-c73c90df8f3c tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.256213 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.256213 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:44.290802 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-23c1158a-f419-4431-82a8-c73c90df8f3c tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040265 Jul 28 11:25:44.292000 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 111/198] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:44 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:44.301763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.302297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:44.302815 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a75f3b68-2fba-4c3e-96ef-5ba226256352 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.318919 Jul 28 11:25:44.309616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 88/199] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Jul 28 11:25:43 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:44.319015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.319368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b02568c1-c88a-4b2b-bf8e-9c5316ded0ed tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.319508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.320130 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.320130 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.320306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.320662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.329926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b02568c1-c88a-4b2b-bf8e-9c5316ded0ed tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b02568c1-c88a-4b2b-bf8e-9c5316ded0ed tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:44.331528 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: exception: Aggregate -1 could not be found. Jul 28 11:25:44.332764 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '-1'} Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.333455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 11:25:44.334626 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b02568c1-c88a-4b2b-bf8e-9c5316ded0ed tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b02568c1-c88a-4b2b-bf8e-9c5316ded0ed tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021832 Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 89/200] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e94011c-b6e5-4a86-a9bb-c732bead910b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.339670 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.377725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e94011c-b6e5-4a86-a9bb-c732bead910b tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.043279 Jul 28 11:25:44.378419 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 90/201] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:44 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:44.383685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8effc0a-3f6c-41b9-9b64-62eb58583efe tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.384926 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.384926 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.386211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8effc0a-3f6c-41b9-9b64-62eb58583efe tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8effc0a-3f6c-41b9-9b64-62eb58583efe tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:25:44.389036 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 11:25:44.390425 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:44.391227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 11:25:44.392381 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:44.394785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8effc0a-3f6c-41b9-9b64-62eb58583efe tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:44.395867 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8effc0a-3f6c-41b9-9b64-62eb58583efe tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016042 Jul 28 11:25:44.396951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 91/202] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:44.407182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-156b615a-d274-4c4d-8c6b-ae6e9f78fe65 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-145272761"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:44.411660 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.411660 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.412702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-156b615a-d274-4c4d-8c6b-ae6e9f78fe65 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid ec2d8309-0106-4b87-b526-a9d6de0e4164 for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:44.444888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-156b615a-d274-4c4d-8c6b-ae6e9f78fe65 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046200 Jul 28 11:25:44.445971 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 92/203] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:44.466961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-adf239fd-2a20-4373-a718-d16c636f0236 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:44.480611 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.480611 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:44.494493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adf239fd-2a20-4373-a718-d16c636f0236 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.495142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adf239fd-2a20-4373-a718-d16c636f0236 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.503254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:44.651560 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-adf239fd-2a20-4373-a718-d16c636f0236 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.194147 Jul 28 11:25:44.652540 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 93/204] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:44.657981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.658885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:44.665469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:44.680417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.680887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.682450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.682986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.687061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41c097ea-55d8-4341-8add-038aec180daf tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1589 microversion: 2.1 time: 0.393566 Jul 28 11:25:44.690621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:44.690771 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 112/205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1589 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:44.696118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab34d444-d959-439a-b7d2-76b51fc18899 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:44.711815 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:44.711815 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:44.736325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab34d444-d959-439a-b7d2-76b51fc18899 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.737858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab34d444-d959-439a-b7d2-76b51fc18899 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.780016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=7,nova_api:INSERT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:44.867374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:44.877535 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1fccbbf2-81f5-4c3a-b619-99447ac2f132 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1278 microversion: 2.1 time: 0.223228 Jul 28 11:25:44.892592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 94/206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:44.906486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:44.907506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:44.921480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.921828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.928356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:44.932011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:44.981588 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab34d444-d959-439a-b7d2-76b51fc18899 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.290819 Jul 28 11:25:44.994601 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 113/207] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.013138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31074000-e684-4474-9d23-d254f1330660 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.014322 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.014322 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.050030 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31074000-e684-4474-9d23-d254f1330660 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.051138 Jul 28 11:25:45.051141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 114/208] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:44 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:45.065399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86765eb3-9d84-45b6-a7b6-af2959ebedf4 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-244395227"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:45.070681 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.070681 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.071833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-86765eb3-9d84-45b6-a7b6-af2959ebedf4 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid 485a194d-2de7-4637-87c6-1f7135b8157a for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:45.107330 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86765eb3-9d84-45b6-a7b6-af2959ebedf4 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048005 Jul 28 11:25:45.108781 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 115/209] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.134387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-597de7b3-a69a-4050-934a-f75b42323c32 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.135591 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.135591 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.167153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-597de7b3-a69a-4050-934a-f75b42323c32 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.047797 Jul 28 11:25:45.168034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 116/210] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 11:25:45.172514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f641e36-aaea-4859-86ce-6e28bca2cfe1 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278676 Jul 28 11:25:45.173124 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 95/211] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:25:44 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.175014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c1829627-1f1f-4f08-b388-44a9a0009901 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1866782689"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:45.177922 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.177922 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.182114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-c1829627-1f1f-4f08-b388-44a9a0009901 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid a442735d-3101-45ba-9f71-76c8ca30eb83 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:45.184446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3578a57f-6caf-4d57-9171-528b957e246f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.185977 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.185977 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:45.210566 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-3578a57f-6caf-4d57-9171-528b957e246f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 28 11:25:45.226377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c1829627-1f1f-4f08-b388-44a9a0009901 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049908 Jul 28 11:25:45.227042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 117/212] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3578a57f-6caf-4d57-9171-528b957e246f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Request method failure captured: Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIAiubHWTYX-_KkP5Lxtl_OcSEfABDJnkbAenSVzEAq1lxC9TakYcgSe0RPnnM0QGZ-Atqjs3Txt7FJuzDfyolu6Fdi4-pVjBqO3eCEbzoVOVb9ZdyJhiIIKibyq5IufOSFmhpNIee0XSNUvDg203ah5GLCSBVA7gNpbyF4ziSj7s0 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:45.229320 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}] Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cd566c4b813d471ab4fbe48a6213b76e Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: exception: Aggregate 12 could not be found. Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '12'} Jul 28 11:25:45.230480 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.231246 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 28 11:25:45.232314 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.234636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3578a57f-6caf-4d57-9171-528b957e246f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:45.235690 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3578a57f-6caf-4d57-9171-528b957e246f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.054968 Jul 28 11:25:45.241435 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 96/213] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:45 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:45.246171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3d40e29-46d6-4913-bf70-875a86b4e934 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.248487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4aaf297b-665b-40b6-b219-a32818a71982 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:45.255791 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.255791 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:45.257785 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.257785 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.279495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aaf297b-665b-40b6-b219-a32818a71982 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:45.279948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aaf297b-665b-40b6-b219-a32818a71982 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:45.295850 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e3d40e29-46d6-4913-bf70-875a86b4e934 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3d40e29-46d6-4913-bf70-875a86b4e934 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Request method failure captured: Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIAiubHWTYX-_KkP5Lxtl_OcSEfABDJnkbAenSVzEAq1lxC9TakYcgSe0RPnnM0QGZ-Atqjs3Txt7FJuzDfyolu6Fdi4-pVjBqO3eCEbzoVOVb9ZdyJhiIIKibyq5IufOSFmhpNIee0XSNUvDg203ah5GLCSBVA7gNpbyF4ziSj7s0 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:45.299600 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}] Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cd566c4b813d471ab4fbe48a6213b76e Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: exception: Aggregate 12 could not be found. Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '12'} Jul 28 11:25:45.300852 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:45.301558 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.302575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.305858 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.305858 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:45.305858 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:45.305858 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 28 11:25:45.305858 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.310671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3d40e29-46d6-4913-bf70-875a86b4e934 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:45.312988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3d40e29-46d6-4913-bf70-875a86b4e934 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.070276 Jul 28 11:25:45.314818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 97/214] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:45.330978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.331952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:45.338747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:45.344221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:45.345681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:45.347553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:45.728308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4aaf297b-665b-40b6-b219-a32818a71982 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.491990 Jul 28 11:25:45.743949 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 118/215] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.757953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3039eacb-e6af-4cc1-aebe-2df2b0bf44a7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1218663024", "name": "tempest-test_aggregate-629100030"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:45.813907 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.813907 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.820144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-3039eacb-e6af-4cc1-aebe-2df2b0bf44a7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid 888a72e5-5110-4f50-8e99-dafc18582e08 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:45.884494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3039eacb-e6af-4cc1-aebe-2df2b0bf44a7 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.139275 Jul 28 11:25:45.893364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 119/216] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Jul 28 11:25:45 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:45.905067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94113ee3-9e4d-47fb-a6b1-6904ba6f15c9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:45.909650 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.909650 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:45.913916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-94113ee3-9e4d-47fb-a6b1-6904ba6f15c9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ca556cc58c694ff4bcf92bb7cd30021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5412558b0ef4420ea6e0b6bf70ca4501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94113ee3-9e4d-47fb-a6b1-6904ba6f15c9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Request method failure captured: Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 42 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH9V0jAOBShFcJriEWjJ_6WOYNXkS0VgShTa5cGLZNugLtEDYR8HnU3tJTuOd9uEUwXQ3vNoJaGGg-DhTPFG1v0M5LlaRHwv6wu8H9I7R4uHkFE1QcZRoGo8r0L5Yd25GhwB5cAXI2BXjIJNi4Kuu2iHtAOasKl8HoRj625qongI-c Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:25:45.916078 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5412558b0ef4420ea6e0b6bf70ca4501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5412558b0ef4420ea6e0b6bf70ca4501"}]}] Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5412558b0ef4420ea6e0b6bf70ca4501 Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-431523464 Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ca556cc58c694ff4bcf92bb7cd30021b Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-431523464-project Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: {"remove_host": {"host": "n-h2-851368-1"}} Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:45.917744 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-851368-1'}}} Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:45.919206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 11:25:45.920915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:45.931031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94113ee3-9e4d-47fb-a6b1-6904ba6f15c9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:45.931954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94113ee3-9e4d-47fb-a6b1-6904ba6f15c9 tempest-AggregatesAdminNegativeTestJSON-431523464 tempest-AggregatesAdminNegativeTestJSON-431523464-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.037204 Jul 28 11:25:45.938194 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 120/217] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:45.953783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6dbeb3b-888e-4c31-aea2-a3b7faaaf023 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:45.969280 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:45.969280 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:46.058770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6dbeb3b-888e-4c31-aea2-a3b7faaaf023 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.119381 Jul 28 11:25:46.061018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 121/218] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:46.101057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:46.101763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:46.149932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:46.150397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:46.154217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:46.154736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:46.226350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:46.584365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:46.596000 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b2305d4-ae37-4906-b9ae-60319bb45712 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1471 microversion: 2.1 time: 1.274860 Jul 28 11:25:46.598044 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 98/219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:45 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1471 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:46.612546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3425ab45-329f-4d85-a247-3998d13ea9af tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:46.629037 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:46.629037 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:46.656263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3425ab45-329f-4d85-a247-3998d13ea9af tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:46.656920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3425ab45-329f-4d85-a247-3998d13ea9af tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:46.894792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3425ab45-329f-4d85-a247-3998d13ea9af tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.293464 Jul 28 11:25:46.898450 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 99/220] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:46 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:46.912156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b5ace0d-ae4c-4d37-a95b-b96b570e20af tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:46.923989 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:46.923989 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:46.941711 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2b5ace0d-ae4c-4d37-a95b-b96b570e20af tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b5ace0d-ae4c-4d37-a95b-b96b570e20af tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Request method failure captured: Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIAiubHWTYX-_KkP5Lxtl_OcSEfABDJnkbAenSVzEAq1lxC9TakYcgSe0RPnnM0QGZ-Atqjs3Txt7FJuzDfyolu6Fdi4-pVjBqO3eCEbzoVOVb9ZdyJhiIIKibyq5IufOSFmhpNIee0XSNUvDg203ah5GLCSBVA7gNpbyF4ziSj7s0 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:46.947567 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}] Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cd566c4b813d471ab4fbe48a6213b76e Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: exception: Aggregate 14 could not be found. Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '14'} Jul 28 11:25:46.948714 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6418, in get_aggregate Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:46.949416 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 28 11:25:46.950496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:46.953257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b5ace0d-ae4c-4d37-a95b-b96b570e20af tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:46.956681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b5ace0d-ae4c-4d37-a95b-b96b570e20af tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.055421 Jul 28 11:25:46.960158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 100/221] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:46 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:46.975566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a27ed67c-f862-4283-bea9-5b7c12680c7d tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:46.976230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:46.976716 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:46.976716 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:46.986142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0aa202ed-48ca-4e32-be63-1e4d0c28e4c0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.923638 Jul 28 11:25:46.999618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 122/222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:46 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:47.006126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e5e962a-2ac7-4b94-b03c-1efe232e005a tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.007300 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.007300 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.018148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4e5e962a-2ac7-4b94-b03c-1efe232e005a tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e5e962a-2ac7-4b94-b03c-1efe232e005a tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Request method failure captured: Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIAiubHWTYX-_KkP5Lxtl_OcSEfABDJnkbAenSVzEAq1lxC9TakYcgSe0RPnnM0QGZ-Atqjs3Txt7FJuzDfyolu6Fdi4-pVjBqO3eCEbzoVOVb9ZdyJhiIIKibyq5IufOSFmhpNIee0XSNUvDg203ah5GLCSBVA7gNpbyF4ziSj7s0 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:25:47.020569 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d093bab5ca564e42a5ce66266cecb5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d093bab5ca564e42a5ce66266cecb5d9"}]}] Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d093bab5ca564e42a5ce66266cecb5d9 Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1199404460 Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: cd566c4b813d471ab4fbe48a6213b76e Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AggregatesAdminTestJSON-1199404460-project-admin Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: exception: Aggregate 14 could not be found. Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '14'} Jul 28 11:25:47.021734 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6471, in delete_aggregate Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:47.022766 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.024439 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:47.027020 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:47.027020 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:47.027020 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:47.027020 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 28 11:25:47.027020 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.029056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e5e962a-2ac7-4b94-b03c-1efe232e005a tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:47.030263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e5e962a-2ac7-4b94-b03c-1efe232e005a tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.029177 Jul 28 11:25:47.031057 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 123/223] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:46 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:47.045273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ddbacf5-ccaf-49ab-a5f1-216588b2274e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-141382262"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.053537 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.053537 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.057571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-2ddbacf5-ccaf-49ab-a5f1-216588b2274e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid d9aa3408-ef85-4323-be36-617c14700a3e for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:47.060085 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a27ed67c-f862-4283-bea9-5b7c12680c7d tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.098619 Jul 28 11:25:47.063835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 101/224] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:46 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:47.080394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-381fd1df-de29-4a5a-8512-b411197f9917 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1540764860"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.095566 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.095566 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:47.097723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-381fd1df-de29-4a5a-8512-b411197f9917 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Generated uuid eb1a1313-77d7-4530-b10e-ae22a8498e6a for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:47.132777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ddbacf5-ccaf-49ab-a5f1-216588b2274e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095108 Jul 28 11:25:47.133683 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 124/225] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:47.154547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-381fd1df-de29-4a5a-8512-b411197f9917 tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.088207 Jul 28 11:25:47.160686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 102/226] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:47.161325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1f501d9-2e2a-447e-b93d-0452eea0ee76 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.162460 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.162460 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.170138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.175213 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.175213 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:47.181419 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1f501d9-2e2a-447e-b93d-0452eea0ee76 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.035939 Jul 28 11:25:47.182571 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 125/227] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:47 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:47.193753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-731d5811-76c6-481d-b10a-dd85f3dd229e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.197196 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.197196 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.213877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:47.214424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:47.233125 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-731d5811-76c6-481d-b10a-dd85f3dd229e tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.042238 Jul 28 11:25:47.234689 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 126/228] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:47 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:47.244494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:47.245261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:47.249103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9958d912-4dd3-47b6-9b1d-84798b06199f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.250033 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.250033 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.261370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.compute.aggregates [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 11:25:47.263801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Request method failure captured: Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 42 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIBnXKSexneu5low7Mjzs3Xiy-lYOh38DmuU5JLQVqG0ALALZ0YIxQs_qulRMUNViYrCn6Y5CIBjVn243GdHWbyWaPdvq-cOFyCzluahmJ9qpwrxw0TyzOQY_NcgFfcMSXzOEkz0ILHAwMgw6VBNs62aVHhHkeU8w9cWvSoxQL79KY Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:25:47.267693 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d768aeee1d6c42539e758963c8b0da9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d768aeee1d6c42539e758963c8b0da9b"}]}] Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d768aeee1d6c42539e758963c8b0da9b Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737017261 Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6911997ab51f4e9ba7bcb7ec0d353272 Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: {"remove_host": {"host": "nonexist_host"}} Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:47.269009 n-d-851368-1 devstack@n-api.service[119235]: exception: Cannot remove host nonexist_host in aggregate 16 Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5950, in _get_service_in_cell_by_host Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5956, in _get_service_in_cell_by_host Jul 28 11:25:47.269863 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6637, in remove_host_from_aggregate Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 28 11:25:47.277020 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5958, in _get_service_in_cell_by_host Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.279000 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jul 28 11:25:47.280356 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:47.280762 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9958d912-4dd3-47b6-9b1d-84798b06199f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.027521 Jul 28 11:25:47.280762 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 127/229] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:25:47 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:47.282829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d62d8841-fef2-4dda-93a8-57e2fb13d13c tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.286668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:47.287751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e38bc920-b264-4eda-8961-86a98d9d47bf tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.122912 Jul 28 11:25:47.288028 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.288028 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.288704 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 103/230] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:25:47 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:25:47.301443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74f7fa3a-7287-458a-8840-4869e218b81c tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.302542 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.302542 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:47.341115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74f7fa3a-7287-458a-8840-4869e218b81c tempest-AggregatesAdminNegativeTestJSON-737017261 tempest-AggregatesAdminNegativeTestJSON-737017261-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.047336 Jul 28 11:25:47.342778 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d62d8841-fef2-4dda-93a8-57e2fb13d13c tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.058039 Jul 28 11:25:47.343483 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 128/231] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:47 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 11:25:47.346047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 104/232] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:47 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:47.354651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-292fef7e-2b52-4689-8e68-ff4f61a5a4e5 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-937778191", "availability_zone": "tempest-test_az-1391544629"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.365019 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.365019 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:47.368131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-292fef7e-2b52-4689-8e68-ff4f61a5a4e5 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid 616bbdcb-26a1-48ea-bf18-684bbdc2b4d4 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:47.430439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-292fef7e-2b52-4689-8e68-ff4f61a5a4e5 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.079683 Jul 28 11:25:47.432634 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 129/233] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Jul 28 11:25:47 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:47.444401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80a16b78-aabf-48d3-838c-83e63301fec6 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-937778191_new", "availability_zone": "tempest-test_az-1391544629_new"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:47.619891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:47.620785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:47.628215 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:47.628215 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:47.636233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:47.636692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:47.638135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:47.638577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:47.724910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80a16b78-aabf-48d3-838c-83e63301fec6 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:47.725356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80a16b78-aabf-48d3-838c-83e63301fec6 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:47.782654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80a16b78-aabf-48d3-838c-83e63301fec6 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.341318 Jul 28 11:25:47.784744 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 105/234] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:25:47 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.099648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb3675700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.101900 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.101900 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:48.103100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.107417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.109892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.112183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.175034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27d065b3-2558-42b6-af84-a7c905de5962 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.386842 Jul 28 11:25:48.183665 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 106/235] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:25:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.189606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d55b3e28-15d2-4967-a849-85a1981d10fe tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.190620 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.190620 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:25:48.201181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d55b3e28-15d2-4967-a849-85a1981d10fe tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.015646 Jul 28 11:25:48.202207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 107/236] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:25:48 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.207933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.209054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:48.216510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.217588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.218671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.219325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.716445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:48.728793 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe701901-9f6a-4d59-8bfe-b21711cd1510 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1471 microversion: 2.1 time: 1.113260 Jul 28 11:25:48.730982 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 130/237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:47 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1471 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:48.736229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb351d790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.739501 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.739501 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:48.740896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.741524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.743988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.744594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.783538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe49014d-8cc8-4f1a-abf8-15f4f40051d0 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.051094 Jul 28 11:25:48.785025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 131/238] 10.222.0.93 () {58 vars in 1139 bytes} [Thu Jul 28 11:25:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.794896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6aea5e0-0c3d-48be-b75d-9a3c18ffe77f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.799154 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.799154 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:48.829766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6aea5e0-0c3d-48be-b75d-9a3c18ffe77f tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043133 Jul 28 11:25:48.831017 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 132/239] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:48 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:48.838619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-53bd6d35-9ce4-4c59-8967-b65f10be4dac req-0ba3ec67-efd2-4f55-a3eb-8c845e933284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97c4d3d-f89c-406c-825a-5dccf7bb8cda", "tag": "f0c4be1e-e3d8-4346-8aab-af69d87f1e24"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:48.853699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-53bd6d35-9ce4-4c59-8967-b65f10be4dac req-0ba3ec67-efd2-4f55-a3eb-8c845e933284 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.854380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-53bd6d35-9ce4-4c59-8967-b65f10be4dac req-0ba3ec67-efd2-4f55-a3eb-8c845e933284 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.869256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-53bd6d35-9ce4-4c59-8967-b65f10be4dac req-0ba3ec67-efd2-4f55-a3eb-8c845e933284 service nova] Creating event network-changed:f0c4be1e-e3d8-4346-8aab-af69d87f1e24 for instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda on n-h1-851368-1 Jul 28 11:25:48.876214 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-53bd6d35-9ce4-4c59-8967-b65f10be4dac req-0ba3ec67-efd2-4f55-a3eb-8c845e933284 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043234 Jul 28 11:25:48.877436 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 133/240] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.888073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb35b49d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.890737 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.890737 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:48.892015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.892471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.893291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.893733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.928582 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1da860de-8ccd-4fc2-8214-654de36394d4 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.049079 Jul 28 11:25:48.929546 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 134/241] 10.222.0.93 () {58 vars in 1145 bytes} [Thu Jul 28 11:25:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:25:48.934152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34963525-9047-4e53-8ec5-03fbdddde167 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586032059"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:48.937796 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.937796 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:48.939763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.aggregate [None req-34963525-9047-4e53-8ec5-03fbdddde167 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Generated uuid f630961d-c85a-4e8e-86db-389434f18004 for aggregate {{(pid=119236) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:25:48.984351 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34963525-9047-4e53-8ec5-03fbdddde167 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053422 Jul 28 11:25:48.985378 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 135/242] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:25:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:48.990418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb351d280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:48.994832 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:48.994832 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:48.996202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.996704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:48.997609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:48.998046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.032855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=11,nova_api:INSERT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:49.040033 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27fdefcb-2981-4144-88ec-83783a5244aa tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.053363 Jul 28 11:25:49.041472 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 136/243] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:25:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.049347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a87b7f3d-f300-4c83-b53a-d485ccba1724 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.050050 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.050050 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.067621 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a87b7f3d-f300-4c83-b53a-d485ccba1724 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.023904 Jul 28 11:25:49.068496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 137/244] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.073630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb35b4040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.077499 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.077499 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.080435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.080779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.081665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.082146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.114953 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce2a96dd-cb07-450b-a16d-44019faa516f tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.045397 Jul 28 11:25:49.123711 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 138/245] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.123711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f41af48-67de-4c6e-ab34-f75cdce3e8a1 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.124370 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.124370 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.150277 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f41af48-67de-4c6e-ab34-f75cdce3e8a1 tempest-AggregatesAdminTestJSON-1199404460 tempest-AggregatesAdminTestJSON-1199404460-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.032387 Jul 28 11:25:49.151317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:49.151816 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 139/246] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:25:49 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:25:49.159606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb3597790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.162125 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.162125 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.163354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.163792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.164529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c908957b-c56d-4294-b325-d25b879210f1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.960217 Jul 28 11:25:49.165137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.165583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.167992 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 108/247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:48 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:49.186861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.187868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:49.202897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.205330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.206270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.206970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.213747 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-885d992b-a815-4873-8586-56c204335b3a tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.059986 Jul 28 11:25:49.214377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 140/248] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.233979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb8140700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.236631 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.236631 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.249155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.249603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.255000 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] HTTP exception thrown: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Request method failure captured: Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 HTTP/1.1 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH82cuCqIZUG3UWIXx1nwC4E6IYjmGMY14NeGCKDYJiqnfvBx-7dXQ4mKYntmY6V25_zXTIjRgMHYvk_Sn4BTcawPWNbEttKU2yn_F981JgoqiNJFzTuTfCFRPgMqjVEEI7GSWvYU2S86LjgatmcI9PGeE--YKfYPzJoeDQAXjHFpY Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:25:49.261643 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/056430504120421397e6d36dc5e59f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_056430504120421397e6d36dc5e59f83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}] Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 164fa3f2feb7406aa38d31c856bf8e89 Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.263905 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cbbbac52-657b-4784-a778-a2f97d691637'} Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:49.264562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.266174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.267259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Returning 404 to user: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:49.267259 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b73ce14-bfdb-4b2a-81e4-73909f0b80bd tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 404 len: 111 microversion: 2.1 time: 0.095010 Jul 28 11:25:49.267259 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 109/249] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:25:49 2022] DELETE /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:49.272630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.276095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] [instance: cbbbac52-657b-4784-a778-a2f97d691637] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:49.287649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.288085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.291211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.294329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.297508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.298141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.330825 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] HTTP exception thrown: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Request method failure captured: Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 HTTP/1.1 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH82cuCqIZUG3UWIXx1nwC4E6IYjmGMY14NeGCKDYJiqnfvBx-7dXQ4mKYntmY6V25_zXTIjRgMHYvk_Sn4BTcawPWNbEttKU2yn_F981JgoqiNJFzTuTfCFRPgMqjVEEI7GSWvYU2S86LjgatmcI9PGeE--YKfYPzJoeDQAXjHFpY Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:25:49.332406 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/056430504120421397e6d36dc5e59f83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_056430504120421397e6d36dc5e59f83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/056430504120421397e6d36dc5e59f83"}]}] Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 056430504120421397e6d36dc5e59f83 Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-401168679 Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 164fa3f2feb7406aa38d31c856bf8e89 Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AggregatesAdminTestJSON-401168679-project Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.333849 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cbbbac52-657b-4784-a778-a2f97d691637'} Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:25:49.334648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. Jul 28 11:25:49.339510 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:25:49.341165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] Returning 404 to user: Instance cbbbac52-657b-4784-a778-a2f97d691637 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:25:49.341165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afafc956-9bde-4d98-be70-966a29d87500 tempest-AggregatesAdminTestJSON-401168679 tempest-AggregatesAdminTestJSON-401168679-project] 10.222.0.93 "GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637" status: 404 len: 111 microversion: 2.1 time: 0.064970 Jul 28 11:25:49.341325 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b5ad94c-8f10-4bc6-858f-d597ae204382 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h2-851368-1" status: 200 len: 467 microversion: 2.1 time: 0.108124 Jul 28 11:25:49.341325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 141/250] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/os-hosts/n-h2-851368-1 => generated 467 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.341486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 110/251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/servers/cbbbac52-657b-4784-a778-a2f97d691637 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:25:49.349941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Calling method '.version_select at 0x7f2eb351d1f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.351918 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:49.351918 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:49.362350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.363512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.402177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.405925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.478747 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da2e9dbe-a969-4a82-b9d0-bbaba1c408c2 tempest-HostsAdminTestJSON-1796575298 tempest-HostsAdminTestJSON-1796575298-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h1-851368-1" status: 200 len: 598 microversion: 2.1 time: 0.127619 Jul 28 11:25:49.485087 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 142/252] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/os-hosts/n-h1-851368-1 => generated 598 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:49.750950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:49.751703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:49.772056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.773452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:49.775683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:49.776754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:50.195406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:50.196786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:50.220132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:50.222508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:50.224977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:50.226961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:50.228104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:50.236643 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-63e039de-f890-4a42-a70d-852e0c12b7b8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.490391 Jul 28 11:25:50.238631 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 111/253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:49 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:50.261582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:50.261582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:50.279505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:50.279995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:50.280823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:50.288449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:50.874830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:50.883335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-833f3ed0-c007-445d-85f4-f691c0d0cfec tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 200 len: 1589 microversion: 2.1 time: 0.643369 Jul 28 11:25:50.902277 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 112/254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:50 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 1589 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:50.913397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f6fb1727-ffac-4f79-80ee-93cf1645cc7f req-16902814-53aa-4a33-bdb7-12104baa90ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5591b2a9-3128-4b07-8a65-50f2690e9064", "tag": "2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:25:50.976880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f6fb1727-ffac-4f79-80ee-93cf1645cc7f req-16902814-53aa-4a33-bdb7-12104baa90ec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:50.977246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f6fb1727-ffac-4f79-80ee-93cf1645cc7f req-16902814-53aa-4a33-bdb7-12104baa90ec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:51.033483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f6fb1727-ffac-4f79-80ee-93cf1645cc7f req-16902814-53aa-4a33-bdb7-12104baa90ec service nova] Creating event network-changed:2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a for instance 5591b2a9-3128-4b07-8a65-50f2690e9064 on n-h2-851368-1 Jul 28 11:25:51.061661 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f6fb1727-ffac-4f79-80ee-93cf1645cc7f req-16902814-53aa-4a33-bdb7-12104baa90ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156585 Jul 28 11:25:51.065613 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 113/255] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:51.118704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:51.157624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54c266e5-23d1-4a63-9e0a-c740ee90953c tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.960251 Jul 28 11:25:51.159526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 143/256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:50 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:51.264973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:51.271000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:51.319153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:51.320988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:51.329340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:51.331095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:51.831881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:51.847615 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06d1eda3-a297-4135-ae10-e19afcde4650 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.592717 Jul 28 11:25:51.848660 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 114/257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:51 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:25:52.182857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:52.186771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:52.191648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:52.246223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:52.247521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:52.250166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:52.250806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:52.718527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:52.736202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-49d88ac7-5963-46b0-88d5-4b86b356fa1a tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.554549 Jul 28 11:25:52.773493 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 144/258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:52 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:52.870080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:52.872028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:52.874329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:52.884380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:52.885089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:52.886158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:52.886890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:53.714054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:53.739734 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4032c203-b4a6-463d-92fc-eebaaf042f94 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.871284 Jul 28 11:25:53.742591 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 115/259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:52 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:53.769978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:53.770610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:53.783245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:53.783933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:53.784926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:53.785785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:54.355639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:54.372955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-898ad1f1-912e-4686-86fa-ee01e447f9c4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.608307 Jul 28 11:25:54.386202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 145/260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:53 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:54.767175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:54.767754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:54.775318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:54.776098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:54.777829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:54.778589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:55.164013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:55.180254 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1360d938-16d1-49b6-9488-a5492770da99 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.416093 Jul 28 11:25:55.184938 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 116/261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:54 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:55.396559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:55.397810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:55.422595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:55.424233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:55.428079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:55.429572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:55.914118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:55.926197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-655b395e-4282-4835-9168-1394c4d588fc tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.535023 Jul 28 11:25:55.929181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 146/262] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:55 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:56.206042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:56.206692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:56.216809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:56.217529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:56.220070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:56.220900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:56.554715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:56.574104 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc87558a-b0a6-4180-8ea3-878da6d0beb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.369601 Jul 28 11:25:56.577698 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 117/263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:56 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:56.949878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:56.951407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:56.967677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:56.973340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:56.974408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:56.986380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:57.606638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:57.609652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:57.660931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:57.664192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:57.665665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:57.669383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:58.148705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:58.326886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:58.337928 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16c7a554-da35-490d-a5ef-e817c9144a9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 1.392960 Jul 28 11:25:58.339130 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 147/264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:56 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:58.670175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9be6bcb3-b607-4c05-80f5-04126753403d tempest-InstanceUsageAuditLogTestJSON-1773997922 tempest-InstanceUsageAuditLogTestJSON-1773997922-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:58.671359 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:58.671359 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:58.717319 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9be6bcb3-b607-4c05-80f5-04126753403d tempest-InstanceUsageAuditLogTestJSON-1773997922 tempest-InstanceUsageAuditLogTestJSON-1773997922-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 11:25:57" status: 200 len: 318 microversion: 2.1 time: 0.376101 Jul 28 11:25:58.720927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:58.722213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 148/265] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:25:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2011%3A25%3A57 => generated 318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:25:58.735881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2d5a23e-1ea3-41bd-bea5-bc80c9e35860 tempest-InstanceUsageAuditLogTestJSON-1773997922 tempest-InstanceUsageAuditLogTestJSON-1773997922-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:58.736879 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:25:58.736879 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:25:58.749633 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c094d89e-0646-48fc-9de2-424e2050b479 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 1.150427 Jul 28 11:25:58.753614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 118/266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:57 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:25:58.776925 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2d5a23e-1ea3-41bd-bea5-bc80c9e35860 tempest-InstanceUsageAuditLogTestJSON-1773997922 tempest-InstanceUsageAuditLogTestJSON-1773997922-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.041143 Jul 28 11:25:58.781138 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 149/267] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:25:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:25:59.361026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:59.361944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:59.375591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:59.377399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:59.379479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:59.380097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:59.778141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:25:59.778858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:25:59.783215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:59.790757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:59.791505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:59.792825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:25:59.794508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:25:59.844784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:25:59.870030 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e19812d0-62d3-4ee6-a051-2b07c0df17b1 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.511090 Jul 28 11:25:59.873559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 119/268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:59 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:00.310899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:00.321662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c16116e9-4bea-4477-8741-51e6d620e369 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.547772 Jul 28 11:26:00.335101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 150/269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:25:59 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:00.894324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:00.895559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:00.914191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:00.917070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:00.917920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:00.918430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:01.346756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:01.348164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:01.367370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:01.368191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:01.369199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:01.369853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:01.509223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:01.522339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a26d2575-b948-4f46-88f6-5f70d369ada0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.632689 Jul 28 11:26:01.523711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 120/270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:00 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:01.746866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:01.761678 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1eeaf4f-5ca3-4931-baef-e7732e3ac96e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.418713 Jul 28 11:26:01.762971 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 151/271] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:01 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:01.836949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3f773e5a-f679-4079-aafa-0a5a0d62d162 req-e4569d88-9551-4ac4-9b70-87a65ed17fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97c4d3d-f89c-406c-825a-5dccf7bb8cda", "name": "network-vif-plugged", "status": "completed", "tag": "f0c4be1e-e3d8-4346-8aab-af69d87f1e24"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:01.881787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3f773e5a-f679-4079-aafa-0a5a0d62d162 req-e4569d88-9551-4ac4-9b70-87a65ed17fb3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:01.882809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3f773e5a-f679-4079-aafa-0a5a0d62d162 req-e4569d88-9551-4ac4-9b70-87a65ed17fb3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:01.927094 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3f773e5a-f679-4079-aafa-0a5a0d62d162 req-e4569d88-9551-4ac4-9b70-87a65ed17fb3 service nova] Creating event network-vif-plugged:f0c4be1e-e3d8-4346-8aab-af69d87f1e24 for instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda on n-h1-851368-1 Jul 28 11:26:01.947147 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3f773e5a-f679-4079-aafa-0a5a0d62d162 req-e4569d88-9551-4ac4-9b70-87a65ed17fb3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113697 Jul 28 11:26:01.949269 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 121/272] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:02.547017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:02.548825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:02.559563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:02.560449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:02.562429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:02.563116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:03.040696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ef9094f-75c4-448a-b2d5-742ab8288363 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-320394731", "id": 446453854, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:03.048105 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:03.048105 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:03.133202 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ef9094f-75c4-448a-b2d5-742ab8288363 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.391776 Jul 28 11:26:03.141602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 122/273] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:02 2022] POST /compute/v2.1/flavors => generated 426 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:26:03.168649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.181094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:03.193797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:03.195026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:03.196227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:03.199001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:03.225739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:03.239803 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c72adf7-08da-49f0-a4d0-76dbf64f8e59 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1320 microversion: 2.1 time: 0.696872 Jul 28 11:26:03.241096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 152/274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:02 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:03.260175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-93c496d4-fdcd-4dd1-99f6-a7967a537118 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.261299 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:03.261299 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:03.315691 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-93c496d4-fdcd-4dd1-99f6-a7967a537118 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/446453854" status: 202 len: 0 microversion: 2.1 time: 0.072552 Jul 28 11:26:03.316368 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 153/275] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:03 2022] DELETE /compute/v2.1/flavors/446453854 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:03.334982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e59fa967-8490-467a-8532-e76194b6f4bc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.387001 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e59fa967-8490-467a-8532-e76194b6f4bc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.065881 Jul 28 11:26:03.391161 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 154/276] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:03.530844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:03.547990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab59e840-cd25-4e31-a533-3167ac29337b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.404968 Jul 28 11:26:03.548580 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 123/277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:03 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:03.559348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be34b0af-5393-41fe-8762-bc6f3f354ab0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-626704340", "id": 1069695095, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:03.559348 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:03.559348 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:03.586718 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be34b0af-5393-41fe-8762-bc6f3f354ab0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.037082 Jul 28 11:26:03.587726 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 124/278] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:03 2022] POST /compute/v2.1/flavors => generated 416 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:03.597997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08bbe705-95df-4768-9647-906d67ea308c tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Action: 'create', calling method: .version_select at 0x7f2eb34c2af0>, body: {"pool": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:03.600868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de45e4ad-e2cd-4dc9-8a3a-c020b04111b8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.641820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de45e4ad-e2cd-4dc9-8a3a-c020b04111b8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.045830 Jul 28 11:26:03.646413 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 125/279] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:03 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:03.668582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4639cd2-038c-42c9-be6e-bdcfb28755c9 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.669464 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:03.669464 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:03.672492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:03.713216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4639cd2-038c-42c9-be6e-bdcfb28755c9 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1069695095" status: 202 len: 0 microversion: 2.1 time: 0.048758 Jul 28 11:26:03.714357 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 126/280] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:03 2022] DELETE /compute/v2.1/flavors/1069695095 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:03.732575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5531651a-4c63-499c-90cd-84bddd359a4c tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.768811 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5531651a-4c63-499c-90cd-84bddd359a4c tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.050263 Jul 28 11:26:03.773239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 127/281] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:03.794405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7879c252-f902-4ad6-b03d-b9b1e11835b0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1208473819", "id": 261742032, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:03.828768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7879c252-f902-4ad6-b03d-b9b1e11835b0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038543 Jul 28 11:26:03.832525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 128/282] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:03 2022] POST /compute/v2.1/flavors => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:26:03.846581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21ed04a7-95d4-4b36-a718-79673f77fd9e tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.884180 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21ed04a7-95d4-4b36-a718-79673f77fd9e tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/261742032" status: 202 len: 0 microversion: 2.1 time: 0.042431 Jul 28 11:26:03.885880 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 129/283] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:03 2022] DELETE /compute/v2.1/flavors/261742032 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:26:03.895782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3998caea-6684-42ff-83f9-a61d257b6361 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:03.991445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3998caea-6684-42ff-83f9-a61d257b6361 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.100663 Jul 28 11:26:03.992356 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 130/284] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:26:04.016170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6c1d44e-b42c-48b2-9bc0-1c01f0bac391 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-8101044", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:04.069659 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6c1d44e-b42c-48b2-9bc0-1c01f0bac391 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 504 microversion: 2.1 time: 0.058197 Jul 28 11:26:04.078763 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 131/285] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:04 2022] POST /compute/v2.1/flavors => generated 504 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:26:04.090855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e3f6403-184a-4ac6-8c27-33cf0a4f1f5f tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:04.146014 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e3f6403-184a-4ac6-8c27-33cf0a4f1f5f tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/7a553e9c-c8da-46e1-a977-01d4a71c0401" status: 202 len: 0 microversion: 2.1 time: 0.064477 Jul 28 11:26:04.146674 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 132/286] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:04 2022] DELETE /compute/v2.1/flavors/7a553e9c-c8da-46e1-a977-01d4a71c0401 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:04.165569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9e35a9e-a5b2-4353-9459-0d4bc9ed18d7 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:04.247610 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9e35a9e-a5b2-4353-9459-0d4bc9ed18d7 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.096236 Jul 28 11:26:04.260296 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 133/287] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:04.272319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:04.273294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:04.281306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:04.281984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:04.283128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:04.283858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:04.316423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:05.606259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:05.615393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b593139b-4461-4520-971d-010fd824ee65 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1470 microversion: 2.1 time: 1.348995 Jul 28 11:26:05.620008 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 134/288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:04 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1470 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:05.645616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6e5e278-5236-4aff-9599-3251517e7faa tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-449279200", "id": "3b6249df-1d75-4b9a-86ba-5932af04426f", "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:05.652059 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:05.652059 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:05.687668 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6e5e278-5236-4aff-9599-3251517e7faa tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.066164 Jul 28 11:26:05.696704 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 135/289] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:05 2022] POST /compute/v2.1/flavors => generated 506 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:05.705678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:05.713926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:05.722175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:05.723018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:05.724102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:05.724769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:06.220895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:06.230894 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb4271bc-c529-4868-8a2f-aebd530b9674 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.532261 Jul 28 11:26:06.233608 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 136/290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:05 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:06.478360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a71d4b18-6da3-4bbe-8e0e-521ccc1ffe1a tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Action: 'create', calling method: .version_select at 0x7f2eb359b820>, body: {"keypair": {"name": "tempest-keypair-1242412519", "type": "ssh", "user_id": "13d0fe1eef7d4a4a933f5ea6cf783e56", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFL72YcFWuA/ZzzzNO66C7MBvb/UgURzLL+lLhA+FL2LWPbitX3WzhudPRtZHXWYB17gIdl1ENwQh5STUKl/i2tt6q3sSNvqUmMbJ9lBR/M8qbT6P+pnr//8+1vgelpzQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:06.517447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a71d4b18-6da3-4bbe-8e0e-521ccc1ffe1a tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:06.534162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a71d4b18-6da3-4bbe-8e0e-521ccc1ffe1a tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for user ac0fbdd145cd4ea1b226a76b7f67bcfb and project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:06.612530 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a71d4b18-6da3-4bbe-8e0e-521ccc1ffe1a tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.359392 Jul 28 11:26:06.613905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 137/291] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:26:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 362 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:26:06.619177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:06.625881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:06.636362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:06.637364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:06.638612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:06.641193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:06.791294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-572715a1-7ac9-44cd-8d28-6b20e730bab0 tempest-DeleteServersAdminTestJSON-2057789624 tempest-DeleteServersAdminTestJSON-2057789624-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda/action" status: 202 len: 0 microversion: 2.1 time: 0.175231 Jul 28 11:26:06.792611 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 138/292] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:26:06 2022] POST /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:06.807895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d5271c6e-237f-4620-871e-e3fc9e1a243e tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:06.808956 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:06.808956 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:06.846899 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d5271c6e-237f-4620-871e-e3fc9e1a243e tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/3b6249df-1d75-4b9a-86ba-5932af04426f" status: 202 len: 0 microversion: 2.1 time: 0.052080 Jul 28 11:26:06.847960 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 139/293] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:06 2022] DELETE /compute/v2.1/flavors/3b6249df-1d75-4b9a-86ba-5932af04426f => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:06.854878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0aca51f-ab0b-4eaf-a396-87e281f00714 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Action: 'create', calling method: .version_select at 0x7f2eb359b280>, body: {"keypair": {"name": "tempest-keypair-1759760056", "type": "ssh", "user_id": "13d0fe1eef7d4a4a933f5ea6cf783e56", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9pzYCKYT1q1+4Er5Ke76G2fEEaWxgxB6Tf+/tawlyUSXeFRphYvF3DL3CBBIwBJ2f7y0aEtgscJ8wE/7yzpppEu6ZBy7qOLmFu8nS2LvB3lSW2gMUG6NFCzuz8UZC9TQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:06.886225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f0aca51f-ab0b-4eaf-a396-87e281f00714 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:06.897800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f0aca51f-ab0b-4eaf-a396-87e281f00714 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for user ac0fbdd145cd4ea1b226a76b7f67bcfb and project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:06.944451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0aca51f-ab0b-4eaf-a396-87e281f00714 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.094700 Jul 28 11:26:06.951450 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 140/294] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:26:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:26:06.957294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:06.958997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:06.975446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:06.976649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:06.977457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:06.979226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.010923 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08bbe705-95df-4768-9647-906d67ea308c tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.621042 Jul 28 11:26:07.015276 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 155/295] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:26:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:07.018544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-669abf41-bf84-4abd-b3cb-bae06caffccc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:07.050549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-669abf41-bf84-4abd-b3cb-bae06caffccc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.035031 Jul 28 11:26:07.053953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:07.054480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.057062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lazy-loading 'fault' on Instance uuid e97c4d3d-f89c-406c-825a-5dccf7bb8cda {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:07.057635 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 156/296] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:07 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:07.063213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3501c7ce-29c6-4e29-b223-29e9e53be672 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Calling method '.version_select at 0x7f2eb35eed30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:07.075201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3501c7ce-29c6-4e29-b223-29e9e53be672 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1242412519?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56" status: 200 len: 512 microversion: 2.10 time: 0.016181 Jul 28 11:26:07.085463 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 157/297] 10.222.0.93 () {60 vars in 1340 bytes} [Thu Jul 28 11:26:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1242412519?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:07.091672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60b7d82c-92db-4757-b232-489380360b2d tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Action: 'create', calling method: .version_select at 0x7f2eb3536c10>, body: {"pool": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:07.292147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:07.300741 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8a3f781-24f0-4c89-adda-7f1973c51f70 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1453 microversion: 2.1 time: 0.353427 Jul 28 11:26:07.304311 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 141/298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:06 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1453 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:07.312902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6436cf03-2ab3-48a5-aca0-9fffa1c745d5 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1050881592", "id": 757716908, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:07.319789 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:07.319789 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:07.347364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6436cf03-2ab3-48a5-aca0-9fffa1c745d5 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.040604 Jul 28 11:26:07.347983 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 142/299] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:07.354156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5bacba23-1d66-43fb-984d-d96414d6135d tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Action: 'create', calling method: .version_select at 0x7f2eb35a53a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-545689577", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz+lSMEfsYhsZW7kM6MprqNKDTA5neqUHeLT6sRszKZo7t1U4jgdGTiR1ax9R46TRIeq4Tnv6Jys66WuqLTVXCBLIP8ZEwJ3A7slV50QkoxEnXDP30o4t8Jvxjp2tftjw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:07.394357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-5bacba23-1d66-43fb-984d-d96414d6135d tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:07.400676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-5bacba23-1d66-43fb-984d-d96414d6135d tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Getting quotas for user ac0fbdd145cd4ea1b226a76b7f67bcfb and project 76588d8e2ea34ef6a0b7ac3f291ff208. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:07.481753 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5bacba23-1d66-43fb-984d-d96414d6135d tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.131177 Jul 28 11:26:07.483396 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 143/300] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:26:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:26:07.496342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:07.497014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:07.504688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:07.506059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.507050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:07.507700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.764938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:07.775820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb38525b-5e51-483c-a898-beec7122c77d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.291255 Jul 28 11:26:07.789716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 144/301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:07 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:07.789716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:07.792039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:07.805795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:07.806247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.807047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:07.807512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:07.874141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:26:08.043795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:08.088814 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0461d9c6-d101-454f-a429-06cd53e51048 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 204 len: 0 microversion: 2.1 time: 0.304705 Jul 28 11:26:08.089485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 145/302] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:07 2022] DELETE /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:08.103064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43867692-e87d-4fdb-b94f-8ac137fba300 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.126718 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43867692-e87d-4fdb-b94f-8ac137fba300 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/757716908" status: 200 len: 411 microversion: 2.1 time: 0.033948 Jul 28 11:26:08.127672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 146/303] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:26:08 2022] GET /compute/v2.1/flavors/757716908 => generated 411 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:08.139416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31e9abb7-9c44-409f-8dcc-5add179eb1c2 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Calling method '.version_select at 0x7f2eb360cc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.146281 n-d-851368-1 devstack@n-api.service[119235]: WARNING oslo_db.sqlalchemy.utils [None req-31e9abb7-9c44-409f-8dcc-5add179eb1c2 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:26:08.160433 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31e9abb7-9c44-409f-8dcc-5add179eb1c2 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56" status: 200 len: 726 microversion: 2.10 time: 0.031052 Jul 28 11:26:08.167742 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 147/304] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Jul 28 11:26:08 2022] GET /compute/v2.1/os-keypairs?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56 => generated 726 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:08.192579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.193256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:08.202495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:08.203359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:08.204649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:08.205319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:08.263449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:08.263902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:08.264788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lazy-loading 'fault' on Instance uuid e97c4d3d-f89c-406c-825a-5dccf7bb8cda {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:08.519102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:08.530727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c40ffecd-2610-41e2-bd5c-c227c59e60cf tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1459 microversion: 2.1 time: 0.360113 Jul 28 11:26:08.532207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 148/305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:08 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1459 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:08.665456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9242e167-a26f-415f-bf83-4ce8515a5c6a tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.735053 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9242e167-a26f-415f-bf83-4ce8515a5c6a tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.198738 Jul 28 11:26:08.737572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 149/306] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:08 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:08.749274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ff338f4-1f8b-448a-8b36-92966205c29c tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Calling method '.version_select at 0x7f2eb36ef820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.766193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:08.808491 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ff338f4-1f8b-448a-8b36-92966205c29c tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-545689577" status: 204 len: 0 microversion: 2.10 time: 0.069633 Jul 28 11:26:08.809396 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 150/307] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 28 11:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-545689577 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:26:08.818447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-851c24f9-fd3f-4cde-aa6d-34602a735129 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.819353 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:08.819353 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:08.868746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-851c24f9-fd3f-4cde-aa6d-34602a735129 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/757716908" status: 202 len: 0 microversion: 2.1 time: 0.058036 Jul 28 11:26:08.872489 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 151/308] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:08 2022] DELETE /compute/v2.1/flavors/757716908 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:08.881244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:08.881876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:08.901577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:08.902031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:08.906426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:08.907615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:09.270746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:09.280912 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f3789fb-ba44-4597-a8ea-eacb472ab0e3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1476 microversion: 2.1 time: 0.410135 Jul 28 11:26:09.298228 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 152/309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:08 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:09.304661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04f721b7-b04f-48da-b7ee-e39109746269 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Calling method '.version_select at 0x7f2eb356d1f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:09.333704 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60b7d82c-92db-4757-b232-489380360b2d tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.246662 Jul 28 11:26:09.334964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 158/310] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:26:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:09.339091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04f721b7-b04f-48da-b7ee-e39109746269 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759760056?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56" status: 204 len: 0 microversion: 2.10 time: 0.038434 Jul 28 11:26:09.340491 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 153/311] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759760056?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:26:09.345242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd765d12-1158-4f73-9f36-2af88a6476d0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:09.410651 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd765d12-1158-4f73-9f36-2af88a6476d0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.072541 Jul 28 11:26:09.413088 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 159/312] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:09 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:09.427681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92524931-8d7a-4fd8-bdcd-cac45e1021a2 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Action: 'create', calling method: .version_select at 0x7f2eb8126e50>, body: {"pool": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:09.483975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1945598959", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2ee9bbf6-5533-4c74-b21c-9d3ad61e8713"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:09.585176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] validate_networks() for [('2ee9bbf6-5533-4c74-b21c-9d3ad61e8713', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:10.455223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:10.456441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:10.457201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:10.457824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:10.459558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:10.477559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:10.480450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:10.485103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:10.486078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:10.525156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:10.532828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for user d61cd4ba16e748bbac55fe74a20c557e and project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:10.557737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:26:10.560138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:26:10.687028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1eba7fb-8c27-4426-8f56-98ef9c4f5010 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334287 Jul 28 11:26:10.689646 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 154/313] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:26:10.711357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4463ac2f-8d82-48dd-bc13-d75c7c4c4492 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] Calling method '.version_select at 0x7f2eb36ef4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:10.745865 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4463ac2f-8d82-48dd-bc13-d75c7c4c4492 tempest-KeyPairsV210TestJSON-1319399744 tempest-KeyPairsV210TestJSON-1319399744-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242412519?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56" status: 204 len: 0 microversion: 2.10 time: 0.054440 Jul 28 11:26:10.754969 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 155/314] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242412519?user_id=13d0fe1eef7d4a4a933f5ea6cf783e56 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:26:10.766889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce022fd3-3b57-4146-ba92-955c48e2dadc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1644198263", "id": 391241565, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:10.771262 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:10.771262 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:10.800038 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce022fd3-3b57-4146-ba92-955c48e2dadc tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.043519 Jul 28 11:26:10.801564 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 156/315] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:10 2022] POST /compute/v2.1/flavors => generated 427 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:10.821607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:10.822461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:10.836673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:10.837786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:10.838831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:10.839507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:10.890777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:10.891505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:10.892074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lazy-loading 'fault' on Instance uuid e97c4d3d-f89c-406c-825a-5dccf7bb8cda {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:11.628515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:11.645181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-124d1c71-ac7e-45d7-83a9-f47ee08dd09d tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1459 microversion: 2.1 time: 0.842011 Jul 28 11:26:11.646383 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 157/316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:10 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1459 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:11.656448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:11.661012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:11.694072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:11.694825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:11.704150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:11.706081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:12.710689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:12.723516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a3e88dc-bb33-43e8-98e8-be07f717e9ce tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1475 microversion: 2.1 time: 1.074110 Jul 28 11:26:12.730070 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 158/317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:11 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1475 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:12.736420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:12.738935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:12.756686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:12.757509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:12.758572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:12.759264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:13.077240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:13.090873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-87ff3835-4056-41d8-972e-7c2288efa911 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1269 microversion: 2.1 time: 0.355988 Jul 28 11:26:13.106557 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 159/318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:12 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1269 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:13.126506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4f1fa2e-797a-4372-a658-fdf3c2e7ad06 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "391241565"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:13.162506 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a4f1fa2e-797a-4372-a658-fdf3c2e7ad06 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] HTTP exception thrown: Flavor 391241565 could not be found. Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4f1fa2e-797a-4372-a658-fdf3c2e7ad06 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Request method failure captured: Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 106 Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJJfUMD84uggq6EAFTdR2UU7pE3Scfi9mgrCP2YIKih8Dpjskyi1W_h6u_At0CftY_j5cXbqe7g85pWL__0aiC7CzwMhSOtKiIfet_oLcMj_IL7k0upvA_ouhhooWWwBd4IxCaKxodLCAVuPlDGyTyED_chOszueerABqqSfl4jQzs Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 506bcdd0c44f43d38e987dba5bead3db Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsAdminTestJSON-1407388317 Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:13.170451 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/506bcdd0c44f43d38e987dba5bead3db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/506bcdd0c44f43d38e987dba5bead3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_506bcdd0c44f43d38e987dba5bead3db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/506bcdd0c44f43d38e987dba5bead3db"}]}] Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsAdminTestJSON-1407388317 Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 506bcdd0c44f43d38e987dba5bead3db Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1407388317 Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsAdminTestJSON-1407388317-project Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 12fbd2cc3a364359ac426de6654913bb Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsAdminTestJSON-1407388317-project Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "test", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "391241565"}} Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:13.171941 n-d-851368-1 devstack@n-api.service[119235]: exception: Flavor 391241565 could not be found. Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '391241565'}}} Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 391241565 could not be found. Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:13.172746 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 391241565 could not be found. Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:13.173897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:13.175183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:13.175183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:13.175183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:13.175183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 391241565 could not be found. Jul 28 11:26:13.175183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:13.175511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4f1fa2e-797a-4372-a658-fdf3c2e7ad06 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Returning 400 to user: Flavor 391241565 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:13.181200 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4f1fa2e-797a-4372-a658-fdf3c2e7ad06 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.069113 Jul 28 11:26:13.182318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 160/319] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:13 2022] POST /compute/v2.1/servers => generated 80 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:26:13.194381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:13.196184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:13.210152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:13.211806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:13.213731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:13.215317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:13.230666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=81 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:13.297524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:13.301450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:13.302223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lazy-loading 'fault' on Instance uuid e97c4d3d-f89c-406c-825a-5dccf7bb8cda {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:14.468514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bf5f1e1d2948b88e16555f16e34b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175fd7cb8b284562bf2f7d9ff09e06ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:14.471962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:14.478147 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bc5aebb-e2be-419e-a5b5-5dc7284580a0 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 200 len: 1459 microversion: 2.1 time: 1.294425 Jul 28 11:26:14.478734 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 161/320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:13 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 1459 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:14.529590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "name": "network-vif-unplugged", "status": "completed", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:14.560635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:14.569044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:14.586169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] Creating event network-vif-unplugged:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h2-851368-1 Jul 28 11:26:14.630675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] Instance 62b0cacf-222b-4265-b429-5c4f2578553f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:26:14.666222 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b47eca73-ccf1-44d5-a17e-3f9805817bed req-1ef8b89e-8d7b-45d1-a74d-87396944b438 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146738 Jul 28 11:26:14.666662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 162/321] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:14.689099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e77eb2a-4df2-4d13-867d-9128152f2cc5 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:14.690042 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:14.690042 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:14.732218 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e77eb2a-4df2-4d13-867d-9128152f2cc5 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/391241565" status: 202 len: 0 microversion: 2.1 time: 0.058435 Jul 28 11:26:14.733047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 163/322] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:14 2022] DELETE /compute/v2.1/flavors/391241565 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:14.739779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:14.743318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:14.760476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:14.763356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:14.764392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:14.767507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:15.539267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:15.548671 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6d36942-015d-4894-a3a9-c77b7117aa5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1475 microversion: 2.1 time: 0.814282 Jul 28 11:26:15.549257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 164/323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:14 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1475 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:15.553683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:15.554285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:15.572760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:15.573486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:15.574905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:15.575345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:15.631410 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92524931-8d7a-4fd8-bdcd-cac45e1021a2 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.211567 Jul 28 11:26:15.639444 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 160/324] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:26:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:15.639444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e012681-527a-4702-be26-5ad74f1f6fc8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:15.696315 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e012681-527a-4702-be26-5ad74f1f6fc8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.062730 Jul 28 11:26:15.701474 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 161/325] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:15 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:15.712077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:15.712975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:15.740184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:15.740939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:15.743285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:15.746800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:15.780949 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda HTTP/1.1 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:15.784528 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:15.785957 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e97c4d3d-f89c-406c-825a-5dccf7bb8cda'} Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:15.786785 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:15.788158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:15.789950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:15.790320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be5a6d16-7e94-4824-bfa3-96202246a0b7 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 404 len: 111 microversion: 2.1 time: 0.087027 Jul 28 11:26:15.791317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 162/326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:15 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:15.801093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b9ef8ed-c9ab-4bfc-ba35-68d2f64efcfb tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Action: 'create', calling method: .version_select at 0x7f2eb34c2d30>, body: {"pool": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:15.862257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:15.881935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99e8642e-69d0-43dc-8546-d0440590010e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1269 microversion: 2.1 time: 0.331614 Jul 28 11:26:15.895627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 165/327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:15 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1269 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:15.900451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9438b74-acea-4df0-bb62-e1ca185cfe73 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-890463927", "id": 318386259, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:15.916118 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:15.916118 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:15.971392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9438b74-acea-4df0-bb62-e1ca185cfe73 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.066684 Jul 28 11:26:15.971905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 166/328] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:15 2022] POST /compute/v2.1/flavors => generated 411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:15.982926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:15.984961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:16.006197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.006822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.007829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.012583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.038680 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda HTTP/1.1 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:16.040714 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.042149 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e97c4d3d-f89c-406c-825a-5dccf7bb8cda'} Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:16.043461 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.044784 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.051569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:16.053275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa1e2af9-e6d6-4c7e-8ba5-9d2ffd40bc9b tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 404 len: 111 microversion: 2.1 time: 0.077740 Jul 28 11:26:16.057522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 167/329] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:15 2022] DELETE /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:16.063132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a355e7e3-5ffa-411c-bfbd-f58d29bf43dd tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-385594066", "id": 2017786064, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:16.085145 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:16.085145 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:16.107095 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a355e7e3-5ffa-411c-bfbd-f58d29bf43dd tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.047482 Jul 28 11:26:16.108136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 168/330] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:16.116592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.117266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: e97c4d3d-f89c-406c-825a-5dccf7bb8cda] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:16.130627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.131106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.134060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.135594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.169116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda HTTP/1.1 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:16.170681 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.171940 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e97c4d3d-f89c-406c-825a-5dccf7bb8cda'} Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:16.172706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. Jul 28 11:26:16.173774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.174755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:16.174755 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d98030dd-500e-4838-b1b7-29ca01e12fa4 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda" status: 404 len: 111 microversion: 2.1 time: 0.062825 Jul 28 11:26:16.174755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 169/331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/servers/e97c4d3d-f89c-406c-825a-5dccf7bb8cda => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:16.188381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d36416a-9708-42d3-abd2-282ab2a28e40 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.237445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d36416a-9708-42d3-abd2-282ab2a28e40 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.054096 Jul 28 11:26:16.238577 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 170/332] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:16.249023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.249320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:16.264393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.264860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.265657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.266107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.287987 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 HTTP/1.1 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:16.291555 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.293587 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '69cd6b85-26e6-4f56-acf8-33c7fa925475'} Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:16.294407 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.295717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.309023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:16.309891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f64f01c-16a5-4d33-8222-67ff16251630 tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "DELETE /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 404 len: 111 microversion: 2.1 time: 0.070128 Jul 28 11:26:16.315388 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 171/333] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:16 2022] DELETE /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:16.324550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c59c0a91-26e7-4736-8fc6-248e38093c31 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.339324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:16.348942 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c59c0a91-26e7-4736-8fc6-248e38093c31 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.032402 Jul 28 11:26:16.362111 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 172/334] 10.222.0.93 () {58 vars in 1177 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:16.367335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.370631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] [instance: 69cd6b85-26e6-4f56-acf8-33c7fa925475] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:16.381252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.381970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.383739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.384351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.403159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] HTTP exception thrown: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Request method failure captured: Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 HTTP/1.1 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nH8AMt_mw4ydoJBTBeqr9y3-gA7KBTR9jjEq5Y8Lo4Vk2DWIUl63nG9vp8GjCjsjIa1UnMA-UvYPRp6Cz6pj7XCJs9c-Fzt-JeDVVbH1w_OOBVvOCoku2FqqpuJOikDPkSLI1T8XEsCaADC_GW8VfxvPhJN8xZg5rxB8hxDu4EwUN8 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:16.412538 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_175fd7cb8b284562bf2f7d9ff09e06ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/175fd7cb8b284562bf2f7d9ff09e06ea"}]}] Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 175fd7cb8b284562bf2f7d9ff09e06ea Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1801132660 Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d1bf5f1e1d2948b88e16555f16e34b85 Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersAdminTestJSON-1801132660-project Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.413911 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '69cd6b85-26e6-4f56-acf8-33c7fa925475'} Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:16.415453 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. Jul 28 11:26:16.416687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:16.418091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] Returning 404 to user: Instance 69cd6b85-26e6-4f56-acf8-33c7fa925475 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:16.418091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-088acb7e-30a0-47ea-8eeb-086719195eeb tempest-DeleteServersAdminTestJSON-1801132660 tempest-DeleteServersAdminTestJSON-1801132660-project] 10.222.0.93 "GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475" status: 404 len: 111 microversion: 2.1 time: 0.047749 Jul 28 11:26:16.421905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 173/335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/servers/69cd6b85-26e6-4f56-acf8-33c7fa925475 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:16.439841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-011ba198-ae2b-478b-8bcc-fc3261b40ebd tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.457792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-011ba198-ae2b-478b-8bcc-fc3261b40ebd tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.034527 Jul 28 11:26:16.467423 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 174/336] 10.222.0.93 () {58 vars in 1171 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:16.475959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-404110bf-966b-4398-b03a-f0e5850a058a tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.499138 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-404110bf-966b-4398-b03a-f0e5850a058a tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.027823 Jul 28 11:26:16.507311 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 175/337] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:16.517663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-773e21f6-b537-45e8-95cb-8aaec0823160 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.553908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-773e21f6-b537-45e8-95cb-8aaec0823160 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.042639 Jul 28 11:26:16.576236 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 176/338] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:16.588629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:16.589468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:16.604986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.606239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:16.607217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:16.608593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:17.489268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:17.506701 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d6f088a-b093-4fbe-a30f-9dc64536bf01 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1475 microversion: 2.1 time: 0.929000 Jul 28 11:26:17.519755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 177/339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:16 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1475 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:17.529677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d54eb43-e388-4bb8-b5f2-a3a6960c9142 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:17.644903 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d54eb43-e388-4bb8-b5f2-a3a6960c9142 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.123518 Jul 28 11:26:17.647803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 178/340] 10.222.0.93 () {58 vars in 1175 bytes} [Thu Jul 28 11:26:17 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:17.665436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97c4d3d-f89c-406c-825a-5dccf7bb8cda", "name": "network-vif-deleted", "tag": "f0c4be1e-e3d8-4346-8aab-af69d87f1e24"}, {"name": "network-changed", "server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:17.685435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:17.687420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:17.731691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Creating event network-vif-deleted:f0c4be1e-e3d8-4346-8aab-af69d87f1e24 for instance e97c4d3d-f89c-406c-825a-5dccf7bb8cda on n-h1-851368-1 Jul 28 11:26:17.732557 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Creating event network-changed:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h2-851368-1 Jul 28 11:26:17.739446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] Instance 62b0cacf-222b-4265-b429-5c4f2578553f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:26:17.759599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2646964c-9efb-4876-b574-c10bea740045 req-2c0a6421-76aa-407c-89c8-22e9b99f770f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106597 Jul 28 11:26:17.760812 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 179/341] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:17.767406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:17.768419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:17.776543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:17.778119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:17.779438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:17.780097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:18.494887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:18.504415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5c70080-9761-4d60-89b3-5b1135f2e8ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.741397 Jul 28 11:26:18.507757 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 180/342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:17 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:18.715251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb3518f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:18.861853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:18.863538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:18.864449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:18.866009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:19.062778 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ea38ab7-14fa-4e35-8621-7792f939aa10 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0" status: 200 len: 148 microversion: 2.57 time: 0.551099 Jul 28 11:26:19.063515 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 181/343] 10.222.0.93 () {62 vars in 1303 bytes} [Thu Jul 28 11:26:18 2022] PUT /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0 => generated 148 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:19.086538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4da62d58-5875-44dd-a8fd-2d6a796d5ce9 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:19.137603 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4da62d58-5875-44dd-a8fd-2d6a796d5ce9 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.060641 Jul 28 11:26:19.162694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 182/344] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Jul 28 11:26:19 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:19.169263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:19.170991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:19.178037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:19.178630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:19.179518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:19.180155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.016649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:20.024082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19b41578-8d4e-4ae0-b91f-13b309cf515f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1475 microversion: 2.1 time: 0.860055 Jul 28 11:26:20.024641 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 183/345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:19 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:20.040131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Calling method '.version_select at 0x7f2eb34d9ee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:20.499303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.499754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.503974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.505670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.571184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eca96baf-e102-4d4b-bede-6ba150f2d3ff tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0/detail" status: 200 len: 463 microversion: 2.57 time: 0.534762 Jul 28 11:26:20.572389 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 184/346] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Jul 28 11:26:20 2022] GET /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0/detail => generated 463 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:20.582897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d50f735-f093-4faf-87c6-5bc256d1b44a tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:20.656016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d50f735-f093-4faf-87c6-5bc256d1b44a tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.082237 Jul 28 11:26:20.660116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 185/347] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 28 11:26:20 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:20.666813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:20.672861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:20.681769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.683001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.685475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.686166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.738093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:26:20.917021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b6986a6-b321-4319-8843-e86be6f0e648 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 204 len: 0 microversion: 2.1 time: 0.255176 Jul 28 11:26:20.918432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 186/348] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:26:20 2022] DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:20.941047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:20.941970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:20.963632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.966929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:20.968011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:20.971495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:21.720162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:21.743227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0d24eda-3859-47ab-9bdb-97e1a29e41ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.822765 Jul 28 11:26:21.743827 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 187/349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:20 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:22.061849 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b9ef8ed-c9ab-4bfc-ba35-68d2f64efcfb tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.264632 Jul 28 11:26:22.063418 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 163/350] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:26:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:22.069175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9570d92a-268b-44a6-b842-0cfc97844d55 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:22.070915 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:22.070915 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:22.079269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=5 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:22.095150 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9570d92a-268b-44a6-b842-0cfc97844d55 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2017786064" status: 202 len: 0 microversion: 2.1 time: 0.029607 Jul 28 11:26:22.096426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 164/351] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:22 2022] DELETE /compute/v2.1/flavors/2017786064 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:22.102217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb3548a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:22.115787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-428186493", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "b93dd60e-eebc-4156-8fe1-0460817e9901"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:22.202017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] validate_networks() for [('b93dd60e-eebc-4156-8fe1-0460817e9901', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:22.565550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.566005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:22.567263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.567854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:22.652774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.653468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:22.654782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.655436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:22.751367 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b19ba9b-6bbd-487e-b5a3-120a8efdd5dd tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0?user_id=d06e12da77fc4a93b89130cfe5eef36f" status: 200 len: 148 microversion: 2.57 time: 0.653224 Jul 28 11:26:22.758961 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 165/352] 10.222.0.93 () {62 vars in 1384 bytes} [Thu Jul 28 11:26:22 2022] PUT /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0?user_id=d06e12da77fc4a93b89130cfe5eef36f => generated 148 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:22.765976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:22.766848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:22.778400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.778861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:22.779686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:22.780502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:23.345587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:23.356834 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e599cced-c44b-4451-914d-6c10df257280 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1470 microversion: 2.1 time: 0.596362 Jul 28 11:26:23.357611 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 166/353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:22 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1470 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:23.363250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-128105076", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "1385482101", "adminPass": "***", "networks": [{"uuid": "c6e066f9-62be-4561-bf81-78745fae59fd"}], "security_groups": [{"name": "tempest-securitygroup--1975633822"}], "key_name": "tempest-keypair-1723843283", "user_data": "}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:23.641880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:23.642349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:23.642765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:23.643221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:23.643651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:23.653416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:23.653866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:23.654713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:23.655179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:23.673544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:23.678760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for user ccea87d21921492f8544e0e81ea485d5 and project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:23.691717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:26:23.694631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:26:23.714157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] validate_networks() for [('c6e066f9-62be-4561-bf81-78745fae59fd', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:23.743876 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cffc7cda-49ec-47d2-ab25-42c8cc885f7c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.999007 Jul 28 11:26:23.744529 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 188/354] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:26:23.749921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d9156a16-4679-45fc-aaf4-3cf51e1268f9 req-3fb1b0fa-e36f-4a3e-8d8e-2d10881814ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:23.760545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d9156a16-4679-45fc-aaf4-3cf51e1268f9 req-3fb1b0fa-e36f-4a3e-8d8e-2d10881814ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:23.760996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d9156a16-4679-45fc-aaf4-3cf51e1268f9 req-3fb1b0fa-e36f-4a3e-8d8e-2d10881814ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:23.774202 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d9156a16-4679-45fc-aaf4-3cf51e1268f9 req-3fb1b0fa-e36f-4a3e-8d8e-2d10881814ea service nova] Creating event network-changed:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h2-851368-1 Jul 28 11:26:23.779895 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d9156a16-4679-45fc-aaf4-3cf51e1268f9 req-3fb1b0fa-e36f-4a3e-8d8e-2d10881814ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 Jul 28 11:26:23.781054 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 189/355] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:23.788296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad1156b2-6afe-45b2-84d1-5cd3b827a873 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb34ea0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:24.508809 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad1156b2-6afe-45b2-84d1-5cd3b827a873 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/426c99e4-43af-46d9-bf80-ced1a84e3580" status: 200 len: 141 microversion: 2.1 time: 0.724691 Jul 28 11:26:24.509985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 190/356] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:26:23 2022] GET /compute/v2.1/os-floating-ips/426c99e4-43af-46d9-bf80-ced1a84e3580 => generated 141 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:24.522709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d68491a-2b64-4245-af46-294be30dc676 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:24.567465 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d68491a-2b64-4245-af46-294be30dc676 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.054603 Jul 28 11:26:24.569215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 191/357] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:24 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:24.576663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-017c1798-e6fe-459b-a082-1c126071ce34 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] Calling method '.version_select at 0x7f2eb37603a0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:24.865253 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-017c1798-e6fe-459b-a082-1c126071ce34 tempest-QuotasAdminTestV257-1954758788 tempest-QuotasAdminTestV257-1954758788-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0?user_id=d06e12da77fc4a93b89130cfe5eef36f" status: 200 len: 190 microversion: 2.57 time: 0.294473 Jul 28 11:26:24.866536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 192/358] 10.222.0.93 () {60 vars in 1364 bytes} [Thu Jul 28 11:26:24 2022] GET /compute/v2.1/os-quota-sets/23378cf8f1d14c0792c989cca9b4b1e0?user_id=d06e12da77fc4a93b89130cfe5eef36f => generated 190 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:24.871882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:24.872873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:24.921678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:24.924046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:24.925410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:24.925867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:25.783581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:25.794440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72bc7f10-b784-4cf6-b861-28070e53651e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.926614 Jul 28 11:26:25.801006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 193/359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:24 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:25.815831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:25.816745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:25.830646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:25.833276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:25.834237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:25.835591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:25.985318 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4665681-e1ff-4993-94a7-2587831b0bb4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f/action" status: 204 len: 0 microversion: 2.1 time: 0.182175 Jul 28 11:26:25.987124 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 194/360] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:26:25 2022] POST /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f/action => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:26.049180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:26.050938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:26.051860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:26.052479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:26.053055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:26.070207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.072187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.075542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.077150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.147363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:26.158951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Getting quotas for user 54e94603a7ad4df4a79f38b48c063ab6 and project e17dc42396ba4ec0bdca9f3e08b42555. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:26.192812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:26:26.205615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:26:26.363701 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eda5c81e-06ab-4d15-8714-1e9fb7fab2f7 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.004106 Jul 28 11:26:26.371429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 167/361] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:26:26.381388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:26.382063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:26.409478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.409969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.412092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.413291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.584226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:26.598606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:26.602011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:26.603027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f501aa62-14cf-4eda-ab1e-76aa7fa15acf tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-776358886", "id": 1844698287, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:26.606873 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:26.606873 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:26.607822 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1971a56-cd76-4c26-b92b-28ba599f6c53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1319 microversion: 2.25 time: 0.240694 Jul 28 11:26:26.609511 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 168/362] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:26 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:26.620618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "name": "network-vif-plugged", "status": "completed", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:26.644989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.645753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.659467 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f501aa62-14cf-4eda-ab1e-76aa7fa15acf tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.667691 Jul 28 11:26:26.664159 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 195/363] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:25 2022] POST /compute/v2.1/flavors => generated 438 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:26.688567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8519b45-bd9f-4c06-9009-602905673413 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb34d91f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:26.693346 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] Creating event network-vif-plugged:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h2-851368-1 Jul 28 11:26:26.730576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] Instance 62b0cacf-222b-4265-b429-5c4f2578553f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:26:26.756450 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f3e3d710-2259-41c5-ae21-c8e2af139e16 req-1552f5da-e3e2-4ea2-b549-208f4872851a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144655 Jul 28 11:26:26.757064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 169/364] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:26.771504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27f0fcbf-d4da-433b-adcd-9bb150285a05 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:26.776198 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:26.776198 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:26.823474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27f0fcbf-d4da-433b-adcd-9bb150285a05 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/318386259" status: 202 len: 0 microversion: 2.1 time: 0.062877 Jul 28 11:26:26.824064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 170/365] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:26 2022] DELETE /compute/v2.1/flavors/318386259 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:26.835872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-51dd6b2e-8b22-44d0-b674-b49cf4f0b8b2 req-e5d706be-e537-4885-b9c6-be570c9a6b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5591b2a9-3128-4b07-8a65-50f2690e9064", "name": "network-vif-deleted", "tag": "2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:26.865172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-51dd6b2e-8b22-44d0-b674-b49cf4f0b8b2 req-e5d706be-e537-4885-b9c6-be570c9a6b0b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.884101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-51dd6b2e-8b22-44d0-b674-b49cf4f0b8b2 req-e5d706be-e537-4885-b9c6-be570c9a6b0b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.934091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-51dd6b2e-8b22-44d0-b674-b49cf4f0b8b2 req-e5d706be-e537-4885-b9c6-be570c9a6b0b service nova] Creating event network-vif-deleted:2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a for instance 5591b2a9-3128-4b07-8a65-50f2690e9064 on n-h2-851368-1 Jul 28 11:26:26.958290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-51dd6b2e-8b22-44d0-b674-b49cf4f0b8b2 req-e5d706be-e537-4885-b9c6-be570c9a6b0b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131478 Jul 28 11:26:26.959593 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 171/366] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:26.971192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:26.971922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:26.979512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.980054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:26.982004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:26.982211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:27.925252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:27.937629 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b87859f-2b31-41fa-9ae4-5847b3caa8ab tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1470 microversion: 2.1 time: 0.976180 Jul 28 11:26:27.942836 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 172/367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:26 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1470 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:27.955957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:27.956827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:27.969662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:27.970393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:27.975733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:27.976522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:28.282130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:28.292099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39301a21-a109-4f09-a861-73dd51e5bae9 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1316 microversion: 2.1 time: 0.347890 Jul 28 11:26:28.307488 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 173/368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:27 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:28.319857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d23d8c26-fa91-449f-bf52-e6069202334f tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:28.324772 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:28.324772 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:28.785911 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d23d8c26-fa91-449f-bf52-e6069202334f tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1844698287/action" status: 200 len: 97 microversion: 2.1 time: 0.473839 Jul 28 11:26:28.790560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 174/369] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:28 2022] POST /compute/v2.1/flavors/1844698287/action => generated 97 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:26:28.797238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:28.803787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:28.823805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:28.824670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:28.825926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:28.826585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:29.559414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:29.568842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c6ba1d8d-638a-4f24-b015-2cb4f6e2e557 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.776894 Jul 28 11:26:29.570731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 175/370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:28 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:29.576969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01212b20-220d-4d49-b9ab-3c61872795a0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:29.603098 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01212b20-220d-4d49-b9ab-3c61872795a0 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.030722 Jul 28 11:26:29.604346 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 176/371] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:29 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:29.612372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:29.613617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:29.621205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:29.621864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:29.623004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:29.623682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.041782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:30.056843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:30.059159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:30.060858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24fb6117-9abb-406d-84ae-6888b9a40cc0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.454947 Jul 28 11:26:30.061800 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 177/372] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:29 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:30.082768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7799981-dc54-4a07-8697-37125ccd5e28 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:30.086329 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:30.086329 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:30.212285 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8519b45-bd9f-4c06-9009-602905673413 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/426c99e4-43af-46d9-bf80-ced1a84e3580" status: 202 len: 0 microversion: 2.1 time: 3.545781 Jul 28 11:26:30.213927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 196/373] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:26:26 2022] DELETE /compute/v2.1/os-floating-ips/426c99e4-43af-46d9-bf80-ced1a84e3580 => generated 0 bytes in 3549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:30.223838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a4694e5a-5f2d-480b-967c-bffc8999cc76 req-449705c7-b21d-4454-81c2-2d5424420191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5591b2a9-3128-4b07-8a65-50f2690e9064", "name": "network-vif-unplugged", "status": "completed", "tag": "2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:30.247468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a4694e5a-5f2d-480b-967c-bffc8999cc76 req-449705c7-b21d-4454-81c2-2d5424420191 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.247895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a4694e5a-5f2d-480b-967c-bffc8999cc76 req-449705c7-b21d-4454-81c2-2d5424420191 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.275599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a4694e5a-5f2d-480b-967c-bffc8999cc76 req-449705c7-b21d-4454-81c2-2d5424420191 service nova] Creating event network-vif-unplugged:2cf609a8-d9d7-4be5-9bf1-d3161e3ab60a for instance 5591b2a9-3128-4b07-8a65-50f2690e9064 on n-h2-851368-1 Jul 28 11:26:30.285689 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a4694e5a-5f2d-480b-967c-bffc8999cc76 req-449705c7-b21d-4454-81c2-2d5424420191 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068900 Jul 28 11:26:30.291916 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 197/374] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:30.301558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:30.302740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:30.313759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.314644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.316138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.316771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.342643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:30.482488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a7799981-dc54-4a07-8697-37125ccd5e28 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7799981-dc54-4a07-8697-37125ccd5e28 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Request method failure captured: Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/flavors/1844698287/action HTTP/1.1 Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 67 Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJeuoLX3cIe-i1RSYcWwnayD_uVzNlXgWelc44YajZcVN3oX6iTcJ0_12aeMHmqExVuyRSYTkaZEe_YVfEP9I0KqcNfnquCZOyXd3fxjP1KMB8YyoAuXaWF5DJemnERwvA8XN8R3nBiXtn96tyNn2od2jidaIhFfXDMWbDi3U10fFs Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:30.486107 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}] Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: a9157ebeaabf445cbade18f080632876 Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} Jul 28 11:26:30.487689 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1844698287', 'body': {'addTenantAccess': {'tenant': '5fc88f00484d47758b27376dce0af826'}}} Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:26:30.488586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-5fc88f00484d47758b27376dce0af826' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 11:26:30.489820 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 11:26:30.491064 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:26:30.493295 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-5fc88f00484d47758b27376dce0af826' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 11, 26, 30, 477741), 'updated_at': None, 'flavor_id': 29, 'project_id': '5fc88f00484d47758b27376dce0af826'}] Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:30.494338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:30.495357 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:30.496830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7799981-dc54-4a07-8697-37125ccd5e28 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 5fc88f00484d47758b27376dce0af826 combination. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7799981-dc54-4a07-8697-37125ccd5e28 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1844698287/action" status: 409 len: 152 microversion: 2.1 time: 0.412429 Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 178/375] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:30 2022] POST /compute/v2.1/flavors/1844698287/action => generated 152 bytes in 426 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:30.499338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:30.499831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:30.502620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.503091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.503902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.504365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.628548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:30.637867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ef8cc6e-da64-4ce7-a4fb-c4db33ab17ab tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1322 microversion: 2.1 time: 0.148110 Jul 28 11:26:30.652698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 179/376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:30 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:30.657620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-959e9402-4205-45a2-8e5a-56d9bb859aab tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1727839628", "id": 1350431354, "os-flavor-access:is_public": "False"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:30.660151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:30.661886 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:30.661886 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:30.683873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-542f0f94-46d2-4c4f-9a1b-922b69b5aad9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1462 microversion: 2.1 time: 0.386376 Jul 28 11:26:30.685667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-959e9402-4205-45a2-8e5a-56d9bb859aab tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.031800 Jul 28 11:26:30.687460 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 180/377] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:30.689219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 198/378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:30 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1462 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:30.694855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fdca2ae-0fb4-42ba-8c17-08d7b92cae75 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:30.697875 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:30.697875 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:30.698084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-68983dca-f7d7-461a-a7e8-8155ae2fe639 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb344f0d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:30.973075 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9fdca2ae-0fb4-42ba-8c17-08d7b92cae75 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1844698287/action" status: 200 len: 21 microversion: 2.1 time: 0.282452 Jul 28 11:26:30.974536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 199/379] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:30 2022] POST /compute/v2.1/flavors/1844698287/action => generated 21 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:26:30.981971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:30.982683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:30.988745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.989217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:30.989984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:30.990551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:31.103024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-68983dca-f7d7-461a-a7e8-8155ae2fe639 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.412026 Jul 28 11:26:31.109149 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 181/380] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Jul 28 11:26:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:26:31.113103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b14039c-a0c8-4b19-a413-05fde707f5d2 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:31.137715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b14039c-a0c8-4b19-a413-05fde707f5d2 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032927 Jul 28 11:26:31.138405 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 182/381] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:31 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:31.152677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:31.153307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:31.160142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:31.160599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:31.162884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:31.163459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:31.366135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:31.375530 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb164126-5cbb-44fb-b6f1-1aa601297caa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.398935 Jul 28 11:26:31.376106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 200/382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:30 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:31.448406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f6f0e7f-9d57-4824-9c56-9987b15a7f09 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Calling method '.version_select at 0x7f2eb34f31f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:31.508062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:31.523527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f6f0e7f-9d57-4824-9c56-9987b15a7f09 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 371 microversion: 2.1 time: 0.146135 Jul 28 11:26:31.524262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 201/383] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:26:31 2022] GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:31.529700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1794467e-0d62-4368-a3d9-a714509e076d tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:31.531260 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:31.531260 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:31.551010 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1794467e-0d62-4368-a3d9-a714509e076d tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1844698287" status: 202 len: 0 microversion: 2.1 time: 0.024567 Jul 28 11:26:31.551815 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 202/384] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:31 2022] DELETE /compute/v2.1/flavors/1844698287 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:31.557372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:31.558548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:31.566501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:31.567354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:31.568367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:31.569067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:31.593720 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7ceba9f-e5d0-4253-a87e-910f98a20433 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1613 microversion: 2.1 time: 0.454075 Jul 28 11:26:31.594553 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 183/385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:31 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1613 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:31.599302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad430a4e-405c-44ea-bfe8-2f980fd6c8b8 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb3548790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.304345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:32.313080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:32.314576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:32.315731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ab25af8-3c81-4815-b077-7dca53c54816 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.762981 Jul 28 11:26:32.316478 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 203/386] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:31 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:32.320830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2b2560b-dc71-41ab-844a-bf988e8a3259 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.343139 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2b2560b-dc71-41ab-844a-bf988e8a3259 tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025726 Jul 28 11:26:32.343714 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 204/387] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:32 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:32.348015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-238a45d3-c6f6-4687-9799-f00a106c4e80 req-e41a2cee-c670-42b3-8d9e-9f431ddfada4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:32.357590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-238a45d3-c6f6-4687-9799-f00a106c4e80 req-e41a2cee-c670-42b3-8d9e-9f431ddfada4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.358024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-238a45d3-c6f6-4687-9799-f00a106c4e80 req-e41a2cee-c670-42b3-8d9e-9f431ddfada4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.368823 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-238a45d3-c6f6-4687-9799-f00a106c4e80 req-e41a2cee-c670-42b3-8d9e-9f431ddfada4 service nova] Creating event network-changed:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h1-851368-1 Jul 28 11:26:32.374297 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-238a45d3-c6f6-4687-9799-f00a106c4e80 req-e41a2cee-c670-42b3-8d9e-9f431ddfada4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029440 Jul 28 11:26:32.374888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 205/388] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:32.379713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb3518820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:32.414159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad430a4e-405c-44ea-bfe8-2f980fd6c8b8 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.818245 Jul 28 11:26:32.424535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 184/389] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:26:31 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:32.428178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd7839e7-6cee-40cd-a7c9-21fc82c44ea3 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.448971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.449584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.450499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.451024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.457701 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd7839e7-6cee-40cd-a7c9-21fc82c44ea3 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041242 Jul 28 11:26:32.458293 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 185/390] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:32 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:32.465532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2713990-9d6f-4abf-a286-b33f915647d0 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '.version_select at 0x7f2eb34c3e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.471051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2713990-9d6f-4abf-a286-b33f915647d0 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.473937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2713990-9d6f-4abf-a286-b33f915647d0 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.488154 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2713990-9d6f-4abf-a286-b33f915647d0 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.028517 Jul 28 11:26:32.499795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 186/391] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:26:32 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:32.500154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.501201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:32.511647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.512598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.514070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.514882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.518542 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da0e2d7b-05e5-4e38-8f98-3b4b51cbd4f5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 328 microversion: 2.1 time: 0.142440 Jul 28 11:26:32.519770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 206/392] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:32 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:32.524838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dab4adc5-89f3-4144-a267-68d634429576 req-814b5e2f-aba2-4b41-a1fc-e594a45ed20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "name": "network-vif-plugged", "status": "completed", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:32.536273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dab4adc5-89f3-4144-a267-68d634429576 req-814b5e2f-aba2-4b41-a1fc-e594a45ed20f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.536963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dab4adc5-89f3-4144-a267-68d634429576 req-814b5e2f-aba2-4b41-a1fc-e594a45ed20f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.552905 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dab4adc5-89f3-4144-a267-68d634429576 req-814b5e2f-aba2-4b41-a1fc-e594a45ed20f service nova] Creating event network-vif-plugged:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h2-851368-1 Jul 28 11:26:32.560271 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dab4adc5-89f3-4144-a267-68d634429576 req-814b5e2f-aba2-4b41-a1fc-e594a45ed20f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038682 Jul 28 11:26:32.561630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 207/393] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:32.568322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b20562c0-fccc-4336-8fca-cba1fb5422d8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.569395 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:32.569395 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:32.599146 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b20562c0-fccc-4336-8fca-cba1fb5422d8 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1350431354" status: 202 len: 0 microversion: 2.1 time: 0.035850 Jul 28 11:26:32.604631 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 208/394] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:32 2022] DELETE /compute/v2.1/flavors/1350431354 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:32.611984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:32.613088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:32.639546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.640349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:32.641301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:32.641742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:33.022647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:33.030694 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3e93e10-e821-4ea8-be6c-57a6833c2898 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.538177 Jul 28 11:26:33.032171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:33.039648 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef6267ad-a9cd-4147-90bc-72f1f639dfeb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1311 microversion: 2.1 time: 0.432994 Jul 28 11:26:33.054309 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 209/395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:32 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:33.054500 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 187/396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:32 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:33.054596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a925c0f9-a513-46a2-9915-985405be61c5 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb34d9310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:33.054710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb5ad821-2748-4cb4-8301-f0ed643da36f tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1326504906", "id": 655107324, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:33.054710 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:33.054710 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:33.063326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:33.069376 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb5ad821-2748-4cb4-8301-f0ed643da36f tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024107 Jul 28 11:26:33.069985 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 188/397] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:33 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:33.074774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99d9f035-8859-44c7-8430-a773b4c4de3f tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:33.099138 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-99d9f035-8859-44c7-8430-a773b4c4de3f tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6245 microversion: 2.1 time: 0.028029 Jul 28 11:26:33.100079 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 189/398] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:33 2022] GET /compute/v2.1/flavors/detail => generated 6245 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:33.104947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1202644415", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:33.167763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:33.754199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:33.754712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:33.755144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:33.755562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:33.756016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:33.765173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:33.765624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:33.766443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:33.766923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:33.785487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:33.789637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:33.801802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:26:33.804160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:26:33.850036 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfd0dc64-802b-4a66-9288-2c08e0468281 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748627 Jul 28 11:26:33.855391 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 190/399] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:26:33.921636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-609774609", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:33.982251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:34.359378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:34.359796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:34.360267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:34.360708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:34.361114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:34.369721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.370159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.370951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.371416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.387888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a925c0f9-a513-46a2-9915-985405be61c5 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/fc397e18-d9b5-4db0-bf38-b391aced99aa" status: 202 len: 0 microversion: 2.1 time: 1.346191 Jul 28 11:26:34.388376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:34.388526 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 210/400] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:26:33 2022] DELETE /compute/v2.1/os-floating-ips/fc397e18-d9b5-4db0-bf38-b391aced99aa => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:34.393214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cdbbd016-a601-4b5f-960e-cb40123dfbbb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.394055 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:34.394055 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:34.395521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for user 22dd92205f7d494e98b9574be721b7b9 and project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:34.401017 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-cdbbd016-a601-4b5f-960e-cb40123dfbbb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cdbbd016-a601-4b5f-960e-cb40123dfbbb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Request method failure captured: Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/flavors/655107324/os-flavor-access HTTP/1.1 Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJeuoLX3cIe-i1RSYcWwnayD_uVzNlXgWelc44YajZcVN3oX6iTcJ0_12aeMHmqExVuyRSYTkaZEe_YVfEP9I0KqcNfnquCZOyXd3fxjP1KMB8YyoAuXaWF5DJemnERwvA8XN8R3nBiXtn96tyNn2od2jidaIhFfXDMWbDi3U10fFs Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:26:34.403394 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}] Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: a9157ebeaabf445cbade18f080632876 Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: exception: Access list not available for public flavors. Jul 28 11:26:34.404615 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'flavor_id': '655107324'} Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 28 11:26:34.405305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.406508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cdbbd016-a601-4b5f-960e-cb40123dfbbb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:34.406508 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cdbbd016-a601-4b5f-960e-cb40123dfbbb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/655107324/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015125 Jul 28 11:26:34.406508 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 211/401] 10.222.0.93 () {58 vars in 1206 bytes} [Thu Jul 28 11:26:34 2022] GET /compute/v2.1/flavors/655107324/os-flavor-access => generated 91 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:34.415485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.utils [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] cores quota exceeded for f713505b1a2345e9a24b56a0f6a93241, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119236) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 11:26:34.416165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7508a439-51b6-4084-9657-03a39acc22ef tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-380840343", "id": 1842440818, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:34.416310 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 11:26:34.420358 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:34.420358 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Request method failure captured: Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 144 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJme8KJgXS491XCgdebwNc5buDSmM-0dPLycala1lGFcMYhurIMrM5dRxrkghWpnn34tS-xuBqoXB7wRw3BNE-F5OLtNHRDF_lID04lZhaPEXJz2mVRXIk9yEKFTR68kICd0P-eNs5pPPPiHLaSvl0QNYdoJt6z1odkpRvPn8Wdqrw Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:34.420553 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}] Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 22dd92205f7d494e98b9574be721b7b9 Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-609774609", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} Jul 28 11:26:34.421983 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-609774609', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452'}}} Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 11:26:34.422843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:34.424177 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.425908 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6768046e-4779-4e21-bd10-a99bc55d5a14 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.570539 Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 191/402] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:33 2022] POST /compute/v2.1/servers => generated 111 bytes in 572 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:34.428061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.429317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:34.435857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.436941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.437665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.438135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.446634 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7508a439-51b6-4084-9657-03a39acc22ef tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.039507 Jul 28 11:26:34.448034 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 212/403] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:34.459271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.459887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:34.466457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.466913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.467722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.468166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.580657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.588137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de979bed-18ff-49cd-aaa2-06f11469e251 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1217 microversion: 2.1 time: 0.132624 Jul 28 11:26:34.588703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 213/404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:34 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:34.593861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.594462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:34.600389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.600805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.601626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.602073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.704171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.713575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.715661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.717059 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed6d2e04-4cfc-4926-abf0-43efbbd17e18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.293027 Jul 28 11:26:34.718109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 192/405] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:34 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:34.723682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.724893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:34.732204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.732783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.734119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:34.734561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:34.767692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.775646 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-979b2e5e-a11e-441a-8ebc-f863658dbf63 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.185304 Jul 28 11:26:34.776213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 214/406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:34 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:34.781484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69057760-f293-462f-98b4-711d4b883eda tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb34ea670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.957133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:34.964789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76d3a698-f03b-48f3-aa9d-763bc2a5a1ea tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1494 microversion: 2.1 time: 0.245332 Jul 28 11:26:34.965572 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 193/407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:34 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1494 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:34.969636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-03525c35-1920-4e9f-bae9-7894399eb34b tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:34.970389 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:34.970389 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:34.987494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-03525c35-1920-4e9f-bae9-7894399eb34b tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/655107324" status: 202 len: 0 microversion: 2.1 time: 0.021042 Jul 28 11:26:34.988080 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 194/408] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:34 2022] DELETE /compute/v2.1/flavors/655107324 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:34.992597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8ca779c2-0576-481a-a1f8-a2782e92d079 req-3209c8e8-9818-4d4a-876c-a613efc7c8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d4f6b0-68cb-4d66-997b-8ce975ce1e9f", "tag": "a605567d-901a-4631-92a9-83bee7fd875e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:35.002558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8ca779c2-0576-481a-a1f8-a2782e92d079 req-3209c8e8-9818-4d4a-876c-a613efc7c8fc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:35.003003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8ca779c2-0576-481a-a1f8-a2782e92d079 req-3209c8e8-9818-4d4a-876c-a613efc7c8fc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:35.014600 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8ca779c2-0576-481a-a1f8-a2782e92d079 req-3209c8e8-9818-4d4a-876c-a613efc7c8fc service nova] Creating event network-changed:a605567d-901a-4631-92a9-83bee7fd875e for instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f on n-h2-851368-1 Jul 28 11:26:35.019944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8ca779c2-0576-481a-a1f8-a2782e92d079 req-3209c8e8-9818-4d4a-876c-a613efc7c8fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030739 Jul 28 11:26:35.020525 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 195/409] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:35.025441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb347fa60>, body: {"quota_set": {"cores": 20}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:35.093664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:35.093664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:35.093664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:35.094280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:35.157289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6d2fc26-7663-4a60-8e04-c84d4290a74d tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 329 microversion: 2.1 time: 0.135198 Jul 28 11:26:35.165455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 196/410] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:35 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 329 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:35.165455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7162c664-5ac3-41ac-900c-176d1d8cbb7d tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:35.186197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7162c664-5ac3-41ac-900c-176d1d8cbb7d tempest-FlavorsAdminTestJSON-1407388317 tempest-FlavorsAdminTestJSON-1407388317-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.026662 Jul 28 11:26:35.186768 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 197/411] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:35 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:35.322906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:35.323760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:35.330497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:35.331044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:35.331898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:35.332393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:35.865229 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b81026b3-d9a8-42b5-a16b-ab103ca56a8e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1645 microversion: 2.1 time: 0.677400 Jul 28 11:26:35.865951 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 198/412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:35 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1645 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:35.870859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-797285b6-e6a4-4990-b02e-a16a59803d5d tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:35.894465 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-797285b6-e6a4-4990-b02e-a16a59803d5d tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.027160 Jul 28 11:26:35.895459 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 199/413] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:35 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:35.900247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae6e06eb-bd51-47c4-a49b-6afbb4b5ea50 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Calling method '.version_select at 0x7f2eb34cedc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:35.991817 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae6e06eb-bd51-47c4-a49b-6afbb4b5ea50 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 371 microversion: 2.1 time: 0.095045 Jul 28 11:26:35.992466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 200/414] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:26:35 2022] GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:36.005861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91a23a2a-2559-4e0e-97c9-6a70a6be0353 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.007276 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:36.007276 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:36.036084 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91a23a2a-2559-4e0e-97c9-6a70a6be0353 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1842440818" status: 202 len: 0 microversion: 2.1 time: 0.035359 Jul 28 11:26:36.041627 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 201/415] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:35 2022] DELETE /compute/v2.1/flavors/1842440818 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:36.047698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.048669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:36.055674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.056416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.057797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.058612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.080030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:36.170549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:36.179515 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7d18b9e-3777-4802-a0b9-21e3df9ed373 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1271 microversion: 2.1 time: 0.135825 Jul 28 11:26:36.180353 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 202/416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:36 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:36.194863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.195524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:36.202679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.203394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.204195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.205521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.378410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69057760-f293-462f-98b4-711d4b883eda tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/9141359a-c131-476e-ac97-6ad433e3b7fa" status: 202 len: 0 microversion: 2.1 time: 1.600512 Jul 28 11:26:36.383957 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 215/417] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:26:34 2022] DELETE /compute/v2.1/os-floating-ips/9141359a-c131-476e-ac97-6ad433e3b7fa => generated 0 bytes in 1607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:36.388772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.389393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:36.395487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.395939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.396894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.397494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.606469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:36.615461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:36.620970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:36.624888 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e71b6ba-7689-4612-ae80-0cb0e37bde87 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.443789 Jul 28 11:26:36.625589 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 203/418] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:36 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:36.630834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.631745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:36.639529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.640304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.641322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:36.641987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:36.814859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:36.824115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d653069-c182-4c1a-be71-18a8c4930435 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.438485 Jul 28 11:26:36.843657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 216/419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:36 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:36.854207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b75a6cea-9559-4cc1-af05-d89804853528 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2137207960", "id": 704048889, "os-flavor-access:is_public": "False"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:36.862137 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:36.862137 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:36.891341 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b75a6cea-9559-4cc1-af05-d89804853528 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.057697 Jul 28 11:26:36.892133 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 217/420] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:36.898501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb34f34c0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:36.948317 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-66e27579-facc-4aac-8e9e-ef5eb249b232 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1645 microversion: 2.1 time: 0.318157 Jul 28 11:26:36.951026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 204/421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:36 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1645 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:36.958710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d35156cc-dcd9-46d7-9484-ddbd2be59c52 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:36.996569 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d35156cc-dcd9-46d7-9484-ddbd2be59c52 tempest-FlavorsAdminTestJSON-153386020 tempest-FlavorsAdminTestJSON-153386020-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.044224 Jul 28 11:26:37.007282 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 205/422] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:37.022628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=49 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:37.027938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.028586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.029991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-298b689c-0417-4352-a5d6-49349d343950 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] Calling method '.version_select at 0x7f2eb3548310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:37.030271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.030953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.105570 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abadb7c2-a91e-4efe-8b31-9a8e9f9461e5 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 328 microversion: 2.1 time: 0.208708 Jul 28 11:26:37.107238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 218/423] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:36 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 328 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:37.313612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb7de644-c5b2-47ac-8bd9-e27b9aa922d8 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:37.318232 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:37.318232 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:37.321447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb7de644-c5b2-47ac-8bd9-e27b9aa922d8 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bb22815fb52d4950a89ce2ee20fe51d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc88f00484d47758b27376dce0af826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb7de644-c5b2-47ac-8bd9-e27b9aa922d8 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Request method failure captured: Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/flavors/704048889/action HTTP/1.1 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 67 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJevxcgm3WmEorOBIG1jok_00qH8I0wa5uwyijHlXlfRtLuaz2swqhIXrWl0I5VYPkC3_VgftJsXRsXc2ha1TY4zG8H2SJ5PLzPxcbEZ8OK9bOqv-KEECv_IERRyLKPyHgw_Ncs5tq9fzL9J92ip3PhVvYXfvCcdIgOnIBwPFmMAbc Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5fc88f00484d47758b27376dce0af826 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:37.326601 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5fc88f00484d47758b27376dce0af826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5fc88f00484d47758b27376dce0af826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5fc88f00484d47758b27376dce0af826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5fc88f00484d47758b27376dce0af826"}]}] Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5fc88f00484d47758b27376dce0af826 Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsAccessNegativeTestJSON-1416896986-project Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: bb22815fb52d4950a89ce2ee20fe51d5 Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986-project Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} Jul 28 11:26:37.328213 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '704048889', 'body': {'addTenantAccess': {'tenant': '5fc88f00484d47758b27376dce0af826'}}} Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:37.328998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 11:26:37.330588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:37.335845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb7de644-c5b2-47ac-8bd9-e27b9aa922d8 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:37.338840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb7de644-c5b2-47ac-8bd9-e27b9aa922d8 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] 10.222.0.93 "POST /compute/v2.1/flavors/704048889/action" status: 403 len: 130 microversion: 2.1 time: 0.230080 Jul 28 11:26:37.342699 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 219/424] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Jul 28 11:26:37 2022] POST /compute/v2.1/flavors/704048889/action => generated 130 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:37.356024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:37.359957 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:37.359957 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:37.361602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.362269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.363767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.364687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.402092 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58be9c83-5ff3-46cf-8727-3b8fa851c1b0 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056865 Jul 28 11:26:37.422629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 220/425] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:26:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:37.440180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:37.440910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:37.450766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.451591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.452976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.453754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.804247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:37.812599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-84f856b6-47be-4700-8e16-aa38468e458d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.387483 Jul 28 11:26:37.813295 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 221/426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:37 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:37.817937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9a6c4e3-c46a-420d-a548-ef18f5e3e079 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:37.818855 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:37.818855 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:37.841321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9a6c4e3-c46a-420d-a548-ef18f5e3e079 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/704048889" status: 202 len: 0 microversion: 2.1 time: 0.026686 Jul 28 11:26:37.841893 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 222/427] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:26:37 2022] DELETE /compute/v2.1/flavors/704048889 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:37.850277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:37.852794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:37.860943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.861391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.862163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:37.862594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:37.937137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lazy-loading 'flavor' on Instance uuid 700eda5f-3857-46a7-9490-37f5f31aa2df {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:38.006794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Going to try to live migrate instance to n-h1-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:26:38.282112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-298b689c-0417-4352-a5d6-49349d343950 tempest-FloatingIPDetailsTestJSON-1429222514 tempest-FloatingIPDetailsTestJSON-1429222514-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/f92b8db9-9619-48a1-a548-d7bb3130a508" status: 202 len: 0 microversion: 2.1 time: 1.268689 Jul 28 11:26:38.282770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 206/428] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:26:37 2022] DELETE /compute/v2.1/os-floating-ips/f92b8db9-9619-48a1-a548-d7bb3130a508 => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:38.287707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-de288049-7314-4ac5-aff2-7d3cd387c62f req-6b6d0d09-8663-44a3-9859-72122cb5a1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:38.311900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-de288049-7314-4ac5-aff2-7d3cd387c62f req-6b6d0d09-8663-44a3-9859-72122cb5a1dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:38.312808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-de288049-7314-4ac5-aff2-7d3cd387c62f req-6b6d0d09-8663-44a3-9859-72122cb5a1dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:38.343337 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-de288049-7314-4ac5-aff2-7d3cd387c62f req-6b6d0d09-8663-44a3-9859-72122cb5a1dc service nova] Creating event network-changed:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h1-851368-1 Jul 28 11:26:38.353930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-de288049-7314-4ac5-aff2-7d3cd387c62f req-6b6d0d09-8663-44a3-9859-72122cb5a1dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069857 Jul 28 11:26:38.354375 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 207/429] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:38.362651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1442851644", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:38.428485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:38.863161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:38.863658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:38.864235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:38.864792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:38.866445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:38.887808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:38.888432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:38.889868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:38.894326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:38.926815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:38.935239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for user 22dd92205f7d494e98b9574be721b7b9 and project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:38.955536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.utils [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] instances quota exceeded for f713505b1a2345e9a24b56a0f6a93241, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119236) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 11:26:38.956516 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Request method failure captured: Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 145 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJme8KJgXS491XCgdebwNc5buDSmM-0dPLycala1lGFcMYhurIMrM5dRxrkghWpnn34tS-xuBqoXB7wRw3BNE-F5OLtNHRDF_lID04lZhaPEXJz2mVRXIk9yEKFTR68kICd0P-eNs5pPPPiHLaSvl0QNYdoJt6z1odkpRvPn8Wdqrw Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:38.959099 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}] Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 22dd92205f7d494e98b9574be721b7b9 Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1442851644", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} Jul 28 11:26:38.960793 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1442851644', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452'}}} Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 11:26:38.961718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:38.963125 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.964392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 11:26:38.965873 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:38.967356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:38.968403 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5989195a-41cc-4a7f-b3cf-d04cf2191096 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.612017 Jul 28 11:26:38.969514 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 208/430] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:38 2022] POST /compute/v2.1/servers => generated 119 bytes in 614 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:38.975280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:38.976228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:38.982735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:38.984987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:38.994528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:38.996278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:38.998440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:39.242441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:39.253055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:39.254584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:39.255744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e078134c-154b-4d33-8525-6a6a8574d8a3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.285010 Jul 28 11:26:39.257177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 209/431] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:38 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:39.262172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:39.263030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:39.269797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:39.270611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:39.271635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:39.272289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:39.743388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:39.763952 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc4f3c2b-689a-4e8b-9218-9b6b16701de5 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.505413 Jul 28 11:26:39.764531 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 210/432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:39 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:39.775347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-960010ae-40e9-4248-b95f-923833d6df97 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:39.801489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-960010ae-40e9-4248-b95f-923833d6df97 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031032 Jul 28 11:26:39.802074 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 211/433] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:39 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:39.806710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-eab4a5c6-c9d9-419b-a336-4aaa18c8d061 req-18d2008d-4dbb-44d6-9786-18f27f3dadbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "name": "network-vif-plugged", "status": "completed", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:39.820726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eab4a5c6-c9d9-419b-a336-4aaa18c8d061 req-18d2008d-4dbb-44d6-9786-18f27f3dadbe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:39.821175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eab4a5c6-c9d9-419b-a336-4aaa18c8d061 req-18d2008d-4dbb-44d6-9786-18f27f3dadbe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:39.835148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-eab4a5c6-c9d9-419b-a336-4aaa18c8d061 req-18d2008d-4dbb-44d6-9786-18f27f3dadbe service nova] Creating event network-vif-plugged:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h1-851368-1 Jul 28 11:26:39.840922 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-eab4a5c6-c9d9-419b-a336-4aaa18c8d061 req-18d2008d-4dbb-44d6-9786-18f27f3dadbe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037478 Jul 28 11:26:39.841523 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 212/434] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:39.847272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:39.848015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:39.854746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:39.855235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:39.856045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:39.856480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:40.168088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:40.195021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4024dc8f-2e86-4068-88b2-2a0ee2523144 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.352163 Jul 28 11:26:40.221356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 213/435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:39 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:40.234336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb33890d0>, body: {"quota_set": {"instances": 10}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:40.492421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:40.492874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:40.493689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:40.494132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:40.597114 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a6554d8-e6e0-480c-bea5-4216505e98e9 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 329 microversion: 2.1 time: 0.374295 Jul 28 11:26:40.598043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 214/436] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:40 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 329 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:40.602907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ba942c0-bfee-4906-bd53-36041bbe65d4 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-450011431", "id": 1160484100, "os-flavor-access:is_public": "False"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:40.606952 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:40.606952 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:40.627110 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ba942c0-bfee-4906-bd53-36041bbe65d4 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.027661 Jul 28 11:26:40.627909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 215/437] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:40.639664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:40.640281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:40.646121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:40.646574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:40.647376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:40.647818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:40.803437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:40.816677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:40.818805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:40.820404 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9aa5a398-d751-4ea4-aee0-0f17618b8640 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1361 microversion: 2.25 time: 0.184463 Jul 28 11:26:40.820976 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 216/438] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:40 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:40.825624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f717383-6dae-43e0-bb2c-f68b9c273bff tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Calling method '.version_select at 0x7f2eb339c310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:41.039970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f717383-6dae-43e0-bb2c-f68b9c273bff tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 371 microversion: 2.1 time: 0.217757 Jul 28 11:26:41.041597 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 217/439] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:26:40 2022] GET /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:41.053067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc91ee59-f764-4ce0-89c2-616bfe0cebb7 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:41.056441 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:41.056441 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:41.240949 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc91ee59-f764-4ce0-89c2-616bfe0cebb7 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1160484100/action" status: 200 len: 97 microversion: 2.1 time: 0.197005 Jul 28 11:26:41.247121 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 218/440] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:41 2022] POST /compute/v2.1/flavors/1160484100/action => generated 97 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:26:41.309547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3784c57-b595-45d4-91b2-c29c5af081de tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1272499491", "id": 792410862, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:41.312391 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:41.312391 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:41.330391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3784c57-b595-45d4-91b2-c29c5af081de tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.087557 Jul 28 11:26:41.335620 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 219/441] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:26:41 2022] POST /compute/v2.1/flavors => generated 446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:41.348482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:41.349488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:41.355946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.356674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.357463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.357902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.498809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:41.506643 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcd28a4e-9340-4330-927e-1dd52db3d192 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.174232 Jul 28 11:26:41.507191 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 220/442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:41 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:41.511971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb35365e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:41.571989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.572438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.573896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.574367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.622601 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-78e596b7-8393-433a-a701-b3844b0ed6c8 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 325 microversion: 2.1 time: 0.114339 Jul 28 11:26:41.623389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 221/443] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:41 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:41.627947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:41.628567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:41.640760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.641531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.642331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:41.642909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:41.838907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:41.848171 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92096a3b-470a-4d52-bc49-a2392d5d7bcb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.223713 Jul 28 11:26:41.849710 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 222/444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:41 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:41.860000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e933371f-e02b-4084-9aeb-0be62b2c37b2 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:41.863441 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:41.863441 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:41.864999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e933371f-e02b-4084-9aeb-0be62b2c37b2 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bb22815fb52d4950a89ce2ee20fe51d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc88f00484d47758b27376dce0af826', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e933371f-e02b-4084-9aeb-0be62b2c37b2 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Request method failure captured: Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/flavors/1160484100/action HTTP/1.1 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 70 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJevxcgm3WmEorOBIG1jok_00qH8I0wa5uwyijHlXlfRtLuaz2swqhIXrWl0I5VYPkC3_VgftJsXRsXc2ha1TY4zG8H2SJ5PLzPxcbEZ8OK9bOqv-KEECv_IERRyLKPyHgw_Ncs5tq9fzL9J92ip3PhVvYXfvCcdIgOnIBwPFmMAbc Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5fc88f00484d47758b27376dce0af826 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:41.867161 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5fc88f00484d47758b27376dce0af826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5fc88f00484d47758b27376dce0af826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5fc88f00484d47758b27376dce0af826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5fc88f00484d47758b27376dce0af826"}]}] Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5fc88f00484d47758b27376dce0af826 Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986 Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsAccessNegativeTestJSON-1416896986-project Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: bb22815fb52d4950a89ce2ee20fe51d5 Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1416896986-project Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: {"removeTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} Jul 28 11:26:41.868628 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1160484100', 'body': {'removeTenantAccess': {'tenant': '5fc88f00484d47758b27376dce0af826'}}} Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can( Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:41.869451 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 11:26:41.871431 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:41.874226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e933371f-e02b-4084-9aeb-0be62b2c37b2 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:41.876837 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e933371f-e02b-4084-9aeb-0be62b2c37b2 tempest-FlavorsAccessNegativeTestJSON-1416896986 tempest-FlavorsAccessNegativeTestJSON-1416896986-project] 10.222.0.93 "POST /compute/v2.1/flavors/1160484100/action" status: 403 len: 133 microversion: 2.1 time: 0.024518 Jul 28 11:26:41.878003 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 223/445] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:41 2022] POST /compute/v2.1/flavors/1160484100/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:42.016608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85368b43-e798-435c-90e3-b15427e8895f tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:42.029809 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85368b43-e798-435c-90e3-b15427e8895f tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] 10.222.0.93 "GET /compute/v2.1/flavors/792410862" status: 200 len: 446 microversion: 2.55 time: 0.150385 Jul 28 11:26:42.030504 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 224/446] 10.222.0.93 () {60 vars in 1196 bytes} [Thu Jul 28 11:26:41 2022] GET /compute/v2.1/flavors/792410862 => generated 446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:42.040321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1015599074", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:42.107606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:42.221144 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-534bf8f6-cbb3-461f-b331-e7063fa924fa tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df/action" status: 202 len: 0 microversion: 2.1 time: 4.377264 Jul 28 11:26:42.222925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 223/447] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:26:37 2022] POST /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df/action => generated 0 bytes in 4380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:42.248932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:42.253326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:42.273276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.273748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.274550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.274990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.410180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:42.410604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:42.411108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:42.411497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:42.411906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:42.422517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.422979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.424113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.424556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.443918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:26:42.448999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Getting quotas for user 22dd92205f7d494e98b9574be721b7b9 and project f713505b1a2345e9a24b56a0f6a93241. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:26:42.462611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.utils [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] ram quota exceeded for f713505b1a2345e9a24b56a0f6a93241, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119236) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 11:26:42.463355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Request method failure captured: Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 145 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJme8KJgXS491XCgdebwNc5buDSmM-0dPLycala1lGFcMYhurIMrM5dRxrkghWpnn34tS-xuBqoXB7wRw3BNE-F5OLtNHRDF_lID04lZhaPEXJz2mVRXIk9yEKFTR68kICd0P-eNs5pPPPiHLaSvl0QNYdoJt6z1odkpRvPn8Wdqrw Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:42.465976 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}] Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 22dd92205f7d494e98b9574be721b7b9 Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1015599074", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} Jul 28 11:26:42.467486 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1015599074', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452'}}} Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 11:26:42.468288 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1679, in _create_instance Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:42.469497 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.470852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd113ff1-fd18-439d-b617-bd9e481c8b5c tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.436641 Jul 28 11:26:42.475892 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 225/448] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 440 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:42.476620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e64016e5-5f32-43ec-bc53-21565fcdd8cb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5fc88f00484d47758b27376dce0af826"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:42.479043 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:42.479043 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:42.511060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:42.520951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:42.523354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:42.524714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3636ce5-a258-4538-805e-80bfd138b930 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1557 microversion: 2.25 time: 0.299906 Jul 28 11:26:42.525718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 224/449] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:42 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1557 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:42.531390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-12637361-653e-405c-94e2-04510121b312 req-9521701a-406d-4355-a13a-449b8ec2360c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d4f6b0-68cb-4d66-997b-8ce975ce1e9f", "name": "network-vif-plugged", "status": "completed", "tag": "a605567d-901a-4631-92a9-83bee7fd875e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:42.545722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-12637361-653e-405c-94e2-04510121b312 req-9521701a-406d-4355-a13a-449b8ec2360c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.546399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-12637361-653e-405c-94e2-04510121b312 req-9521701a-406d-4355-a13a-449b8ec2360c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.560021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-12637361-653e-405c-94e2-04510121b312 req-9521701a-406d-4355-a13a-449b8ec2360c service nova] Creating event network-vif-plugged:a605567d-901a-4631-92a9-83bee7fd875e for instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f on n-h2-851368-1 Jul 28 11:26:42.565191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-12637361-653e-405c-94e2-04510121b312 req-9521701a-406d-4355-a13a-449b8ec2360c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037383 Jul 28 11:26:42.565890 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 225/450] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:42.571212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20cdb917-3164-49a4-8009-183a6881d50e tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb9b46310>, body: {"flavor": {"description": "new"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:42.583879 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:42.583879 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:42.608592 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e64016e5-5f32-43ec-bc53-21565fcdd8cb tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1160484100/action" status: 200 len: 21 microversion: 2.1 time: 0.131726 Jul 28 11:26:42.611114 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 226/451] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:42 2022] POST /compute/v2.1/flavors/1160484100/action => generated 21 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:26:42.616457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20cdb917-3164-49a4-8009-183a6881d50e tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/792410862" status: 200 len: 447 microversion: 2.55 time: 0.049269 Jul 28 11:26:42.617443 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 226/452] 10.222.0.93 () {62 vars in 1216 bytes} [Thu Jul 28 11:26:42 2022] PUT /compute/v2.1/flavors/792410862 => generated 447 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:42.622622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb346f310>, body: {"quota_set": {"ram": 51200}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:42.623020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:42.623682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:42.639441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.640145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.641143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.642029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.721832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:42.737542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.738300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.739588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.740655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.757830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=15 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:42.876877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-395fde94-ea40-4de7-92b0-8f8827f70043 tempest-QuotasAdminNegativeTest-1561977508 tempest-QuotasAdminNegativeTest-1561977508-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 200 len: 329 microversion: 2.1 time: 0.257383 Jul 28 11:26:42.887667 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 227/453] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:42 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 329 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:42.911507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:42.913086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:42.925713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.926170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.927404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:42.927850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:42.996539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:43.008043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1a251cf-29b6-437f-9529-f72a0935e874 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.391948 Jul 28 11:26:43.010238 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 227/454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:42 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:43.105354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:43.116472 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2360b2bf-15c9-44d5-8cc9-d7b133c9bea4 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1390 microversion: 2.1 time: 0.217764 Jul 28 11:26:43.117860 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 228/455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:42 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:43.122884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b6d5546-10dc-47d9-bd0a-b2d717d36a89 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.123776 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:43.123776 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:43.159641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b6d5546-10dc-47d9-bd0a-b2d717d36a89 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1160484100" status: 202 len: 0 microversion: 2.1 time: 0.040317 Jul 28 11:26:43.160443 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 229/456] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:43 2022] DELETE /compute/v2.1/flavors/1160484100 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:43.168508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-619173ca-f75d-436e-a07f-9c44e6c3da04 tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.177287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.178121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:43.187769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.189091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.190344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.191042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.224078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-619173ca-f75d-436e-a07f-9c44e6c3da04 tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.061905 Jul 28 11:26:43.225797 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 230/457] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:43.230728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.231429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:43.243137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.243987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.246297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.247376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.416732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:43.443752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:43.464227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4f88b87-2d05-4d51-884d-8da830fe22ba tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.237318 Jul 28 11:26:43.465436 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 231/458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:43.470683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1c97531-aaea-4804-8719-5d321abb3141 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Action: 'update', calling method: .version_select at 0x7f2eb33c93a0>, body: {"quota_set": {"ram": 0}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:43.476298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d1c97531-aaea-4804-8719-5d321abb3141 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '22dd92205f7d494e98b9574be721b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f713505b1a2345e9a24b56a0f6a93241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1c97531-aaea-4804-8719-5d321abb3141 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Request method failure captured: Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 HTTP/1.1 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 25 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJme8KJgXS491XCgdebwNc5buDSmM-0dPLycala1lGFcMYhurIMrM5dRxrkghWpnn34tS-xuBqoXB7wRw3BNE-F5OLtNHRDF_lID04lZhaPEXJz2mVRXIk9yEKFTR68kICd0P-eNs5pPPPiHLaSvl0QNYdoJt6z1odkpRvPn8Wdqrw Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:43.478992 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f713505b1a2345e9a24b56a0f6a93241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f713505b1a2345e9a24b56a0f6a93241"}]}] Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: f713505b1a2345e9a24b56a0f6a93241 Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-500211463 Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 22dd92205f7d494e98b9574be721b7b9 Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-QuotasAdminNegativeTest-500211463-project Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: {"quota_set": {"ram": 0}} Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 11:26:43.481114 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f713505b1a2345e9a24b56a0f6a93241', 'body': {'quota_set': {'ram': 0}}} Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:43.486403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.487799 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1c97531-aaea-4804-8719-5d321abb3141 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1c97531-aaea-4804-8719-5d321abb3141 tempest-QuotasAdminNegativeTest-500211463 tempest-QuotasAdminNegativeTest-500211463-project] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241" status: 403 len: 116 microversion: 2.1 time: 0.014416 Jul 28 11:26:43.489361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 232/459] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:26:43 2022] PUT /compute/v2.1/os-quota-sets/f713505b1a2345e9a24b56a0f6a93241 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:43.494528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b094ad61-cecb-45d7-8a0e-e7c450450d1a tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.513190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ea4ebab-4287-4637-a775-3c5f2da571d7 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 2049 microversion: 2.25 time: 0.500616 Jul 28 11:26:43.514049 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 228/460] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 2049 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:43.528029 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b094ad61-cecb-45d7-8a0e-e7c450450d1a tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.044794 Jul 28 11:26:43.535635 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 233/461] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:43.536491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4ae4bd5-5a26-4bbb-a46c-04ecc6b0abef tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.561218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.562027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:43.568013 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4ae4bd5-5a26-4bbb-a46c-04ecc6b0abef tempest-FlavorsV255TestJSON-1088390722 tempest-FlavorsV255TestJSON-1088390722-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.052457 Jul 28 11:26:43.568811 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 229/462] 10.222.0.93 () {60 vars in 1166 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:43.573397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.574257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b0f9d65-97ef-4129-a853-f4f27c07fde7 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-103435407", "id": 1929200846, "os-flavor-access:is_public": "False"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:43.574555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.576072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.576935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.577843 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:43.577843 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:43.597499 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b0f9d65-97ef-4129-a853-f4f27c07fde7 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.027323 Jul 28 11:26:43.599032 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 230/463] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:43 2022] POST /compute/v2.1/flavors => generated 438 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:43.605017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b2a5a16-9659-4fdb-a36a-146eb3775c31 tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.606154 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:43.606154 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:43.625270 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b2a5a16-9659-4fdb-a36a-146eb3775c31 tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/792410862" status: 202 len: 0 microversion: 2.55 time: 0.024683 Jul 28 11:26:43.626532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 231/464] 10.222.0.93 () {60 vars in 1199 bytes} [Thu Jul 28 11:26:43 2022] DELETE /compute/v2.1/flavors/792410862 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:43.631736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6a5b7ef-cf95-48c8-a89e-92300edb2392 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "571c991e97e943d1a2c478da92b7c621"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:43.634360 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:43.634360 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:43.710686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:43.727252 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c6a5b7ef-cf95-48c8-a89e-92300edb2392 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] HTTP exception thrown: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6a5b7ef-cf95-48c8-a89e-92300edb2392 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Request method failure captured: Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/flavors/1929200846/action HTTP/1.1 Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 70 Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJeuoLX3cIe-i1RSYcWwnayD_uVzNlXgWelc44YajZcVN3oX6iTcJ0_12aeMHmqExVuyRSYTkaZEe_YVfEP9I0KqcNfnquCZOyXd3fxjP1KMB8YyoAuXaWF5DJemnERwvA8XN8R3nBiXtn96tyNn2od2jidaIhFfXDMWbDi3U10fFs Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:43.731385 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb90f4547b6e4a479065e4fb25e6a2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb90f4547b6e4a479065e4fb25e6a2de"}]}] Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: eb90f4547b6e4a479065e4fb25e6a2de Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-183808692 Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: a9157ebeaabf445cbade18f080632876 Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: {"removeTenantAccess": {"tenant": "571c991e97e943d1a2c478da92b7c621"}} Jul 28 11:26:43.732752 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1929200846', 'body': {'removeTenantAccess': {'tenant': '571c991e97e943d1a2c478da92b7c621'}}} Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 28 11:26:43.738414 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.740061 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6a5b7ef-cf95-48c8-a89e-92300edb2392 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Returning 404 to user: Flavor access not found for 36 / 571c991e97e943d1a2c478da92b7c621 combination. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c6a5b7ef-cf95-48c8-a89e-92300edb2392 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1929200846/action" status: 404 len: 124 microversion: 2.1 time: 0.105136 Jul 28 11:26:43.741458 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 232/465] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Jul 28 11:26:43 2022] POST /compute/v2.1/flavors/1929200846/action => generated 124 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:43.742340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60e672b1-e34c-42aa-b15c-d913884d3ccf tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.757629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:43.771649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:43.792935 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60e672b1-e34c-42aa-b15c-d913884d3ccf tempest-FlavorsV255TestJSON-588077440 tempest-FlavorsV255TestJSON-588077440-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.056293 Jul 28 11:26:43.793463 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 233/466] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:43.798880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-702f7186-d035-440c-98c5-e850dd841834 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.836914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b09fe840-0651-4bd5-9cdd-b754b3982235 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 2049 microversion: 2.25 time: 0.300078 Jul 28 11:26:43.845619 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 234/467] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 2049 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:43.865197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.868395 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:43.868395 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:43.870281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.872403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.873656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.874261 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-702f7186-d035-440c-98c5-e850dd841834 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1929200846" status: 202 len: 0 microversion: 2.1 time: 0.078877 Jul 28 11:26:43.874454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.875065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 234/468] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:26:43 2022] DELETE /compute/v2.1/flavors/1929200846 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:43.884432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-58bf29fe-d685-4234-b1d7-5770e695afa1 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:43.907315 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b501424a-9c34-4223-846e-f266e025ec1c tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048078 Jul 28 11:26:43.915464 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 235/469] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:43.921280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851368-1", "block_migration": "auto"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:43.924886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:43.927354 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-58bf29fe-d685-4234-b1d7-5770e695afa1 tempest-FlavorsAccessNegativeTestJSON-183808692 tempest-FlavorsAccessNegativeTestJSON-183808692-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.047359 Jul 28 11:26:43.928857 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 235/470] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:26:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:43.938554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.939167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.939484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:43.940110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:43.969817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'flavor' on Instance uuid ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:26:43.994465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Going to try to live migrate instance to n-h2-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:26:44.029577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:44.030205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:44.043059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.059803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.060664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.061113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.330827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:44.338628 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-03035963-4ca8-45bd-9590-b946e837a91e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.313502 Jul 28 11:26:44.340984 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 236/471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:44 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:26:44.346893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:44.348187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:44.357351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.358213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.359490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.361506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.537980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:44.548882 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56032eaf-ffdd-4dc5-8ddd-d3e4d057d2c8 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1590 microversion: 2.1 time: 0.205666 Jul 28 11:26:44.563848 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 237/472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:44 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1590 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:44.571178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:44.572676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:44.580554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.581227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.582178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.582777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.933900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:44.947752 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c7bd2ef-f423-4849-8f91-a7b39799fc71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.382545 Jul 28 11:26:44.949217 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 238/473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:44 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:44.964886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:44.965631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:44.976364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.977119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:44.978316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:44.978974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:45.201185 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c3e6b7c-8ce7-41e9-9371-9b5c8eab5326 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250673 Jul 28 11:26:45.212260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 239/474] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:26:44 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:45.221613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a9729a28-d832-49f5-87d6-0733eae674aa req-f04c13c9-050d-43c4-841e-ffde82ccd7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "name": "network-vif-plugged", "status": "completed", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:45.248193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a9729a28-d832-49f5-87d6-0733eae674aa req-f04c13c9-050d-43c4-841e-ffde82ccd7aa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:45.248714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a9729a28-d832-49f5-87d6-0733eae674aa req-f04c13c9-050d-43c4-841e-ffde82ccd7aa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:45.256687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:45.270780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a9729a28-d832-49f5-87d6-0733eae674aa req-f04c13c9-050d-43c4-841e-ffde82ccd7aa service nova] Creating event network-vif-plugged:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h1-851368-1 Jul 28 11:26:45.277409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a9729a28-d832-49f5-87d6-0733eae674aa req-f04c13c9-050d-43c4-841e-ffde82ccd7aa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068001 Jul 28 11:26:45.278267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 240/475] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:45.287925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2bb8c036-379a-4fde-97ff-c632ac46040b req-6ceadc9f-4cf3-4b08-abb9-0d566bde247d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "name": "network-vif-unplugged", "status": "completed", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:45.300370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2bb8c036-379a-4fde-97ff-c632ac46040b req-6ceadc9f-4cf3-4b08-abb9-0d566bde247d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:45.301108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2bb8c036-379a-4fde-97ff-c632ac46040b req-6ceadc9f-4cf3-4b08-abb9-0d566bde247d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:45.340804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2bb8c036-379a-4fde-97ff-c632ac46040b req-6ceadc9f-4cf3-4b08-abb9-0d566bde247d service nova] Creating event network-vif-unplugged:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h2-851368-1 Jul 28 11:26:45.362567 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2bb8c036-379a-4fde-97ff-c632ac46040b req-6ceadc9f-4cf3-4b08-abb9-0d566bde247d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080156 Jul 28 11:26:45.364055 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 241/476] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:45.379477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:45.380640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:45.403171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:45.405037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:45.406994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:45.408351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:45.994675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:46.011046 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-755066a0-a1cf-4c1a-a6b9-0675bdd4b64a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.642222 Jul 28 11:26:46.013532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 242/477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:45 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:46.040472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:46.048314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:46.074812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:46.076246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:46.086666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:46.090751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:46.694021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:46.711473 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b8c371f-af2b-4316-942c-8f47e746e7eb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1313 microversion: 2.1 time: 0.695464 Jul 28 11:26:46.712057 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 243/478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:46 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1313 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:47.036569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:47.037436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:47.048166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:47.048864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:47.050907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:47.051523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:47.288865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:47.300947 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8a66eb9-24ff-4ba4-b640-ce70589fbb27 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.267189 Jul 28 11:26:47.305427 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 244/479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:47 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:47.462447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c0d7f549-1112-4a6d-908c-5458f5534f37 req-da2e31b3-6213-4791-8c08-8ecb05795506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:47.477626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c0d7f549-1112-4a6d-908c-5458f5534f37 req-da2e31b3-6213-4791-8c08-8ecb05795506 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:47.478162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c0d7f549-1112-4a6d-908c-5458f5534f37 req-da2e31b3-6213-4791-8c08-8ecb05795506 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:47.492549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c0d7f549-1112-4a6d-908c-5458f5534f37 req-da2e31b3-6213-4791-8c08-8ecb05795506 service nova] Creating event network-changed:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h2-851368-1 Jul 28 11:26:47.498186 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c0d7f549-1112-4a6d-908c-5458f5534f37 req-da2e31b3-6213-4791-8c08-8ecb05795506 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040316 Jul 28 11:26:47.499489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 245/480] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:26:47.735517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:47.737546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:47.745610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:47.747151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:47.749002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:47.769079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:48.188522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:48.207864 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67375b38-4a4d-4278-a341-23d5587cbeca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1463 microversion: 2.1 time: 0.469498 Jul 28 11:26:48.209741 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 246/481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:47 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:48.241023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:48.244180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:48.255613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:48.256369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:48.258797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:48.261165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:48.511876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:48.521095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Old instance type m1.heat2, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 11:26:48.543166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:26:48.543166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:26:48.543407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:26:48.543765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:26:48.544181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:26:48.716291 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f73481f-b754-4aa5-9bff-e14e44d04c66 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.485873 Jul 28 11:26:48.717671 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 247/482] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:26:48 2022] POST /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:26:48.723471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:48.725159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:48.737555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:48.739149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:48.740337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:48.741014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:49.515812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:49.525444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73f68914-bd67-4cef-9a59-1a1f343484e7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.805826 Jul 28 11:26:49.527947 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 248/483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:48 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:49.539034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:49.539946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:49.552802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:49.556034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:49.560131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:49.561895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:49.816191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:49.824940 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4888d46d-528c-4f90-a151-4adc7779b58c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1590 microversion: 2.1 time: 0.295751 Jul 28 11:26:49.825517 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 249/484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:49 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1590 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:49.830688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:49.831501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:49.852679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:49.853130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:49.853909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:49.854926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:50.131756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:50.139808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-061740b6-4e73-47df-8e54-6f6ae93ee791 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1472 microversion: 2.1 time: 0.313004 Jul 28 11:26:50.140325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 250/485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:49 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:50.149179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7271df2b-5468-4236-8bbb-ab5bdebbf538 req-140c4f85-9ef1-435b-9cce-8fd404b8d332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d4f6b0-68cb-4d66-997b-8ce975ce1e9f", "tag": "a605567d-901a-4631-92a9-83bee7fd875e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:50.169046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7271df2b-5468-4236-8bbb-ab5bdebbf538 req-140c4f85-9ef1-435b-9cce-8fd404b8d332 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:50.169860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7271df2b-5468-4236-8bbb-ab5bdebbf538 req-140c4f85-9ef1-435b-9cce-8fd404b8d332 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:50.184951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7271df2b-5468-4236-8bbb-ab5bdebbf538 req-140c4f85-9ef1-435b-9cce-8fd404b8d332 service nova] Creating event network-changed:a605567d-901a-4631-92a9-83bee7fd875e for instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f on n-h2-851368-1 Jul 28 11:26:50.196766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7271df2b-5468-4236-8bbb-ab5bdebbf538 req-140c4f85-9ef1-435b-9cce-8fd404b8d332 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050808 Jul 28 11:26:50.197662 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 251/486] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:50.416883 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-676b1c9f-1dad-4450-a7f0-3473eb84c041 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23/action" status: 202 len: 0 microversion: 2.25 time: 6.499933 Jul 28 11:26:50.418338 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 236/487] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:26:43 2022] POST /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23/action => generated 0 bytes in 6502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:50.428591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:50.430150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:50.452599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7df490f0-b635-499f-9fc1-66d1a628fea9 tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:50.456243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:50.459009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:50.460074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:50.461427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:50.476274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7df490f0-b635-499f-9fc1-66d1a628fea9 tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.275643 Jul 28 11:26:50.479052 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 252/488] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:26:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:50.622511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:50.623461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:50.651851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:50.654187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:50.655223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:50.658476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:51.084454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:51.096734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:51.098878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:51.100359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf8d0488-03fe-4de2-8e68-22f6bc82b0c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.677799 Jul 28 11:26:51.116318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 237/489] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:50 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:51.162457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:51.163095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:51.177905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:51.189550 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cc4f3de-6ea5-43c6-94c5-49eeebda5e0b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.573029 Jul 28 11:26:51.192684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:51.222008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:51.222591 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 253/490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:50 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:51.223729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:51.228946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:51.865720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:51.889204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e754459-de0d-4dab-9148-63551b739ab4 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1472 microversion: 2.1 time: 0.731124 Jul 28 11:26:51.890625 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 238/491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:51 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1472 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:52.126317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:52.127661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:52.154586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:52.155382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:52.156374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:52.160537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:52.220490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:52.221204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:52.233916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:52.234380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:52.235178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:52.235616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:52.433726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=21 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:52.458709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=70 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:52.576246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:52.587498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:52.588299 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-003c9019-7489-4c2d-9c77-be242dd2e650 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.371670 Jul 28 11:26:52.589776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 239/492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:52 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:26:52.598527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:52.603738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-919357953", "imageRef": "e4527abd-b87e-43f0-aac0-dc6b8a57d5fb", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:52.605720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:52.607035 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c3fe8ec-2735-4959-bbf4-538dd1c55907 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.484956 Jul 28 11:26:52.608732 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 254/493] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:52 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:52.692304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:26:52.845449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=15 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:53.120371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Calling method '.version_select at 0x7f2eb32044c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:53.124023 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:53.124023 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:53.127365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.129510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.132625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.133304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.199931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d86604a3-7f0b-4bcb-8e02-7890348da167 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.470818 Jul 28 11:26:53.207897 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 255/494] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:26:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:26:53.214646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:53.215699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:53.223535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.224238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.225396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.226239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.690012 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] Request method failure captured: Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 142 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJ5wtslQ_K-3eC-tmHufVvj7KYupOTaScvhZK4TgxH6zj1lSOqR8u7bNWj1MmAo55lOXR8tpttdLfE12MeCzhnV-0aJM1yAunTDhHAgP5aem-wzPm_Kx5NO3PLElifJu0eDEgVvvSXDiWTFDdQ_s4fzaB2M12qGqVFtvsAbGoUwJGA Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: bd7074326444417382e7247fcab9a199 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsV2NegativeTest-1089997080 Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:53.691767 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bd7074326444417382e7247fcab9a199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bd7074326444417382e7247fcab9a199"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bd7074326444417382e7247fcab9a199"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bd7074326444417382e7247fcab9a199"}]}] Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsV2NegativeTest-1089997080 Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: bd7074326444417382e7247fcab9a199 Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1089997080 Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsV2NegativeTest-1089997080-project Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e3374cd3704b49fab7c7c9bf0c6c75a8 Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsV2NegativeTest-1089997080-project Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-919357953", "imageRef": "e4527abd-b87e-43f0-aac0-dc6b8a57d5fb", "flavorRef": "452"}} Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:26:53.693325 n-d-851368-1 devstack@n-api.service[119235]: exception: Flavor's memory is too small for requested image. Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-919357953', 'imageRef': 'e4527abd-b87e-43f0-aac0-dc6b8a57d5fb', 'flavorRef': '452'}}} Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1670, in _create_instance Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1008, in _checks_for_create_and_rebuild Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 672, in _validate_flavor_image Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 740, in _validate_flavor_image_nostatus Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:53.694338 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:53.695816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-917868a7-8dac-463f-9786-fdec3d34e88a tempest-FlavorsV2NegativeTest-1089997080 tempest-FlavorsV2NegativeTest-1089997080-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.102463 Jul 28 11:26:53.697824 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 240/495] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:26:52 2022] POST /compute/v2.1/servers => generated 93 bytes in 1104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:26:53.794263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:53.804307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5014c22a-aa1f-4798-8569-fb02a5d2bd6f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1472 microversion: 2.1 time: 0.594954 Jul 28 11:26:53.806689 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 256/496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:53 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1472 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:53.816043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:53.819759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:53.835938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.836736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.837869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:53.839736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:53.883117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:54.096151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:54.106282 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-360248f8-02b6-434a-beaa-40565e93e169 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.298134 Jul 28 11:26:54.115125 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 257/497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:53 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:54.119091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:54.123183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:54.134213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96d4b143-8f82-4e6b-91f8-35ab2502ba17 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Calling method '.version_select at 0x7f2eb33cc160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:54.137719 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:54.137719 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:54.139259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96d4b143-8f82-4e6b-91f8-35ab2502ba17 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96d4b143-8f82-4e6b-91f8-35ab2502ba17 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:54.144814 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:26:54.146191 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:54.147022 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 11:26:54.148149 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.152318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:54.154606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96d4b143-8f82-4e6b-91f8-35ab2502ba17 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:54.159842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:54.160416 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96d4b143-8f82-4e6b-91f8-35ab2502ba17 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.461862 Jul 28 11:26:54.161036 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 241/498] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:26:53 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 466 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:54.165693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:54.165693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:54.177882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-bb18e799-e4e7-4b85-87a3-0526bb7725e3 req-f45f92e2-fe58-4947-b3cd-aaa6470c23a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "name": "network-vif-unplugged", "status": "completed", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:54.216051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bb18e799-e4e7-4b85-87a3-0526bb7725e3 req-f45f92e2-fe58-4947-b3cd-aaa6470c23a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:54.216507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bb18e799-e4e7-4b85-87a3-0526bb7725e3 req-f45f92e2-fe58-4947-b3cd-aaa6470c23a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:54.258547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-bb18e799-e4e7-4b85-87a3-0526bb7725e3 req-f45f92e2-fe58-4947-b3cd-aaa6470c23a6 service nova] Creating event network-vif-unplugged:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h2-851368-1 Jul 28 11:26:54.270806 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-bb18e799-e4e7-4b85-87a3-0526bb7725e3 req-f45f92e2-fe58-4947-b3cd-aaa6470c23a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106133 Jul 28 11:26:54.272251 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 242/499] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:54.401863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f46dc784-2970-454c-b073-20cf3f2d1284 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1727771129", "id": 1519294408, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:54.406124 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:54.406124 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:54.455176 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f46dc784-2970-454c-b073-20cf3f2d1284 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.177471 Jul 28 11:26:54.468006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 243/500] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:26:54 2022] POST /compute/v2.1/flavors => generated 471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:26:54.477696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5799411f-2be8-49c7-b606-6b7d70b9dcdb tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Calling method '.version_select at 0x7f2eb34f3dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:54.484028 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:54.484028 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:54.490984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5799411f-2be8-49c7-b606-6b7d70b9dcdb tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5799411f-2be8-49c7-b606-6b7d70b9dcdb tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hosts/n-d-851368-1/reboot HTTP/1.1 Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:26:54.501701 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'n-d-851368-1'} Jul 28 11:26:54.503181 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:54.504091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 11:26:54.505319 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:54.507600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5799411f-2be8-49c7-b606-6b7d70b9dcdb tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:54.511278 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5799411f-2be8-49c7-b606-6b7d70b9dcdb tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851368-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.039418 Jul 28 11:26:54.515510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 244/501] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Jul 28 11:26:54 2022] GET /compute/v2.1/os-hosts/n-d-851368-1/reboot => generated 111 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:54.522820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75e47812-c6f5-4399-90b7-c99c622b8f15 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:54.528506 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:54.528506 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:26:54.981071 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75e47812-c6f5-4399-90b7-c99c622b8f15 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1519294408/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.462546 Jul 28 11:26:54.983008 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 245/502] 10.222.0.93 () {62 vars in 1265 bytes} [Thu Jul 28 11:26:54 2022] POST /compute/v2.1/flavors/1519294408/os-extra_specs => generated 62 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:54.997206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ded942b2-0d69-49fe-b0f4-e75e0800e616 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Calling method '.version_select at 0x7f2eb37f5b80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.013787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ded942b2-0d69-49fe-b0f4-e75e0800e616 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ded942b2-0d69-49fe-b0f4-e75e0800e616 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:26:55.016534 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'nonexistent_hostname'} Jul 28 11:26:55.017919 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:55.018700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 11:26:55.019840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.022947 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.025273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ded942b2-0d69-49fe-b0f4-e75e0800e616 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.026469 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ded942b2-0d69-49fe-b0f4-e75e0800e616 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035994 Jul 28 11:26:55.027694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 246/503] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Jul 28 11:26:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:55.032781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.033770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:55.043430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:55.044168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:55.045473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:55.046144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:55.509074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.539945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.547378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.551276 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24fd1f53-4024-4bfb-a69a-cac6cac1ef21 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 1.435229 Jul 28 11:26:55.551920 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 258/504] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:54 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:55.571784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ae4a6e5-6626-4a46-813f-03a4b959a5b5 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.572507 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:55.572507 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:55.626955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1ae4a6e5-6626-4a46-813f-03a4b959a5b5 tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1519294408" status: 202 len: 0 microversion: 2.86 time: 0.070783 Jul 28 11:26:55.628196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 259/505] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Jul 28 11:26:55 2022] DELETE /compute/v2.1/flavors/1519294408 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:26:55.630061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.639113 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8db410e-59b3-40e6-bba2-b76dea6890ec tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.610081 Jul 28 11:26:55.639700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c4e8da0-6155-47d0-b42d-a1106ac225c7 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Calling method '.version_select at 0x7f2eb324c550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.640821 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:55.640821 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:55.642286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c4e8da0-6155-47d0-b42d-a1106ac225c7 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.643537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 247/506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c4e8da0-6155-47d0-b42d-a1106ac225c7 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/n-d-851368-1 HTTP/1.1 Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:55.649597 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1'} Jul 28 11:26:55.650902 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.652282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 11:26:55.653345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.654314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c4e8da0-6155-47d0-b42d-a1106ac225c7 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.654314 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c4e8da0-6155-47d0-b42d-a1106ac225c7 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851368-1" status: 403 len: 109 microversion: 2.1 time: 0.021606 Jul 28 11:26:55.661089 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 260/507] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/n-d-851368-1 => generated 109 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:55.662047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.664655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:55.673533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dbbeba0-6619-4984-aa05-380c4593e98d tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.678947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:55.683039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:55.686136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:55.690213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:55.710436 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dbbeba0-6619-4984-aa05-380c4593e98d tempest-FlavorMetadataValidation-1927341734 tempest-FlavorMetadataValidation-1927341734-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.042580 Jul 28 11:26:55.711469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 261/508] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:55.716712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fadb16f-034f-458c-bac6-ac8c08433646 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Calling method '.version_select at 0x7f2eb33b3160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.742257 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9fadb16f-034f-458c-bac6-ac8c08433646 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fadb16f-034f-458c-bac6-ac8c08433646 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:55.748132 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'nonexistent_hostname'} Jul 28 11:26:55.749457 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.750209 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.751327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.752349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fadb16f-034f-458c-bac6-ac8c08433646 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.752349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9fadb16f-034f-458c-bac6-ac8c08433646 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039224 Jul 28 11:26:55.757139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 262/509] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:55.775940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79d6663c-fbb9-46f4-9e13-a0d744a2b471 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Calling method '.version_select at 0x7f2eb37fdd30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.777899 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:55.777899 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:55.780686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-79d6663c-fbb9-46f4-9e13-a0d744a2b471 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79d6663c-fbb9-46f4-9e13-a0d744a2b471 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/n-d-851368-1/shutdown HTTP/1.1 Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:55.784373 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1'} Jul 28 11:26:55.785641 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.786379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 11:26:55.787525 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.788486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79d6663c-fbb9-46f4-9e13-a0d744a2b471 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.788486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79d6663c-fbb9-46f4-9e13-a0d744a2b471 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851368-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.028178 Jul 28 11:26:55.791317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 263/510] 10.222.0.93 () {58 vars in 1194 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/n-d-851368-1/shutdown => generated 113 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:55.804573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3aad0bfb-56a9-4d79-998d-35ea49d07e21 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Calling method '.version_select at 0x7f2eb34c33a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.817068 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3aad0bfb-56a9-4d79-998d-35ea49d07e21 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3aad0bfb-56a9-4d79-998d-35ea49d07e21 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:55.819562 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'nonexistent_hostname'} Jul 28 11:26:55.821122 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:55.822039 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 11:26:55.824096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.825364 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.831999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3aad0bfb-56a9-4d79-998d-35ea49d07e21 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.833032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3aad0bfb-56a9-4d79-998d-35ea49d07e21 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.036729 Jul 28 11:26:55.834276 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 264/511] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:55.860866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67263e70-9fd2-4409-89bb-9be710925aa0 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Calling method '.version_select at 0x7f2eb326e9d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.862103 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:55.862103 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:55.865379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67263e70-9fd2-4409-89bb-9be710925aa0 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67263e70-9fd2-4409-89bb-9be710925aa0 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/n-d-851368-1/startup HTTP/1.1 Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:55.870950 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1'} Jul 28 11:26:55.872507 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.873415 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 11:26:55.874714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.880876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67263e70-9fd2-4409-89bb-9be710925aa0 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.882959 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67263e70-9fd2-4409-89bb-9be710925aa0 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851368-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.041929 Jul 28 11:26:55.884408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 265/512] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/n-d-851368-1/startup => generated 110 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:55.896980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5360a93d-bf02-4630-a985-1a13d3997cf6 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Calling method '.version_select at 0x7f2eb3204310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:55.915919 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-5360a93d-bf02-4630-a985-1a13d3997cf6 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5360a93d-bf02-4630-a985-1a13d3997cf6 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:55.918823 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'nonexistent_hostname'} Jul 28 11:26:55.920475 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:55.921605 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 11:26:55.923372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:55.925273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.937912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5360a93d-bf02-4630-a985-1a13d3997cf6 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.940093 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5360a93d-bf02-4630-a985-1a13d3997cf6 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.048427 Jul 28 11:26:55.943027 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 266/513] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:55.959817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0ea23a3-9c4e-4326-9b45-dbb2834e39f4 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb326e3a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0ea23a3-9c4e-4326-9b45-dbb2834e39f4 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-hosts/n-d-851368-1 HTTP/1.1 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 51 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:55.972219 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: {"status": "enable", "maintenance_mode": "invalid"} Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:55.973709 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance: Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.974607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:55.976328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:55.977613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:55.977613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:26:55.977613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:26:55.977613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:55.977613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:55.978307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0ea23a3-9c4e-4326-9b45-dbb2834e39f4 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:55.979490 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0ea23a3-9c4e-4326-9b45-dbb2834e39f4 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851368-1" status: 400 len: 199 microversion: 2.1 time: 0.024403 Jul 28 11:26:55.980345 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 267/514] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-851368-1 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:26:55.997495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd032b33-bd01-4b39-8047-2412942333d8 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb37fdd30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd032b33-bd01-4b39-8047-2412942333d8 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-hosts/n-d-851368-1 HTTP/1.1 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 51 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:56.008476 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: {"status": "invalid", "maintenance_mode": "enable"} Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:56.010066 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance: Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.011582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.013311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.014566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd032b33-bd01-4b39-8047-2412942333d8 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:56.015001 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd032b33-bd01-4b39-8047-2412942333d8 tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851368-1" status: 400 len: 189 microversion: 2.1 time: 0.026402 Jul 28 11:26:56.018356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 268/515] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-851368-1 => generated 189 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:26:56.035121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2741b662-5341-4983-926b-c551b37de2b4 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Action: 'update', calling method: .version_select at 0x7f2eb3548790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:56.043289 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:56.043289 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:26:56.044529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2741b662-5341-4983-926b-c551b37de2b4 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c79559c3a7454e4184135635217ea131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a0faed6b0c54747b8c223d49ac25d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2741b662-5341-4983-926b-c551b37de2b4 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Request method failure captured: Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-hosts/n-d-851368-1 HTTP/1.1 Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 50 Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ7diw9AhCY8Jnoy-EZHZv2utUzUpaQOvh48_RgFMgBeVk3i_GoN9C-h_7rcsJiQb18BfgSRvM9emCeMrrbDVtff3jiWU_a4J5OPzYT7jdSDebfYX4671HWSB6iX1gm_KxeMj2LJVpTer1egEQhpczdetviTI-5BVfIoi3y1znRN_o Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:56.051601 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a0faed6b0c54747b8c223d49ac25d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a0faed6b0c54747b8c223d49ac25d7a"}]}] Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5a0faed6b0c54747b8c223d49ac25d7a Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1415232525 Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c79559c3a7454e4184135635217ea131 Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1415232525-project Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 11:26:56.052930 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:56.053733 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 11:26:56.058611 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.059858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2741b662-5341-4983-926b-c551b37de2b4 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:56.059858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2741b662-5341-4983-926b-c551b37de2b4 tempest-HostsAdminNegativeTestJSON-1415232525 tempest-HostsAdminNegativeTestJSON-1415232525-project] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851368-1" status: 403 len: 111 microversion: 2.1 time: 0.025607 Jul 28 11:26:56.067487 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 269/516] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:56 2022] PUT /compute/v2.1/os-hosts/n-d-851368-1 => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:56.073995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79928dc4-a948-46e9-9680-8391058cb5be tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb324c9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79928dc4-a948-46e9-9680-8391058cb5be tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-hosts/n-d-851368-1 HTTP/1.1 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 42 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:56.086914 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: {"status": null, "maintenance_mode": null} Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 11:26:56.088466 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'n-d-851368-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance: Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi None Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.089430 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.091038 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79928dc4-a948-46e9-9680-8391058cb5be tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:56.092959 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79928dc4-a948-46e9-9680-8391058cb5be tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851368-1" status: 400 len: 127 microversion: 2.1 time: 0.019827 Jul 28 11:26:56.095357 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 270/517] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:26:56 2022] PUT /compute/v2.1/os-hosts/n-d-851368-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:26:56.108448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb3204550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:56.112308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.hosts [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Enabling host nonexistent_hostname. Jul 28 11:26:56.129520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Request method failure captured: Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 50 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJ8IdoZVG6kds3R20VVp8pLb1rKtzGbBSudqUiaQrVj5AAAz8FGslQhQTKaZZv_HoGFa2QL9qmqO84r5Lxe385q5Omhcf7N1aNxSjh5haXR0ZRA08YN92T8DkbbL8Dy3xHqVmJ9NfEkOsINrEKIDOaShltw-PAIfIfQfEXB8xkeey0 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:26:56.131307 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9dd10656b9154d72a57dfd5538d91a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9dd10656b9154d72a57dfd5538d91a04"}]}] Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9dd10656b9154d72a57dfd5538d91a04 Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1123015294 Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: f76f79b8aab449b69a55d2fb479d2f36 Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1123015294-project-admin Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:56.132764 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5941, in targeted Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 11:26:56.133690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:26:56.134803 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:56.136717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:56.138386 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c58611c-167b-41aa-bf48-4719c78d8abe tempest-HostsAdminNegativeTestJSON-1123015294 tempest-HostsAdminNegativeTestJSON-1123015294-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036675 Jul 28 11:26:56.144065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 271/518] 10.222.0.93 () {60 vars in 1211 bytes} [Thu Jul 28 11:26:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:26:56.190914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:56.200169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f97b765-ae12-4323-abc4-9e914619340a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.555264 Jul 28 11:26:56.203889 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 248/519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:55 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:56.357986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-58a0f38c-ac12-47e4-913e-3f16ddf34a04 req-9490cf5c-aeb8-4df1-ab2f-e747762a0e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "name": "network-vif-unplugged", "status": "completed", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:56.395784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-58a0f38c-ac12-47e4-913e-3f16ddf34a04 req-9490cf5c-aeb8-4df1-ab2f-e747762a0e8f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:56.396252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-58a0f38c-ac12-47e4-913e-3f16ddf34a04 req-9490cf5c-aeb8-4df1-ab2f-e747762a0e8f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:56.440771 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-58a0f38c-ac12-47e4-913e-3f16ddf34a04 req-9490cf5c-aeb8-4df1-ab2f-e747762a0e8f service nova] Creating event network-vif-unplugged:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h1-851368-1 Jul 28 11:26:56.457751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-58a0f38c-ac12-47e4-913e-3f16ddf34a04 req-9490cf5c-aeb8-4df1-ab2f-e747762a0e8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109412 Jul 28 11:26:56.460037 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 272/520] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:56.575343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:56.576257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:56.591944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:56.592684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:56.593898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:56.594782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:56.668940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:56.669847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:56.691091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:56.694391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:56.699451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:56.711329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:56.742433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:57.240151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:57.261304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:57.267766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:57.273396 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ce78ea9-ef94-4d21-bb46-a28662f6ccfb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.703048 Jul 28 11:26:57.311097 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 249/521] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:56 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:26:57.311097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:57.311097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:57.319502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:57.319966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:57.320773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:57.321212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:57.588992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:57.612882 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16c447fd-47b4-48ae-983f-25ecb3db30e8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.948571 Jul 28 11:26:57.615002 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 273/522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:56 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:26:57.828491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:57.838951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61868720-9932-4d2a-b5d0-c1f2da34080f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.540652 Jul 28 11:26:57.843439 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 250/523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:57 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:58.327840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:58.328573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:58.342813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.345088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.346710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.347772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.689999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:58.707921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:58.707921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:58.707921 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e9bd748-ae06-4c8b-a918-75769d05bb2b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.385687 Jul 28 11:26:58.708726 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 251/524] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:58 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:26:58.713489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f0dde37f-0b54-49cf-b977-a83a10df967c req-fee52dae-4d99-485c-ac4f-62ac5c3760c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:26:58.725069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0dde37f-0b54-49cf-b977-a83a10df967c req-fee52dae-4d99-485c-ac4f-62ac5c3760c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.726036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0dde37f-0b54-49cf-b977-a83a10df967c req-fee52dae-4d99-485c-ac4f-62ac5c3760c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.744446 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f0dde37f-0b54-49cf-b977-a83a10df967c req-fee52dae-4d99-485c-ac4f-62ac5c3760c3 service nova] Creating event network-changed:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h1-851368-1 Jul 28 11:26:58.750926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f0dde37f-0b54-49cf-b977-a83a10df967c req-fee52dae-4d99-485c-ac4f-62ac5c3760c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041247 Jul 28 11:26:58.752334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 252/525] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:26:58.762338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:58.763440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:58.771448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.773587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.774828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.776655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.816513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] Calling method '.version_select at 0x7f2eb33b3e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:58.874387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 883a7937-dde7-4154-9f0a-84ab29603cc3 could not be found", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:26:58.875111 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] HTTP exception thrown: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] Request method failure captured: Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-floating-ips/883a7937-dde7-4154-9f0a-84ab29603cc3 HTTP/1.1 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKCjjcZ5Mm5zTMV2s3_D_rFUn5mb9mKK56qXGEhZ90MLg8MDUq0PVT4jRyz0VdZAlNBs6KpMbj_hUjJiQWVT9SO-Q9diYF4xTnm6KxTtQwIlv2Tn0wqoyK45uTdNstzA9UeMQTESHPJdtA00WHTy0qpkOve2j014lfkFy6R9_AALL8 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d2a84c52f77949af9919a7c00c30802c Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1377721781 Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:26:58.902076 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2a84c52f77949af9919a7c00c30802c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2a84c52f77949af9919a7c00c30802c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2a84c52f77949af9919a7c00c30802c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2a84c52f77949af9919a7c00c30802c"}]}] Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1377721781 Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d2a84c52f77949af9919a7c00c30802c Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1377721781 Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 44da94d43b724bd18e5ee0895dbd623c Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: exception: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3 Jul 28 11:26:58.903511 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '883a7937-dde7-4154-9f0a-84ab29603cc3'} Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:26:58.904242 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 883a7937-dde7-4154-9f0a-84ab29603cc3 could not be found Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef974310-87e2-482f-ad11-0c4e2496fd16'] Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3. Jul 28 11:26:58.905349 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3 Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:26:58.907943 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:26:58.910890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:26:58.910890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3 Jul 28 11:26:58.910890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:26:58.913493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] Returning 404 to user: Floating IP not found for ID 883a7937-dde7-4154-9f0a-84ab29603cc3 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:26:58.915055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0813440-025e-4e7f-b54a-4292f825df89 tempest-FloatingIPDetailsNegativeTestJSON-1377721781 tempest-FloatingIPDetailsNegativeTestJSON-1377721781-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/883a7937-dde7-4154-9f0a-84ab29603cc3" status: 404 len: 111 microversion: 2.1 time: 0.661137 Jul 28 11:26:58.916250 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 274/526] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:26:58 2022] GET /compute/v2.1/os-floating-ips/883a7937-dde7-4154-9f0a-84ab29603cc3 => generated 111 bytes in 663 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:26:58.924883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:58.925619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:58.974611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.975921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:58.977660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:58.978169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:59.016182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:59.032289 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11113dff-82b4-4d15-a2f3-f142aec58e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.274577 Jul 28 11:26:59.035301 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 253/527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:58 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:59.182974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:26:59.191583 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41278a0a-7f0c-45e8-950c-5786f0422d38 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1504 microversion: 2.1 time: 0.272994 Jul 28 11:26:59.200964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 275/528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:26:58 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:26:59.732859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:26:59.733674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:26:59.741467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:59.743912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:26:59.745636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:26:59.746120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.061970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:00.062574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:00.079129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.081286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.082249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.082858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.089388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:00.102483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:00.105773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:00.114686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-754248c4-8413-4f26-8b75-a5fe6cffb2c5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.386407 Jul 28 11:27:00.121553 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 254/529] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:26:59 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:00.218680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:00.220295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:00.230170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.240965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.242653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.243461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.261042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:00.269733 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46c92f31-e4a1-4062-8779-03b8cc24fff7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.211506 Jul 28 11:27:00.271428 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 276/530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:00 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:00.529739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:00.539718 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0df6c1a0-94ce-47cc-9ad5-5b67ea118594 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1494 microversion: 2.1 time: 0.326853 Jul 28 11:27:00.542358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 255/531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:00 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1494 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:00.562809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e7e2114c-df46-4451-a8de-18fef30a953e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '.version_select at 0x7f2eb35365e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:00.567389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7e2114c-df46-4451-a8de-18fef30a953e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.568183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7e2114c-df46-4451-a8de-18fef30a953e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.602763 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e7e2114c-df46-4451-a8de-18fef30a953e tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.045747 Jul 28 11:27:00.604383 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 277/532] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:27:00 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:00.617679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:00.620838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:00.628750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.629602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.630599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:00.631836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:00.894367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa64a994-6cfe-478f-84dd-b7ddbc1ab79f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1645 microversion: 2.1 time: 0.280218 Jul 28 11:27:00.897241 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 256/533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:00 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1645 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:01.145546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:01.146648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:01.176194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:01.176912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:01.180420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:01.181097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:01.283792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1391315866", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2ee9bbf6-5533-4c74-b21c-9d3ad61e8713"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:01.452713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] validate_networks() for [('2ee9bbf6-5533-4c74-b21c-9d3ad61e8713', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:02.665838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:02.677307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:02.683965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:02.685288 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0219a1e1-abb3-443c-9bed-7831d8d5a63d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 1.545208 Jul 28 11:27:02.688729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 278/534] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:01 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:02.700211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:02.701165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:02.716589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:02.719677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:02.721433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:02.721433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:02.982075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:02.982513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:02.983682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:02.984333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:02.985271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:03.023754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:03.027120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:03.032664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:03.033512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:03.052501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:03.085821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:03.093455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for user d61cd4ba16e748bbac55fe74a20c557e and project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:03.112205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:03.121762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:03.125220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:03.152818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:03.161533 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46c81362-14bc-4134-87b2-3a68e1d6301c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.469343 Jul 28 11:27:03.166117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 279/535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:02 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:03.192556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:03.225953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa32e896-8da9-403b-9e5e-c4d8efc3291b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946714 Jul 28 11:27:03.227437 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 257/536] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:27:03.238093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f0e6a850-9a6b-459a-901c-0bdc63bae0f9 req-96a203aa-49cf-4053-9900-5d604194e68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "name": "network-vif-unplugged", "status": "completed", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:03.264564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0e6a850-9a6b-459a-901c-0bdc63bae0f9 req-96a203aa-49cf-4053-9900-5d604194e68e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:03.265308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0e6a850-9a6b-459a-901c-0bdc63bae0f9 req-96a203aa-49cf-4053-9900-5d604194e68e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:03.284539 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f0e6a850-9a6b-459a-901c-0bdc63bae0f9 req-96a203aa-49cf-4053-9900-5d604194e68e service nova] Creating event network-vif-unplugged:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h1-851368-1 Jul 28 11:27:03.292988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f0e6a850-9a6b-459a-901c-0bdc63bae0f9 req-96a203aa-49cf-4053-9900-5d604194e68e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061856 Jul 28 11:27:03.294755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 258/537] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:03.301938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a863d86f-dbdd-4174-b2ef-3df438808b6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:03.303887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a863d86f-dbdd-4174-b2ef-3df438808b6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:03.620094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a863d86f-dbdd-4174-b2ef-3df438808b6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:03.629071 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a863d86f-dbdd-4174-b2ef-3df438808b6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1211 microversion: 2.1 time: 0.332907 Jul 28 11:27:03.632080 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 259/538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:03 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1211 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:03.712796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:03.714667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:03.727626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:03.728084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:03.733625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:03.734093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:03.889539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-75fbab86-4ca1-4c39-ab8c-86ca7767c21b tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-38356537", "ram": 512, "vcpus": 1, "disk": 10, "id": 1145828381, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:03.894907 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:03.894907 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:03.930553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-75fbab86-4ca1-4c39-ab8c-86ca7767c21b tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.753586 Jul 28 11:27:03.931181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 280/539] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:04.336589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Calling method '.version_select at 0x7f2eb3166280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:04.339274 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:04.339274 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:04.340499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.340947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.369044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:04.376208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.376689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.451380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.451831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.481831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.482523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.524338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.527406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.546320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4519c0e5-a8cc-413e-94de-3b7c99303453 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.614000 Jul 28 11:27:04.549277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 281/540] 10.222.0.93 () {60 vars in 1243 bytes} [Thu Jul 28 11:27:03 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:04.746449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-632bb803-0f21-444d-82bc-89aaea06797a tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:04.765350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-632bb803-0f21-444d-82bc-89aaea06797a tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] HTTP exception thrown: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-632bb803-0f21-444d-82bc-89aaea06797a tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Request method failure captured: Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKFYL4Z9uvnGAePVD-vfyGc3Qr5TMQtOIzpMvXboKnNs4O3hot5cgFFki7G_0A0gy4LfNfxPq_80H8Wnnhm4jdBpkilFdrD9Mz6rkPcE05y57NCP09eOp1UOsdbwJnjwwHaEorU1Tv7HGF_SL0mjfPyccsjVC0ZQY7e-N1SwbRMqXY Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:04.769921 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}] Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5bbbb2fa472d4ca4ac636a57e9fd8c8b Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:04.771478 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'flavor_id': '1145828381', 'id': 'hw:cpu_thread_policy'} Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:04.772340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:04.773828 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:04.776926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-632bb803-0f21-444d-82bc-89aaea06797a tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Returning 404 to user: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:04.779170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-632bb803-0f21-444d-82bc-89aaea06797a tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] 10.222.0.93 "GET /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.228762 Jul 28 11:27:04.781526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 282/541] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:27:04 2022] GET /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:04.795623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:04.796747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:04.814706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.815956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.817508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.819483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.920406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:04.932204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:04.933986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:04.935553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b9acfd0-90eb-4e5b-ab5e-3cb4aa9f7aff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 1.228281 Jul 28 11:27:04.952602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 260/542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:03 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:27:04.957894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Calling method '.version_select at 0x7f2eb33cc0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:04.960938 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:04.960938 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:04.962593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.963800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:04.981349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:04.982046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.033840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.034560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.046890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.047590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.078773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.079521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.089355 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb4d5530-d49c-4515-9e30-42dbcf4aaa09 tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.134582 Jul 28 11:27:05.097117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 261/543] 10.222.0.93 () {60 vars in 1222 bytes} [Thu Jul 28 11:27:04 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:27:05.101916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.102715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:05.110349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.111035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.112001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.113070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.206319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:05.212703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:05.216324 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b45a605-6120-4f26-abe6-0f100e8f8366 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1263 microversion: 2.1 time: 0.118053 Jul 28 11:27:05.217100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 262/544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:05 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1263 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:05.229094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4fdaf264-4f9f-4086-ae3e-035232abbd29 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.235140 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.235140 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:05.238589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4fdaf264-4f9f-4086-ae3e-035232abbd29 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5bbbb2fa472d4ca4ac636a57e9fd8c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60e57fa4b2f4796beb6f134e4888be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4fdaf264-4f9f-4086-ae3e-035232abbd29 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Request method failure captured: Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/flavors/1145828381/os-extra_specs HTTP/1.1 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 66 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKFYL4Z9uvnGAePVD-vfyGc3Qr5TMQtOIzpMvXboKnNs4O3hot5cgFFki7G_0A0gy4LfNfxPq_80H8Wnnhm4jdBpkilFdrD9Mz6rkPcE05y57NCP09eOp1UOsdbwJnjwwHaEorU1Tv7HGF_SL0mjfPyccsjVC0ZQY7e-N1SwbRMqXY Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:05.244446 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}] Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5bbbb2fa472d4ca4ac636a57e9fd8c8b Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 28 11:27:05.245804 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'flavor_id': '1145828381', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:27:05.246514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 11:27:05.247627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.248751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4fdaf264-4f9f-4086-ae3e-035232abbd29 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.248751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4fdaf264-4f9f-4086-ae3e-035232abbd29 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] 10.222.0.93 "POST /compute/v2.1/flavors/1145828381/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.028046 Jul 28 11:27:05.248751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 263/545] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Jul 28 11:27:05 2022] POST /compute/v2.1/flavors/1145828381/os-extra_specs => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:05.255681 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f88ec394-0d7e-49c9-aeaa-4c34a973967f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.472739 Jul 28 11:27:05.263552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Calling method '.version_select at 0x7f2eb33c38b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.267349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 283/546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:04 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:05.272033 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.272033 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:05.273880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.275512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.287993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b7efa08-16a7-4922-98d0-fb19ddea0715 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.291916 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.291916 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:05.313114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.313575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.334677 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d6a4cfb-abea-4de1-8d91-d514609e0d7c tempest-HypervisorAdminV253TestBase-1319884824 tempest-HypervisorAdminV253TestBase-1319884824-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/52e1cfd1-9f85-4244-81bd-82fd49669bd6" status: 200 len: 792 microversion: 2.53 time: 0.085310 Jul 28 11:27:05.352926 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 264/547] 10.222.0.93 () {60 vars in 1298 bytes} [Thu Jul 28 11:27:05 2022] GET /compute/v2.1/os-hypervisors/52e1cfd1-9f85-4244-81bd-82fd49669bd6 => generated 792 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:27:05.387008 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b7efa08-16a7-4922-98d0-fb19ddea0715 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1145828381/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101891 Jul 28 11:27:05.393189 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 284/548] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Jul 28 11:27:05 2022] POST /compute/v2.1/flavors/1145828381/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:27:05.402110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa2477fc-1b80-4143-bbf1-2ee75cf98c60 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.404025 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.404025 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:05.405813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aa2477fc-1b80-4143-bbf1-2ee75cf98c60 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5bbbb2fa472d4ca4ac636a57e9fd8c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60e57fa4b2f4796beb6f134e4888be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa2477fc-1b80-4143-bbf1-2ee75cf98c60 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Request method failure captured: Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKFYL4Z9uvnGAePVD-vfyGc3Qr5TMQtOIzpMvXboKnNs4O3hot5cgFFki7G_0A0gy4LfNfxPq_80H8Wnnhm4jdBpkilFdrD9Mz6rkPcE05y57NCP09eOp1UOsdbwJnjwwHaEorU1Tv7HGF_SL0mjfPyccsjVC0ZQY7e-N1SwbRMqXY Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:05.410832 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}] Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5bbbb2fa472d4ca4ac636a57e9fd8c8b Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:05.412965 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'flavor_id': '1145828381', 'id': 'hw:numa_nodes'} Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:27:05.413618 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 11:27:05.414840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.420974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa2477fc-1b80-4143-bbf1-2ee75cf98c60 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.426308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa2477fc-1b80-4143-bbf1-2ee75cf98c60 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] 10.222.0.93 "DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029245 Jul 28 11:27:05.429090 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 265/549] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:27:05 2022] DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:05.438215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13caf748-f39b-4539-8721-2177b0d69e9e tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.488022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13caf748-f39b-4539-8721-2177b0d69e9e tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1145828381/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053744 Jul 28 11:27:05.492103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 285/550] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Jul 28 11:27:05 2022] POST /compute/v2.1/flavors/1145828381/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:27:05.499658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bad8bf05-77fa-4305-83f7-055b72fd054c tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.503697 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.503697 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bad8bf05-77fa-4305-83f7-055b72fd054c tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5bbbb2fa472d4ca4ac636a57e9fd8c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60e57fa4b2f4796beb6f134e4888be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bad8bf05-77fa-4305-83f7-055b72fd054c tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Request method failure captured: Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 22 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKFYL4Z9uvnGAePVD-vfyGc3Qr5TMQtOIzpMvXboKnNs4O3hot5cgFFki7G_0A0gy4LfNfxPq_80H8Wnnhm4jdBpkilFdrD9Mz6rkPcE05y57NCP09eOp1UOsdbwJnjwwHaEorU1Tv7HGF_SL0mjfPyccsjVC0ZQY7e-N1SwbRMqXY Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:05.508363 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f60e57fa4b2f4796beb6f134e4888be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f60e57fa4b2f4796beb6f134e4888be8"}]}] Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: f60e57fa4b2f4796beb6f134e4888be8 Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5bbbb2fa472d4ca4ac636a57e9fd8c8b Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: {"hw:numa_nodes": "1"} Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:05.510781 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'flavor_id': '1145828381', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:27:05.511603 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 11:27:05.518139 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.523740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bad8bf05-77fa-4305-83f7-055b72fd054c tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.523740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bad8bf05-77fa-4305-83f7-055b72fd054c tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678 tempest-FlavorsExtraSpecsNegativeTestJSON-1270051678-project] 10.222.0.93 "PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014601 Jul 28 11:27:05.523740 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 266/551] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Jul 28 11:27:05 2022] PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:05.526583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a8842f1-c04d-43c1-bffe-1f09fe77649c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.527908 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.527908 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:05.542684 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7a8842f1-c04d-43c1-bffe-1f09fe77649c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] HTTP exception thrown: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a8842f1-c04d-43c1-bffe-1f09fe77649c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Request method failure captured: Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKGxj5txvDm1dB3JK7DF3LJrZD4jZuwUQzk-rFgWO4Yyo92si8rine9ZnjOVTedk_FYp0rDE1iE3H84p8ApK4pdQ15CjeJkkZR5zOEnhIm020SBsUPHtgWsyavd7LGFfaqvSUqE748xnGwS7xcdb3Xk0VBwQ147wi1n4irXrknbXeQ Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:27:05.545247 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}] Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 932fe5ce9f85438da690b79fcfb64640 Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:05.546495 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'flavor_id': '1145828381', 'id': 'hw:cpu_thread_policy'} Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.547676 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a8842f1-c04d-43c1-bffe-1f09fe77649c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Returning 404 to user: Flavor 1145828381 has no extra specs with key hw:cpu_thread_policy. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a8842f1-c04d-43c1-bffe-1f09fe77649c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.028071 Jul 28 11:27:05.553475 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 286/552] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:27:05 2022] DELETE /compute/v2.1/flavors/1145828381/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:05.561010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4a6ca85-5bdb-472f-8cde-5675038bdd02 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.565966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f4a6ca85-5bdb-472f-8cde-5675038bdd02 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4a6ca85-5bdb-472f-8cde-5675038bdd02 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Request method failure captured: Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 27 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKGxj5txvDm1dB3JK7DF3LJrZD4jZuwUQzk-rFgWO4Yyo92si8rine9ZnjOVTedk_FYp0rDE1iE3H84p8ApK4pdQ15CjeJkkZR5zOEnhIm020SBsUPHtgWsyavd7LGFfaqvSUqE748xnGwS7xcdb3Xk0VBwQ147wi1n4irXrknbXeQ Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:27:05.598073 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}] Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 932fe5ce9f85438da690b79fcfb64640 Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: {"hw:cpu_policy": "shared"} Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:05.599447 n-d-851368-1 devstack@n-api.service[119235]: exception: Request body and URI mismatch Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'flavor_id': '1145828381', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.600221 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4a6ca85-5bdb-472f-8cde-5675038bdd02 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f4a6ca85-5bdb-472f-8cde-5675038bdd02 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.046243 Jul 28 11:27:05.606316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 267/553] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Jul 28 11:27:05 2022] PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes => generated 73 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:27:05.612067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8f85deb-9408-4728-b416-a308685936eb tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8f85deb-9408-4728-b416-a308685936eb tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Request method failure captured: Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 49 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKGxj5txvDm1dB3JK7DF3LJrZD4jZuwUQzk-rFgWO4Yyo92si8rine9ZnjOVTedk_FYp0rDE1iE3H84p8ApK4pdQ15CjeJkkZR5zOEnhIm020SBsUPHtgWsyavd7LGFfaqvSUqE748xnGwS7xcdb3Xk0VBwQ147wi1n4irXrknbXeQ Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:27:05.618480 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_503294e312c34ec5a296f6588a9fa2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/503294e312c34ec5a296f6588a9fa2e6"}]}] Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 503294e312c34ec5a296f6588a9fa2e6 Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 932fe5ce9f85438da690b79fcfb64640 Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 28 11:27:05.620947 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'flavor_id': '1145828381', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance: Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 28 11:27:05.621816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.623340 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:05.624729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8f85deb-9408-4728-b416-a308685936eb tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:05.625906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8f85deb-9408-4728-b416-a308685936eb tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017911 Jul 28 11:27:05.631206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 287/554] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Jul 28 11:27:05 2022] PUT /compute/v2.1/flavors/1145828381/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:27:05.639487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e73cf9e-dc14-44a0-aa78-3477aab1fba9 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.641023 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:05.641023 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:05.685193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e73cf9e-dc14-44a0-aa78-3477aab1fba9 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1145828381" status: 202 len: 0 microversion: 2.1 time: 0.052454 Jul 28 11:27:05.687322 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 268/555] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:27:05 2022] DELETE /compute/v2.1/flavors/1145828381 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:05.699604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46550e89-c52d-4683-9c4c-50ca9a1da11c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.745667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46550e89-c52d-4683-9c4c-50ca9a1da11c tempest-FlavorsExtraSpecsNegativeTestJSON-279450331 tempest-FlavorsExtraSpecsNegativeTestJSON-279450331-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.051939 Jul 28 11:27:05.747380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 288/556] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:27:05 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:05.959671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:05.960338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:05.980702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.984145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:05.988453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:05.989152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:06.237505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:06.238250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:06.250131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:06.250857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:06.255341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:06.256159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:06.471307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:06.481606 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2edca394-59ac-4d47-8dc4-e9a20508880b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1269 microversion: 2.1 time: 0.247644 Jul 28 11:27:06.482545 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 289/557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:06 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:06.502383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:06.503011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:06.508794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:06.510820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:06.511574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:06.512857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:06.513545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:06.531225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:06.533914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:06.536740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79cc564a-faa3-47f6-acdf-eaa51f731b13 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1567 microversion: 2.25 time: 0.581753 Jul 28 11:27:06.538426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 269/558] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:05 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1567 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:06.945471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:06.956381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65496f14-9ae7-4d92-98be-34f4a805d57e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.458858 Jul 28 11:27:06.959420 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 290/559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:06 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:07.504017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:07.505179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:07.516422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:07.518669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:07.521272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:07.521901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:07.561411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:07.562984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:07.580191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:07.590243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:07.591568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:07.592025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:07.869418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:07.879836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc83c3a2-104c-44cd-b823-3a043147a3c2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1269 microversion: 2.1 time: 0.380627 Jul 28 11:27:07.886202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 270/560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:07 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1269 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:07.981761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:07.983006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:08.000142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.000762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.001740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.002256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.266274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:08.282295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:08.289556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:08.304971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e23631d-f922-4998-8685-e9a4258446c8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1557 microversion: 2.25 time: 0.738833 Jul 28 11:27:08.307091 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 291/561] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:07 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1557 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:08.341211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6bc974f3-748f-4f52-8c0c-d83ad9f09bfc tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '.version_select at 0x7f2eb3145ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:08.347056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bc974f3-748f-4f52-8c0c-d83ad9f09bfc tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.349826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bc974f3-748f-4f52-8c0c-d83ad9f09bfc tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.376476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6bc974f3-748f-4f52-8c0c-d83ad9f09bfc tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.039340 Jul 28 11:27:08.381726 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 292/562] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Jul 28 11:27:08 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:27:08.396567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:08.397382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:08.406116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.406807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.407946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.408584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.412224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:08.424918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d39f84b3-d7b4-4629-8a4a-20c78b0a52a6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.448965 Jul 28 11:27:08.428351 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 271/563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:07 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:08.884160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:08.901647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:08.903585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:08.916548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.917548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.919592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:08.920912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:08.922638 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e4268ad9-b640-45aa-b8b3-1d3306f81a83 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 2049 microversion: 2.25 time: 0.529724 Jul 28 11:27:08.926470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 293/564] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:08 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 2049 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:09.132061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-872305003", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "b93dd60e-eebc-4156-8fe1-0460817e9901"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:09.224629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] validate_networks() for [('b93dd60e-eebc-4156-8fe1-0460817e9901', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:09.490020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:09.500866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ad731b7-2f3e-42cb-854e-dac6d0d2f3a5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.604381 Jul 28 11:27:09.501859 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 272/565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:08 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:09.513895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:09.518594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:09.535363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:09.542696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:09.543855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:09.544531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:10.131381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:10.142417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04d5bafe-37ab-4f6c-8821-5d015c58351d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.636643 Jul 28 11:27:10.144655 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 273/566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:09 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:10.532502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:10.534248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:10.560002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:10.560887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:10.577192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:10.577941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:10.849734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:10.850845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:10.851980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:10.856958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:10.857620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:10.878556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:10.880000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:10.883478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:10.885165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:10.915028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:10.929781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for user ccea87d21921492f8544e0e81ea485d5 and project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:10.974325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:10.978431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:11.022419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:11.036525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a02b624-3978-4b6a-9b67-d4afc24e3bc7 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.516184 Jul 28 11:27:11.038418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 274/567] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:10 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:11.051388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc1db50a-2204-4b13-ba37-8b42540672df tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.923146 Jul 28 11:27:11.055486 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 294/568] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 11:27:11.072819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:11.077082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:11.167209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-02d23d50-44e5-4345-8bac-00d0fb55d7ee req-223fc474-ec0e-4259-b74d-7d837a10fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:11.189773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-02d23d50-44e5-4345-8bac-00d0fb55d7ee req-223fc474-ec0e-4259-b74d-7d837a10fd65 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:11.191436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-02d23d50-44e5-4345-8bac-00d0fb55d7ee req-223fc474-ec0e-4259-b74d-7d837a10fd65 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:11.222649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-02d23d50-44e5-4345-8bac-00d0fb55d7ee req-223fc474-ec0e-4259-b74d-7d837a10fd65 service nova] Creating event network-changed:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h2-851368-1 Jul 28 11:27:11.234085 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-02d23d50-44e5-4345-8bac-00d0fb55d7ee req-223fc474-ec0e-4259-b74d-7d837a10fd65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074402 Jul 28 11:27:11.238437 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 295/569] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:11.250570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:11.257194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:11.273962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:11.274428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:11.276421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:11.278730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:11.324324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:11.337991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:11.349140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:11.356166 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b614ecc-7f78-47ec-b694-92d958362102 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1261 microversion: 2.25 time: 0.291339 Jul 28 11:27:11.372160 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 275/570] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:11 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:11.672157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:11.690196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2301b6d6-1c3c-4fe3-bd6f-1185603c5424 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.449579 Jul 28 11:27:11.691140 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 296/571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:11 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:12.059718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:12.060377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:12.074626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.075220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.075924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.076382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.279665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b0b177f-ab44-4dce-bf9b-41e52aaf4768 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Action: 'create', calling method: .version_select at 0x7f2eb330df70>, body: {"pool": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:12.292467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:12.310369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b312abc-f21f-4f0b-b5a2-4109c2f8b9e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.252082 Jul 28 11:27:12.312367 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 297/572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:12 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:12.387469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:12.388105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:12.395611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.396805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.397928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.399032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.504479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:12.516541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:12.518057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:12.519203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6825bbbd-2f56-43a1-8d89-78c4feb20251 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1313 microversion: 2.25 time: 0.138886 Jul 28 11:27:12.519766 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 298/573] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:12 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:27:12.712895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:12.714243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:12.727649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.728455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.730404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:12.732042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:12.781867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:13.054015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:13.175681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:13.191501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a0945dfd-f075-4562-b938-4ece96fa6d17 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.477996 Jul 28 11:27:13.194002 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 299/574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:12 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:13.773562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1852203307", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:13.891269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:14.550486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:14.553154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:14.553999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:14.555468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:14.557660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:14.592881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:14.594851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:14.598359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:14.600380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:14.703157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Getting quotas for project 7b2f86d16fa4429c8b3a7a1832f514d3. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:14.732326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Getting quotas for user 53ed4c22e33040f9952b722136dd6e5e and project 7b2f86d16fa4429c8b3a7a1832f514d3. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:14.811044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:14.819660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:14.976336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8eb25c61-b28f-426d-9086-a19bb0e19771 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723100 Jul 28 11:27:14.977674 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 300/575] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:14.983696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:14.984654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:14.996849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:14.997699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:14.998594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:14.999161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:15.245787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b0b177f-ab44-4dce-bf9b-41e52aaf4768 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.429435 Jul 28 11:27:15.246761 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 276/576] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:27:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:15.261778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:15.262548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:15.274693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:15.275477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:15.277077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:15.277676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:15.288021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.298248 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc6d5235-4e39-4e3b-bac6-5595b8a60109 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.318843 Jul 28 11:27:15.299302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 301/577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:14 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:15.305207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:15.306489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:15.314255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:15.315215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:15.316173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:15.316776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:15.542445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.560424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.562342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.568404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75d48064-822a-43be-9a89-d0ed8802337b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1361 microversion: 2.25 time: 0.320428 Jul 28 11:27:15.569659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 277/578] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:15 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:15.578254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-237d379c-8900-4c40-b4b4-556e5303951f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb330dd30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:15.629541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.643339 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73d649ac-2f53-44f4-a696-3dffae3fcddc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.340871 Jul 28 11:27:15.644542 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 302/579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:15 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:15.652517 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-237d379c-8900-4c40-b4b4-556e5303951f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a" status: 200 len: 661 microversion: 2.1 time: 0.080723 Jul 28 11:27:15.653188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 278/580] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:15 2022] GET /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:15.663584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c0da79a-4012-43db-9108-a4071eb88397 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:15.665614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c0da79a-4012-43db-9108-a4071eb88397 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:15.745893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c0da79a-4012-43db-9108-a4071eb88397 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:15.757901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c0da79a-4012-43db-9108-a4071eb88397 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1214 microversion: 2.1 time: 0.102000 Jul 28 11:27:15.758941 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 279/581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:15 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:15.778699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cab0b5aa-0b03-4449-b87e-966ac7dd8712 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb3325670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:15.928746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-38454570", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:16.050465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:16.268282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cab0b5aa-0b03-4449-b87e-966ac7dd8712 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/a8038ac2-9c5f-47b8-af86-4346409fcef3" status: 200 len: 142 microversion: 2.1 time: 0.495860 Jul 28 11:27:16.277240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 280/582] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:27:15 2022] GET /compute/v2.1/os-floating-ips/a8038ac2-9c5f-47b8-af86-4346409fcef3 => generated 142 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:16.283085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27cc7371-1350-498e-a3fb-c3ad83d700fa tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb346f790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:16.344651 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27cc7371-1350-498e-a3fb-c3ad83d700fa tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a" status: 200 len: 661 microversion: 2.1 time: 0.065883 Jul 28 11:27:16.345642 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 281/583] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:16 2022] GET /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:16.367320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-333c94df-1a9c-4c59-bd2a-545ab36304af req-d7b05110-4448-4fa5-917a-6bece7c92715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:16.392746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-333c94df-1a9c-4c59-bd2a-545ab36304af req-d7b05110-4448-4fa5-917a-6bece7c92715 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.393651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-333c94df-1a9c-4c59-bd2a-545ab36304af req-d7b05110-4448-4fa5-917a-6bece7c92715 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.421385 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-333c94df-1a9c-4c59-bd2a-545ab36304af req-d7b05110-4448-4fa5-917a-6bece7c92715 service nova] Creating event network-changed:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h1-851368-1 Jul 28 11:27:16.427824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-333c94df-1a9c-4c59-bd2a-545ab36304af req-d7b05110-4448-4fa5-917a-6bece7c92715 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080760 Jul 28 11:27:16.428967 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 282/584] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:16.435840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3c6ac596-e752-485c-be90-979074be6c72 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb32988b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:16.457120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:16.457500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:16.458248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:16.458989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:16.459674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:16.476413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.477265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.478863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.479557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.536711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Getting quotas for project bb7ce63d583a435eaa1a20ab3501347b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:16.557393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Getting quotas for user c553fb2ab09f41f8bd7a345a5bf9c13b and project bb7ce63d583a435eaa1a20ab3501347b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:16.564997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:16.594855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:16.601913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:16.694605 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d9dc3469-8595-42a1-8214-b15611ac9e13 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046186 Jul 28 11:27:16.696324 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 303/585] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:16.703163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:16.704434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:16.714614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.715567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.716657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.717247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.757121 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3c6ac596-e752-485c-be90-979074be6c72 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.326754 Jul 28 11:27:16.767292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 283/586] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:27:16 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:16.772719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:16.773689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:16.789407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.790843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:16.793733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:16.794454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.147378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.162496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.163208 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84ec430d-cd7a-406d-ba71-96494449fe9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.465655 Jul 28 11:27:17.163800 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 304/587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:16 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:17.168440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.169207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:17.173363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.176344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.177921 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78c7f8c3-4d77-4db8-a5d8-9d8a7b33f117 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1361 microversion: 2.25 time: 0.409452 Jul 28 11:27:17.178163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.178595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.187885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.187885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.188783 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 284/588] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:16 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:17.205273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.205900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:17.221445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.223933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.224868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.225318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.332168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.339893 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ecd9a54-b81a-4162-88af-52d7328134f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1221 microversion: 2.1 time: 0.146565 Jul 28 11:27:17.340510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 285/589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:17 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:17.352752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51527530-cdad-4eb6-9c5b-4cef2a8bffc6 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb33560d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.546392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.555043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0dbcae84-116c-4ea3-88f0-ed3d9578e3fe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.390219 Jul 28 11:27:17.555794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 305/590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:17 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:17.560961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.561525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:17.576069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.576863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.577832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:17.578383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:17.699429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:17.709561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33ead680-febf-43b8-b0ea-2cf7d532affc tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1272 microversion: 2.1 time: 0.152550 Jul 28 11:27:17.710398 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 306/591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:17 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:17.778782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d999c2b3-b982-42d1-939c-efbd52e333ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb326e1f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.822814 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d999c2b3-b982-42d1-939c-efbd52e333ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85" status: 200 len: 662 microversion: 2.1 time: 0.048275 Jul 28 11:27:17.823426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 307/592] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:17 2022] GET /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85 => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:27:17.836573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2911a7b-9709-4111-aa5b-cdb3338385d8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3145dc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:17.880586 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2911a7b-9709-4111-aa5b-cdb3338385d8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85" status: 200 len: 662 microversion: 2.1 time: 0.047714 Jul 28 11:27:17.881145 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 308/593] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:17 2022] GET /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85 => generated 662 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:27:18.183833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:18.184477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:18.190738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.191231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.192008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.192448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.457199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:18.469154 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eb20e695-0444-4696-821a-7bfc5230b607 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.289163 Jul 28 11:27:18.469916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 309/594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:18 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:18.475292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:18.475928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:18.481901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.482358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.483143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.483577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.614142 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51527530-cdad-4eb6-9c5b-4cef2a8bffc6 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/a8038ac2-9c5f-47b8-af86-4346409fcef3" status: 202 len: 0 microversion: 2.1 time: 1.267050 Jul 28 11:27:18.615344 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 286/595] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:27:17 2022] DELETE /compute/v2.1/os-floating-ips/a8038ac2-9c5f-47b8-af86-4346409fcef3 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:18.623246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:18.624619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:18.631500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.631952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.633331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.633773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.740221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:18.748312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99a99aae-058f-4e41-ae1d-8a794f1f378a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1221 microversion: 2.1 time: 0.131820 Jul 28 11:27:18.748879 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 287/596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:18 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:18.753222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9c06683b-9862-462c-bec4-4d5457d370d8 req-769594b9-31be-4119-a6a0-12d57ae102e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "name": "network-vif-plugged", "status": "completed", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:18.762700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c06683b-9862-462c-bec4-4d5457d370d8 req-769594b9-31be-4119-a6a0-12d57ae102e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.763165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c06683b-9862-462c-bec4-4d5457d370d8 req-769594b9-31be-4119-a6a0-12d57ae102e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.776863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:18.781949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9c06683b-9862-462c-bec4-4d5457d370d8 req-769594b9-31be-4119-a6a0-12d57ae102e0 service nova] Creating event network-vif-plugged:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h2-851368-1 Jul 28 11:27:18.786352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:18.787895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:18.788803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9c06683b-9862-462c-bec4-4d5457d370d8 req-769594b9-31be-4119-a6a0-12d57ae102e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038785 Jul 28 11:27:18.789213 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-111ca8d6-6a3f-45bf-a542-79d8750d1858 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1361 microversion: 2.25 time: 0.318115 Jul 28 11:27:18.789630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 288/597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:18.789842 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 310/598] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:18 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:18.801578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:18.801578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:18.802362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.803254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.804222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:18.804816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:18.812388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c58b549-a7d7-48a3-bb34-b7ffac1d5390 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Action: 'create', calling method: .version_select at 0x7f2eb3145c10>, body: {"pool": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:18.828997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:19.522570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:19.530700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1fa7e788-955d-46b3-9b9a-2567f005c01a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.740148 Jul 28 11:27:19.531388 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 289/599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:18 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:19.536150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:19.536749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:19.542652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:19.543234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:19.544247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:19.544695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:19.872721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:19.885901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4453b48b-05e8-4bab-b3d6-82e51f48e445 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1314 microversion: 2.1 time: 0.352564 Jul 28 11:27:19.886678 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 290/600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:19 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:19.896444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-23a58847-47e3-4e98-bf72-84022fee3c32 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3331430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:19.981888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-23a58847-47e3-4e98-bf72-84022fee3c32 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19" status: 200 len: 662 microversion: 2.1 time: 0.093343 Jul 28 11:27:19.982476 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 291/601] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:19 2022] GET /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19 => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:19.993378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:19.993995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:20.008360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.009253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.010787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.011441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.458788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:20.466210 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fe08186-f83d-4034-a054-f1fa72f20528 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1311 microversion: 2.1 time: 0.478457 Jul 28 11:27:20.466779 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 292/602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:19 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1311 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:20.482843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:20.483497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:20.489563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.490017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.490790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.491253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.634670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:20.643802 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70a1393e-6c11-4222-b507-ef2076165efb tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1275 microversion: 2.1 time: 0.175751 Jul 28 11:27:20.644708 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 293/603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:20 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:20.653786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:20.654624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:20.671657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.672334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.673391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:20.673941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:20.976801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:20.985772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:20.987302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:20.988695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b0f26c6-3c00-4b29-b6fb-81131a1cbc0b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1361 microversion: 2.25 time: 0.342923 Jul 28 11:27:20.989244 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 294/604] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:20 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:20.994026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbe5ce78-a573-4d57-920d-c1b5b059226c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb33310d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:21.039670 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bbe5ce78-a573-4d57-920d-c1b5b059226c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19" status: 200 len: 662 microversion: 2.1 time: 0.049073 Jul 28 11:27:21.040497 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 295/605] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:20 2022] GET /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19 => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:21.046463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:21.047097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:21.054032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:21.054319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:21.055291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:21.055956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:21.509247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:21.517418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7f58d4a-6f84-43fd-a789-c24248646dfc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.474464 Jul 28 11:27:21.518052 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 296/606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:21 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:21.522428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7319ad0c-5314-432c-b06f-d0eeda7a4d7e req-b67891d8-fe72-42b1-aa4b-0d75135a69f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5", "tag": "470b53a2-2e9c-4ae7-9244-08c7c0201486"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:21.532164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7319ad0c-5314-432c-b06f-d0eeda7a4d7e req-b67891d8-fe72-42b1-aa4b-0d75135a69f5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:21.532541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7319ad0c-5314-432c-b06f-d0eeda7a4d7e req-b67891d8-fe72-42b1-aa4b-0d75135a69f5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:21.544337 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7319ad0c-5314-432c-b06f-d0eeda7a4d7e req-b67891d8-fe72-42b1-aa4b-0d75135a69f5 service nova] Creating event network-changed:470b53a2-2e9c-4ae7-9244-08c7c0201486 for instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 on n-h2-851368-1 Jul 28 11:27:21.549811 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7319ad0c-5314-432c-b06f-d0eeda7a4d7e req-b67891d8-fe72-42b1-aa4b-0d75135a69f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030308 Jul 28 11:27:21.550405 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 297/607] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:21.555384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:21.556419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:21.562925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:21.563422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:21.564187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:21.564625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.277616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:22.285668 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-483b3f70-7dd8-4809-9aa7-a53a6b565e28 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1314 microversion: 2.1 time: 0.734135 Jul 28 11:27:22.286656 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 298/608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:21 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:22.306971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1145605601", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:22.363670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:22.465393 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c58b549-a7d7-48a3-bb34-b7ffac1d5390 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.661097 Jul 28 11:27:22.466099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 311/609] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:27:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:22.470699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:22.471408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:22.479849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.480300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.481073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.481513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.791384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:22.797666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:22.799468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:22.799612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3cf4330b-2352-425d-8a94-2820160dd693 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1494 microversion: 2.1 time: 0.332248 Jul 28 11:27:22.800071 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 312/610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:22 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1494 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:22.800933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:22.801461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:22.802271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:22.805454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:22.806295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:22.813345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.813998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.814966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.815530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.815788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.816742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.818890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.820895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.843196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Getting quotas for project b13821299b7647b6b6d508fa1c1bfd07. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:22.848088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Getting quotas for user 6c2681b19d364fa69126e05da24c4bac and project b13821299b7647b6b6d508fa1c1bfd07. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:22.861045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:22.863524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:22.914619 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d226aa91-ac8c-4235-adab-4a5d884ae226 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626359 Jul 28 11:27:22.915162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 299/611] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:22.919951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:22.920568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:22.926835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.927755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:22.928109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:22.928599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:23.121048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:23.129242 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3ebc67a-65e9-405e-9ed6-30a68b3178f8 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.327965 Jul 28 11:27:23.129815 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 313/612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:22 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:23.136459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4cd2f3d7-1765-46df-a492-60cb92731b7a req-5f95fe72-f3c1-4231-b657-9518b22c4673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "name": "network-vif-plugged", "status": "completed", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:23.148860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4cd2f3d7-1765-46df-a492-60cb92731b7a req-5f95fe72-f3c1-4231-b657-9518b22c4673 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:23.149233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4cd2f3d7-1765-46df-a492-60cb92731b7a req-5f95fe72-f3c1-4231-b657-9518b22c4673 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:23.162626 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4cd2f3d7-1765-46df-a492-60cb92731b7a req-5f95fe72-f3c1-4231-b657-9518b22c4673 service nova] Creating event network-vif-plugged:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h1-851368-1 Jul 28 11:27:23.167735 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4cd2f3d7-1765-46df-a492-60cb92731b7a req-5f95fe72-f3c1-4231-b657-9518b22c4673 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036592 Jul 28 11:27:23.168325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 314/613] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:23.175463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-72a1e203-0049-4066-969e-deab956edff8 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb33b3310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:23.267970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:23.283318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:23.286134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:23.287755 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-752a55fb-1412-4e88-a745-850015d54c36 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1361 microversion: 2.25 time: 0.371562 Jul 28 11:27:23.289405 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 300/614] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:22 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:23.295587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:23.296992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:23.307365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:23.307931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:23.308728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:23.309164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:23.698336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:23.706436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-94cbcef2-546a-46d3-99d7-ac95bf4adefa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.415816 Jul 28 11:27:23.721481 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 301/615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:23 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:23.726484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:23.727204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:23.730541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:23.734960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:23.735431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:23.736196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:23.736631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:24.171590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-819bc99f-a797-46a1-94e1-f1c6931ab0e6 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1645 microversion: 2.1 time: 0.448790 Jul 28 11:27:24.172809 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 302/616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:23 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1645 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:24.177545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-893972253", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:24.232854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:25.302941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:25.303555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:25.303862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:25.304300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:25.304709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:25.313425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.313870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.314660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.315165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.333156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Getting quotas for project b13821299b7647b6b6d508fa1c1bfd07. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:25.337419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Getting quotas for user 6c2681b19d364fa69126e05da24c4bac and project b13821299b7647b6b6d508fa1c1bfd07. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:25.348868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:25.350995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:25.394149 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e916ac88-d438-4e4b-a1ad-5b95697a6d57 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220154 Jul 28 11:27:25.394792 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 303/617] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:25.405440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:25.406162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:25.412170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.412622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.413397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.413834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.635596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-72a1e203-0049-4066-969e-deab956edff8 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b" status: 202 len: 0 microversion: 2.1 time: 2.463814 Jul 28 11:27:25.639402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 315/618] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:27:23 2022] DELETE /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b => generated 0 bytes in 2467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:25.643395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:25.644240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:25.679855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.680414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.681526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.682461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.824714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:25.833572 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-973fd8b6-66e6-42bb-85ef-7d1a3fcb734f tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1314 microversion: 2.1 time: 0.431795 Jul 28 11:27:25.849120 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 304/619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:25 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:25.855724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:25.856798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:25.864168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.864785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:25.865553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:25.866226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.028941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.036414 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01d64f97-970b-467a-bb03-a939f509a2a7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.398550 Jul 28 11:27:26.037211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 316/620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:25 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:26.042355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.043106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.049146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.049774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.050738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.051210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.118001 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e02c0cc5-d995-49d8-9814-3b1857b1151c tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1645 microversion: 2.1 time: 0.267050 Jul 28 11:27:26.118564 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 305/621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:25 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1645 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:26.123157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.124548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.130335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.130772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.131805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.132240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.157786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:27:26.237507 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a51b631f-d397-4972-b08d-e496d5dd9bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 204 len: 0 microversion: 2.1 time: 0.117613 Jul 28 11:27:26.238154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 306/622] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:27:26 2022] DELETE /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:27:26.245199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.245897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.251900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.252283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.253050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.253475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.277848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.290471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.292068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.293428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9de233ad-55dd-4a19-80bf-f01f83dba3e4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1558 microversion: 2.25 time: 0.255297 Jul 28 11:27:26.293986 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 317/623] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:26.303090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3ea8efbf-322a-4e52-8ea9-9d5f2f38ec0e req-cce19564-f9c2-4235-9d63-64d62ac81cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16320f50-fa73-42c8-94bf-5793de42fa53", "tag": "6c390ed7-154a-4d1b-8735-de70405e525f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:26.317794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3ea8efbf-322a-4e52-8ea9-9d5f2f38ec0e req-cce19564-f9c2-4235-9d63-64d62ac81cd4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.318376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3ea8efbf-322a-4e52-8ea9-9d5f2f38ec0e req-cce19564-f9c2-4235-9d63-64d62ac81cd4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.331207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3ea8efbf-322a-4e52-8ea9-9d5f2f38ec0e req-cce19564-f9c2-4235-9d63-64d62ac81cd4 service nova] Creating event network-changed:6c390ed7-154a-4d1b-8735-de70405e525f for instance 16320f50-fa73-42c8-94bf-5793de42fa53 on n-h1-851368-1 Jul 28 11:27:26.336197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3ea8efbf-322a-4e52-8ea9-9d5f2f38ec0e req-cce19564-f9c2-4235-9d63-64d62ac81cd4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040749 Jul 28 11:27:26.336953 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 318/624] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:26.343835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.344617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.351446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.351960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.353013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.353678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.440792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.449268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3984d7d6-72dc-4f52-8d13-3b55219c62e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1221 microversion: 2.1 time: 0.110234 Jul 28 11:27:26.449942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 319/625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:26.461820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb322a040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.491599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:26.530136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.542439 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98c6a404-a0be-476f-b71c-5125bd67f7de tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1477 microversion: 2.1 time: 0.302852 Jul 28 11:27:26.543472 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 307/626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:26.549537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 762eb219-4a79-463a-95a0-7a59a217260b could not be found", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:27:26.550519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] HTTP exception thrown: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.550889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Request method failure captured: Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b HTTP/1.1 Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKPBx_KWu2pgznoDdpsprc32SS7mXCYTbE8ZvNL7Pf_TWH-bdspOgiiajc1Sa4tFDfpY7GG12-KPXRnHSfOGIw5jkPeeoCfiMIVwH_kfEQVS8RsBT_TKN6v5nGc2PqnyrQHHSeKM-rdxOJSi1gOABZ-CjWWPPLSh9wowDdnJCvHeGQ Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: b11c14ad7b9b461fbf77f2c48bd4bc5f Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:26.554179 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}] Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: b11c14ad7b9b461fbf77f2c48bd4bc5f Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPsTestJSON-1513430764-project Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a439ef553b947da8efd9b5b013bd24d Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPsTestJSON-1513430764-project Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: exception: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '762eb219-4a79-463a-95a0-7a59a217260b'} Jul 28 11:27:26.555651 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:27:26.556952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 762eb219-4a79-463a-95a0-7a59a217260b could not be found Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42500891-b93a-4819-89c6-e0394e4d6e4e'] Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b. Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.558040 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:26.559720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:26.561085 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.561085 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.561249 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:26.561249 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:26.561249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.561249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.561249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.561825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.562840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Returning 404 to user: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:26.563715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4591847-4d03-4b20-af2d-4894099e5f96 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b" status: 404 len: 111 microversion: 2.1 time: 0.112498 Jul 28 11:27:26.564414 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 320/627] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:26.569057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.570016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.574084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:26.583813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.584767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.586097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.586810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.614251 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88c35a76-c850-4b60-be06-81a586c5d8bc tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069264 Jul 28 11:27:26.614904 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 308/628] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:26.620188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.620806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.627789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.628240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.629074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.629570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.632659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:26.807638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:26.819312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-660578f0-0264-4c36-bf14-2178a82c423b tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1715 microversion: 2.1 time: 0.253556 Jul 28 11:27:26.819892 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 321/629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1715 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:26.824217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:26.825296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Calling method '.version_select at 0x7f2eb33890d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.855467 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-860f9097-659b-4e17-8aaf-99118ba569bb tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 2050 microversion: 2.25 time: 0.239323 Jul 28 11:27:26.868428 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 309/630] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 2050 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 762eb219-4a79-463a-95a0-7a59a217260b could not be found", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] HTTP exception thrown: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Request method failure captured: Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b HTTP/1.1 Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKPBx_KWu2pgznoDdpsprc32SS7mXCYTbE8ZvNL7Pf_TWH-bdspOgiiajc1Sa4tFDfpY7GG12-KPXRnHSfOGIw5jkPeeoCfiMIVwH_kfEQVS8RsBT_TKN6v5nGc2PqnyrQHHSeKM-rdxOJSi1gOABZ-CjWWPPLSh9wowDdnJCvHeGQ Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: b11c14ad7b9b461fbf77f2c48bd4bc5f Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:26.877663 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b11c14ad7b9b461fbf77f2c48bd4bc5f"}]}] Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: b11c14ad7b9b461fbf77f2c48bd4bc5f Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1513430764 Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPsTestJSON-1513430764-project Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a439ef553b947da8efd9b5b013bd24d Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPsTestJSON-1513430764-project Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: exception: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '762eb219-4a79-463a-95a0-7a59a217260b'} Jul 28 11:27:26.880389 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:27:26.889263 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 762eb219-4a79-463a-95a0-7a59a217260b could not be found Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44d37110-ad2f-4278-8b28-c8431d945221'] Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b. Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.892215 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:26.895688 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] Returning 404 to user: Floating IP not found for ID 762eb219-4a79-463a-95a0-7a59a217260b {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8fd362c6-a6f1-4567-9392-e11ddb96aff4 tempest-FloatingIPsTestJSON-1513430764 tempest-FloatingIPsTestJSON-1513430764-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b" status: 404 len: 111 microversion: 2.1 time: 0.057189 Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 322/631] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:27:26 2022] DELETE /compute/v2.1/os-floating-ips/762eb219-4a79-463a-95a0-7a59a217260b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:26.899728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.909822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.909822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.909822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.909822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.911412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:26.912177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:26.919553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.921921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:26.923942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:26.927270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.053228 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-325ef22d-a196-4bf5-b8be-3ef83627935a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18/action" status: 202 len: 0 microversion: 2.1 time: 0.181088 Jul 28 11:27:27.055607 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 310/632] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:27:26 2022] POST /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:27.064053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.064760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.073095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.073689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.074602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.075170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.310106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:27.319025 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b2b0dc8-937d-4163-8127-ae9c5f491d31 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1314 microversion: 2.1 time: 0.439301 Jul 28 11:27:27.319619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 323/633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:26 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:27.324344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.325202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.332647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.333392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.334662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.335217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.357488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:27.363868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:27.378491 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c1a895bc-01fe-4a16-a825-387ca36f8705 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 2050 microversion: 2.25 time: 0.320451 Jul 28 11:27:27.379428 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 311/634] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 2050 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:27.383862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.384743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.390675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.391526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.392553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.393209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.625125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:27.635831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d8f9cd9-e33b-488b-92c2-7b40a49bdb49 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.314937 Jul 28 11:27:27.649631 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 324/635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:27.662750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.665544 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:27.665544 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:27.667563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.668092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.668972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.669473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.702159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c00d28f2-cbdb-4974-9371-a9d192a80ede tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050550 Jul 28 11:27:27.702899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 325/636] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:27:27.714589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.716100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.726367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.726833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.727667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.728127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.755349 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e305fd48-bbf4-4fc0-9d8b-a9559fd02695 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1650 microversion: 2.1 time: 0.374574 Jul 28 11:27:27.759143 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 312/637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1650 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:27.766426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:27.767034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.773669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.775971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.777161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.777828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.882456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:27.890901 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-221b8313-a1b8-4577-8412-d920e825d8e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1277 microversion: 2.1 time: 0.186835 Jul 28 11:27:27.891496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 326/638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:27.896365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:27.897123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:27.904127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.904810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:27.905789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:27.906442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.032523 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-549043f1-ef5c-4464-a2ac-f0071cd0ed39 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf/action" status: 202 len: 0 microversion: 2.25 time: 0.137983 Jul 28 11:27:28.033330 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 327/639] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:27:27 2022] POST /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:27:28.045698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:28.047108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:28.055832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.057027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.057604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.058254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.378526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:28.389774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6be5a7d-ae27-40ce-ad3f-d98878853929 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1476 microversion: 2.1 time: 0.628762 Jul 28 11:27:28.390721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 313/640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:27 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:28.397047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:28.398831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:28.409576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.410393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.412392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.413889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.625993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:28.641215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da05f532-d784-4191-9fb7-6167752fae24 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1715 microversion: 2.1 time: 0.602667 Jul 28 11:27:28.657527 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 328/641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:28 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1715 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:28.664515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:28.665459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:28.672399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.672852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:28.674585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:28.675031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:29.307319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:29.323745 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec381254-f659-487c-abd7-040cb18e3535 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 2055 microversion: 2.25 time: 0.931391 Jul 28 11:27:29.325106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 314/642] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:28 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 2055 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:29.330380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7a2d1e1c-59e6-4b41-b66f-bf53d5633026 req-fb7a33d8-b695-425d-b895-4d1f9eaea382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5", "name": "network-vif-plugged", "status": "completed", "tag": "470b53a2-2e9c-4ae7-9244-08c7c0201486"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:29.341105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7a2d1e1c-59e6-4b41-b66f-bf53d5633026 req-fb7a33d8-b695-425d-b895-4d1f9eaea382 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:29.341902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7a2d1e1c-59e6-4b41-b66f-bf53d5633026 req-fb7a33d8-b695-425d-b895-4d1f9eaea382 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:29.353859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7a2d1e1c-59e6-4b41-b66f-bf53d5633026 req-fb7a33d8-b695-425d-b895-4d1f9eaea382 service nova] Creating event network-vif-plugged:470b53a2-2e9c-4ae7-9244-08c7c0201486 for instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 on n-h2-851368-1 Jul 28 11:27:29.364558 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7a2d1e1c-59e6-4b41-b66f-bf53d5633026 req-fb7a33d8-b695-425d-b895-4d1f9eaea382 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037952 Jul 28 11:27:29.369290 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 315/643] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:29.374825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:29.375804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:29.382622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:29.383093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:29.383890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:29.384391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:29.495552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:29.503442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-940f1f2b-e03d-4c03-86e5-b92da0e96066 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1314 microversion: 2.1 time: 0.844699 Jul 28 11:27:29.504038 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 329/644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:28 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:29.521952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:29.522580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:29.534986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:29.534986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:29.535827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:29.536271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.047111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:30.079011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-65866016-335f-4282-905b-d8585429daff tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.707886 Jul 28 11:27:30.080654 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 316/645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:29 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:30.095249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:30.099918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:30.115240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.116341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.131498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.133512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.142870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca58d16e-42ab-4c25-ba0e-b184b31565b4 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1630 microversion: 2.1 time: 0.637546 Jul 28 11:27:30.147675 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 330/646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:29 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1630 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:30.161215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:30.162058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:30.185649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.186379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.187430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.191734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.284486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:30.297152 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5adf9b5-0628-44da-aaa5-739757dd97eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1287 microversion: 2.1 time: 0.214048 Jul 28 11:27:30.298002 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 317/647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:30 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:30.302975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:30.308787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:30.324658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.325415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.326485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.327330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.660302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:30.711289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7294bc58-da7a-487c-8d1a-7db5e879f1f7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1476 microversion: 2.1 time: 0.556962 Jul 28 11:27:30.757285 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 331/648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:30 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:30.803286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:30.819189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:30.836416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.838407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.842156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:30.842601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:30.934920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e94603a7ad4df4a79f38b48c063ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17dc42396ba4ec0bdca9f3e08b42555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:30.957153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae37d7f6-cdf5-4659-88ba-bc2aea11fa7c tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 200 len: 1715 microversion: 2.1 time: 0.657543 Jul 28 11:27:30.959537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 318/649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:30 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 1715 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:30.974737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "name": "network-vif-unplugged", "status": "completed", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:31.008344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:31.008883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:31.021623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lazy-loading 'flavor' on Instance uuid 9c1d97a9-421f-485d-8322-4b75e50fde18 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:31.039700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] Creating event network-vif-unplugged:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h2-851368-1 Jul 28 11:27:31.053052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] Instance 09408043-13e3-4390-8f50-8c8703ae3b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:27:31.081156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-75759441-c866-4ec9-8436-2417ce2371ff req-894fc1fe-314f-49f2-9408-a2d8422b28b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120186 Jul 28 11:27:31.082280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 319/650] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:31.088602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:31.099445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:31.106479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:31.107267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:31.108275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:31.108933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:31.126190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Going to try to live migrate instance to n-h1-851368-1 {{(pid=119236) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:27:31.913871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:31.934503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f647746-279e-470f-b91c-b2622b3b3edd tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 2035 microversion: 2.25 time: 0.850843 Jul 28 11:27:31.938399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 320/651] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:31 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 2035 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:31.987865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:31.988742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:31.998521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:31.999367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:32.000354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:32.001168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:32.899364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:32.918482 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfca86f5-a90c-401b-a0c5-de7f6973a06e tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1463 microversion: 2.1 time: 0.978096 Jul 28 11:27:32.920154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 321/652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:31 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1463 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:32.939004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:32.939688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:32.946680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:32.952297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:32.953401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:32.953856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.169180 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c8ed6de-d155-458d-aeea-b814273b582d tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18/action" status: 202 len: 0 microversion: 2.1 time: 2.385325 Jul 28 11:27:33.170452 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 332/653] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:27:30 2022] POST /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18/action => generated 0 bytes in 2412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:33.181922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:33.183104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:33.214199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.215606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.219872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.220513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.392151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:33.403435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1851e28d-27c3-49d7-bc0a-866023ba7421 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1275 microversion: 2.1 time: 0.231357 Jul 28 11:27:33.404360 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 333/654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:33 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:33.410658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:33.412145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:33.423167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.423616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.424963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.425582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.479113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:33.499641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc869a1a-c244-46fa-b688-8e30a5f50dca tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.578226 Jul 28 11:27:33.502625 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 322/655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:32 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:33.514794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851368-1", "block_migration": "auto"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:33.520255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:33.545603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.552775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.556216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.558486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.622452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'flavor' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:33.642948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Going to try to live migrate instance to n-h2-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:27:33.672486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:33.753911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:33.779949 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1cd3529-1765-45a2-8b99-72cb9dd95693 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1476 microversion: 2.1 time: 0.359432 Jul 28 11:27:33.782969 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 334/656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:33 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:33.793122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:33.793987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:33.800875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.802258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.803273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:33.804172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:33.842185 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f HTTP/1.1 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:33.844147 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:33.845583 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74d4f6b0-68cb-4d66-997b-8ce975ce1e9f'} Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:33.846532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:33.847956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:33.850363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:33.852699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10573c4e-bd84-412a-8e42-1b14914c211f tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 404 len: 111 microversion: 2.1 time: 0.067693 Jul 28 11:27:33.854046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 335/657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:33 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:34.171829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Calling method '.version_select at 0x7f2eb301d5e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:34.194958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.196599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.231900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.232382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.257735 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8daac666-bea5-4b07-98f4-8e28750ac38a tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/7b2f86d16fa4429c8b3a7a1832f514d3?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186" status: 200 len: 691 microversion: 2.1 time: 0.402290 Jul 28 11:27:34.258415 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 336/658] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 28 11:27:33 2022] GET /compute/v2.1/os-simple-tenant-usage/7b2f86d16fa4429c8b3a7a1832f514d3?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186 => generated 691 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:34.265061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}, {"name": "network-changed", "server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}, {"server_uuid": "74d4f6b0-68cb-4d66-997b-8ce975ce1e9f", "name": "network-vif-deleted", "tag": "a605567d-901a-4631-92a9-83bee7fd875e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:34.284387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.284834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.302364 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Creating event network-changed:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:27:34.303144 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Creating event network-changed:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h2-851368-1 Jul 28 11:27:34.303771 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Creating event network-vif-deleted:a605567d-901a-4631-92a9-83bee7fd875e for instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f on n-h2-851368-1 Jul 28 11:27:34.310855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] Instance 09408043-13e3-4390-8f50-8c8703ae3b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:27:34.326871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5db515a9-1b77-40a9-9707-165bf8b17bc3 req-eebdb0fb-3588-4650-8a85-02b504048ee0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.067010 Jul 28 11:27:34.328054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 337/659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:34.334027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-49f0c0fb-84e9-43ae-8464-ca64df2532b7 req-55243202-7300-4c7e-acd9-c5fb0de66023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16320f50-fa73-42c8-94bf-5793de42fa53", "name": "network-vif-plugged", "status": "completed", "tag": "6c390ed7-154a-4d1b-8735-de70405e525f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:34.344916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-49f0c0fb-84e9-43ae-8464-ca64df2532b7 req-55243202-7300-4c7e-acd9-c5fb0de66023 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.345625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-49f0c0fb-84e9-43ae-8464-ca64df2532b7 req-55243202-7300-4c7e-acd9-c5fb0de66023 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.367870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-49f0c0fb-84e9-43ae-8464-ca64df2532b7 req-55243202-7300-4c7e-acd9-c5fb0de66023 service nova] Creating event network-vif-plugged:6c390ed7-154a-4d1b-8735-de70405e525f for instance 16320f50-fa73-42c8-94bf-5793de42fa53 on n-h1-851368-1 Jul 28 11:27:34.376433 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-49f0c0fb-84e9-43ae-8464-ca64df2532b7 req-55243202-7300-4c7e-acd9-c5fb0de66023 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 Jul 28 11:27:34.379386 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 338/660] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:34.388707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:34.389827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:34.396281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.396661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.397419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.397849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.884226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:34.895690 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be74d55c-887f-4b96-a604-1f4389001e28 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.513870 Jul 28 11:27:34.896964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 339/661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:34 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:34.902491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:34.903040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:34.909287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.910444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.911370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.911900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.928846 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 HTTP/1.1 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:34.930519 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:34.932249 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '5591b2a9-3128-4b07-8a65-50f2690e9064'} Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:34.933156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:34.934600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:34.936142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:34.936142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d08ce410-262e-463b-96a1-7846f7d92682 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 404 len: 111 microversion: 2.1 time: 0.036413 Jul 28 11:27:34.940334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 340/662] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:27:34 2022] DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:34.945458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '.version_select at 0x7f2eb2fc75e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:34.955754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.956285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.968554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.968994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.982637 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f75df8b3-64f4-4e6b-adc4-6fd14e6de1ae tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/7b2f86d16fa4429c8b3a7a1832f514d3?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186" status: 200 len: 695 microversion: 2.1 time: 0.041111 Jul 28 11:27:34.983237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 341/663] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 28 11:27:34 2022] GET /compute/v2.1/os-simple-tenant-usage/7b2f86d16fa4429c8b3a7a1832f514d3?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186 => generated 695 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:34.987969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:34.988731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:34.996573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.997023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:34.997790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:34.998702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:35.013977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:35.344583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=24 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:35.545320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:35.568985 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0aad533c-9f2a-4310-b33b-b1c1b7289dbf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.582734 Jul 28 11:27:35.571640 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 342/664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:34 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:35.577263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:35.578307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:35.589717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:35.590407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:35.592768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:35.593418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:35.858308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8218d1e3-5d9f-4183-bf28-7c97de46b2b5 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf/action" status: 202 len: 0 microversion: 2.25 time: 2.353459 Jul 28 11:27:35.864355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 323/665] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:27:33 2022] POST /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf/action => generated 0 bytes in 2361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:27:35.872478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:35.875947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:35.886628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:35.887446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:35.888523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:35.889545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.166012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:36.177466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06c6a275-690c-4e8b-a6fb-976f8a162b29 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1317 microversion: 2.1 time: 0.601886 Jul 28 11:27:36.178076 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 343/666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:35 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:36.186064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:36.186686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:36.198589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.199046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.199854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.200464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.217159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 HTTP/1.1 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:36.218863 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:36.220388 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '5591b2a9-3128-4b07-8a65-50f2690e9064'} Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:36.221241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:36.222723 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:36.225924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:36.226873 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce29a861-4653-4e53-9247-b6e535729e12 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 404 len: 111 microversion: 2.1 time: 0.044543 Jul 28 11:27:36.231423 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 344/667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:36 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:36.236911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Calling method '.version_select at 0x7f2eb303ab80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:36.247522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.248233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.268441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.268952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.288639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:36.301064 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24032711-0e05-45bc-a484-ba94402229b5 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1474 microversion: 2.1 time: 0.434907 Jul 28 11:27:36.310474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a8f557b-cf1d-4fbc-9a6e-12d836b7a61f tempest-TenantUsagesTestJSON-358501077 tempest-TenantUsagesTestJSON-358501077-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186&detailed=1" status: 200 len: 6734 microversion: 2.1 time: 0.077713 Jul 28 11:27:36.311612 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 345/668] 10.222.0.93 () {58 vars in 1335 bytes} [Thu Jul 28 11:27:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T11%3A27%3A32.933186&end=2022-07-29T11%3A27%3A32.933186&detailed=1 => generated 6734 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:36.317510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-15b3c186-0842-4183-ab6d-6274ddf46c96 req-9c4f47b6-6479-43c3-829e-79c305686653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "name": "network-vif-unplugged", "status": "completed", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:36.320321 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 324/669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:35 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1474 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:36.329985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-15b3c186-0842-4183-ab6d-6274ddf46c96 req-9c4f47b6-6479-43c3-829e-79c305686653 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.330928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-15b3c186-0842-4183-ab6d-6274ddf46c96 req-9c4f47b6-6479-43c3-829e-79c305686653 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.335380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:36.336006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:36.344079 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-15b3c186-0842-4183-ab6d-6274ddf46c96 req-9c4f47b6-6479-43c3-829e-79c305686653 service nova] Creating event network-vif-unplugged:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h2-851368-1 Jul 28 11:27:36.350652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-15b3c186-0842-4183-ab6d-6274ddf46c96 req-9c4f47b6-6479-43c3-829e-79c305686653 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037128 Jul 28 11:27:36.352124 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 346/670] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:36.355564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.356081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.358272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.359908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:36.360791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:36.362196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.381919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.390533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.391768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:36.392372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:36.578970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:37.074002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:37.085999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:37.088570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:37.089970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5e5e9bc-f533-4ec7-b8b0-16980b40e24c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.768603 Jul 28 11:27:37.090779 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 325/671] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:36 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:37.095774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20f99358-6b4b-4e58-a31b-04532102c0a0 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '.version_select at 0x7f2eb3356af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:37.107712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:37.117703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20f99358-6b4b-4e58-a31b-04532102c0a0 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723843283" status: 202 len: 0 microversion: 2.1 time: 0.025519 Jul 28 11:27:37.119359 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 326/672] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723843283 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:37.123582 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0f48f61-0a76-49fe-b419-309fb32c4cb2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.763977 Jul 28 11:27:37.125677 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 347/673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:36 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:37.155771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ec7ae2dd-cc4d-49d9-b2fa-49125768efb2 req-3fa522a9-d9e1-4153-a4af-31482da16400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffe02a6-d004-4892-b66a-5ec170b6b039", "tag": "4cd77d76-1baf-42eb-82a8-7cad5959f74a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:37.156220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:37.156749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:37.166471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.166927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.167948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.168606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.169260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ec7ae2dd-cc4d-49d9-b2fa-49125768efb2 req-3fa522a9-d9e1-4153-a4af-31482da16400 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.169999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ec7ae2dd-cc4d-49d9-b2fa-49125768efb2 req-3fa522a9-d9e1-4153-a4af-31482da16400 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.191896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ec7ae2dd-cc4d-49d9-b2fa-49125768efb2 req-3fa522a9-d9e1-4153-a4af-31482da16400 service nova] Creating event network-changed:4cd77d76-1baf-42eb-82a8-7cad5959f74a for instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 on n-h1-851368-1 Jul 28 11:27:37.206032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ec7ae2dd-cc4d-49d9-b2fa-49125768efb2 req-3fa522a9-d9e1-4153-a4af-31482da16400 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077783 Jul 28 11:27:37.208129 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 348/674] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:37.209998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:27:37.221126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:37.223529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:37.240262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.241224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.243576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.245340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.377028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be0776da-42ac-4df3-b72d-49c8b07479e2 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "DELETE /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 204 len: 0 microversion: 2.1 time: 0.256028 Jul 28 11:27:37.377927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 327/675] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:27:37 2022] DELETE /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:27:37.484793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1250822626", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "4fddd136-8334-4165-9137-14d500573a3f"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:37.550629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] validate_networks() for [('4fddd136-8334-4165-9137-14d500573a3f', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:37.900144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:37.908773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60868bd6-1319-416c-bee8-52b842c3bc56 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.697841 Jul 28 11:27:37.926802 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 349/676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:37 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:37.937990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:37.938821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:37.945416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.964482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:37.965464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:37.965920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.277889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:38.286425 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8aafd6f4-307a-4a6b-9473-c19c8fe189d3 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1467 microversion: 2.1 time: 0.357906 Jul 28 11:27:38.287261 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 350/677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:37 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:38.292198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:38.292812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:38.298905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.299339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.300122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.300559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.528222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:38.529269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:38.529988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:38.530639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:38.531309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:38.541340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.542028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.543086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.543748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.569972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:38.575597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for user 8efe0fe3f3db4805962d856d017f82de and project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:38.578801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:38.587681 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45651c3b-bb56-49e9-8d69-703d47ab458a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1474 microversion: 2.1 time: 0.299264 Jul 28 11:27:38.591161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:38.594172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:38.600891 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 351/678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:38 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:38.610954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:38.611996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:38.621961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.622769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.623851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.624452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.665503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a90628b-c056-472c-83a9-abdd9faaa1fc tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285818 Jul 28 11:27:38.665911 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 328/679] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:38.708876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:38.709564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:38.718941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:38.730445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.731463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.732501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.733043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.853353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:38.866696 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-971ac254-b956-44ad-b392-7f180ecbdda0 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1469 microversion: 2.1 time: 0.264601 Jul 28 11:27:38.867320 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 352/680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:38 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:38.880177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:38.881165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:38.894404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.895214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:38.896116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:38.896710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.104044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:39.114080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:39.116077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:39.117267 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afbe5761-54e6-4285-ac52-b6dbc4451e0e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.450349 Jul 28 11:27:39.118300 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 329/681] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:38 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:39.163421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:39.173267 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c8e6b2a-2854-4c70-a739-9a80f54235be tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.302235 Jul 28 11:27:39.175231 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 353/682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:38 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:39.181136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-445c558e-8218-42f4-a794-1b34786749f8 req-2fdfa4fe-7bad-482b-bacb-b8ad1678110c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:39.188321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:39.202762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-445c558e-8218-42f4-a794-1b34786749f8 req-2fdfa4fe-7bad-482b-bacb-b8ad1678110c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.203791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-445c558e-8218-42f4-a794-1b34786749f8 req-2fdfa4fe-7bad-482b-bacb-b8ad1678110c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.218587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-445c558e-8218-42f4-a794-1b34786749f8 req-2fdfa4fe-7bad-482b-bacb-b8ad1678110c service nova] Creating event network-changed:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h2-851368-1 Jul 28 11:27:39.225480 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-445c558e-8218-42f4-a794-1b34786749f8 req-2fdfa4fe-7bad-482b-bacb-b8ad1678110c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048779 Jul 28 11:27:39.229735 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 354/683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:39.235713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3efa1f11-6028-40e4-a9c9-349ebf828d02 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:39.236794 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:39.236794 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:27:39.264644 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3efa1f11-6028-40e4-a9c9-349ebf828d02 tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1477067090" status: 202 len: 0 microversion: 2.1 time: 0.033426 Jul 28 11:27:39.265989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 355/684] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:27:39 2022] DELETE /compute/v2.1/flavors/1477067090 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:39.271491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-589fd019-f176-4e68-b3b7-a586901eb321 req-6bc0d947-2016-4f87-8e4d-0cafffd1c2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-plugged", "status": "completed", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:39.279762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-739995743", "block_migration": true, "disk_over_commit": false}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:39.283929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:39.285828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-589fd019-f176-4e68-b3b7-a586901eb321 req-6bc0d947-2016-4f87-8e4d-0cafffd1c2fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.290901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-589fd019-f176-4e68-b3b7-a586901eb321 req-6bc0d947-2016-4f87-8e4d-0cafffd1c2fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.291569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.292171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.294006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.294731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.305077 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-589fd019-f176-4e68-b3b7-a586901eb321 req-6bc0d947-2016-4f87-8e4d-0cafffd1c2fd service nova] Creating event network-vif-plugged:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:27:39.311538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-589fd019-f176-4e68-b3b7-a586901eb321 req-6bc0d947-2016-4f87-8e4d-0cafffd1c2fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043719 Jul 28 11:27:39.312310 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 356/685] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:39.320150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-946078580", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "4fddd136-8334-4165-9137-14d500573a3f"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:39.345389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lazy-loading 'flavor' on Instance uuid 16320f50-fa73-42c8-94bf-5793de42fa53 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:27:39.363765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Going to try to live migrate instance to tempest-host-739995743 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:27:39.374748 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] HTTP exception thrown: Compute host tempest-host-739995743 could not be found. Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Request method failure captured: Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53/action HTTP/1.1 Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 106 Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKSUn2xQgCfWe4cPuOVVZCRfasHxckHLklKfrhd9vaFcgXMDlUIJFG3iuPNrY6e5I97oUCyNy5cLlemX133qJ1cHXIM_KjFutAwvtdw2dCFaISpIc3IcQru7xF19oSgVCQMfhsPALYh8lDNRdvBO2LNpsOrLmU-aYikQzMGiKxRoXs Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 53ae559c71ca456c8de5ad7279da9aaa Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:27:39.379057 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53ae559c71ca456c8de5ad7279da9aaa"}]}] Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 53ae559c71ca456c8de5ad7279da9aaa Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-LiveMigrationNegativeTest-1858270889-project-admin Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 42c77a9a20824348b89cf9e17a755c0c Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-LiveMigrationNegativeTest-1858270889-project-admin Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: {"os-migrateLive": {"host": "tempest-host-739995743", "block_migration": true, "disk_over_commit": false}} Jul 28 11:27:39.380762 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: exception: Compute host tempest-host-739995743 could not be found. Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '16320f50-fa73-42c8-94bf-5793de42fa53', 'body': {'os-migrateLive': {'host': 'tempest-host-739995743', 'block_migration': True, 'disk_over_commit': False}}} Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:27:39.381647 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5437, in live_migrate Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-739995743 could not be found. Jul 28 11:27:39.383021 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-739995743 could not be found. Jul 28 11:27:39.387957 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-739995743 could not be found. Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Returning 400 to user: Compute host tempest-host-739995743 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-853eba92-9e0b-4052-8937-95e44f27f989 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53/action" status: 400 len: 99 microversion: 2.1 time: 0.261124 Jul 28 11:27:39.389435 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 330/686] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 28 11:27:39 2022] POST /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53/action => generated 99 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:27:39.397097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:39.397722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:39.410393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] validate_networks() for [('4fddd136-8334-4165-9137-14d500573a3f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:39.419224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.419690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.420740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.421255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.841351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:39.863324 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d44f196-9281-4a1b-bc5f-fe14397e6917 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.476164 Jul 28 11:27:39.864179 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 331/687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:39 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:39.872288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a3b89885-0327-402c-9186-39584bc588ca tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:39.897019 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a3b89885-0327-402c-9186-39584bc588ca tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.031075 Jul 28 11:27:39.897919 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 332/688] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:27:39 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:39.902596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:39.903481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:39.910182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.910864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:39.911829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:39.912520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:40.818538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:40.827224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00c23cbd-9624-4407-9b46-49d92fcb4c4a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1467 microversion: 2.1 time: 0.928144 Jul 28 11:27:40.837416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 333/689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:39 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1467 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:40.844870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:40.847093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:40.858774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:40.860449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:40.861652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:40.862411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:40.917727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:40.918137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:40.918245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:40.918620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:40.919026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:40.934302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:40.934747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:40.935578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:40.936196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:40.971422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:40.975808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for user 8efe0fe3f3db4805962d856d017f82de and project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:40.988101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:40.990716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:41.053905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-908fe1b3-e3a3-4f43-bcbb-d89515616db9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739738 Jul 28 11:27:41.055523 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 357/690] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:41.062144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:41.063266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:41.072398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.073077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:41.074207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.074792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:41.786941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:41.800123 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88294e29-5978-445e-9504-2708984c2fb0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.960570 Jul 28 11:27:41.830516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 334/691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:40 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:41.843693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68a0dd38-4add-4077-8d10-28af93bd838b tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:41.844695 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:27:41.844695 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:27:41.875142 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68a0dd38-4add-4077-8d10-28af93bd838b tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1385482101" status: 202 len: 0 microversion: 2.1 time: 0.042894 Jul 28 11:27:41.876917 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 335/692] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:27:41 2022] DELETE /compute/v2.1/flavors/1385482101 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:27:41.885759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:41.890001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:41.907532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.908334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:41.909744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.910875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:41.918957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ed4c22e33040f9952b722136dd6e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2f86d16fa4429c8b3a7a1832f514d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:41.938800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af194297-2d0d-4c93-b483-d0931c4fe38d tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 200 len: 1469 microversion: 2.1 time: 0.881629 Jul 28 11:27:41.939524 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 358/693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:41 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 1469 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:41.944241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:41.944854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:41.972614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.973070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:41.973859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:41.974303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:42.810972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:42.821604 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d85c955-b962-44bc-ac44-cf6f5c0804e4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.878630 Jul 28 11:27:42.822235 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 359/694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:41 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:42.831002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:42.831671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:42.842209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:42.849126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:42.849578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:42.850563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:42.852499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:42.857940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:42.860994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:42.862775 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2cfceba-bf1b-4e57-9242-54febb366155 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.983947 Jul 28 11:27:42.867693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 336/695] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:41 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:42.894897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-323884206", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:42.994268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:43.588907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:43.603444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a72a701-cac3-4305-a9f6-f0b79e8852b9 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.777675 Jul 28 11:27:43.620288 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 360/696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:42 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:43.626150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-396405787", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "451", "networks": [{"uuid": "4fddd136-8334-4165-9137-14d500573a3f"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:43.723010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] validate_networks() for [('4fddd136-8334-4165-9137-14d500573a3f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:27:43.900872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:43.901415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:43.902077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:43.902547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:43.903297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:43.925174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:43.925174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:43.925944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:43.926435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:43.975673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Getting quotas for project bb7ce63d583a435eaa1a20ab3501347b. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:43.980155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Getting quotas for user c553fb2ab09f41f8bd7a345a5bf9c13b and project bb7ce63d583a435eaa1a20ab3501347b. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:43.997865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:44.000120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:44.074877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77124956-de5a-488a-bf79-ce735335195e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204980 Jul 28 11:27:44.084464 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 337/697] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:44.091786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "name": "network-vif-plugged", "status": "completed", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:44.105291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.106120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.122979 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] Creating event network-vif-plugged:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h2-851368-1 Jul 28 11:27:44.131782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] Instance 09408043-13e3-4390-8f50-8c8703ae3b3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:27:44.148424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-742dd881-2339-4240-b2c1-903dedf2458c req-6470f4ca-3417-47a7-adbb-4ee971f81ec6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062177 Jul 28 11:27:44.149633 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 338/698] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:44.157083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:44.158137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:44.165079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.165875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.167351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.168156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.266193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-267f77e8-78ab-4585-aab7-9062246b1c68 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e/action" status: 204 len: 0 microversion: 2.1 time: 0.114040 Jul 28 11:27:44.267573 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 339/699] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:27:44 2022] POST /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e/action => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:27:44.289119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0731e556-6418-4306-8655-0974048f846a tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:44.324171 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0731e556-6418-4306-8655-0974048f846a tempest-ServersWithSpecificFlavorTestJSON-1855643727 tempest-ServersWithSpecificFlavorTestJSON-1855643727-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055057 Jul 28 11:27:44.333590 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 340/700] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:27:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:44.351256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-503aa877-c65b-495d-b86b-9fb55d66ae43 req-d6df2503-8fff-43f0-a658-f33f3859bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5", "name": "network-vif-deleted", "tag": "470b53a2-2e9c-4ae7-9244-08c7c0201486"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:44.367212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-503aa877-c65b-495d-b86b-9fb55d66ae43 req-d6df2503-8fff-43f0-a658-f33f3859bbfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.368193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-503aa877-c65b-495d-b86b-9fb55d66ae43 req-d6df2503-8fff-43f0-a658-f33f3859bbfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.381562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-503aa877-c65b-495d-b86b-9fb55d66ae43 req-d6df2503-8fff-43f0-a658-f33f3859bbfd service nova] Creating event network-vif-deleted:470b53a2-2e9c-4ae7-9244-08c7c0201486 for instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 on n-h2-851368-1 Jul 28 11:27:44.387425 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-503aa877-c65b-495d-b86b-9fb55d66ae43 req-d6df2503-8fff-43f0-a658-f33f3859bbfd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052555 Jul 28 11:27:44.388603 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 341/701] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:44.394957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:44.395998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] [instance: 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:44.403737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.404459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.405603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.406132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.411623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:44.426233 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] HTTP exception thrown: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Request method failure captured: Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 HTTP/1.1 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKP5Liz8JyGbQzbcOgo5uZ298mX4ZSf41yBiaAeve4nu_EANXbpeocffHj-sTdAOs1peED4ZGQPYVbSLMtI2LGVN7SMLGwr9pMB3uQXUOwgQEmWDuktjJ1bdOQGSSLaIxhTkfdY0NqOj6rVqkhqgm3tMjHNuZzMidkRvqF4BhEnIfE Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 7b2f86d16fa4429c8b3a7a1832f514d3 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TenantUsagesTestJSON-1833599383 Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:44.428102 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b2f86d16fa4429c8b3a7a1832f514d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b2f86d16fa4429c8b3a7a1832f514d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b2f86d16fa4429c8b3a7a1832f514d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b2f86d16fa4429c8b3a7a1832f514d3"}]}] Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TenantUsagesTestJSON-1833599383 Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 7b2f86d16fa4429c8b3a7a1832f514d3 Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1833599383 Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TenantUsagesTestJSON-1833599383-project Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 53ed4c22e33040f9952b722136dd6e5e Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TenantUsagesTestJSON-1833599383-project Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. Jul 28 11:27:44.429505 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5'} Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:44.430325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. Jul 28 11:27:44.434324 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:44.437144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] Returning 404 to user: Instance 35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:44.437144 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bd1c642-8a43-4a8b-b5bd-563942c021d8 tempest-TenantUsagesTestJSON-1833599383 tempest-TenantUsagesTestJSON-1833599383-project] 10.222.0.93 "GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5" status: 404 len: 111 microversion: 2.1 time: 0.039619 Jul 28 11:27:44.437144 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 342/702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:44 2022] GET /compute/v2.1/servers/35a6a3b9-9a5a-48ae-bce9-3c6a0ed643d5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:44.437144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9beb411d-4fc1-4d16-953b-3608afec8ab0 req-0493e7a2-008b-4253-ad74-d6093f972a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1eae57-5ddc-4644-b62e-7a5342ad0210", "tag": "6cab6cba-9655-446a-bd21-2cf98735e092"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:44.449820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9beb411d-4fc1-4d16-953b-3608afec8ab0 req-0493e7a2-008b-4253-ad74-d6093f972a20 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.450261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9beb411d-4fc1-4d16-953b-3608afec8ab0 req-0493e7a2-008b-4253-ad74-d6093f972a20 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.464427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9beb411d-4fc1-4d16-953b-3608afec8ab0 req-0493e7a2-008b-4253-ad74-d6093f972a20 service nova] Creating event network-changed:6cab6cba-9655-446a-bd21-2cf98735e092 for instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 on n-h2-851368-1 Jul 28 11:27:44.471162 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9beb411d-4fc1-4d16-953b-3608afec8ab0 req-0493e7a2-008b-4253-ad74-d6093f972a20 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039611 Jul 28 11:27:44.472310 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 343/703] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:44.478557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:44.480777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:44.488450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.488949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.489736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.490179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.852297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:27:44.854199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:27:44.854885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:27:44.855698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:27:44.856418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:27:44.867925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.868323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.869215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:44.869690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:44.891299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:44.895692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Getting quotas for user 8efe0fe3f3db4805962d856d017f82de and project e4bdb9a00e7a45ad8fa087550f1a53ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:44.907963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:27:44.910567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:27:44.997017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:45.008543 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95e45f1d-9975-45fc-88a5-c3dfcdc54689 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.534915 Jul 28 11:27:45.010910 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 344/704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:44 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:45.026957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:45.031283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a06b956-a58d-445b-bb6b-e5fe18a4c14a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409074 Jul 28 11:27:45.032135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 361/705] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:27:45.033038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:45.045920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:45.046732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:45.055458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.055956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.056757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.057206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.057444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.058165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.059464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.060150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.233339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:45.246017 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19ae94f3-ac41-4b2d-bf0e-e3d8cc8f2862 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1222 microversion: 2.1 time: 0.205496 Jul 28 11:27:45.261744 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 362/706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:45 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:45.273058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:45.280451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:45.297087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.297087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.304884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:45.306548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:45.930556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:45.939823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:45.941332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:45.942510 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4271f2a8-661d-42f9-a549-c8ceffe8c082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.929309 Jul 28 11:27:45.943224 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 345/707] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:45 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:45.975921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:45.976436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:46.005957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.014201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.015309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.022645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.054067 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f HTTP/1.1 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:46.055807 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:46.057790 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74d4f6b0-68cb-4d66-997b-8ce975ce1e9f'} Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:46.058543 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:46.059837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:46.062643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:46.062643 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-458b5912-2a64-4526-a0d7-2fc9d2d13bda tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 404 len: 111 microversion: 2.1 time: 0.085808 Jul 28 11:27:46.063934 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 346/708] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:27:45 2022] DELETE /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:46.080779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:46.081904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:46.106365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.106939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.109237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.109944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.195349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:46.207222 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b028229-3d94-4899-8844-c689d6cc41e6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.944121 Jul 28 11:27:46.213262 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 363/709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:45 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:46.224506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:46.225367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:46.241009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.241839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.244693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.245425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.497897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:46.506960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a23c510-4dd3-4d75-9719-fc0e75209a3b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1224 microversion: 2.1 time: 0.291780 Jul 28 11:27:46.515888 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 364/710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:46 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1224 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:46.527550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:46.528424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:46.544534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.545276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.551111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:46.553910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:46.586454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:46.963885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:46.976338 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14afd609-b328-4fff-9238-8b617baeef62 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.907647 Jul 28 11:27:46.977003 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 347/711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:46 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:46.985270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:46.988881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:46.999652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.000330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.001847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.002448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.020919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f HTTP/1.1 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:47.023836 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:47.025531 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74d4f6b0-68cb-4d66-997b-8ce975ce1e9f'} Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:47.026492 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. Jul 28 11:27:47.028005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.038909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 74d4f6b0-68cb-4d66-997b-8ce975ce1e9f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:47.041114 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-998ea3b1-4667-4409-8026-18d93bc0590d tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f" status: 404 len: 111 microversion: 2.1 time: 0.062503 Jul 28 11:27:47.042700 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 348/712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:46 2022] GET /compute/v2.1/servers/74d4f6b0-68cb-4d66-997b-8ce975ce1e9f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:47.048898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d8f481bf-935b-4c1b-8b37-ff34e8dd2b77 req-c2bf8ee3-ac77-43b1-8821-311df73a124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffe02a6-d004-4892-b66a-5ec170b6b039", "name": "network-vif-plugged", "status": "completed", "tag": "4cd77d76-1baf-42eb-82a8-7cad5959f74a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:47.081991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d8f481bf-935b-4c1b-8b37-ff34e8dd2b77 req-c2bf8ee3-ac77-43b1-8821-311df73a124e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.082734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d8f481bf-935b-4c1b-8b37-ff34e8dd2b77 req-c2bf8ee3-ac77-43b1-8821-311df73a124e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.119658 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d8f481bf-935b-4c1b-8b37-ff34e8dd2b77 req-c2bf8ee3-ac77-43b1-8821-311df73a124e service nova] Creating event network-vif-plugged:4cd77d76-1baf-42eb-82a8-7cad5959f74a for instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 on n-h1-851368-1 Jul 28 11:27:47.132246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d8f481bf-935b-4c1b-8b37-ff34e8dd2b77 req-c2bf8ee3-ac77-43b1-8821-311df73a124e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086404 Jul 28 11:27:47.135047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 349/713] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:47.148167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:47.149842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:47.163971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:47.168058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.168689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.170778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.172689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.176528 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4c4bcf7-fb14-4c93-a306-d81580bdf202 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.659191 Jul 28 11:27:47.177884 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 365/714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:46 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:47.192257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}, {"name": "network-changed", "server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:47.212343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.222495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.249032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] Creating event network-vif-unplugged:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h1-851368-1 Jul 28 11:27:47.249891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] Creating event network-changed:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h1-851368-1 Jul 28 11:27:47.265192 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-359ec076-bf4c-4815-bf27-52336363ec94 req-2c00ec17-7063-4ee3-a961-2d734088aac8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.081857 Jul 28 11:27:47.266391 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 366/715] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:47.275684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f736d749-1b8d-41df-b582-d315b78987c8 req-83977505-676f-42b0-aeb4-cba98eb6082d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d7dcd2-34d5-433d-9797-0896e25304eb", "tag": "4a2cfd99-9abc-455b-acfc-2f7ef408c1c5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:47.301274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f736d749-1b8d-41df-b582-d315b78987c8 req-83977505-676f-42b0-aeb4-cba98eb6082d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.302106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f736d749-1b8d-41df-b582-d315b78987c8 req-83977505-676f-42b0-aeb4-cba98eb6082d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.322408 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f736d749-1b8d-41df-b582-d315b78987c8 req-83977505-676f-42b0-aeb4-cba98eb6082d service nova] Creating event network-changed:4a2cfd99-9abc-455b-acfc-2f7ef408c1c5 for instance 05d7dcd2-34d5-433d-9797-0896e25304eb on n-h1-851368-1 Jul 28 11:27:47.340285 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f736d749-1b8d-41df-b582-d315b78987c8 req-83977505-676f-42b0-aeb4-cba98eb6082d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072256 Jul 28 11:27:47.341264 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 367/716] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:47.346419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:47.347406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:47.362589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.363448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.364462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.365122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.510413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:47.522098 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dbf24756-049a-4e5e-b43c-536eee066e79 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1276 microversion: 2.1 time: 0.385062 Jul 28 11:27:47.523290 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 350/717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:47 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1276 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:47.528645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:47.529386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:47.537583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.538310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.540133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.541285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.557531 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 HTTP/1.1 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:47.559287 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:47.560663 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5591b2a9-3128-4b07-8a65-50f2690e9064'} Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:47.561625 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:47.563904 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:47.566720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:47.567835 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8660c76e-be41-4c42-99dc-2da488259e77 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 404 len: 111 microversion: 2.1 time: 0.043267 Jul 28 11:27:47.568865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 351/718] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:27:47 2022] DELETE /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:47.574402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:47.575364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:47.582188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.582893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:47.583906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:47.584488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.180121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.190359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.191906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.193086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06e517d0-d159-4c49-9429-68be98b5a0f6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.850534 Jul 28 11:27:48.193641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 368/719] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:47 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:48.207906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:48.209588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:48.220203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.220874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.221559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.222356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.302585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.311739 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92b3e205-f06e-4d99-bdfe-8657b471b20d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.741504 Jul 28 11:27:48.312297 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 352/720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:47 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:48.317905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:48.318587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] [instance: 5591b2a9-3128-4b07-8a65-50f2690e9064] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:48.325836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.326533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.327413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.327908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.345994 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] HTTP exception thrown: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:48.346667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Request method failure captured: Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 HTTP/1.1 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIGGvuYXkHmBC9aQFQMwdLfQhnRthpAq80ppCZ8Cd66x2XAgevUTsqFGFNldeDcqllGTQ2FUU3pG1WAAL4UrxMAW80fE1vhdqIxjlJEuXxL0tFV7TyWXKsZXhit6kA6tfd0n6o2KM4kggbso4FdJY1Lq94f6xFfi-nFmhd2HgaiL1M Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:27:48.346924 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e17dc42396ba4ec0bdca9f3e08b42555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e17dc42396ba4ec0bdca9f3e08b42555"}]}] Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e17dc42396ba4ec0bdca9f3e08b42555 Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497 Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 54e94603a7ad4df4a79f38b48c063ab6 Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1702459497-project Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:48.348500 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5591b2a9-3128-4b07-8a65-50f2690e9064'} Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:48.349400 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. Jul 28 11:27:48.350807 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:48.352239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] Returning 404 to user: Instance 5591b2a9-3128-4b07-8a65-50f2690e9064 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:48.352239 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db1c2ede-7a32-411f-a98e-de35c584ed70 tempest-ServersWithSpecificFlavorTestJSON-1702459497 tempest-ServersWithSpecificFlavorTestJSON-1702459497-project] 10.222.0.93 "GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064" status: 404 len: 111 microversion: 2.1 time: 0.036169 Jul 28 11:27:48.353440 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 353/721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:48 2022] GET /compute/v2.1/servers/5591b2a9-3128-4b07-8a65-50f2690e9064 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:48.361487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:48.362550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:48.373240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.373927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.375241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.375827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.382665 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-141c352e-fa1e-4cb0-b6fa-8c2cfb26b905 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1278 microversion: 2.1 time: 0.183331 Jul 28 11:27:48.383922 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 369/722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:48 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:48.398477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:48.401527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:48.411629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.412244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.413129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.414077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.714839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.742602 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecd5e765-ff73-49b0-8512-3392c934d684 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.383548 Jul 28 11:27:48.745751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 354/723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:48 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:48.760464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:48.763937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:48.782576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.783596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.786034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:48.788409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:48.792981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.802447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01173502-2129-47cc-b49e-3fb32ee4351b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.415146 Jul 28 11:27:48.812577 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 370/724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:48 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:48.956432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:48.976650 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8212be2-8689-4f85-b88f-2bd93d91bb81 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1276 microversion: 2.1 time: 0.228904 Jul 28 11:27:48.980507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 355/725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:48 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:49.218368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:49.218941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:49.225530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.226951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.228737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.229582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.561141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a31513b-5faa-473a-a04c-7eeee767034f tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T11%3A27%3A49.289644&end=2022-07-29T11%3A27%3A49.289644" status: 404 len: 112 microversion: - time: 0.267266 Jul 28 11:27:49.561806 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 356/726] 10.222.0.93 () {58 vars in 1316 bytes} [Thu Jul 28 11:27:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T11%3A27%3A49.289644&end=2022-07-29T11%3A27%3A49.289644 => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 11:27:49.570336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:49.574653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:49.582345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.582796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.583610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.584047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.744663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:49.773498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:49.777690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:49.799375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51694466-677b-46cc-a336-306eb3dfe1c3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.570625 Jul 28 11:27:49.803283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 371/727] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:49 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:49.836635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4b54fc4c-fe59-4d8e-88ea-3c5e681cd1af req-e6823b4d-4f88-411b-b1ee-dc166bf7e07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "name": "network-vif-unplugged", "status": "completed", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:49.854566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4b54fc4c-fe59-4d8e-88ea-3c5e681cd1af req-e6823b4d-4f88-411b-b1ee-dc166bf7e07e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.856943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4b54fc4c-fe59-4d8e-88ea-3c5e681cd1af req-e6823b4d-4f88-411b-b1ee-dc166bf7e07e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.871308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4b54fc4c-fe59-4d8e-88ea-3c5e681cd1af req-e6823b4d-4f88-411b-b1ee-dc166bf7e07e service nova] Creating event network-vif-unplugged:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h2-851368-1 Jul 28 11:27:49.877217 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4b54fc4c-fe59-4d8e-88ea-3c5e681cd1af req-e6823b4d-4f88-411b-b1ee-dc166bf7e07e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071769 Jul 28 11:27:49.878571 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 372/728] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:49.889483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:49.892675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:49.901426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.902335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:49.903576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:49.904780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.286683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:50.313444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7c194b8-e948-4c08-bef4-517e1dbcfe25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.750671 Jul 28 11:27:50.314436 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 357/729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:49 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:50.324365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d87e708-b59f-412c-9225-82b914299239 tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] Calling method '.version_select at 0x7f2eb325c670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:50.338502 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2d87e708-b59f-412c-9225-82b914299239 tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d87e708-b59f-412c-9225-82b914299239 tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] Request method failure captured: Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-simple-tenant-usage/9d2255d9011c4707b6c3413eb1aa1946?start=2022-07-29T11%3A27%3A49.289644&end=2022-07-27T11%3A27%3A49.289644 HTTP/1.1 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nK1DmBn1tWjVFZrfHJ50rzhLdd1w8b-eMf23SAlwcIjCikmrMyh44pPNv9YypADf9_0nz8_hsEo2AL-BFYDdkLWfpl8U_iSgjL6KL5dCCQ-T7Rpoprys1OHH48aPz_C-iHzM_v5GTE347pXYkQvHtGfqZTdeXKmqqO92Avwr6F_3Po Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1d43b453c4654a4f99ac4814c74fef18 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1826458564 Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:27:50.341485 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d43b453c4654a4f99ac4814c74fef18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d43b453c4654a4f99ac4814c74fef18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d43b453c4654a4f99ac4814c74fef18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d43b453c4654a4f99ac4814c74fef18"}]}] Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1826458564 Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1d43b453c4654a4f99ac4814c74fef18 Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1826458564 Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 85b48ed1738547eca38bb6787add8cc4 Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid start time. The start time cannot occur after the end time. Jul 28 11:27:50.342929 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '9d2255d9011c4707b6c3413eb1aa1946'} Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 11:27:50.344405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 28 11:27:50.345842 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:27:50.348278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d87e708-b59f-412c-9225-82b914299239 tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:50.349375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d87e708-b59f-412c-9225-82b914299239 tempest-TenantUsagesNegativeTestJSON-1826458564 tempest-TenantUsagesNegativeTestJSON-1826458564-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/9d2255d9011c4707b6c3413eb1aa1946?start=2022-07-29T11%3A27%3A49.289644&end=2022-07-27T11%3A27%3A49.289644" status: 400 len: 111 microversion: 2.1 time: 0.030902 Jul 28 11:27:50.350162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 358/730] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 28 11:27:50 2022] GET /compute/v2.1/os-simple-tenant-usage/9d2255d9011c4707b6c3413eb1aa1946?start=2022-07-29T11%3A27%3A49.289644&end=2022-07-27T11%3A27%3A49.289644 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:27:50.355493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:50.356383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:50.365457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.366291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.367296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.368014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.552748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:50.560962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aba3336d-201d-43eb-ac03-a41ed9ed5c8c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.680398 Jul 28 11:27:50.581684 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 373/731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:49 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:50.587828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:50.588742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:50.594672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.595238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.596115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.596658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.779890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:50.808314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd186326-1dd5-4ece-885b-7fd62275dacb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.454756 Jul 28 11:27:50.823577 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 359/732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:50 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:50.831185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:50.831997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:50.838751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.839483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.840983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:50.841617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:50.928873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:50.941215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1639c60-3df1-4417-a874-372f678b5f42 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.358089 Jul 28 11:27:50.943784 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 374/733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:50 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:51.154154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1641d3e3-1d4c-4a97-a74c-6c77293ed90f tempest-TenantUsagesNegativeTestJSON-1639194821 tempest-TenantUsagesNegativeTestJSON-1639194821-project] Calling method '.version_select at 0x7f2eb2f8b1f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:51.158002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1641d3e3-1d4c-4a97-a74c-6c77293ed90f tempest-TenantUsagesNegativeTestJSON-1639194821 tempest-TenantUsagesNegativeTestJSON-1639194821-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '632182fb0b904f6d8dc825680baa2e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2255d9011c4707b6c3413eb1aa1946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1641d3e3-1d4c-4a97-a74c-6c77293ed90f tempest-TenantUsagesNegativeTestJSON-1639194821 tempest-TenantUsagesNegativeTestJSON-1639194821-project] Request method failure captured: Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T11%3A27%3A49.289644&end=2022-07-29T11%3A27%3A49.289644&detailed=1 HTTP/1.1 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nK0MD5NyFpTDq1FmAQtEaOA-blZ1ceVI6W6fpXsxKLn2W_GYWnOJTNkFw3MEe92O2eaJDM3o5tCB4Ea0M9v7WOjLY7pNr1cHuHz3mgEw-durLG72xyqhcqL3xfZiQuGyo8qdQRM2lzvt7F8EEvPrx_oN4gKX4GZOdTOnRFVRs-tZLM Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9d2255d9011c4707b6c3413eb1aa1946 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1639194821 Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:27:51.163480 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9d2255d9011c4707b6c3413eb1aa1946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9d2255d9011c4707b6c3413eb1aa1946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9d2255d9011c4707b6c3413eb1aa1946"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9d2255d9011c4707b6c3413eb1aa1946"}]}] Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1639194821 Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9d2255d9011c4707b6c3413eb1aa1946 Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1639194821 Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TenantUsagesNegativeTestJSON-1639194821-project Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 632182fb0b904f6d8dc825680baa2e7b Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1639194821-project Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:27:51.165091 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:27:51.166569 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:27:51.168012 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:27:51.169655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 11:27:51.169655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:27:51.170623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1641d3e3-1d4c-4a97-a74c-6c77293ed90f tempest-TenantUsagesNegativeTestJSON-1639194821 tempest-TenantUsagesNegativeTestJSON-1639194821-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:27:51.171671 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1641d3e3-1d4c-4a97-a74c-6c77293ed90f tempest-TenantUsagesNegativeTestJSON-1639194821 tempest-TenantUsagesNegativeTestJSON-1639194821-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T11%3A27%3A49.289644&end=2022-07-29T11%3A27%3A49.289644&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.221609 Jul 28 11:27:51.172688 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 375/734] 10.222.0.93 () {58 vars in 1335 bytes} [Thu Jul 28 11:27:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T11%3A27%3A49.289644&end=2022-07-29T11%3A27%3A49.289644&detailed=1 => generated 123 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:27:51.178811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:51.179818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:51.188588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:51.189310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:51.190417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:51.191017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:51.493160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:51.505367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9cb385d5-d03a-46e8-97a2-06ad54ba1d0e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.680313 Jul 28 11:27:51.508490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 360/735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:50 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:51.524268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6238edf8-24aa-4878-a9bf-932d06ee4edd req-e8492bee-cea4-4b10-b5ca-ee6084b3c541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1eae57-5ddc-4644-b62e-7a5342ad0210", "name": "network-vif-plugged", "status": "completed", "tag": "6cab6cba-9655-446a-bd21-2cf98735e092"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:51.541435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6238edf8-24aa-4878-a9bf-932d06ee4edd req-e8492bee-cea4-4b10-b5ca-ee6084b3c541 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:51.542183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6238edf8-24aa-4878-a9bf-932d06ee4edd req-e8492bee-cea4-4b10-b5ca-ee6084b3c541 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:51.574175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6238edf8-24aa-4878-a9bf-932d06ee4edd req-e8492bee-cea4-4b10-b5ca-ee6084b3c541 service nova] Creating event network-vif-plugged:6cab6cba-9655-446a-bd21-2cf98735e092 for instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 on n-h2-851368-1 Jul 28 11:27:51.585881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6238edf8-24aa-4878-a9bf-932d06ee4edd req-e8492bee-cea4-4b10-b5ca-ee6084b3c541 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075229 Jul 28 11:27:51.590226 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 361/736] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:51.610143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:51.610919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:51.625265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:51.625720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:51.626522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:51.626963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:52.340335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:52.373214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:52.378416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:52.384808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06eabf81-9fcb-4e26-b086-0cfb32128ad8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 1.208282 Jul 28 11:27:52.385689 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 376/737] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:51 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:52.396608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:52.399693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:52.402570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:52.410364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-493343e7-16d9-4539-917a-60a5ddee33fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.817517 Jul 28 11:27:52.411274 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 362/738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:51 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:52.418474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:52.419334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:52.436539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:52.437182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:52.438143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:52.438740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:52.439614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:52.442390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:52.445463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:52.445924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.193789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:53.195752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:53.207253 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd4a8f62-06f2-47da-a2ea-3c29641c15f0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.818882 Jul 28 11:27:53.208047 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 377/739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:52 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:53.213286 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ca8ca14-7d9c-40dd-839d-c6e5aea8d89a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1317 microversion: 2.1 time: 0.800780 Jul 28 11:27:53.215296 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 363/740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:52 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:53.233833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cddbd5c8-1dc3-421a-b2ed-fd17472cdd21 req-341877b8-5bc2-4c35-a7cf-02bf558c48c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "name": "network-vif-unplugged", "status": "completed", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:53.234348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:53.235314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:53.262015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cddbd5c8-1dc3-421a-b2ed-fd17472cdd21 req-341877b8-5bc2-4c35-a7cf-02bf558c48c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.262488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cddbd5c8-1dc3-421a-b2ed-fd17472cdd21 req-341877b8-5bc2-4c35-a7cf-02bf558c48c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.269154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.269993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.270856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.272587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.299884 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cddbd5c8-1dc3-421a-b2ed-fd17472cdd21 req-341877b8-5bc2-4c35-a7cf-02bf558c48c3 service nova] Creating event network-vif-unplugged:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h1-851368-1 Jul 28 11:27:53.310444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cddbd5c8-1dc3-421a-b2ed-fd17472cdd21 req-341877b8-5bc2-4c35-a7cf-02bf558c48c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093753 Jul 28 11:27:53.314104 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 364/741] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:53.328240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:53.328961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:53.351177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.351632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.352444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.353022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.597050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:53.608903 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a407f6b-fa14-49e0-9c94-3b5648f585d9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1504 microversion: 2.1 time: 0.398533 Jul 28 11:27:53.623101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 378/742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:53 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:53.623101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1cdfd9b3-db4c-4217-9c17-c0ffd734b122 req-9b7f701c-1093-4789-b99b-1b6c05e24bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fe9645-adaf-4c3a-95d3-92760ad22d00", "tag": "73bfb417-9dfd-44dd-abca-d54640949e06"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:53.626439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1cdfd9b3-db4c-4217-9c17-c0ffd734b122 req-9b7f701c-1093-4789-b99b-1b6c05e24bf0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.626439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1cdfd9b3-db4c-4217-9c17-c0ffd734b122 req-9b7f701c-1093-4789-b99b-1b6c05e24bf0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.632803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:53.640554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1cdfd9b3-db4c-4217-9c17-c0ffd734b122 req-9b7f701c-1093-4789-b99b-1b6c05e24bf0 service nova] Creating event network-changed:73bfb417-9dfd-44dd-abca-d54640949e06 for instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 on n-h2-851368-1 Jul 28 11:27:53.648655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1cdfd9b3-db4c-4217-9c17-c0ffd734b122 req-9b7f701c-1093-4789-b99b-1b6c05e24bf0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037642 Jul 28 11:27:53.652455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 379/743] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:53.652904 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4156a38b-9f66-436d-a4ac-b10cbd22833a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.337512 Jul 28 11:27:53.658363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:53.659097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:53.665627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.666078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.666858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.667350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.667722 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 365/744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:53 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:53.682156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:53.683251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:53.690755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.691259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.692046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:53.692491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:53.958717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:53.992787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:54.183596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:54.209912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:54.214881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:54.216820 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04bcda01-583f-41de-b781-e189ff58ed7d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.563129 Jul 28 11:27:54.218079 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 380/745] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:53 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:54.230555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:54.231540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:54.238410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:54.239778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:54.240825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:54.241548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:54.256260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:54.259919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:54.268603 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a70e70e-b9ad-494f-9978-d9055bef230d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1471 microversion: 2.1 time: 0.599406 Jul 28 11:27:54.282548 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 366/746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:53 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1471 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:54.291609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:54.292424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:54.300370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:54.300993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:54.301938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:54.302525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:54.880119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:54.903224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:55.024834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.038567 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b842e94-fe79-44ab-8e5c-5b9dcf4832d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.813805 Jul 28 11:27:55.040763 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 381/747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:54 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:27:55.045632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2bf6f4b7-729e-49cd-a8c9-09b673428843 req-629afe1b-adf9-4bf0-b272-875b6d1bc5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d7dcd2-34d5-433d-9797-0896e25304eb", "name": "network-vif-plugged", "status": "completed", "tag": "4a2cfd99-9abc-455b-acfc-2f7ef408c1c5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:55.065281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2bf6f4b7-729e-49cd-a8c9-09b673428843 req-629afe1b-adf9-4bf0-b272-875b6d1bc5a8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.065903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2bf6f4b7-729e-49cd-a8c9-09b673428843 req-629afe1b-adf9-4bf0-b272-875b6d1bc5a8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.078047 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2bf6f4b7-729e-49cd-a8c9-09b673428843 req-629afe1b-adf9-4bf0-b272-875b6d1bc5a8 service nova] Creating event network-vif-plugged:4a2cfd99-9abc-455b-acfc-2f7ef408c1c5 for instance 05d7dcd2-34d5-433d-9797-0896e25304eb on n-h1-851368-1 Jul 28 11:27:55.081611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.084707 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2bf6f4b7-729e-49cd-a8c9-09b673428843 req-629afe1b-adf9-4bf0-b272-875b6d1bc5a8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042421 Jul 28 11:27:55.085831 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 382/748] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:55.093531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:55.094403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:55.095914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a6842c5-c579-4f30-a651-b1ddaf120518 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1467 microversion: 2.1 time: 0.810147 Jul 28 11:27:55.096517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 367/749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:54 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1467 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:55.101354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.101997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.104205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.104814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.107801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:55.108426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:55.128201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.129917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.130659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.131122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.619665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.628743 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e5d1801-7e5b-4a9c-82a3-1b24a522df82 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.530283 Jul 28 11:27:55.636329 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 368/750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:55 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:55.638993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.641039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:55.641656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:55.651487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.653501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.655653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.657324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.657804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfbf4e2e-33e0-466f-a780-23d9efc8f7cd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1479 microversion: 2.1 time: 0.569585 Jul 28 11:27:55.660469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 383/751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:55 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1479 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:55.665969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:55.666580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:55.677900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.679442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.681056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.682467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.919337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.933920 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af41d58b-2c7e-4c8d-aa4f-eb1e8389fa55 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1468 microversion: 2.1 time: 0.298495 Jul 28 11:27:55.934659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 369/752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:55 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:55.944527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:55.945375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:55.974679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.975189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.976005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:55.976458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:55.986499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.996821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.998340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:55.999652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e99e1c0d-3680-493b-925a-f6b96d10a05d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.338072 Jul 28 11:27:56.000617 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 384/753] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:55 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:27:56.007110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-74f89351-5b60-49b5-8a6c-eac190c4eb29 req-6f0d9621-8be9-4f92-b907-e7273cb1d9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96684fb4-c980-47d4-be6b-1823d4a194a5", "tag": "c91f74cf-0159-4743-b8ff-59387577efe9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:56.019509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-74f89351-5b60-49b5-8a6c-eac190c4eb29 req-6f0d9621-8be9-4f92-b907-e7273cb1d9cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.019930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-74f89351-5b60-49b5-8a6c-eac190c4eb29 req-6f0d9621-8be9-4f92-b907-e7273cb1d9cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.034937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-74f89351-5b60-49b5-8a6c-eac190c4eb29 req-6f0d9621-8be9-4f92-b907-e7273cb1d9cf service nova] Creating event network-changed:c91f74cf-0159-4743-b8ff-59387577efe9 for instance 96684fb4-c980-47d4-be6b-1823d4a194a5 on n-h2-851368-1 Jul 28 11:27:56.047125 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-74f89351-5b60-49b5-8a6c-eac190c4eb29 req-6f0d9621-8be9-4f92-b907-e7273cb1d9cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044858 Jul 28 11:27:56.048110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 385/754] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:56.059001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56b31678-6cba-4dda-a9e0-ef43aaef7445 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '.version_select at 0x7f2eb3583430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.063348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56b31678-6cba-4dda-a9e0-ef43aaef7445 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.063966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56b31678-6cba-4dda-a9e0-ef43aaef7445 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.077772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56b31678-6cba-4dda-a9e0-ef43aaef7445 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2334 microversion: 2.1 time: 0.026805 Jul 28 11:27:56.078493 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 386/755] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/os-migrations => generated 2334 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.087187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-119763039"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:56.091369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:56.098142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.098971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.100444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.101273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.137583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:56.185635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:56.195626 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2cc6c497-1fb8-4a2a-95ee-129c0ccfa1af tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1463 microversion: 2.1 time: 0.258412 Jul 28 11:27:56.204564 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 370/756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:55 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.218422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.219090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:56.224427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:56.226463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.228208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.228315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.228829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.354556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29e85ed1-e8fe-4ae9-a27a-81dfc199aa89 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "POST /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e/action" status: 202 len: 0 microversion: 2.1 time: 0.273632 Jul 28 11:27:56.355244 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 387/757] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:27:56 2022] POST /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:27:56.360647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.361567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:56.368140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.369338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.370283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.370888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.432561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:56.441609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f5a49a1-8b7c-43e1-9e89-42b1c8965b55 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.233604 Jul 28 11:27:56.442966 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 371/758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.463932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.464856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:56.476112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.476569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.477359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.478612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.554362 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c01e959e-dd92-4249-873e-1ff7e1738ed9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1630 microversion: 2.1 time: 0.196907 Jul 28 11:27:56.555312 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 388/759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1630 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.560704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-77caa1a6-ee46-46c4-9182-a843f6d444cf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3130af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.623992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-77caa1a6-ee46-46c4-9182-a843f6d444cf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.066878 Jul 28 11:27:56.625074 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 389/760] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.641198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7622468a-3bf8-4af9-ad5f-8b786569bc40 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: .version_select at 0x7f2eb2f71670>, body: {"keypair": {"name": "tempest-keypair-67063366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqLLxrBcrhZ/KlFDtgvU4XVcuENmq2KY538OMChm+ryEyuSPiz809WxWOEufwwq6qqSSWYcv2ulGNGFvvSoIUopkpgUgQrRvZ/CUlmSlZJAY/gr8qV7JSnw3Tvh1lOHRQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:56.657596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:27:56.669686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7622468a-3bf8-4af9-ad5f-8b786569bc40 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for project 64fcfa8211044955bd77c76a587dc952. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:56.674677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7622468a-3bf8-4af9-ad5f-8b786569bc40 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for user d61cd4ba16e748bbac55fe74a20c557e and project 64fcfa8211044955bd77c76a587dc952. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:56.685412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:56.695926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-29a1cdfb-2e5a-4656-8178-64bf5c051074 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1463 microversion: 2.1 time: 0.251581 Jul 28 11:27:56.710610 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 372/761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:56.728691 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7622468a-3bf8-4af9-ad5f-8b786569bc40 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.101568 Jul 28 11:27:56.734909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:56.735257 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 390/762] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:27:56 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:56.735385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:56.740729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.741190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.741971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:56.742415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:56.747742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1870d2b7-5270-49c2-929a-fb4e1414138f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'create', calling method: .version_select at 0x7f2eb301d820>, body: {"keypair": {"name": "tempest-keypair-1533695898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYdEo6P2aT95k4EwM7bejqnCdxVyjAHrDwZhxXUTGsf05YYmlsXrrfFzT+whDxQXzwZlPBv7Z6GllUGQXuHgvBdQX2fef+JeI1oxYt/qexEQs/S0RWsfe4Sc7whoqAOMw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:27:56.765527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1870d2b7-5270-49c2-929a-fb4e1414138f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:27:56.770032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1870d2b7-5270-49c2-929a-fb4e1414138f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:27:56.800554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1870d2b7-5270-49c2-929a-fb4e1414138f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066922 Jul 28 11:27:56.801332 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 391/763] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:27:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:27:57.014693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:57.026610 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b184472-5d7c-4e20-af95-c1f22ca8052c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.314754 Jul 28 11:27:57.028048 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 373/764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:56 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:57.030322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:57.031104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:57.038850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:57.039574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:57.040223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:57.040870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:57.315946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:57.325044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:57.326919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:57.328331 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33448edd-1910-4190-ba06-c88c7f83b0b2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.305846 Jul 28 11:27:57.343586 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 392/765] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:57 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:27:57.466826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:57.468903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:57.483278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:57.485252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:57.487105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:57.489213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:57.638526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1a652c1-d870-4c67-8c24-d5ceb65880eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3021b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:57.695167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1a652c1-d870-4c67-8c24-d5ceb65880eb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.060986 Jul 28 11:27:57.696113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 393/766] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:57 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:58.051844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:58.052358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:58.064931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:58.065786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:58.069114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:58.069795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:58.193968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:58.208908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4bcaa006-03e9-4f62-ad9b-3c0808b00b2a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.747343 Jul 28 11:27:58.210867 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 374/767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:57 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:58.353737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:58.354719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:58.369967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:58.370486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:58.371395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:58.372079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:58.676465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:58.684693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7b21002-dcea-4d87-8117-d2173a31156e tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.640443 Jul 28 11:27:58.699277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 394/768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:58 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:58.710715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-520803bf-6e25-446d-876c-2e874f2175b8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2f8b550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:58.768480 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-520803bf-6e25-446d-876c-2e874f2175b8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.062150 Jul 28 11:27:58.769113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 395/769] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:58 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:58.933766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:58.943175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:58.945049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:58.955116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9bd4ff3e-216f-4c18-88b6-f8cea0207c6c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 0.597776 Jul 28 11:27:58.956710 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 375/770] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:27:58 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:27:59.234726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:59.235357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:59.245065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:59.245739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:59.246661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:59.247273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:59.706708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:27:59.707555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:27:59.715794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:59.716494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:59.717497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:27:59.718154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:27:59.898934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:27:59.912690 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c477cbc-8b0b-4a37-b94c-341e48aa3ed0 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.683032 Jul 28 11:27:59.915457 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 396/771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:59 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:27:59.920511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c75c8ac6-26bf-410f-a887-d1825ecf0a4c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2f8bd30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:00.032313 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c75c8ac6-26bf-410f-a887-d1825ecf0a4c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.115465 Jul 28 11:28:00.043659 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 397/772] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:27:59 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:00.049813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:00.050988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:00.060896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:00.061594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:00.063475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:00.064400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:00.801549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:00.811432 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-16d85191-85f8-4aa3-bb0f-6d0c750d89e7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 1.109126 Jul 28 11:28:00.812733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 376/773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:27:59 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:00.818151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d0aa4507-00a5-44dd-a074-f1e93de4e64a tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '.version_select at 0x7f2eb31f0670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:00.824850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0aa4507-00a5-44dd-a074-f1e93de4e64a tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:00.825590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0aa4507-00a5-44dd-a074-f1e93de4e64a tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:00.843365 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d0aa4507-00a5-44dd-a074-f1e93de4e64a tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.029377 Jul 28 11:28:00.844234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 377/774] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:28:00 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:00.848972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-857158947", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2ee9bbf6-5533-4c74-b21c-9d3ad61e8713"}], "security_groups": [{"name": "tempest-securitygroup--176763135"}], "key_name": "tempest-keypair-67063366", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:01.164217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:01.175038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:01.176884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:01.179377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f929d7e-5efe-4cd9-ba21-da63b16b095a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1568 microversion: 2.25 time: 1.133342 Jul 28 11:28:01.180133 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 398/775] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:00 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1568 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:01.203605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-489e4902-ba29-4ff4-b74e-1ee5b25a9791 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:01.218018 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-489e4902-ba29-4ff4-b74e-1ee5b25a9791 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036062 Jul 28 11:28:01.219392 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 399/776] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:01.226451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:01.227462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:01.234583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:01.236295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:01.237313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:01.237946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:01.331534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] validate_networks() for [('2ee9bbf6-5533-4c74-b21c-9d3ad61e8713', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:01.978458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:01.995330 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-312f1cf0-1e3d-4404-b55a-68755f7e09f9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.773826 Jul 28 11:28:01.996423 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 400/777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:01 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:02.001040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8dbe788a-e259-4b10-8b06-553fcdcc4560 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3166ee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:02.086172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8dbe788a-e259-4b10-8b06-553fcdcc4560 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.088513 Jul 28 11:28:02.087369 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 401/778] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:01 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:02.093572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f97165df-a0d5-413a-8a2c-9db4e3ff1ce3 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-971568170", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:02.096873 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:02.096873 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:02.131026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f97165df-a0d5-413a-8a2c-9db4e3ff1ce3 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.041134 Jul 28 11:28:02.139045 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 402/779] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 28 11:28:02 2022] POST /compute/v2.1/flavors => generated 498 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:02.144218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-88d53c00-0ee3-45a6-8308-c62b107374c9 req-a29e5396-96aa-4207-9fff-4cc51c84ee46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fe9645-adaf-4c3a-95d3-92760ad22d00", "name": "network-vif-plugged", "status": "completed", "tag": "73bfb417-9dfd-44dd-abca-d54640949e06"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:02.173083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-88d53c00-0ee3-45a6-8308-c62b107374c9 req-a29e5396-96aa-4207-9fff-4cc51c84ee46 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:02.174554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-88d53c00-0ee3-45a6-8308-c62b107374c9 req-a29e5396-96aa-4207-9fff-4cc51c84ee46 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:02.233187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-88d53c00-0ee3-45a6-8308-c62b107374c9 req-a29e5396-96aa-4207-9fff-4cc51c84ee46 service nova] Creating event network-vif-plugged:73bfb417-9dfd-44dd-abca-d54640949e06 for instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 on n-h2-851368-1 Jul 28 11:28:02.245226 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-88d53c00-0ee3-45a6-8308-c62b107374c9 req-a29e5396-96aa-4207-9fff-4cc51c84ee46 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104454 Jul 28 11:28:02.247521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 403/780] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:02.277231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:02.278146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:02.286872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:02.313776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:02.314894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:02.315669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:02.919333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:02.931905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d779e1e5-69b5-4fd9-a1c7-4b9315b7762f tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1318 microversion: 2.1 time: 0.682849 Jul 28 11:28:02.956362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 404/781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:02 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:02.963362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b208971-7f02-4740-a7ad-aa3db6f67619 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:02.980225 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b208971-7f02-4740-a7ad-aa3db6f67619 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021975 Jul 28 11:28:02.981641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 405/782] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Jul 28 11:28:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:02.988669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:02.989643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:02.998123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:02.998977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.000020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:03.000851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.119855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:03.121006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:03.122228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:03.122870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:03.123570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:03.142868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:03.144989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.149284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:03.150790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.268810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:03.298857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for user d61cd4ba16e748bbac55fe74a20c557e and project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:03.362483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:03.370816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:03.519415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cade8f47-9265-4f80-9e67-5cf9f38e4f71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.671264 Jul 28 11:28:03.524004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 378/783] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:03.525415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:03.535661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:03.537168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:03.538335 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-59ea3687-bdd9-4559-b09e-71257baa09ac tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1543 microversion: 2.25 time: 0.555485 Jul 28 11:28:03.538893 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 406/784] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:02 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1543 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:03.540503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:03.542937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:03.553930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:03.554873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.557372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:03.558044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:03.577845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40f6b5fc-7cb1-4f2b-8353-65b83f0a1936 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2edee50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:03.678553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40f6b5fc-7cb1-4f2b-8353-65b83f0a1936 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.104406 Jul 28 11:28:03.682273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 407/785] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:03 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:03.702004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2113751145", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "706ea037-14f6-4f51-bbe0-1cdda0448f2f"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:03.873633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:03.910627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:03.922031 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-affafc0e-6067-47a7-ba97-df6c1721b8d9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.394849 Jul 28 11:28:03.922613 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 379/786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:03 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:03.935252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c1a62579-00ba-413f-948e-fb28a310480a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:03.935998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c1a62579-00ba-413f-948e-fb28a310480a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:04.128117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c1a62579-00ba-413f-948e-fb28a310480a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:04.136609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c1a62579-00ba-413f-948e-fb28a310480a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1232 microversion: 2.1 time: 0.212685 Jul 28 11:28:04.137919 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 380/787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:03 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1232 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:04.159158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-920b86fa-5b99-460f-8451-8ddb1d40f12d tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '.version_select at 0x7f2eb31fa3a0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:04.180225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920b86fa-5b99-460f-8451-8ddb1d40f12d tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.183617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920b86fa-5b99-460f-8451-8ddb1d40f12d tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.243219 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-920b86fa-5b99-460f-8451-8ddb1d40f12d tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2541 microversion: 2.25 time: 0.104870 Jul 28 11:28:04.255813 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 381/788] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Jul 28 11:28:04 2022] GET /compute/v2.1/os-migrations => generated 2541 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:04.279298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:04.282174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:04.299599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.300181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.302303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.303371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.563938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:04.565186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:04.566169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:04.566968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:04.567771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:04.611189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.612901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.616491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.626708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.683130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:04.696806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:04.699670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:04.711572 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ec10e0f-b6ed-48b8-a340-987a280b2ac6 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1468 microversion: 2.1 time: 0.448921 Jul 28 11:28:04.718224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:04.721779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:04.725448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 382/789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:04 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:04.743818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:04.745588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:04.762112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.770247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.772378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:04.775369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:04.903505 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b919fb98-22bf-45dd-9c6e-22d9cfd96d34 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215081 Jul 28 11:28:04.910429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 408/790] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:04.916075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-339908ff-bcc3-43a9-bece-c02135abfe15 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2f218b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:05.444207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-339908ff-bcc3-43a9-bece-c02135abfe15 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.531903 Jul 28 11:28:05.445099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 409/791] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:04 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:05.450562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:05.451402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:05.460813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:05.460982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:05.464916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:05.465386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:05.530364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lazy-loading 'flavor' on Instance uuid 14fe9645-adaf-4c3a-95d3-92760ad22d00 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:05.698549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-865d77e2-8879-4e97-8401-a3d2c32cf623 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00/action" status: 202 len: 0 microversion: 2.1 time: 0.245536 Jul 28 11:28:05.700781 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 410/792] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:05 2022] POST /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:05.714930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-204096d3-c702-481b-9934-56c6870bc5ae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:05.716860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-204096d3-c702-481b-9934-56c6870bc5ae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:05.988051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-204096d3-c702-481b-9934-56c6870bc5ae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:05.996177 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-204096d3-c702-481b-9934-56c6870bc5ae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1279 microversion: 2.1 time: 0.294062 Jul 28 11:28:06.014588 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 411/793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:05 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1279 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:06.025329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:06.032650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:06.044004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.044601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.045538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.046062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.429384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:06.442603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2ffe3b9-5e58-4d2f-ae43-700560f7ae66 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.425957 Jul 28 11:28:06.443455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 412/794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:06 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:06.459994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:06.482196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:06.482196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:06.489629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.490087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.490888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.491457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.497715 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ca55e2b-f3b4-46d8-ba32-e4c68191052e tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 2035 microversion: 2.25 time: 1.764172 Jul 28 11:28:06.503282 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 383/795] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:04 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 2035 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:06.514123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-34145fdb-ffb9-4ebd-a255-ea94291174a9 req-a9048b74-9475-4d48-9988-2a3706d0e3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96684fb4-c980-47d4-be6b-1823d4a194a5", "name": "network-vif-plugged", "status": "completed", "tag": "c91f74cf-0159-4743-b8ff-59387577efe9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:06.543410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-34145fdb-ffb9-4ebd-a255-ea94291174a9 req-a9048b74-9475-4d48-9988-2a3706d0e3e4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.544250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-34145fdb-ffb9-4ebd-a255-ea94291174a9 req-a9048b74-9475-4d48-9988-2a3706d0e3e4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.569296 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-34145fdb-ffb9-4ebd-a255-ea94291174a9 req-a9048b74-9475-4d48-9988-2a3706d0e3e4 service nova] Creating event network-vif-plugged:c91f74cf-0159-4743-b8ff-59387577efe9 for instance 96684fb4-c980-47d4-be6b-1823d4a194a5 on n-h2-851368-1 Jul 28 11:28:06.575556 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-34145fdb-ffb9-4ebd-a255-ea94291174a9 req-a9048b74-9475-4d48-9988-2a3706d0e3e4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070560 Jul 28 11:28:06.576425 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 384/796] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:06.586346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:06.587454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:06.594052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.594813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.595862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:06.596533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:06.766826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:06.785418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-269da178-2f3f-4081-91cf-37df44ef5432 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1290 microversion: 2.1 time: 0.319390 Jul 28 11:28:06.786006 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 413/797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:06 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1290 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:06.810448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a75ca9c-ebce-4953-a137-0fd63040fd6d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2e7f8b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:06.905446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a75ca9c-ebce-4953-a137-0fd63040fd6d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.104184 Jul 28 11:28:06.916860 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 414/798] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:06 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:06.928627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-17d56fbc-9e83-4612-9e1f-69a96e4d7b31 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: .version_select at 0x7f2eb2f59940>, body: {"keypair": {"name": "tempest-keypair-979904633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGMoVJvpceRbIXSnMFplZdUVJBnh5cVPbR8PiQZ4uKD6Wddhu1PbkRxUUEWOoQ9hJltxelOLJHECmq96k3mo8rP4oQ5T2TgILNCE0+/NOCvXziucWHrweWIsr+eXl5ryg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:06.968531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-17d56fbc-9e83-4612-9e1f-69a96e4d7b31 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for project 2367458a06b245769d5851becc658136. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:06.975549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-17d56fbc-9e83-4612-9e1f-69a96e4d7b31 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for user ccea87d21921492f8544e0e81ea485d5 and project 2367458a06b245769d5851becc658136. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:07.031900 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-17d56fbc-9e83-4612-9e1f-69a96e4d7b31 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.113350 Jul 28 11:28:07.032768 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 415/799] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:28:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:28:07.044701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:07.045834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:07.059451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.059901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:07.060680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.061110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:07.087216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:07.101788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-09c20eb5-ef70-4424-bfe0-3608039c0d26 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1459 microversion: 2.1 time: 0.519325 Jul 28 11:28:07.106335 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 385/800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:06 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1459 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:07.125648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:07.126943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:07.146157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.151757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:07.155649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.157425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:07.546109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:07.553908 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d6f96a8-dde9-4cdf-a590-1475e2f88b7f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1339 microversion: 2.1 time: 0.520324 Jul 28 11:28:07.571963 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 416/801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:07 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1339 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:07.584628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:07.593949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:07.605466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.606905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:07.607953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:07.608605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.097840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:08.103842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-318dca7e-219c-466d-8329-2a6d08325a5f tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1610 microversion: 2.1 time: 0.981481 Jul 28 11:28:08.108394 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 386/802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:07 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1610 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:08.114015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.126185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:08.133409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.137954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.139320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.140001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.210324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:08.213441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:08.230767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eb19f471-400a-43e5-abd1-c40cdcd5f82e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1320 microversion: 2.1 time: 0.651924 Jul 28 11:28:08.231796 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 417/803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:07 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:08.248027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4499fc5-ac75-4eb0-8365-282f7b39241e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3166a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.361050 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4499fc5-ac75-4eb0-8365-282f7b39241e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.127935 Jul 28 11:28:08.364447 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 418/804] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:08 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:08.376117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.385640 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:08.385640 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:08.387483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.388123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.389234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.389780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.441413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5e8576c3-d4bd-4981-a055-d96c6c7d27d1 tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075758 Jul 28 11:28:08.444710 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 419/805] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:28:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:08.456550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:08.471291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:08.478370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.479144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.479927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.480615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.527096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Lazy-loading 'flavor' on Instance uuid 14fe9645-adaf-4c3a-95d3-92760ad22d00 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:08.572045 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 while it is in vm_state suspended Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Request method failure captured: Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00/action HTTP/1.1 Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 97 Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKSUn2xQgCfWe4cPuOVVZCRfasHxckHLklKfrhd9vaFcgXMDlUIJFG3iuPNrY6e5I97oUCyNy5cLlemX133qJ1cHXIM_KjFutAwvtdw2dCFaISpIc3IcQru7xF19oSgVCQMfhsPALYh8lDNRdvBO2LNpsOrLmU-aYikQzMGiKxRoXs Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 53ae559c71ca456c8de5ad7279da9aaa Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:28:08.574579 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53ae559c71ca456c8de5ad7279da9aaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53ae559c71ca456c8de5ad7279da9aaa"}]}] Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 53ae559c71ca456c8de5ad7279da9aaa Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1858270889 Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveMigrationNegativeTest-1858270889-project-admin Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 42c77a9a20824348b89cf9e17a755c0c Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveMigrationNegativeTest-1858270889-project-admin Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": true, "disk_over_commit": false}} Jul 28 11:28:08.576033 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'os-migrateLive' instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 while it is in vm_state suspended Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '14fe9645-adaf-4c3a-95d3-92760ad22d00', 'body': {'os-migrateLive': {'host': 'n-h1-851368-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 11:28:08.576786 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:08.583755 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 while it is in vm_state suspended Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 while it is in vm_state suspended Jul 28 11:28:08.585112 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:08.588699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 while it is in vm_state suspended {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:08.590121 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d7b0eb2-3a9d-4609-8343-26e92c3242bc tempest-LiveMigrationNegativeTest-1858270889 tempest-LiveMigrationNegativeTest-1858270889-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00/action" status: 409 len: 155 microversion: 2.1 time: 0.137675 Jul 28 11:28:08.591271 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 420/806] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:08 2022] POST /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00/action => generated 155 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:28:08.600683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.602235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:08.609920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.610905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.612148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.613008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.624139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:08.637836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c856d568-3762-444f-ac4e-258b5f083c39 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.526948 Jul 28 11:28:08.640397 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 387/807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:08 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:08.650137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.650999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:08.668344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.670561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.671683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.675467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.713897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:28:08.746870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:08.759466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed20eca1-d7c3-4fa9-bcb8-890a294c1d2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1337 microversion: 2.1 time: 0.166136 Jul 28 11:28:08.760549 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 421/808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:08 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1337 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:08.865722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-119a6c21-40ef-4a26-a01c-111b9a91877a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "DELETE /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 204 len: 0 microversion: 2.1 time: 0.222423 Jul 28 11:28:08.867688 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 388/809] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:08 2022] DELETE /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:28:08.875415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-47288e4a-92f8-442a-9255-c49a560cd890 req-7b082200-65e7-4e69-bcec-878f859a1df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-plugged", "status": "completed", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:08.890265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-47288e4a-92f8-442a-9255-c49a560cd890 req-7b082200-65e7-4e69-bcec-878f859a1df7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.890922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-47288e4a-92f8-442a-9255-c49a560cd890 req-7b082200-65e7-4e69-bcec-878f859a1df7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.910761 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-47288e4a-92f8-442a-9255-c49a560cd890 req-7b082200-65e7-4e69-bcec-878f859a1df7 service nova] Creating event network-vif-plugged:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:28:08.916893 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-47288e4a-92f8-442a-9255-c49a560cd890 req-7b082200-65e7-4e69-bcec-878f859a1df7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047714 Jul 28 11:28:08.917933 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 389/810] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:08.924278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:08.925882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:08.939525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.940208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:08.941204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:08.942134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.161069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e54a366-6fb2-4a1f-b9cb-bb84447412af tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-906663148", "ram": 512, "vcpus": 1, "disk": 10, "id": 435343973, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:09.166206 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:09.166206 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:09.188059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:09.197493 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e54a366-6fb2-4a1f-b9cb-bb84447412af tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.435695 Jul 28 11:28:09.201942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 422/811] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:08 2022] POST /compute/v2.1/flavors => generated 412 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:09.216543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4cb0aa29-9c41-47d8-9327-5ef377cd1b84 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:09.220126 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:09.220126 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:09.294691 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4cb0aa29-9c41-47d8-9327-5ef377cd1b84 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082964 Jul 28 11:28:09.296036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 423/812] 10.222.0.93 () {60 vars in 1221 bytes} [Thu Jul 28 11:28:09 2022] POST /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:09.307038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:09.309441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:09.321758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.324985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.327357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.330861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.366854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:09.377685 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-130de59b-0a85-4142-a4b7-7cda26fc45c1 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1465 microversion: 2.1 time: 0.456019 Jul 28 11:28:09.387375 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 390/813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:08 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1465 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:09.605685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-515779ea-69f7-4eff-87c2-e4c2a72a6663 tempest-FlavorsExtraSpecsTestJSON-10757149 tempest-FlavorsExtraSpecsTestJSON-10757149-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:09.636882 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-515779ea-69f7-4eff-87c2-e4c2a72a6663 tempest-FlavorsExtraSpecsTestJSON-10757149 tempest-FlavorsExtraSpecsTestJSON-10757149-project] 10.222.0.93 "GET /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.250563 Jul 28 11:28:09.642699 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 391/814] 10.222.0.93 () {58 vars in 1200 bytes} [Thu Jul 28 11:28:09 2022] GET /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:09.645372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:09.659731 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9353e6b-e093-45a5-bb99-2c4c4264635a tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1511 microversion: 2.1 time: 0.357216 Jul 28 11:28:09.660523 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 424/815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:09 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:09.669922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1812128a-0f35-42a6-b1d6-a61fed3b234c tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:09.673133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e668bafb-0696-4008-80c5-6c22d9e8215e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb31aa550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:09.677133 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:09.677133 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:09.745627 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1812128a-0f35-42a6-b1d6-a61fed3b234c tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083872 Jul 28 11:28:09.748219 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 425/816] 10.222.0.93 () {60 vars in 1221 bytes} [Thu Jul 28 11:28:09 2022] POST /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:09.760705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:09.763912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:09.780330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.782657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.784440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.785141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.791235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e668bafb-0696-4008-80c5-6c22d9e8215e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.142679 Jul 28 11:28:09.801088 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 392/817] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:09 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:09.820908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:09.828171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:09.848007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.849666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:09.853535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:09.854553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.242743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:10.256766 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8da8e1db-7f3e-4507-95d6-50e0aa395da7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1512 microversion: 2.1 time: 0.454274 Jul 28 11:28:10.261764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 393/818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:09 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:10.268619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3aceb49f-85a5-4187-ae07-f2d8ff44a95b tempest-FlavorsExtraSpecsTestJSON-10757149 tempest-FlavorsExtraSpecsTestJSON-10757149-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:10.308057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3aceb49f-85a5-4187-ae07-f2d8ff44a95b tempest-FlavorsExtraSpecsTestJSON-10757149 tempest-FlavorsExtraSpecsTestJSON-10757149-project] 10.222.0.93 "GET /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.035454 Jul 28 11:28:10.308057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 394/819] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes => generated 22 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:10.308057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:10.308057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:10.311564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:10.338259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.338259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.338259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.338259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.381619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ffed6910-0f17-433d-a8ca-6028251edec5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.631784 Jul 28 11:28:10.401210 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 426/820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:09 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:10.437389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a779c4a5-e238-4275-a4a0-0b7702562780 req-3e929e1e-e85c-440f-ad4c-87a4f4b4a86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:10.509983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a779c4a5-e238-4275-a4a0-0b7702562780 req-3e929e1e-e85c-440f-ad4c-87a4f4b4a86e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.510595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a779c4a5-e238-4275-a4a0-0b7702562780 req-3e929e1e-e85c-440f-ad4c-87a4f4b4a86e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.524724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a779c4a5-e238-4275-a4a0-0b7702562780 req-3e929e1e-e85c-440f-ad4c-87a4f4b4a86e service nova] Creating event network-changed:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:28:10.533418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a779c4a5-e238-4275-a4a0-0b7702562780 req-3e929e1e-e85c-440f-ad4c-87a4f4b4a86e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130517 Jul 28 11:28:10.534633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 427/821] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:10.557290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:10.558325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:10.565667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.566629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.567682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.568334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.582063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:10.592182 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-659b8525-60e6-4250-ab9f-2c355419f859 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1337 microversion: 2.1 time: 0.291280 Jul 28 11:28:10.595576 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 395/822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1337 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:10.605761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ff1cdc5-159b-4f54-95d8-91e0bbf8b12c tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:10.608649 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:10.608649 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:10.649600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ff1cdc5-159b-4f54-95d8-91e0bbf8b12c tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051784 Jul 28 11:28:10.671216 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 396/823] 10.222.0.93 () {60 vars in 1221 bytes} [Thu Jul 28 11:28:10 2022] POST /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:10.692935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:10.694229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:10.709360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.712050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.714592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:10.715489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:10.914324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:10.930893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-02be4aae-1e73-47da-a94e-19bc81e911c9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1511 microversion: 2.1 time: 0.392830 Jul 28 11:28:10.933608 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 428/824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:10.947912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26f4939e-6cc0-4c82-b6ff-6545da568468 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:10.965521 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26f4939e-6cc0-4c82-b6ff-6545da568468 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029682 Jul 28 11:28:10.969334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 429/825] 10.222.0.93 () {58 vars in 1200 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:10.980463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41423a45-d87b-4bba-a2b2-bef984e7c4a5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2ec4700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:11.066076 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41423a45-d87b-4bba-a2b2-bef984e7c4a5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.095332 Jul 28 11:28:11.067036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 430/826] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:11.089361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:11.098605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:11.099785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:11.133590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:11.135146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:11.136101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:11.143971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:11.408668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:11.667916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:11.676517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:11.677352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:11.765228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:11.784367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1368a314-86cb-4a6d-a815-54d330a9847c tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1465 microversion: 2.1 time: 1.110003 Jul 28 11:28:11.784968 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 397/827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:10 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1465 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:11.836898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc6ed07d-4be3-47c2-8cbb-c2e120522b29 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:11.849359 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:11.849359 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:11.937549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc6ed07d-4be3-47c2-8cbb-c2e120522b29 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.121382 Jul 28 11:28:11.938159 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 398/828] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:28:11 2022] PUT /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes => generated 22 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:11.948173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:11.948788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:11.967580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:11.968029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:11.971582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:11.972043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:12.672230 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-668eaf7f-d9d0-43c9-a954-afc4a616821c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.602823 Jul 28 11:28:12.673091 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 431/829] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:28:11 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:12.678412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:12.679088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:12.706182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:12.706548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:12.711604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:12.712108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:12.827712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:12.840422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7499e7eb-e6f8-44d5-ac5f-7b4a792182ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.901167 Jul 28 11:28:12.841788 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 399/830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:11 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:12.847060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81dfffc8-1caf-4ca3-8020-012cc4e5bebb tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:12.868905 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81dfffc8-1caf-4ca3-8020-012cc4e5bebb tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025270 Jul 28 11:28:12.875458 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 400/831] 10.222.0.93 () {58 vars in 1200 bytes} [Thu Jul 28 11:28:12 2022] GET /compute/v2.1/flavors/435343973/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:12.881080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60382a74-0668-4c60-8e20-aa61cfc6303f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb325e4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:12.954589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60382a74-0668-4c60-8e20-aa61cfc6303f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.077527 Jul 28 11:28:12.955292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 401/832] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:12 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:12.962418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-825da747-f427-4ccf-ae77-19e11b4575b7 req-1531eee4-e6e0-4de9-9edd-f4e593ed69ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fe9645-adaf-4c3a-95d3-92760ad22d00", "name": "network-vif-deleted", "tag": "73bfb417-9dfd-44dd-abca-d54640949e06"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:12.982913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-825da747-f427-4ccf-ae77-19e11b4575b7 req-1531eee4-e6e0-4de9-9edd-f4e593ed69ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:12.983657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-825da747-f427-4ccf-ae77-19e11b4575b7 req-1531eee4-e6e0-4de9-9edd-f4e593ed69ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.005827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-825da747-f427-4ccf-ae77-19e11b4575b7 req-1531eee4-e6e0-4de9-9edd-f4e593ed69ea service nova] Creating event network-vif-deleted:73bfb417-9dfd-44dd-abca-d54640949e06 for instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 on n-h2-851368-1 Jul 28 11:28:13.029649 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-825da747-f427-4ccf-ae77-19e11b4575b7 req-1531eee4-e6e0-4de9-9edd-f4e593ed69ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070946 Jul 28 11:28:13.032048 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 402/833] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:13.054621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:13.069630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:13.071543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1250822626', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:13.085780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.086241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.087601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.088044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.202552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:13.216474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1efb8570-03c8-41f0-a5f1-ed24f4248a71 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.542198 Jul 28 11:28:13.234021 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 432/834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:12 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:13.240918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:13.241544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:13.264078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.264925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.265971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.266782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.364495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.370909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.372184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lazy-loading 'fault' on Instance uuid 14fe9645-adaf-4c3a-95d3-92760ad22d00 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:13.429630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:13.450797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:13.459634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87f6d41d-8309-42da-b6df-7c61d5b84cbc tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 200 len: 1308 microversion: 2.1 time: 0.223961 Jul 28 11:28:13.461327 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 433/835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:13 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:13.490533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-661419f0-ad22-440c-ad78-93eb9ee857a8 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:13.498478 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:13.498478 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:13.573756 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-661419f0-ad22-440c-ad78-93eb9ee857a8 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.107872 Jul 28 11:28:13.575694 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 434/836] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:28:13 2022] DELETE /compute/v2.1/flavors/435343973/os-extra_specs/hw:numa_nodes => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:28:13.584477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1634286750", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "b93dd60e-eebc-4156-8fe1-0460817e9901"}], "security_groups": [{"name": "tempest-securitygroup--1987396413"}], "key_name": "tempest-keypair-979904633", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:13.623327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:13.639194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:13.639653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:13.784876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] validate_networks() for [('b93dd60e-eebc-4156-8fe1-0460817e9901', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:13.891596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd252103-8ee8-44e4-a143-becf036603ba tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1250822626" status: 200 len: 1515 microversion: 2.1 time: 0.855455 Jul 28 11:28:13.894286 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 403/837] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:28:13 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1250822626 => generated 1515 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:13.903875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b1a8bab-f5a9-4dea-aeaf-a8f2e32b8703 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:13.905051 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:13.905051 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:13.918298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:13.943356 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b1a8bab-f5a9-4dea-aeaf-a8f2e32b8703 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/435343973/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.047020 Jul 28 11:28:13.945891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 404/838] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:28:13 2022] DELETE /compute/v2.1/flavors/435343973/os-extra_specs/hw:cpu_policy => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:28:14.110080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-542271746", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:14.254783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] validate_networks() for [('6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:14.745279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:14.746173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:14.747296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:14.747885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:14.748487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:14.765830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:14.766537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:14.767574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:14.770197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:14.805076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:14.822072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for user ccea87d21921492f8544e0e81ea485d5 and project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:14.849311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:14.852113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:14.928654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d2b20749-7002-47d3-b204-22e5e8f921aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.351675 Jul 28 11:28:14.935883 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 435/839] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:28:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:28:14.956125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:14.957443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:14.974947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:14.975726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:14.976779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:14.977491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:14.985640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:14.986392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:14.989559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:14.989559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:14.989559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:15.000171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:15.000905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:15.001897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:15.002507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:15.047011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Getting quotas for project 96f5ee2d77c24a0793c7b8dfe861c8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:15.055033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Getting quotas for user 2d4a96d2d92446baa9795668f555ae5f and project 96f5ee2d77c24a0793c7b8dfe861c8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:15.071537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:15.074197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:15.211976 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37064772-1bb2-41ef-9db2-2d2b0c4793ff tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264078 Jul 28 11:28:15.212630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 405/840] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:15.230520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:15.254322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:15.262802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:15.285082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:15.289232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:15.296576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:15.299017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:16.040296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:16.298163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:16.307399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:16.325884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c50ed09-e2cf-413c-a87d-926b454f1920 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 1.387493 Jul 28 11:28:16.327023 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 436/841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:14 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:16.337448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3eb5160-5793-439f-aa10-41722b60befd tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:16.354466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3eb5160-5793-439f-aa10-41722b60befd tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/435343973/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025565 Jul 28 11:28:16.361700 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 437/842] 10.222.0.93 () {58 vars in 1200 bytes} [Thu Jul 28 11:28:16 2022] GET /compute/v2.1/flavors/435343973/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:16.367194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1de1609-8655-48ff-93f4-00f85112e3f6 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb33e3820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:16.387353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:16.388083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:16.433631 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1de1609-8655-48ff-93f4-00f85112e3f6 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.070424 Jul 28 11:28:16.434902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 438/843] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:16 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:16.448239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:16.449187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:16.464426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:16.465341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:16.466430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:16.467087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.162845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.175887 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-832eb740-3faa-46f5-ac28-9716f6b3fe5e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.737012 Jul 28 11:28:17.179237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 439/844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:16 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:17.194090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.196618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 14fe9645-adaf-4c3a-95d3-92760ad22d00] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:17.212315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.220062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.224502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.225423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.240272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe70132b-c9e2-493c-a276-6e71b720ea33 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 2.024022 Jul 28 11:28:17.241588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 406/845] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Jul 28 11:28:15 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:17.252095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.255391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:17.269269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.270703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.273167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] HTTP exception thrown: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. Jul 28 11:28:17.274116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.274797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Request method failure captured: Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 HTTP/1.1 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKRP9QKsdy4SLJlOb0aHucMWhvvHfymMXHugpDWAIr7dTD8GjvrtIc_N7FiV1MPi7FW1uWkLuwcHoNMquQyuto0s1_Tmzr-KRWjv_JMIwHGUnofr5hIIyKddboZ0two-dKs21llG9A2W7YyBTMM1RYriPRz53qBsC5lNpBOu0ldC64 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: bb7ce63d583a435eaa1a20ab3501347b Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:17.278410 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bb7ce63d583a435eaa1a20ab3501347b"}]}] Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: bb7ce63d583a435eaa1a20ab3501347b Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveMigrationNegativeTest-55514750-project Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c553fb2ab09f41f8bd7a345a5bf9c13b Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveMigrationNegativeTest-55514750-project Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. Jul 28 11:28:17.280072 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '14fe9645-adaf-4c3a-95d3-92760ad22d00'} Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:17.280923 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. Jul 28 11:28:17.282189 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:17.290424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Returning 404 to user: Instance 14fe9645-adaf-4c3a-95d3-92760ad22d00 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:17.291710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce6e419e-68de-4fd0-8477-53c78a304819 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00" status: 404 len: 111 microversion: 2.1 time: 0.111134 Jul 28 11:28:17.295735 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 440/846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:17 2022] GET /compute/v2.1/servers/14fe9645-adaf-4c3a-95d3-92760ad22d00 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:17.309165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.310625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:17.324941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.326552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.331985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.333088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.433069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.447261 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b940d00d-85f4-4037-aee3-edf6abd461ae tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1219 microversion: 2.1 time: 0.149089 Jul 28 11:28:17.463100 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 441/847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:17 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:17.464290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-462eac10-5f5d-454c-99ce-79abd1281f9e tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.469153 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:17.469153 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:17.499883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.515201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.519758 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-462eac10-5f5d-454c-99ce-79abd1281f9e tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/435343973" status: 202 len: 0 microversion: 2.1 time: 0.067951 Jul 28 11:28:17.523767 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 442/848] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:28:17 2022] DELETE /compute/v2.1/flavors/435343973 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:17.550744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.578971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.587842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c11160c-0a3e-41cf-9e75-a3f27f51e270 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1337 microversion: 2.25 time: 0.337468 Jul 28 11:28:17.588513 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 407/849] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:17 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1337 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:17.599742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.600551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.servers [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Removing options 'limit' from query {{(pid=119236) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 11:28:17.604067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:17.609223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:17.609969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:17.624401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.624682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.625135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.625955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.626396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.626789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.632161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.632925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:17.710478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:28:17.911189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:17.940129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:17.983375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:17.995148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.000125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-264c376b-e404-4b07-adc5-d2ec44bc255a tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "DELETE /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 204 len: 0 microversion: 2.1 time: 0.406149 Jul 28 11:28:18.004224 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 408/850] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:17 2022] DELETE /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:28:18.011553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:18.012622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:18.020663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.021346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.022335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.022954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.612476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7f1a100-549a-47fd-b502-1e1927c066d7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.090268 Jul 28 11:28:18.613375 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 443/851] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:28:17 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:18.618385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b8d7287-1ef2-47b2-a268-af183c84342d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb344f820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:18.644343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:18.653326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ade51c38-b60d-409e-bd81-c0bae8b079dc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.647448 Jul 28 11:28:18.675096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 409/852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:18 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:18.675096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-42f6d2bc-38ae-41d4-b2c4-63b073575759 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:18.700208 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b8d7287-1ef2-47b2-a268-af183c84342d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.085513 Jul 28 11:28:18.700780 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 444/853] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:18 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:18.706034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-42f6d2bc-38ae-41d4-b2c4-63b073575759 tempest-FlavorsExtraSpecsTestJSON-1898382527 tempest-FlavorsExtraSpecsTestJSON-1898382527-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.040037 Jul 28 11:28:18.714728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 410/854] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:18 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:18.720381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:18.720544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0af7d302-706a-42e2-9063-ea319dd8a0a5 req-2a123b8b-52a6-474e-a86d-bc449ba2631b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:18.720664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:18.723786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.724244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.725033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.725528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.741042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0af7d302-706a-42e2-9063-ea319dd8a0a5 req-2a123b8b-52a6-474e-a86d-bc449ba2631b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.741654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0af7d302-706a-42e2-9063-ea319dd8a0a5 req-2a123b8b-52a6-474e-a86d-bc449ba2631b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.773675 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0af7d302-706a-42e2-9063-ea319dd8a0a5 req-2a123b8b-52a6-474e-a86d-bc449ba2631b service nova] Creating event network-changed:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:28:18.783200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0af7d302-706a-42e2-9063-ea319dd8a0a5 req-2a123b8b-52a6-474e-a86d-bc449ba2631b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079709 Jul 28 11:28:18.784386 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 445/855] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:18.791607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:18.792555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:18.799199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.800081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:18.801039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:18.801537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.216022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.228393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-250a204c-97ae-46ce-b58e-4b0231e93034 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1473 microversion: 2.1 time: 0.520415 Jul 28 11:28:19.246325 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 411/856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:18 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:19.259341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:19.260365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:19.280771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.281899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.283720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.284396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.340134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.349490 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5905be1c-64a7-4fd9-bcce-f8fcefa16440 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.563692 Jul 28 11:28:19.356436 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 446/857] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:18 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:19.373160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:19.377952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:19.400015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.400466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.401340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.404441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.600828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.616244 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf021c03-9e41-4eca-a6cf-d1c79309f6cf tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1281 microversion: 2.1 time: 0.368509 Jul 28 11:28:19.617423 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 412/858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:19.622563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:19.630218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.631270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:19.637559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.638288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.639339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.639984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.645290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.649702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:19.663772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.666124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:19.667388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a071a6b3-da11-434d-a265-37ec4ccfd0ff tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1343 microversion: 2.25 time: 0.309554 Jul 28 11:28:19.668033 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 447/859] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1343 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:19.683581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ad38efd4-5bc6-4ad6-b364-17f55a8b8544 req-55ba61c9-6d49-4ded-8a57-a42720fb0543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "name": "network-vif-plugged", "status": "completed", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:19.690469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5,nova_api:DELETE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:19.700405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ad38efd4-5bc6-4ad6-b364-17f55a8b8544 req-55ba61c9-6d49-4ded-8a57-a42720fb0543 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.710312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ad38efd4-5bc6-4ad6-b364-17f55a8b8544 req-55ba61c9-6d49-4ded-8a57-a42720fb0543 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.743989 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ad38efd4-5bc6-4ad6-b364-17f55a8b8544 req-55ba61c9-6d49-4ded-8a57-a42720fb0543 service nova] Creating event network-vif-plugged:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:28:19.760919 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ad38efd4-5bc6-4ad6-b364-17f55a8b8544 req-55ba61c9-6d49-4ded-8a57-a42720fb0543 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091032 Jul 28 11:28:19.762019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 448/860] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:19.762903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:19.768009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:19.768799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:19.783966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.784522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.785372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:19.785903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:19.869779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-885a9dfa-bd00-4ac5-9711-b47e9ac18dc3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.250814 Jul 28 11:28:19.871270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 413/861] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:19.886903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0e4e27b-4b01-41a3-9901-c408b8a5d6e3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3356dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:19.976160 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0e4e27b-4b01-41a3-9901-c408b8a5d6e3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.101214 Jul 28 11:28:19.983786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 414/862] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:19.989898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.004566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.006113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.compute.servers [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Removing options 'limit' from query {{(pid=119235) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 11:28:20.006896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:20.021535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.022203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.025586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.026335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.093376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.104265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46e4976a-ed46-43e9-9dad-37eb1ac30533 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.340831 Jul 28 11:28:20.108942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 449/863] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:20.139280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:20.238780 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c33c4660-07ba-41b4-bae3-8187fe1b3dbe tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.257821 Jul 28 11:28:20.249278 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 415/864] 10.222.0.93 () {58 vars in 1150 bytes} [Thu Jul 28 11:28:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:20.254228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.254965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:20.255198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.261617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.262269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:20.265326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.267808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.268364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.269268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.271667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.272232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.272591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.273036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.304929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:20.340879 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9282710c-24b6-4090-b774-7ce7cd4a8c15 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.090241 Jul 28 11:28:20.351510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 416/865] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers => generated 1010 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:20.357461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.363315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.363977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:20.388581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.389044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.390444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.390891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.518394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:20.595692 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a2a3488-00dc-486e-81dc-05492164a85c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.242381 Jul 28 11:28:20.605092 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 417/866] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:20.613581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.615474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:20.627003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.627500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.628884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:20.629327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:20.911521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.948617 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28cc5542-1ea4-4696-bc90-9848b9d7fbd4 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1473 microversion: 2.1 time: 0.697695 Jul 28 11:28:20.959948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 450/867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1473 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:20.978173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:20.986933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:20.999306 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-84498f37-ea80-42d4-81ba-51b9e25bdc86 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.392979 Jul 28 11:28:20.999921 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 418/868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:21.002554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:21.005334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.servers [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Removing options 'limit' from query {{(pid=119236) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 11:28:21.011539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:21.014914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:21.015637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:21.028266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.028815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.029506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.029954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.031749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.034206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.036133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.038128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.334837 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6a4f6e1-6560-4942-bd0f-90a26c7ace1e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.365997 Jul 28 11:28:21.338099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 451/869] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:21.345427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:21.346368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:21.354840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.355784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.356785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.357649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.491531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:21.506361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d861fd67-59cc-46df-a3ef-288fefacb260 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.505389 Jul 28 11:28:21.506958 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 419/870] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:20 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:21.519328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e48bf98d-cc99-4e2a-808b-01487b96d1e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb33c3ee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:21.587095 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e48bf98d-cc99-4e2a-808b-01487b96d1e7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.078968 Jul 28 11:28:21.591727 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 420/871] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:21 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:21.607209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:21.607832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:21.625474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.625929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:21.626728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:21.627198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.147054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.162091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.164946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.166665 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-911cb0dc-8304-4aad-aff7-3e1df80aeba0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.826510 Jul 28 11:28:22.181286 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 452/872] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:21 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:22.186496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:22.194030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.195136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1250822626', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:22.202787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.203579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.204956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.205647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.224635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.232826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8ded194-3d50-4ae6-98c6-8da75fca4b5d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.639992 Jul 28 11:28:22.233399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 421/873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:21 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:22.245672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9da2beca-c018-4e51-8a5b-a319c3aa4809 req-ea7034bb-bebf-4051-a295-2c8dabee4882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16320f50-fa73-42c8-94bf-5793de42fa53", "name": "network-vif-deleted", "tag": "6c390ed7-154a-4d1b-8735-de70405e525f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:22.278241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9da2beca-c018-4e51-8a5b-a319c3aa4809 req-ea7034bb-bebf-4051-a295-2c8dabee4882 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.279229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9da2beca-c018-4e51-8a5b-a319c3aa4809 req-ea7034bb-bebf-4051-a295-2c8dabee4882 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.292918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9da2beca-c018-4e51-8a5b-a319c3aa4809 req-ea7034bb-bebf-4051-a295-2c8dabee4882 service nova] Creating event network-vif-deleted:6c390ed7-154a-4d1b-8735-de70405e525f for instance 16320f50-fa73-42c8-94bf-5793de42fa53 on n-h1-851368-1 Jul 28 11:28:22.300133 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9da2beca-c018-4e51-8a5b-a319c3aa4809 req-ea7034bb-bebf-4051-a295-2c8dabee4882 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058024 Jul 28 11:28:22.301061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 422/874] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:22.318065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:22.323885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:22.337151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.342993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.344323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.344873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.357170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:22.449511 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-328d0af6-91b0-4e70-9fe0-a2cccd7cff12 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1250822626" status: 200 len: 346 microversion: 2.1 time: 0.266778 Jul 28 11:28:22.457621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 453/875] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:28:22 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1250822626 => generated 346 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:22.457621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:22.457621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:22.464918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.465154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.465871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.466200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.509399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:22.526853 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-796ac257-4d0d-4c9e-9ebe-83019138ea84 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1431 microversion: 2.1 time: 0.224298 Jul 28 11:28:22.527465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 423/876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:22 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1431 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:22.548243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4a661b96-dbb8-4786-ae61-a497499ded69 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:22.566797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a661b96-dbb8-4786-ae61-a497499ded69 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.567598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a661b96-dbb8-4786-ae61-a497499ded69 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.667830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4a661b96-dbb8-4786-ae61-a497499ded69 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:28:22.747525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4a661b96-dbb8-4786-ae61-a497499ded69 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "POST /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210/action" status: 202 len: 0 microversion: 2.1 time: 0.202772 Jul 28 11:28:22.753272 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 424/877] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:22 2022] POST /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:22.774637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:22.776053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:22.801102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.801850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:22.802906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:22.807913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:23.017983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:23.028370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ea94e18-b107-45e1-ba7f-f2082fb65e26 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.576118 Jul 28 11:28:23.045819 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 454/878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:22 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:23.051580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-25eb8a63-bc71-4ddc-b202-ac67358d5c6e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb351c940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:23.137232 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-25eb8a63-bc71-4ddc-b202-ac67358d5c6e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1454 microversion: 2.1 time: 0.089936 Jul 28 11:28:23.138092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 455/879] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:23 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:23.150440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:23.152033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:23.162250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:23.163251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:23.165522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:23.166434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:23.392126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:23.409417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be5a5c80-c02f-467a-b696-74d96d74bf25 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.652090 Jul 28 11:28:23.423899 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 425/880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:22 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:23.430815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:23.431546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:23.438442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:23.438993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:23.439881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:23.444087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:23.978662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:23.987784 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-35b13693-2c6f-48a8-8159-5c47f057d21e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.847130 Jul 28 11:28:23.989948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 456/881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:23 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:24.007941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:24.012551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:24.038275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.039163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.040210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.040863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.428148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.442657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:24.454671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.459145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.461123 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64cffaad-46d3-40eb-9165-9aad37b2458c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 1.036035 Jul 28 11:28:24.463644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 426/882] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:23 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:24.468503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:24.471554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:24.487904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.488335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.490803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.491279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.563211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.564947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.566136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lazy-loading 'fault' on Instance uuid 16320f50-fa73-42c8-94bf-5793de42fa53 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:24.714827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c553fb2ab09f41f8bd7a345a5bf9c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7ce63d583a435eaa1a20ab3501347b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.728956 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e162c8c-fbf8-48b5-9046-fc0d820b67d7 tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 200 len: 1307 microversion: 2.1 time: 0.261353 Jul 28 11:28:24.732947 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 427/883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:24 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 1307 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:24.735303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.737862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:24.741696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:24.749500 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fef72dc3-f131-4bef-9249-420f96e88dce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1357 microversion: 2.1 time: 0.754934 Jul 28 11:28:24.756498 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 457/884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:23 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1357 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:24.760038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.764206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.765112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.765552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.766928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3a7693de-7e2d-4b70-a6a1-a94cdeb1c2fe req-b33d0c6b-af00-4aa8-8e9c-2846f87ad8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e136674d-52b8-4587-b731-21134272b802", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:24.792608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3a7693de-7e2d-4b70-a6a1-a94cdeb1c2fe req-b33d0c6b-af00-4aa8-8e9c-2846f87ad8da service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.793056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3a7693de-7e2d-4b70-a6a1-a94cdeb1c2fe req-b33d0c6b-af00-4aa8-8e9c-2846f87ad8da service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:24.809710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3a7693de-7e2d-4b70-a6a1-a94cdeb1c2fe req-b33d0c6b-af00-4aa8-8e9c-2846f87ad8da service nova] Creating event network-changed:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:28:24.815944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3a7693de-7e2d-4b70-a6a1-a94cdeb1c2fe req-b33d0c6b-af00-4aa8-8e9c-2846f87ad8da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056443 Jul 28 11:28:24.816712 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 458/885] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:24.822920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a93030f8-0b5b-4ce2-92ae-37c9129e46bb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb33898b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:24.879173 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a93030f8-0b5b-4ce2-92ae-37c9129e46bb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1463 microversion: 2.1 time: 0.061060 Jul 28 11:28:24.879926 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 459/886] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:24 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1463 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:24.978852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:24.986859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a932e1db-3260-42df-97cc-6bbf86589135 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.252584 Jul 28 11:28:24.987476 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 428/887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:24 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:24.992212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:24.993343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:24.999219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:24.999678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.000444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.000885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.089360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c851ba22-6c81-44ea-a66e-1bb118cd0d97 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Calling method '.version_select at 0x7f2eb35938b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.090253 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:25.090253 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:25.092254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c851ba22-6c81-44ea-a66e-1bb118cd0d97 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '7abfc240c5b440f6a2f385ef7ba0e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a83571f9e8b4014993eb806f538a6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c851ba22-6c81-44ea-a66e-1bb118cd0d97 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Request method failure captured: Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLXCcNoGovVkQWtH3JOFnWnPgIRtseh7XXT_5PEZ1vTzUJ1aZ0Vz-XYkVWZhbN6RQEYqglaagT3A74evqG1kLDQ7oZ8RHhRytNYBM7R4cH5UD143ksL8Y33CcZsd0pXDsq5Av9vQEVSHASCS-SgQacd-wAeHwV5_7Hnf25PKY0KEHI Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:25.094649 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}] Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7abfc240c5b440f6a2f385ef7ba0e14b Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:28:25.095991 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:25.096841 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 11:28:25.098262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.099513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c851ba22-6c81-44ea-a66e-1bb118cd0d97 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:25.099513 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c851ba22-6c81-44ea-a66e-1bb118cd0d97 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.215024 Jul 28 11:28:25.099513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 460/888] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:28:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:25.119645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0ab784e-9441-4a91-bfc2-7646345efa29 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb37fddc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.173290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0ab784e-9441-4a91-bfc2-7646345efa29 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 200 len: 1463 microversion: 2.1 time: 0.075687 Jul 28 11:28:25.174127 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 461/889] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:25.186384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.187258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.193712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.194246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.195109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.196153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.444221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.452358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6d0a5ad-77ff-41bf-abb2-326f001145ee tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.463831 Jul 28 11:28:25.454732 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 429/890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:24 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:25.459217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80c2ad01-aa3d-4af1-89a4-d277bda64e1c tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Calling method '.version_select at 0x7f2eb34d9700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.460289 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:25.460289 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:25.461415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80c2ad01-aa3d-4af1-89a4-d277bda64e1c tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '7abfc240c5b440f6a2f385ef7ba0e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a83571f9e8b4014993eb806f538a6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80c2ad01-aa3d-4af1-89a4-d277bda64e1c tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Request method failure captured: Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLXCcNoGovVkQWtH3JOFnWnPgIRtseh7XXT_5PEZ1vTzUJ1aZ0Vz-XYkVWZhbN6RQEYqglaagT3A74evqG1kLDQ7oZ8RHhRytNYBM7R4cH5UD143ksL8Y33CcZsd0pXDsq5Av9vQEVSHASCS-SgQacd-wAeHwV5_7Hnf25PKY0KEHI Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:25.463095 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}] Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7abfc240c5b440f6a2f385ef7ba0e14b Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:28:25.464537 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:25.465349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 11:28:25.466567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.467771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80c2ad01-aa3d-4af1-89a4-d277bda64e1c tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:25.467771 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80c2ad01-aa3d-4af1-89a4-d277bda64e1c tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010113 Jul 28 11:28:25.468985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 430/891] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:25.473703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.474316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.484636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.485093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.485876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.486319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.542523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.550149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f8350c1f-4207-4bb7-b427-85d0652935a2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.374837 Jul 28 11:28:25.550713 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 462/892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:25.555099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b138a96f-f260-4b56-be0f-f66f54766043 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Calling method '.version_select at 0x7f2eb37fdb80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.556086 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:25.556086 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:25.557411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b138a96f-f260-4b56-be0f-f66f54766043 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '7abfc240c5b440f6a2f385ef7ba0e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a83571f9e8b4014993eb806f538a6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b138a96f-f260-4b56-be0f-f66f54766043 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Request method failure captured: Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLXCcNoGovVkQWtH3JOFnWnPgIRtseh7XXT_5PEZ1vTzUJ1aZ0Vz-XYkVWZhbN6RQEYqglaagT3A74evqG1kLDQ7oZ8RHhRytNYBM7R4cH5UD143ksL8Y33CcZsd0pXDsq5Av9vQEVSHASCS-SgQacd-wAeHwV5_7Hnf25PKY0KEHI Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:25.558933 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}] Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7abfc240c5b440f6a2f385ef7ba0e14b Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:28:25.560484 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:25.561401 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 11:28:25.562717 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.564587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b138a96f-f260-4b56-be0f-f66f54766043 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:25.565413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b138a96f-f260-4b56-be0f-f66f54766043 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.013752 Jul 28 11:28:25.565933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 463/893] 10.222.0.93 () {58 vars in 1179 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:25.571047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.571674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.581039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.581496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.582267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.582697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.763341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.772560 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bdcfbfa8-4dc3-483e-9966-385424afb7ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1468 microversion: 2.1 time: 0.302461 Jul 28 11:28:25.773602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 431/894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:25.801458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.811462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.812967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:25.814083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f888231a-8ff0-4bc1-8e01-973f63bac8ad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.247252 Jul 28 11:28:25.822511 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 464/895] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:25.822511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.822511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] [instance: 16320f50-fa73-42c8-94bf-5793de42fa53] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.829397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.830314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.831512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.831953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.847533 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] HTTP exception thrown: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Request method failure captured: Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 HTTP/1.1 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKRP9QKsdy4SLJlOb0aHucMWhvvHfymMXHugpDWAIr7dTD8GjvrtIc_N7FiV1MPi7FW1uWkLuwcHoNMquQyuto0s1_Tmzr-KRWjv_JMIwHGUnofr5hIIyKddboZ0two-dKs21llG9A2W7YyBTMM1RYriPRz53qBsC5lNpBOu0ldC64 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: bb7ce63d583a435eaa1a20ab3501347b Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:25.849232 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bb7ce63d583a435eaa1a20ab3501347b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bb7ce63d583a435eaa1a20ab3501347b"}]}] Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: bb7ce63d583a435eaa1a20ab3501347b Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-55514750 Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveMigrationNegativeTest-55514750-project Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: c553fb2ab09f41f8bd7a345a5bf9c13b Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveMigrationNegativeTest-55514750-project Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. Jul 28 11:28:25.850489 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '16320f50-fa73-42c8-94bf-5793de42fa53'} Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:25.851334 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. Jul 28 11:28:25.853410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:25.854810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] Returning 404 to user: Instance 16320f50-fa73-42c8-94bf-5793de42fa53 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:25.854810 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07896297-7068-4ef5-8e53-350c27fa9a0b tempest-LiveMigrationNegativeTest-55514750 tempest-LiveMigrationNegativeTest-55514750-project] 10.222.0.93 "GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53" status: 404 len: 111 microversion: 2.1 time: 0.035151 Jul 28 11:28:25.854810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 465/896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/servers/16320f50-fa73-42c8-94bf-5793de42fa53 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:25.859427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.860047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.867218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.867723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.868682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.869297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.878399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Calling method '.version_select at 0x7f2eb972a940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:25.879388 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:25.879388 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:25.880626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.881146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.901639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.902652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.918132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.918580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.928219 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1311ac1-c354-428d-a98e-2aa34fae663d tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.152796 Jul 28 11:28:25.929780 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 432/897] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:25.935244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-171977426"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:25.938078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:25.944851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.946866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:25.947971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:25.948531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.038178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.046129 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-457eb2a4-172c-4f4d-920f-72590973676d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1540 microversion: 2.1 time: 0.190638 Jul 28 11:28:26.046898 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 466/898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:25 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1540 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:26.068143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f50939d-128d-4504-a0f0-2c654cb477f8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Calling method '.version_select at 0x7f2eb35b4a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.069076 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:26.069076 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:26.071023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f50939d-128d-4504-a0f0-2c654cb477f8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '7abfc240c5b440f6a2f385ef7ba0e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a83571f9e8b4014993eb806f538a6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f50939d-128d-4504-a0f0-2c654cb477f8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Request method failure captured: Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLXCcNoGovVkQWtH3JOFnWnPgIRtseh7XXT_5PEZ1vTzUJ1aZ0Vz-XYkVWZhbN6RQEYqglaagT3A74evqG1kLDQ7oZ8RHhRytNYBM7R4cH5UD143ksL8Y33CcZsd0pXDsq5Av9vQEVSHASCS-SgQacd-wAeHwV5_7Hnf25PKY0KEHI Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:26.072606 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}] Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7abfc240c5b440f6a2f385ef7ba0e14b Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1'} Jul 28 11:28:26.073890 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:26.074754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 11:28:26.075930 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.077025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f50939d-128d-4504-a0f0-2c654cb477f8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:26.077025 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f50939d-128d-4504-a0f0-2c654cb477f8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010023 Jul 28 11:28:26.077025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 467/899] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:26.083811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.084412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:26.091894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.092343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.093106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.093538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.222445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be7698e3-b649-4f04-96a6-8a863d475665 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "POST /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039/action" status: 202 len: 0 microversion: 2.1 time: 0.291142 Jul 28 11:28:26.223432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 433/900] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:25 2022] POST /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:28:26.239847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.240677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:26.249952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.251519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.252049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.253145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.253592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.259902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-106b6aec-ce79-4938-b2f8-23feba8146ca tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.180186 Jul 28 11:28:26.261508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 468/901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:26.266585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0aa61d7a-600a-4e8c-a141-a5d9967e1c41 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Calling method '.version_select at 0x7f2eb35934c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.267855 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:26.267855 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:26.269202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0aa61d7a-600a-4e8c-a141-a5d9967e1c41 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] HTTP exception thrown: Hypervisor with ID 'e0683b43-2260-4970-8a7c-add3b05403b5' could not be found. Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0aa61d7a-600a-4e8c-a141-a5d9967e1c41 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Request method failure captured: Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/e0683b43-2260-4970-8a7c-add3b05403b5/uptime HTTP/1.1 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLYlwaE6FYdikvcjM56HB713-EA0QTwsOK7rUyqotOoyoFtQWlnC1poVcSaI2N3uEcdjIaejvbFwTynv8YHILom7f8Db1VFDcfKtB6A5QS3pRyI7zun6laa1HiRiUPgR-EDUlV0dKT7ryhCM7J-c2dsL15varKXHaVJzBu4MIcUWo8 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d0c67aee852946bda61c4df3579c7a52 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:28:26.283299 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c67aee852946bda61c4df3579c7a52"}]}] Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d0c67aee852946bda61c4df3579c7a52 Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e6a17d4057c448ba203e3df52fccd3e Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: exception: Hypervisor with ID 'e0683b43-2260-4970-8a7c-add3b05403b5' could not be found. Jul 28 11:28:26.284822 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e0683b43-2260-4970-8a7c-add3b05403b5'} Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e0683b43-2260-4970-8a7c-add3b05403b5' Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 11:28:26.285718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e0683b43-2260-4970-8a7c-add3b05403b5' could not be found. Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.287176 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e0683b43-2260-4970-8a7c-add3b05403b5' could not be found. Jul 28 11:28:26.288704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.289250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=18 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:26.290871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0aa61d7a-600a-4e8c-a141-a5d9967e1c41 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Returning 404 to user: Hypervisor with ID 'e0683b43-2260-4970-8a7c-add3b05403b5' could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:26.292183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0aa61d7a-600a-4e8c-a141-a5d9967e1c41 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/e0683b43-2260-4970-8a7c-add3b05403b5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029482 Jul 28 11:28:26.293329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 469/902] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/os-hypervisors/e0683b43-2260-4970-8a7c-add3b05403b5/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:26.298404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ca65af5-0705-4289-8c83-5bb22847de7f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb34cedc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.345713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9340a8e-a2f0-4cec-974a-169246464897 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110282 Jul 28 11:28:26.346436 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 434/903] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:26.350630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Calling method '.version_select at 0x7f2eb359b820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.351575 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:26.351575 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:26.353326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.354606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.358369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ca65af5-0705-4289-8c83-5bb22847de7f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.063765 Jul 28 11:28:26.359445 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 470/904] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:26.374504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.374962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.388427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.388897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.396168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-947c3d43-d4fc-42c7-bb9c-7993a91625ee tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048850 Jul 28 11:28:26.396774 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 435/905] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:26.413503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad9ddfb9-830a-4aa8-a5bd-d3bb52c398e8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Calling method '.version_select at 0x7f2eb2ec4e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.416164 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:26.416164 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:26.417356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ad9ddfb9-830a-4aa8-a5bd-d3bb52c398e8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '7abfc240c5b440f6a2f385ef7ba0e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a83571f9e8b4014993eb806f538a6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad9ddfb9-830a-4aa8-a5bd-d3bb52c398e8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Request method failure captured: Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLXCcNoGovVkQWtH3JOFnWnPgIRtseh7XXT_5PEZ1vTzUJ1aZ0Vz-XYkVWZhbN6RQEYqglaagT3A74evqG1kLDQ7oZ8RHhRytNYBM7R4cH5UD143ksL8Y33CcZsd0pXDsq5Av9vQEVSHASCS-SgQacd-wAeHwV5_7Hnf25PKY0KEHI Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:26.419001 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a83571f9e8b4014993eb806f538a6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a83571f9e8b4014993eb806f538a6ae"}]}] Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9a83571f9e8b4014993eb806f538a6ae Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573 Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7abfc240c5b440f6a2f385ef7ba0e14b Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1246735573-project Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1'} Jul 28 11:28:26.421122 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:26.422416 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 11:28:26.424259 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.427392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad9ddfb9-830a-4aa8-a5bd-d3bb52c398e8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:26.427392 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad9ddfb9-830a-4aa8-a5bd-d3bb52c398e8 tempest-HypervisorAdminNegativeTestJSON-1246735573 tempest-HypervisorAdminNegativeTestJSON-1246735573-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015449 Jul 28 11:28:26.427392 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 471/906] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:26.430815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81ce4296-2192-4706-a93b-9ed8631e0970 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Calling method '.version_select at 0x7f2eb325ca60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.431652 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:26.431652 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:26.432528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-81ce4296-2192-4706-a93b-9ed8631e0970 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] HTTP exception thrown: Hypervisor with ID 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' could not be found. Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81ce4296-2192-4706-a93b-9ed8631e0970 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Request method failure captured: Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-hypervisors/e293aad4-7d68-40de-9be5-ed6f5d861a1d HTTP/1.1 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLYlwaE6FYdikvcjM56HB713-EA0QTwsOK7rUyqotOoyoFtQWlnC1poVcSaI2N3uEcdjIaejvbFwTynv8YHILom7f8Db1VFDcfKtB6A5QS3pRyI7zun6laa1HiRiUPgR-EDUlV0dKT7ryhCM7J-c2dsL15varKXHaVJzBu4MIcUWo8 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d0c67aee852946bda61c4df3579c7a52 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:28:26.435412 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d0c67aee852946bda61c4df3579c7a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c67aee852946bda61c4df3579c7a52"}]}] Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d0c67aee852946bda61c4df3579c7a52 Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-316941785 Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7e6a17d4057c448ba203e3df52fccd3e Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: exception: Hypervisor with ID 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' could not be found. Jul 28 11:28:26.439686 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e293aad4-7d68-40de-9be5-ed6f5d861a1d'} Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 11:28:26.440549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:28:26.443856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' could not be found. Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' could not be found. Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81ce4296-2192-4706-a93b-9ed8631e0970 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] Returning 404 to user: Hypervisor with ID 'e293aad4-7d68-40de-9be5-ed6f5d861a1d' could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81ce4296-2192-4706-a93b-9ed8631e0970 tempest-HypervisorAdminNegativeTestJSON-316941785 tempest-HypervisorAdminNegativeTestJSON-316941785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/e293aad4-7d68-40de-9be5-ed6f5d861a1d" status: 404 len: 123 microversion: 2.1 time: 0.009694 Jul 28 11:28:26.445981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 436/907] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/os-hypervisors/e293aad4-7d68-40de-9be5-ed6f5d861a1d => generated 123 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:26.476155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.477498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:26.490745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.491378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.493109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.493550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.571808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.572912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:26.581657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.582474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.583200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.583823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.789574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.800384 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d476f73-af10-46d1-aa56-53f37b204f34 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.329194 Jul 28 11:28:26.815699 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 472/908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:26.821091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:26.841426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-196c5604-1cdd-450c-b71f-ec3de4359ed6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.273659 Jul 28 11:28:26.851285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:26.853492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:26.855234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 437/909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:26.871060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.871635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.872464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.872910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.877197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dc2bc66b-8226-4f12-8ab9-2ddd4a668c3d req-62505b35-45f8-479d-8505-979b353d66a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:26.888162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc2bc66b-8226-4f12-8ab9-2ddd4a668c3d req-62505b35-45f8-479d-8505-979b353d66a5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:26.888646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc2bc66b-8226-4f12-8ab9-2ddd4a668c3d req-62505b35-45f8-479d-8505-979b353d66a5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:26.901532 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dc2bc66b-8226-4f12-8ab9-2ddd4a668c3d req-62505b35-45f8-479d-8505-979b353d66a5 service nova] Creating event network-changed:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:28:26.906413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dc2bc66b-8226-4f12-8ab9-2ddd4a668c3d req-62505b35-45f8-479d-8505-979b353d66a5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041915 Jul 28 11:28:26.907042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 438/910] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:27.037322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:27.047500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:27.050023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:27.052006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d8b4de8f-b2f0-4748-bbe1-16b10019c957 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.208031 Jul 28 11:28:27.067642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 473/911] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:26 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:27.242978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-55d676f5-15ee-4bc8-924f-8fc94cc9a51b req-895f8b9e-effe-4c2c-9f9e-09d637cfeeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-plugged", "status": "completed", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:27.259450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-55d676f5-15ee-4bc8-924f-8fc94cc9a51b req-895f8b9e-effe-4c2c-9f9e-09d637cfeeef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.261886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-55d676f5-15ee-4bc8-924f-8fc94cc9a51b req-895f8b9e-effe-4c2c-9f9e-09d637cfeeef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.291590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:27.292218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:27.301626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.302705 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-55d676f5-15ee-4bc8-924f-8fc94cc9a51b req-895f8b9e-effe-4c2c-9f9e-09d637cfeeef service nova] Creating event network-vif-plugged:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:28:27.307532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.308752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.309354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.334660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-55d676f5-15ee-4bc8-924f-8fc94cc9a51b req-895f8b9e-effe-4c2c-9f9e-09d637cfeeef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075948 Jul 28 11:28:27.335545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 439/912] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:27.384169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1bb75338-622a-4c3b-84a4-baa4bf3f886a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb33c3a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:27.455594 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1bb75338-622a-4c3b-84a4-baa4bf3f886a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.086742 Jul 28 11:28:27.467522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 440/913] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:27 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:27.556208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:27.565272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afcaef77-220e-4509-bbce-1804c6e6077a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.280902 Jul 28 11:28:27.566311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 474/914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:27 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:27.823668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:27.824563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:27.831462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.832106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.832936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.833899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.864180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:27.864797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:27.873425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.874194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.876564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:27.877948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:27.936101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=30 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:28.125685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:28.135304 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7565a574-7122-4f32-b15f-ae7a7b992fa4 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.317375 Jul 28 11:28:28.154644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 441/915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:27 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:28.160360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-389ca35a-ecac-4c76-a572-45f2627e2a6f req-cff38508-7670-4970-9a32-08961a478734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:28.166097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:28.172301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:28.174648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:28.184500 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46256a01-9a2c-4ef8-9cb9-aca3ca7c0fe5 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.323986 Jul 28 11:28:28.185330 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 475/916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:27 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:28.190107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:28.194268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-389ca35a-ecac-4c76-a572-45f2627e2a6f req-cff38508-7670-4970-9a32-08961a478734 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:28.195127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:28.197978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-389ca35a-ecac-4c76-a572-45f2627e2a6f req-cff38508-7670-4970-9a32-08961a478734 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:28.208372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:28.208832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:28.209625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:28.210069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:28.221197 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-389ca35a-ecac-4c76-a572-45f2627e2a6f req-cff38508-7670-4970-9a32-08961a478734 service nova] Creating event network-changed:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:28:28.228023 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-389ca35a-ecac-4c76-a572-45f2627e2a6f req-cff38508-7670-4970-9a32-08961a478734 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072000 Jul 28 11:28:28.228997 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 442/917] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:28.477945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3480aa65-73ec-4654-b9ce-8d332d2729f8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb34d98b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:28.567114 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3480aa65-73ec-4654-b9ce-8d332d2729f8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.095408 Jul 28 11:28:28.577481 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 443/918] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:28 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:28.594102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:28.596777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:28.601653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:28.613261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:28.618044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:28.619915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2cacac73-0ced-40c0-864a-2e2a31cab47b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.432904 Jul 28 11:28:28.622640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:28.623491 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 476/919] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:28 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:28.623628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:28.624482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:28.626750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:29.000998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:29.018666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99985b66-3724-4032-bd7d-b08fffdd048c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1379 microversion: 2.1 time: 0.433535 Jul 28 11:28:29.019279 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 444/920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:28 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1379 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:29.156613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:29.157810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:29.169772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:29.170305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:29.171109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:29.171557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:29.207626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:29.208247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:29.223517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:29.224643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:29.225547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:29.229014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:29.979221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:29.994483 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f670460e-abff-4a3b-9e6c-3932d6a4d86e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.836222 Jul 28 11:28:29.995876 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 477/921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:29 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:30.015329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9526b811-5ff8-478c-ae1f-93de299f8e8e req-7e46e659-ddea-4e8b-8a04-bdda9d8f3145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-unplugged", "status": "completed", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:30.028497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9526b811-5ff8-478c-ae1f-93de299f8e8e req-7e46e659-ddea-4e8b-8a04-bdda9d8f3145 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.029012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9526b811-5ff8-478c-ae1f-93de299f8e8e req-7e46e659-ddea-4e8b-8a04-bdda9d8f3145 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.041968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9526b811-5ff8-478c-ae1f-93de299f8e8e req-7e46e659-ddea-4e8b-8a04-bdda9d8f3145 service nova] Creating event network-vif-unplugged:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:28:30.047248 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9526b811-5ff8-478c-ae1f-93de299f8e8e req-7e46e659-ddea-4e8b-8a04-bdda9d8f3145 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047260 Jul 28 11:28:30.048676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 478/922] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:30.056007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ffe8a848-063f-44e6-aa5b-18639d8e669e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb344f160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.111824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.121088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ffe8a848-063f-44e6-aa5b-18639d8e669e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.070939 Jul 28 11:28:30.124824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b0ce968-cf45-4db9-a9fa-84d6e62f68d3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.922530 Jul 28 11:28:30.138610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 479/923] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:30.140695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 445/924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:29 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:30.146065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.146685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:30.154000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.154456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.155268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.155885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.345565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.356140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.358200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.359482 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd8ea5bb-1ec2-4c65-b907-86d3b9dab922 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.217844 Jul 28 11:28:30.360617 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 446/925] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:30.377616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.378542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:30.390442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.391563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.392597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.393203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.446227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:30.520860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.523431 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.523431 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.524666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.525160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.527169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.527611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.532430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=15 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:30.562302 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-097ca4ba-4e3e-45de-b580-a4c8318c8428 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.429229 Jul 28 11:28:30.563670 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 480/926] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:30.579201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.583841 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.583841 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.585376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.585828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.586699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.587167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.600156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.609346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0cb2a384-544c-4988-8497-18a70f096efe tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1528 microversion: 2.1 time: 0.247365 Jul 28 11:28:30.610526 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 447/927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:30.620855 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e173e85c-b151-4449-91a5-c9bd518588f2 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.049212 Jul 28 11:28:30.621464 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 481/928] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:30.633859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.634054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.634561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:30.636763 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.636763 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.638070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.638519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.639341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.640148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.640678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.641129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.642082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.642527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.646848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:30.665803 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be5fd4f2-92a5-4484-a481-dc21453d4af7 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035686 Jul 28 11:28:30.666401 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 482/929] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:30.678188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.682288 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.682288 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.683713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.684243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.685480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.686274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.711641 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a79eadcc-9e32-4684-9d65-4c63ad08c068 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851368-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.036963 Jul 28 11:28:30.712547 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 483/930] 10.222.0.93 () {58 vars in 1194 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services?host=n-d-851368-1&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:28:30.724331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.727287 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.727287 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.728930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.729062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.730113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.730558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.764703 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfa3b5c3-7538-4b58-8bd0-b61944008dbd tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043971 Jul 28 11:28:30.765654 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 484/931] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:30.780573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.783811 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.783811 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.785075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.785527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.786334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.786800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.809166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:30.818628 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-034c33db-8a77-4dd8-8515-f6c36eebc54f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1528 microversion: 2.1 time: 0.187876 Jul 28 11:28:30.820673 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 448/932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1528 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:30.822872 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea04955d-2768-4da4-9c1c-d379fa9750a3 tempest-ServicesAdminNegativeTestJSON-274500372 tempest-ServicesAdminNegativeTestJSON-274500372-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049398 Jul 28 11:28:30.831229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 485/933] 10.222.0.93 () {58 vars in 1198 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:30.843023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7aff294a-a84f-4587-8b82-9106b7bdf5f4 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.843985 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:30.843985 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:28:30.868067 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7aff294a-a84f-4587-8b82-9106b7bdf5f4 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/706ea037-14f6-4f51-bbe0-1cdda0448f2f" status: 202 len: 0 microversion: 2.1 time: 0.028948 Jul 28 11:28:30.869018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 486/934] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:30 2022] DELETE /compute/v2.1/flavors/706ea037-14f6-4f51-bbe0-1cdda0448f2f => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:30.884766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d39e0834-c884-4a74-a94b-34fcd56641d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:30.908838 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d39e0834-c884-4a74-a94b-34fcd56641d1 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035282 Jul 28 11:28:30.910233 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 487/935] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:30.932476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:30.936127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:30.944301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.945261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.947887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:30.948551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:30.993717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.001265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Old instance type tempest-test_resize_flavor_-971568170, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 11:28:31.014315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:31.014863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:31.015377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:31.015787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:31.016198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:31.092723 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fceaa75a-f254-4505-b627-1ace805a2be6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29/action" status: 202 len: 0 microversion: 2.1 time: 0.168263 Jul 28 11:28:31.097359 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 488/936] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:30 2022] POST /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:28:31.103914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.104830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:31.113019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.113981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.115027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.115630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.151328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f9495e1-fc9b-4412-9607-4a06c7259482 tempest-ServicesAdminNegativeTestJSON-926916590 tempest-ServicesAdminNegativeTestJSON-926916590-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.154236 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:31.154236 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:31.156294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f9495e1-fc9b-4412-9607-4a06c7259482 tempest-ServicesAdminNegativeTestJSON-926916590 tempest-ServicesAdminNegativeTestJSON-926916590-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '23131299bc234047b1dd7e639783bf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c078807e05489194d5c13347130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f9495e1-fc9b-4412-9607-4a06c7259482 tempest-ServicesAdminNegativeTestJSON-926916590 tempest-ServicesAdminNegativeTestJSON-926916590-project] Request method failure captured: Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLcm1ZK9tlMhjzZ-0V0VRCYVJwz9p5Hf1IeGRZfLIZD-6kklfsRHg-TCK2iDeJ7OOlvMux0F_7p4T78e4V_3XK4jrbKGcGPaoMJYcY2fL53B0wgAOyvucbkQwJeVkUIuM8bgsyJZiI_mW5Ve8LW6qecgLvL4VXEdujNhrwRnu1sAwg Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d0c078807e05489194d5c13347130cba Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-926916590 Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:31.159290 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c078807e05489194d5c13347130cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d0c078807e05489194d5c13347130cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d0c078807e05489194d5c13347130cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0c078807e05489194d5c13347130cba"}]}] Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-926916590 Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d0c078807e05489194d5c13347130cba Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-926916590 Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServicesAdminNegativeTestJSON-926916590-project Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23131299bc234047b1dd7e639783bf99 Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-926916590-project Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:28:31.160885 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:31.161643 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:28:31.162913 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.166142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f9495e1-fc9b-4412-9607-4a06c7259482 tempest-ServicesAdminNegativeTestJSON-926916590 tempest-ServicesAdminNegativeTestJSON-926916590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:31.167215 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f9495e1-fc9b-4412-9607-4a06c7259482 tempest-ServicesAdminNegativeTestJSON-926916590 tempest-ServicesAdminNegativeTestJSON-926916590-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.334271 Jul 28 11:28:31.178251 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 449/937] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 346 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:31.279512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec81201f-1151-4169-b852-6649dad0eb6c tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.280348 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:31.280348 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:31.282596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ec81201f-1151-4169-b852-6649dad0eb6c tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec81201f-1151-4169-b852-6649dad0eb6c tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin] Request method failure captured: Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLeJlLPbTD75GdeXZ7QplDt1kFeBPDngNzKMdDwZ9iF0VQU5k9WxFWh7kzJRS5Rsyk3y02nhtxAR6o4h25eHfQ4XbL6fggT83XZZ8mTlkDfuhmcxTPUmEURDuNTfTEqDhG8fJqWV2tQ_jUOwd8XsZ7i5V1GZTpLZf1282B6q1ifuAA Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d7e8f6703f084d4c8b51f6ef169ff96b Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:28:31.294641 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7e8f6703f084d4c8b51f6ef169ff96b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d7e8f6703f084d4c8b51f6ef169ff96b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d7e8f6703f084d4c8b51f6ef169ff96b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7e8f6703f084d4c8b51f6ef169ff96b"}]}] Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d7e8f6703f084d4c8b51f6ef169ff96b Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 425567f2a93d40f0855afcb4d6e46d0b Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:28:31.296273 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid timestamp for date invalid_time Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'invalid_time'} Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:31.297086 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 28 11:28:31.298654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.302323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec81201f-1151-4169-b852-6649dad0eb6c tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:31.307453 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec81201f-1151-4169-b852-6649dad0eb6c tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844 tempest-InstanceUsageAuditLogNegativeTestJSON-1684648844-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.128103 Jul 28 11:28:31.308068 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 450/938] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:28:31.326013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.326868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:31.339904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.340656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.341609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.342379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.392516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.402374 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43c9e888-26d0-4fe1-ae58-326cd8901c59 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.303466 Jul 28 11:28:31.402971 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 489/939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:31.416957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8915ec65-9b19-4ca4-9a52-0862e5395baf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb37fd310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.484822 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8915ec65-9b19-4ca4-9a52-0862e5395baf tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.080561 Jul 28 11:28:31.491159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 490/940] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:31.498491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.501134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:31.512932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.514281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.515333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.515582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.563593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.571862 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e4e3c95-9686-47ac-870b-41e0930352f6 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1537 microversion: 2.1 time: 0.262519 Jul 28 11:28:31.572424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 451/941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:31.843388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.859313 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d048d102-7687-41da-9f8e-93f0030be682 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.371754 Jul 28 11:28:31.860264 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 491/942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:31.883868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69a8613d-0d1e-4598-8c8b-4cf1098413d5 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.884681 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:31.884681 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:31.885812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-69a8613d-0d1e-4598-8c8b-4cf1098413d5 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '64cea988f305440b937074d711221ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652027fc2e6d4017af8f635d1445c8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69a8613d-0d1e-4598-8c8b-4cf1098413d5 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Request method failure captured: Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLdVaCdybdpmYZoOYn9tpTRVNik1EkcpwZORR0Uxqf1_aZwu45B6CfxHgrI-diHY0KDqeOgIT8L95R9vZoNz-M3BC-IdwUiM0yXITCkazAj4B2AIIhriIroBu74Lw-h9sG2nCxbEc-CgpNPc3uleEy6zpqk97XCMNeAhBDVtJOu90M Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 652027fc2e6d4017af8f635d1445c8c4 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:31.888542 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/652027fc2e6d4017af8f635d1445c8c4"}]}] Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 652027fc2e6d4017af8f635d1445c8c4 Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 64cea988f305440b937074d711221ef2 Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:28:31.890138 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:31.890954 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 11:28:31.892444 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.898605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69a8613d-0d1e-4598-8c8b-4cf1098413d5 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:31.899750 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69a8613d-0d1e-4598-8c8b-4cf1098413d5 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.323260 Jul 28 11:28:31.902319 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 452/943] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:31.904860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.905718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:31.912544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d11acc0-03fa-4ad0-ad0b-454abd7b7c49 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:31.913320 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:28:31.913320 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:28:31.914925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d11acc0-03fa-4ad0-ad0b-454abd7b7c49 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '64cea988f305440b937074d711221ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652027fc2e6d4017af8f635d1445c8c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d11acc0-03fa-4ad0-ad0b-454abd7b7c49 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Request method failure captured: Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2011:28:31 HTTP/1.1 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLdVaCdybdpmYZoOYn9tpTRVNik1EkcpwZORR0Uxqf1_aZwu45B6CfxHgrI-diHY0KDqeOgIT8L95R9vZoNz-M3BC-IdwUiM0yXITCkazAj4B2AIIhriIroBu74Lw-h9sG2nCxbEc-CgpNPc3uleEy6zpqk97XCMNeAhBDVtJOu90M Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 652027fc2e6d4017af8f635d1445c8c4 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:31.916529 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_652027fc2e6d4017af8f635d1445c8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/652027fc2e6d4017af8f635d1445c8c4"}]}] Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 652027fc2e6d4017af8f635d1445c8c4 Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 64cea988f305440b937074d711221ef2 Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:28:31.918029 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '2022-07-28 11:28:31'} Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:28:31.918743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:31.919963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d11acc0-03fa-4ad0-ad0b-454abd7b7c49 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:31.924137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.924137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.924599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:31.925040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:31.928016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d11acc0-03fa-4ad0-ad0b-454abd7b7c49 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318 tempest-InstanceUsageAuditLogNegativeTestJSON-1560489318-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 11:28:31" status: 403 len: 128 microversion: 2.1 time: 0.011016 Jul 28 11:28:31.928629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 453/944] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2011%3A28%3A31 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:32.069813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dc41ce25-15c0-4dd4-877c-e9453c6c89fc req-3b698b5a-5852-4a3f-9091-0815dc9aeef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e136674d-52b8-4587-b731-21134272b802", "name": "network-vif-plugged", "status": "completed", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:32.081414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc41ce25-15c0-4dd4-877c-e9453c6c89fc req-3b698b5a-5852-4a3f-9091-0815dc9aeef1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.082087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc41ce25-15c0-4dd4-877c-e9453c6c89fc req-3b698b5a-5852-4a3f-9091-0815dc9aeef1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.110257 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dc41ce25-15c0-4dd4-877c-e9453c6c89fc req-3b698b5a-5852-4a3f-9091-0815dc9aeef1 service nova] Creating event network-vif-plugged:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:28:32.117185 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dc41ce25-15c0-4dd4-877c-e9453c6c89fc req-3b698b5a-5852-4a3f-9091-0815dc9aeef1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052142 Jul 28 11:28:32.118463 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 454/945] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:32.154397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:32.165573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:32.167996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:32.171037 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f558dbf0-bb9a-4fef-aa15-2c5d28be2565 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.274355 Jul 28 11:28:32.171918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 492/946] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:31 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:32.425762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:32.426695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:32.434362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.435506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.436820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.437741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.499742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2818fa6f-376f-42ae-ab52-a6193d1f9fc5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3021d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:32.571584 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2818fa6f-376f-42ae-ab52-a6193d1f9fc5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.075665 Jul 28 11:28:32.579289 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 493/947] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:32 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:32.594806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:32.596395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:32.604847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.605646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.606586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.607201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.616780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:32.626534 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-caa11484-44b2-4117-b28c-158ad3fa841c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.205439 Jul 28 11:28:32.628635 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 455/948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:32 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:32.774415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:32.784724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9426fb3-384d-409b-896f-67a0e73f6fe9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1537 microversion: 2.1 time: 0.195485 Jul 28 11:28:32.799470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 494/949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:32 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:32.884484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:32.885230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:32.894681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.895425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:32.897523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:32.900658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.063282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:33.071464 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4e72348-305c-4744-a8ec-09d6559b8052 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1522 microversion: 2.1 time: 0.192569 Jul 28 11:28:33.072044 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 456/950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:32 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:33.199354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:33.202442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:33.217785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.220949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.222550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.223490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.445575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:33.463364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:33.467064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:33.469480 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f71744bb-c955-4ba5-98ac-32b12f76adb9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1411 microversion: 2.25 time: 0.278725 Jul 28 11:28:33.470917 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 495/951] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:33 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1411 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:33.585855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-253deca3-4b86-44d2-9be4-549cbb31f561 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb31faee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:33.651432 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-253deca3-4b86-44d2-9be4-549cbb31f561 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.065791 Jul 28 11:28:33.654925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 457/952] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:33 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:33.657306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:33.657938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:33.673901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.674356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.675161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.675602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.810152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:33.811115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:33.821533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.822607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.823847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:33.824507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:33.934591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:33.944317 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-14b2b428-34e6-42d4-915d-f49ac98c7393 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.298366 Jul 28 11:28:33.944903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 496/953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:33 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:34.085197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.098325 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77d04f04-9cb9-4620-9433-3345b8de48e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1537 microversion: 2.1 time: 0.294938 Jul 28 11:28:34.098820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 458/954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:33 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:34.114329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.115425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:34.124305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.125033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.126048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.127417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.140838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "name": "network-vif-plugged", "status": "completed", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}, {"server_uuid": "2ffe02a6-d004-4892-b66a-5ec170b6b039", "name": "network-vif-plugged", "status": "completed", "tag": "4cd77d76-1baf-42eb-82a8-7cad5959f74a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:34.155828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.156281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.173897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] Creating event network-vif-plugged:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:28:34.174404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] Creating event network-vif-plugged:4cd77d76-1baf-42eb-82a8-7cad5959f74a for instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 on n-h1-851368-1 Jul 28 11:28:34.200043 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e7cf6064-b9ba-47bd-b19f-7ef6c3198651 req-52a1fc49-6aeb-4c7c-b24f-b8d04270dce8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063092 Jul 28 11:28:34.201822 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 459/955] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:34.346416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.363260 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb8aba70-ceb2-4dec-9350-889255521546 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1499 microversion: 2.1 time: 0.266259 Jul 28 11:28:34.364782 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 497/956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:34.385613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.390653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.391821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:34.403739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.404583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.405476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.407781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.469033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:34.501718 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9186e885-85f7-4758-b011-f6e5cbdf92c6 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.119992 Jul 28 11:28:34.507106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 460/957] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:34.508532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.509371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:34.515656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.516414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.516874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.517366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.582459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a9563ca-b427-4eb4-b330-6d789273a036 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.591902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a9563ca-b427-4eb4-b330-6d789273a036 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.170962 Jul 28 11:28:34.600433 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 498/958] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:34.605911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a99d9cb6-a311-40ee-9c03-398a439f62be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:34.608814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:34.613449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99d9cb6-a311-40ee-9c03-398a439f62be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.613934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99d9cb6-a311-40ee-9c03-398a439f62be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.672110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.678007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a99d9cb6-a311-40ee-9c03-398a439f62be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Going to try to start instance {{(pid=119236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 11:28:34.680663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.682342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.683738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c42f3d83-9a1c-4793-8980-7e250a4a0aa6 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1608 microversion: 2.25 time: 0.179610 Jul 28 11:28:34.691134 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 461/959] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1608 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:28:34.691134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-44f7a5e9-5d90-4e04-ab50-89e315e506e3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.711896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-44f7a5e9-5d90-4e04-ab50-89e315e506e3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.025591 Jul 28 11:28:34.721488 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 462/960] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:34.721488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ebdeaf2-9412-4300-8ebf-504f2c3b86b7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3257790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.731597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a99d9cb6-a311-40ee-9c03-398a439f62be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "POST /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210/action" status: 202 len: 0 microversion: 2.1 time: 0.129818 Jul 28 11:28:34.732198 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 499/961] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:34 2022] POST /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:34.738079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.738902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:34.745457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.746132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.747159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.747792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.770650 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ebdeaf2-9412-4300-8ebf-504f2c3b86b7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.057232 Jul 28 11:28:34.771246 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 463/962] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:34.776226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-562abc71-c4e3-431d-8097-040eab7913e3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.784476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-562abc71-c4e3-431d-8097-040eab7913e3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012242 Jul 28 11:28:34.785017 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 464/963] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:34.790415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.792723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:34.798184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.798636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.799635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.800068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.834794 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-93bb1192-7a10-4d68-b6a0-7ed6fba9c187 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.100563 Jul 28 11:28:34.842965 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 500/964] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:28:34.842965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f142d265-eeb4-445a-8eca-64937980693b tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.849085 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f142d265-eeb4-445a-8eca-64937980693b tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011716 Jul 28 11:28:34.850019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 501/965] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:34.865480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81418aa5-9fcb-433b-a13c-e186d168d53d tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.927151 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81418aa5-9fcb-433b-a13c-e186d168d53d tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.059507 Jul 28 11:28:34.928335 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 502/966] 10.222.0.93 () {58 vars in 1165 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:34.946113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9726588d-3e00-45b0-bd57-b3a9d4f7f6b1 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.963297 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9726588d-3e00-45b0-bd57-b3a9d4f7f6b1 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019672 Jul 28 11:28:34.965297 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 503/967] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:34.980895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:34.981695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:34.989698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:34.991668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.993034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.994052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:34.994573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:34.999520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:35.000868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da765d24-9843-4162-bdd8-3abe622239de tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1508 microversion: 2.1 time: 0.214638 Jul 28 11:28:35.001463 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 465/968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.006955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f75be622-23ee-44eb-8d80-2f703478162e tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.037827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f75be622-23ee-44eb-8d80-2f703478162e tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035044 Jul 28 11:28:35.038604 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 466/969] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.053980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f22c110f-2b9a-4845-a9ab-1c169ae05ae3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.067840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f22c110f-2b9a-4845-a9ab-1c169ae05ae3 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017763 Jul 28 11:28:35.069169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 467/970] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:35.082313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf5bf661-2013-4e81-b1ea-2f7299ff5d7c tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.091791 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf5bf661-2013-4e81-b1ea-2f7299ff5d7c tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013306 Jul 28 11:28:35.093119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 468/971] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.108165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea1e9734-f7b0-4a2d-b451-d780ad8d220b tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.157917 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea1e9734-f7b0-4a2d-b451-d780ad8d220b tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.057009 Jul 28 11:28:35.158776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 469/972] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.163882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.165138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:35.177368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:35.177829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:35.178622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:35.179093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:35.180784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:35.191868 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a2504e4-70dd-4a9f-b14c-ac690156cf7b tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1323 microversion: 2.1 time: 0.225493 Jul 28 11:28:35.203754 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 504/973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:34 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.211966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-551e824e-2b4a-4c8d-b352-de8c0f70ae53 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.231961 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-551e824e-2b4a-4c8d-b352-de8c0f70ae53 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026881 Jul 28 11:28:35.232793 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 505/974] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.245075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26e0ae17-72f5-465a-a271-17a90d658bee tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.271557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26e0ae17-72f5-465a-a271-17a90d658bee tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.030992 Jul 28 11:28:35.272617 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 506/975] 10.222.0.93 () {58 vars in 1144 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:35.287245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e4a826e6-f63f-444b-9eda-4a20999a9514 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.297763 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e4a826e6-f63f-444b-9eda-4a20999a9514 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013787 Jul 28 11:28:35.299252 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 507/976] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.313298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff599c93-e3f8-4fe2-a038-d1f3f3ff68be tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.334753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:35.343362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aafe69af-927b-452c-993a-e4bfc4385e7b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.182996 Jul 28 11:28:35.344177 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 470/977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.347149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff599c93-e3f8-4fe2-a038-d1f3f3ff68be tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.039962 Jul 28 11:28:35.347954 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 508/978] 10.222.0.93 () {58 vars in 1148 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.361635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c87a6a08-e40c-4ef5-aa9d-04cc18344302 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.375030 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c87a6a08-e40c-4ef5-aa9d-04cc18344302 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017125 Jul 28 11:28:35.375766 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 471/979] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.389382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2588ee62-1125-4911-84a9-c8ac7f25d72a tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.400479 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2588ee62-1125-4911-84a9-c8ac7f25d72a tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014456 Jul 28 11:28:35.401434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 509/980] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.412731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71438c72-58c2-4bae-9c30-8a879bcab8ba tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.437875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71438c72-58c2-4bae-9c30-8a879bcab8ba tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.028769 Jul 28 11:28:35.438487 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 472/981] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:35.452273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2f22dcb-1454-4de3-a9d6-1da108eb0990 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.478680 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2f22dcb-1454-4de3-a9d6-1da108eb0990 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030385 Jul 28 11:28:35.480651 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 510/982] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:35.498316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69a26eb9-1809-4a7e-af95-76e9a79e6f32 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.507055 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69a26eb9-1809-4a7e-af95-76e9a79e6f32 tempest-FlavorsV2TestJSON-1314328119 tempest-FlavorsV2TestJSON-1314328119-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012854 Jul 28 11:28:35.508138 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 473/983] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:35.785702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-358499e9-b3eb-42d9-94d7-64c4b1e2b049 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb344f820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:35.838408 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-358499e9-b3eb-42d9-94d7-64c4b1e2b049 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.056527 Jul 28 11:28:35.838992 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 511/984] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:35 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:36.023811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:36.024360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:36.032753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.037654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.038433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.038893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.103383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-283b457a-fa92-4b78-b139-f9e4f39afe23 req-79dfcbbc-a2ad-4a86-b5e9-4e0ff58722de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e136674d-52b8-4587-b731-21134272b802", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:36.114528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-283b457a-fa92-4b78-b139-f9e4f39afe23 req-79dfcbbc-a2ad-4a86-b5e9-4e0ff58722de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.115279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-283b457a-fa92-4b78-b139-f9e4f39afe23 req-79dfcbbc-a2ad-4a86-b5e9-4e0ff58722de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.127674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-283b457a-fa92-4b78-b139-f9e4f39afe23 req-79dfcbbc-a2ad-4a86-b5e9-4e0ff58722de service nova] Creating event network-changed:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:28:36.133852 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-283b457a-fa92-4b78-b139-f9e4f39afe23 req-79dfcbbc-a2ad-4a86-b5e9-4e0ff58722de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034659 Jul 28 11:28:36.139449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 512/985] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:36.218692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:36.219556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:36.230749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.231509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.232970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.236749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.318491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:36.328811 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-365dafb9-e6e0-4b15-9f4d-f670be77e09c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1508 microversion: 2.1 time: 0.310446 Jul 28 11:28:36.329993 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 474/986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:36 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:36.374403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:36.375352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:36.384277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.385002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.386992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:36.387643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:36.761756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:36.779590 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e16a14e9-7726-484a-a738-47ed8c4c7c6c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1519 microversion: 2.1 time: 0.565033 Jul 28 11:28:36.780618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 513/987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:36 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1519 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:36.867431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:36.881495 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95e7e3a5-2868-49a2-bba9-fbfcbfca7888 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.517756 Jul 28 11:28:36.882091 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 475/988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:36 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:36.902624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea9468b5-f6ec-403d-b725-774a394c8e9e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'create', calling method: .version_select at 0x7f2eb31fa9d0>, body: {"pool": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:37.284643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-005c01cd-0c81-4815-82dd-879137e16b9a tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] Calling method '.version_select at 0x7f2eb35363a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:37.517254 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-005c01cd-0c81-4815-82dd-879137e16b9a tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 6057 microversion: 2.1 time: 0.735133 Jul 28 11:28:37.517967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 514/989] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:36 2022] GET /compute/v2.1/os-networks => generated 6057 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:37.528501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9f9ce1f9-ed95-4975-9ccf-3611791bb7e4 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb31308b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:37.628466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9f9ce1f9-ed95-4975-9ccf-3611791bb7e4 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.108727 Jul 28 11:28:37.629037 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 515/990] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:37 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:37.657855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:37.658821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:37.699532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:37.701533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:37.707443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:37.708176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:38.079106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:38.095311 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76b42bae-64ee-482a-8c8a-b67c8215a8e1 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1512 microversion: 2.1 time: 0.451894 Jul 28 11:28:38.096188 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 516/991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:37 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:38.100660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f960efe1-cc7d-4c45-a867-9b5b932b9d69 tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] Calling method '.version_select at 0x7f2eb35363a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:38.276211 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f960efe1-cc7d-4c45-a867-9b5b932b9d69 tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks/b9bbc579-ce4a-4d49-9295-6e1fd796851b" status: 200 len: 652 microversion: 2.1 time: 0.178373 Jul 28 11:28:38.277080 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 517/992] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:28:38 2022] GET /compute/v2.1/os-networks/b9bbc579-ce4a-4d49-9295-6e1fd796851b => generated 652 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:38.284861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:38.285850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:38.295469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:38.296433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:38.298770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:38.299564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:38.522078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:38.532971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6349022b-1ae0-4ccd-990e-25ffcd4c8b67 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.253684 Jul 28 11:28:38.549429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 518/993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:38 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:38.708529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9079fe89-7f64-4aa5-a945-2698250a5bbb tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Calling method '.version_select at 0x7f2eb2fc7670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:38.731014 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9079fe89-7f64-4aa5-a945-2698250a5bbb tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9079fe89-7f64-4aa5-a945-2698250a5bbb tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/1bec10f8-a19c-4acc-a900-7d150104c673/metadata/os_distro HTTP/1.1 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:38.740601 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'image_id': '1bec10f8-a19c-4acc-a900-7d150104c673', 'id': 'os_distro'} Jul 28 11:28:38.742297 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:38.743487 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1bec10f8-a19c-4acc-a900-7d150104c673 Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:38.744951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1bec10f8-a19c-4acc-a900-7d150104c673 could not be found. Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:38.746345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:38.748184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9079fe89-7f64-4aa5-a945-2698250a5bbb tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:38.749615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9079fe89-7f64-4aa5-a945-2698250a5bbb tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "DELETE /compute/v2.1/images/1bec10f8-a19c-4acc-a900-7d150104c673/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.191439 Jul 28 11:28:38.749615 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 519/994] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Jul 28 11:28:38 2022] DELETE /compute/v2.1/images/1bec10f8-a19c-4acc-a900-7d150104c673/metadata/os_distro => generated 62 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:28:38.759537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:38.766848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:38.778835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.servers [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Removing options 'limit' from query {{(pid=119236) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 11:28:38.779970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:38.781320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:38.784301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:38.787553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:38.788212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:38.789980 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7b4475a-9ff7-4a26-9151-45143f3b66b3 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.034839 Jul 28 11:28:38.793656 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 520/995] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Jul 28 11:28:38 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:28:38.801236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-96043419-4c79-4999-aca6-efe3f9746345 tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] Calling method '.version_select at 0x7f2eb344fe50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.067740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea9468b5-f6ec-403d-b725-774a394c8e9e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.171166 Jul 28 11:28:39.074573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-96043419-4c79-4999-aca6-efe3f9746345 tempest-NetworksTest-498879703 tempest-NetworksTest-498879703-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 6057 microversion: 2.1 time: 0.279644 Jul 28 11:28:39.079849 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 521/996] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:28:38 2022] GET /compute/v2.1/os-networks => generated 6057 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:39.090074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eebc36cf-e053-4e78-a451-40353d0f1722 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2f01820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.094245 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 476/997] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:28:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:39.105832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8ad8891-6eef-45eb-9d80-de5be51bd668 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Calling method '.version_select at 0x7f2eb338ef70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.156535 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e8ad8891-6eef-45eb-9d80-de5be51bd668 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8ad8891-6eef-45eb-9d80-de5be51bd668 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/images/8fb8f5f8-028a-4e7f-a041-3347ae94c1a0/metadata/os_version HTTP/1.1 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:39.161451 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'image_id': '8fb8f5f8-028a-4e7f-a041-3347ae94c1a0', 'id': 'os_version'} Jul 28 11:28:39.162748 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.163588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8fb8f5f8-028a-4e7f-a041-3347ae94c1a0 Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.165229 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fb8f5f8-028a-4e7f-a041-3347ae94c1a0 could not be found. Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:39.168071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.171184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8ad8891-6eef-45eb-9d80-de5be51bd668 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:39.175907 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8ad8891-6eef-45eb-9d80-de5be51bd668 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "GET /compute/v2.1/images/8fb8f5f8-028a-4e7f-a041-3347ae94c1a0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.067895 Jul 28 11:28:39.175907 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 477/998] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Jul 28 11:28:39 2022] GET /compute/v2.1/images/8fb8f5f8-028a-4e7f-a041-3347ae94c1a0/metadata/os_version => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:28:39.180878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.182122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:39.184895 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eebc36cf-e053-4e78-a451-40353d0f1722 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.102781 Jul 28 11:28:39.185731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 522/999] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:39 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:39.190740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:39.191316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:39.191520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-206e7e0a-c8eb-4558-8790-4f4a219048c5 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Calling method '.version_select at 0x7f2eb2c08790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.192732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:39.194214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:39.216368 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-206e7e0a-c8eb-4558-8790-4f4a219048c5 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-206e7e0a-c8eb-4558-8790-4f4a219048c5 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/images/d6949cea-851f-49a6-897e-c21b45f7fc51/metadata HTTP/1.1 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:39.220197 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'image_id': 'd6949cea-851f-49a6-897e-c21b45f7fc51'} Jul 28 11:28:39.221776 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.222732 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d6949cea-851f-49a6-897e-c21b45f7fc51 Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.224048 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6949cea-851f-49a6-897e-c21b45f7fc51 could not be found. Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:39.232062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.233529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-206e7e0a-c8eb-4558-8790-4f4a219048c5 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:39.234860 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-206e7e0a-c8eb-4558-8790-4f4a219048c5 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "GET /compute/v2.1/images/d6949cea-851f-49a6-897e-c21b45f7fc51/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036309 Jul 28 11:28:39.234860 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 523/1000] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:28:39 2022] GET /compute/v2.1/images/d6949cea-851f-49a6-897e-c21b45f7fc51/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:28:39.242853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-800592dc-3f7d-42fb-832e-2fdd2a8e5a75 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2f01820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:39.279479 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-800592dc-3f7d-42fb-832e-2fdd2a8e5a75 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-800592dc-3f7d-42fb-832e-2fdd2a8e5a75 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/images/495ec01e-9d7b-475b-aa56-b8621f6c5a01/metadata HTTP/1.1 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 57 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:39.281739 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:28:39.283338 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'image_id': '495ec01e-9d7b-475b-aa56-b8621f6c5a01', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.284392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 495ec01e-9d7b-475b-aa56-b8621f6c5a01 Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.285839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 495ec01e-9d7b-475b-aa56-b8621f6c5a01 could not be found. Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:39.287247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:39.288598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.292190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-800592dc-3f7d-42fb-832e-2fdd2a8e5a75 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:39.292190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-800592dc-3f7d-42fb-832e-2fdd2a8e5a75 tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "PUT /compute/v2.1/images/495ec01e-9d7b-475b-aa56-b8621f6c5a01/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049477 Jul 28 11:28:39.292190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 524/1001] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:28:39 2022] PUT /compute/v2.1/images/495ec01e-9d7b-475b-aa56-b8621f6c5a01/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:28:39.292190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1703247768", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:39.361591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] validate_networks() for [('6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:39.789880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:39.801694 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2fb3ea37-647f-4bf1-af31-22c221ee6fb4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1512 microversion: 2.1 time: 0.626353 Jul 28 11:28:39.802524 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 478/1002] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:39 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1512 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:39.812134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9dabab3-7a4e-44a2-865c-ca9383b4f45c tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Action: 'update', calling method: .version_select at 0x7f2eb30b3dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:39.844204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c9dabab3-7a4e-44a2-865c-ca9383b4f45c tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9dabab3-7a4e-44a2-865c-ca9383b4f45c tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/images/9ca5a3d6-c13c-4168-9178-421a5f615ad6/metadata/os_distro HTTP/1.1 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 30 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:39.846361 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: {"meta": {"os_distro": "alt"}} Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:28:39.848011 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'image_id': '9ca5a3d6-c13c-4168-9178-421a5f615ad6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.849029 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ca5a3d6-c13c-4168-9178-421a5f615ad6 Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:39.850585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ca5a3d6-c13c-4168-9178-421a5f615ad6 could not be found. Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:39.852099 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:39.854091 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:39.855872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9dabab3-7a4e-44a2-865c-ca9383b4f45c tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:39.855872 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9dabab3-7a4e-44a2-865c-ca9383b4f45c tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "PUT /compute/v2.1/images/9ca5a3d6-c13c-4168-9178-421a5f615ad6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.045613 Jul 28 11:28:39.859150 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 479/1003] 10.222.0.93 () {60 vars in 1310 bytes} [Thu Jul 28 11:28:39 2022] PUT /compute/v2.1/images/9ca5a3d6-c13c-4168-9178-421a5f615ad6/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:28:39.863955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:39.864575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:39.873003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:39.873541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:39.874222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:39.874664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.242989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:40.253315 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-245d7880-e877-4625-b6de-871bccc06aae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.393048 Jul 28 11:28:40.254247 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 480/1004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:39 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:40.259674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:40.260452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:40.267269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.268119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.269122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.269783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.662405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:40.673339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7be70c18-1f59-4f30-a31b-105b79013269 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1511 microversion: 2.1 time: 0.417206 Jul 28 11:28:40.674771 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 481/1005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:40 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:40.681867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5f15c2f-caf4-454b-a0e0-bdc32ace79ed tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Action: 'create', calling method: .version_select at 0x7f2eb3518f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:40.689001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:40.689651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:40.690140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:40.690555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:40.691716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:40.715967 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f5f15c2f-caf4-454b-a0e0-bdc32ace79ed tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] HTTP exception thrown: Image not found. Jul 28 11:28:40.716154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.716599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.717402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.717837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5f15c2f-caf4-454b-a0e0-bdc32ace79ed tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Request method failure captured: Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/images/254122b5-4126-4a9d-9c01-bcb672e99d3b/metadata HTTP/1.1 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 57 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLldi-wrJH6z50B28Ub86pw7zn2BtFGPjIpIFjdvLkBPw0c6fQvVWuBmC0IvhGvtneHyP4FkAgIP5Q2OTHI11J64iL_5fZh2l-T74yis15Dh8rCezkRmeOXWrIqRkx51Dfi1ydoB_RdVM5Hn-uC9gkHbuDjheJIUCQv0RJNuVgalNg Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:40.719184 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e9786c5819c2426b9618c1fb503b4189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e9786c5819c2426b9618c1fb503b4189"}]}] Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e9786c5819c2426b9618c1fb503b4189 Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996 Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4ad1773352cb4cc4a661ee5c0bfa9988 Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1062711996-project Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:28:40.720851 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'image_id': '254122b5-4126-4a9d-9c01-bcb672e99d3b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:40.722071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 254122b5-4126-4a9d-9c01-bcb672e99d3b Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:28:40.723401 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 254122b5-4126-4a9d-9c01-bcb672e99d3b could not be found. Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:40.724721 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:28:40.726016 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:40.727727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5f15c2f-caf4-454b-a0e0-bdc32ace79ed tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:40.728868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5f15c2f-caf4-454b-a0e0-bdc32ace79ed tempest-ImagesMetadataNegativeTestJSON-1062711996 tempest-ImagesMetadataNegativeTestJSON-1062711996-project] 10.222.0.93 "POST /compute/v2.1/images/254122b5-4126-4a9d-9c01-bcb672e99d3b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052435 Jul 28 11:28:40.735150 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 482/1006] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Jul 28 11:28:40 2022] POST /compute/v2.1/images/254122b5-4126-4a9d-9c01-bcb672e99d3b/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:28:40.736385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Getting quotas for project 96f5ee2d77c24a0793c7b8dfe861c8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:40.740691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Getting quotas for user 2d4a96d2d92446baa9795668f555ae5f and project 96f5ee2d77c24a0793c7b8dfe861c8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:40.742875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99a04800-a7a3-44e9-bdbe-1b1f99bf2964 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb338e700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:40.754786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:40.757373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:40.809436 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5bd0d32-6402-4f86-ad41-2f92e9e50cd2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.524613 Jul 28 11:28:40.810598 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 525/1007] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:40.815815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:40.816742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:40.826348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.827393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.828707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:40.829305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:40.839563 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99a04800-a7a3-44e9-bdbe-1b1f99bf2964 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.101578 Jul 28 11:28:40.841314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 483/1008] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:40 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:40.860775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ceeaf484-2029-4164-bb2e-1e6762bee5e2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:40.865548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ceeaf484-2029-4164-bb2e-1e6762bee5e2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:40.999356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ceeaf484-2029-4164-bb2e-1e6762bee5e2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:41.010654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ceeaf484-2029-4164-bb2e-1e6762bee5e2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1224 microversion: 2.1 time: 0.165109 Jul 28 11:28:41.012888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 484/1009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:40 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:41.097093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:41.106846 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6166a2bd-c884-49c1-916c-98580534e5e8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1511 microversion: 2.1 time: 0.294902 Jul 28 11:28:41.109645 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 526/1010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:40 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:41.134154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:41.149341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:41.151948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:41.280035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:41.281169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:41.299940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.301713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.303908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.304665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.346811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.347412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.348183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.348658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.521023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:41.544700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:41.557913 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c03dcbd-4748-4d80-bf6c-170d0ac4cb1c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.284676 Jul 28 11:28:41.559140 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 527/1011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:41 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:41.768676 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8cf490e5-5c0c-42ed-b873-05dd327717c4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.641611 Jul 28 11:28:41.769586 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 485/1012] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Jul 28 11:28:41 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:41.783297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:41.784168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:41.793717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.794281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.795060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:41.795719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:41.858908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-854c3318-d7e4-400d-9290-47601d0f4b1b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb30b3c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:41.938750 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-854c3318-d7e4-400d-9290-47601d0f4b1b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.086414 Jul 28 11:28:41.939354 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 486/1013] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:41 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:42.019520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.033946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:42.034613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:42.038115 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-956c3ee5-ebd5-4ebe-b912-3c7091c08608 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1512 microversion: 2.1 time: 0.250509 Jul 28 11:28:42.041622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.043917 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 528/1014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:41 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:42.047756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.048646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.049146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.065348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:42.066381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:42.095347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.098453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.100915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.102344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.141581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:42.291828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.307853 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-580ecdd0-d40d-43c6-a157-c018a1858956 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1228 microversion: 2.1 time: 0.277696 Jul 28 11:28:42.312522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 487/1015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:42 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1228 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:42.395477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.403804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7bf175e1-2111-4863-88b4-9c3d9d7866bf tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1511 microversion: 2.1 time: 0.343293 Jul 28 11:28:42.404390 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 529/1016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:42 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:42.428100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:42.428725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:42.437165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.438056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.439122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.440173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.583462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:42.584086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:42.597892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.600702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.609168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.611878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.659889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.670969 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-618c2718-ce44-42f6-a47c-55262b5cc577 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1511 microversion: 2.1 time: 0.246862 Jul 28 11:28:42.671760 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 488/1017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:42 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:42.694212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:42.716994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.717980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:42.732616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.733110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.734085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:42.734536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:42.898894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:42.978887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:42.991513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:43.000557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.001408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.002336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b09bb494-a3e4-401d-a891-24647a9c41c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.424405 Jul 28 11:28:43.003627 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 530/1018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:42 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:43.009039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d8f2accd-52e1-48b6-ac6d-59a4c4e14dc1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2c0fb80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:43.103205 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d8f2accd-52e1-48b6-ac6d-59a4c4e14dc1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.098315 Jul 28 11:28:43.103794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 531/1019] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:43 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:43.213641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4466953d-7310-449a-afd3-e56f3c1da12e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.524629 Jul 28 11:28:43.214484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 489/1020] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:28:42 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:43.256781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:43.277045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:43.282897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:43.335909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:43.336727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:43.348772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.349348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.350170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.353356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.411628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.412472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.413432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.414606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.509043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:43.517682 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-786b3f04-8bd6-40eb-901d-f042496523db tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1282 microversion: 2.1 time: 0.187712 Jul 28 11:28:43.525446 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 490/1021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:43 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:43.585307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:43.708670 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a6b4129-3665-4a92-a26c-ec53dc86ad80 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1010 microversion: 2.1 time: 0.458610 Jul 28 11:28:43.710466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 532/1022] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:28:43 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1010 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:43.730431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:43.735597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:43.736273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:43.741970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.742551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.743398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.743839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.849282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:43.931368 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-591f498b-9eaf-42ff-83b9-9161efb9f1e2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.204285 Jul 28 11:28:43.939096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 491/1023] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Jul 28 11:28:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:43.946081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:43.959595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:43.960406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:43.974809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.975379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:43.976465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:43.977269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.033563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:44.036250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:44.065585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.070763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.071916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.072576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.187847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:44.355782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06350310-56b4-4f2d-8105-789907c787db tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.414492 Jul 28 11:28:44.380921 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 533/1024] 10.222.0.93 () {58 vars in 1196 bytes} [Thu Jul 28 11:28:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:44.386443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-49350aac-a4e6-4f48-919d-c89ff37f4cdc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2fc7d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:44.474148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-49350aac-a4e6-4f48-919d-c89ff37f4cdc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.091991 Jul 28 11:28:44.483696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 534/1025] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:44 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:44.494026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:44.516044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:44.516894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': '1250822626', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:44.533685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.537459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.538574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.540828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.631904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:44.646260 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5af2e741-8fff-492c-b9c1-fcc88935110c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.617051 Jul 28 11:28:44.661548 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 492/1026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:44 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:44.661548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:44.661994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:44.680420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.680943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.684010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:44.685896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:44.728477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:44.876624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f6797fc-ff09-414a-b507-9f11d558cec9 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=1250822626" status: 200 len: 346 microversion: 2.1 time: 0.387175 Jul 28 11:28:44.886173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 535/1027] 10.222.0.93 () {58 vars in 1156 bytes} [Thu Jul 28 11:28:44 2022] GET /compute/v2.1/servers?name=1250822626 => generated 346 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:45.066377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:45.076678 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4abd3e08-f8ac-4d22-b69c-c34a58c710a1 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.427356 Jul 28 11:28:45.092398 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 493/1028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:44 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:45.098774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.106721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:45.107772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:45.114816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.115463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.116583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.117720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.183917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ff7dba6-5ca8-4a70-a53e-8b467569fa7d tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb2c0f3a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.262156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:45.357314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb7145c0-7dec-482b-aa8d-daee427da565 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.263472 Jul 28 11:28:45.358199 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 494/1029] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Jul 28 11:28:45 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:45.360093 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ff7dba6-5ca8-4a70-a53e-8b467569fa7d tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf" status: 200 len: 371 microversion: 2.1 time: 0.472364 Jul 28 11:28:45.361895 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 536/1030] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:28:44 2022] GET /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf => generated 371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:45.375781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb2b98940>, body: {"quota_set": {"ram": "5120"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:45.396020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.407925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:45.408777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-125082262', 'deleted': False, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:28:45.438011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.438594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.439742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.441731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.515347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.516020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.517143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.517792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.642027 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d034f59-8ddb-49ab-9401-a580c1278284 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf" status: 200 len: 328 microversion: 2.1 time: 0.268155 Jul 28 11:28:45.648530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 537/1031] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:28:45 2022] PUT /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf => generated 328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:45.659165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7ddaf51-050d-47b8-9cad-f97c9303a78c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb29cf040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.676692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:28:45.743562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7ddaf51-050d-47b8-9cad-f97c9303a78c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.098179 Jul 28 11:28:45.751764 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 538/1032] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:45 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:45.751764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70c4661b-fd9f-49cc-957f-97bfcc404b6d tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.766975 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70c4661b-fd9f-49cc-957f-97bfcc404b6d tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf" status: 202 len: 0 microversion: 2.1 time: 0.020886 Jul 28 11:28:45.768187 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 539/1033] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:28:45 2022] DELETE /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:28:45.781360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.782943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:45.796648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.798868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.800584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:45.801162 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-360a574d-e9d2-44eb-b945-09ba02e42508 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125082262" status: 200 len: 346 microversion: 2.1 time: 0.421783 Jul 28 11:28:45.801935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:45.802095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 495/1034] 10.222.0.93 () {58 vars in 1228 bytes} [Thu Jul 28 11:28:45 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125082262 => generated 346 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:45.813114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9e215f7c-b0e4-4e16-90da-a525b29f4789 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb325c820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.973943 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9e215f7c-b0e4-4e16-90da-a525b29f4789 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf" status: 200 len: 371 microversion: 2.1 time: 0.170571 Jul 28 11:28:45.975421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 496/1035] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:28:45 2022] GET /compute/v2.1/os-quota-sets/d4571008085a4c669639b107204f80cf => generated 371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:45.994020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:45.994848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:46.005173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.006427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:46.008031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.010946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:46.077260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:28:46.337275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:46.339122 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d02791f2-73d3-451c-bb71-0693ad2f80d8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "DELETE /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 204 len: 0 microversion: 2.1 time: 0.354990 Jul 28 11:28:46.346117 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b121a52-3910-45ef-8de3-7e9f18578243 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.575592 Jul 28 11:28:46.349831 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 497/1036] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:45 2022] DELETE /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:28:46.351385 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 540/1037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:45 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:46.359736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:46.360444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:46.362231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38dba5c2-460a-4cfb-9fa1-938bf7addef7 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb2b98430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:46.375959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.376548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:46.378083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.378437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:46.880591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:46.892231 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38dba5c2-460a-4cfb-9fa1-938bf7addef7 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.537111 Jul 28 11:28:46.919708 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 541/1038] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:28:46 2022] GET /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb/defaults => generated 371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:46.939625 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e72108b3-b774-4b62-a4cb-5f675459bcf9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.577583 Jul 28 11:28:46.963861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:46.964504 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 498/1039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:46 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:46.966069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:46.978176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57e65a65-e9b9-4e2c-9556-c1398a7c5a77 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2915940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:46.986437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.988106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:46.992266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:46.993005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:47.126168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57e65a65-e9b9-4e2c-9556-c1398a7c5a77 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.157636 Jul 28 11:28:47.128932 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 499/1040] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:46 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:47.137935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8f9095c8-8347-4814-82a2-d4bf003c1a54 req-a4c83e1c-c791-42f7-8330-ef7ab48ec0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140f90ea-cf1f-4a2c-a8a2-a419968b33dd", "tag": "a5383228-6f70-4038-bd04-9cf4b28628a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:47.162668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:47.169922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8f9095c8-8347-4814-82a2-d4bf003c1a54 req-a4c83e1c-c791-42f7-8330-ef7ab48ec0fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:47.171755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8f9095c8-8347-4814-82a2-d4bf003c1a54 req-a4c83e1c-c791-42f7-8330-ef7ab48ec0fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:47.214206 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8f9095c8-8347-4814-82a2-d4bf003c1a54 req-a4c83e1c-c791-42f7-8330-ef7ab48ec0fd service nova] Creating event network-changed:a5383228-6f70-4038-bd04-9cf4b28628a5 for instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd on n-h1-851368-1 Jul 28 11:28:47.238994 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8f9095c8-8347-4814-82a2-d4bf003c1a54 req-a4c83e1c-c791-42f7-8330-ef7ab48ec0fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103304 Jul 28 11:28:47.240789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 500/1041] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:47.337115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb2a5f430>, body: {"quota_set": {"ram": "5120"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:47.567865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:47.569690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:47.571628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:47.575383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:47.758192 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4533875-0e97-4a14-b717-4ebd1efa7873 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b" status: 200 len: 328 microversion: 2.1 time: 0.423222 Jul 28 11:28:47.760406 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 501/1042] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:28:47 2022] PUT /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b => generated 328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:47.773478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:47.774187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:47.789453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:47.790672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:47.791907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:47.792413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.043431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:48.053453 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6e6e20c-b0cc-4263-bb1a-0b974b28f0e7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1517 microversion: 2.1 time: 1.132588 Jul 28 11:28:48.054250 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 542/1043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:46 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1517 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:48.068327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb29cff70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:48.159238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.160137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.161115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.161961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.217583 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3963933-c5aa-488f-b496-1d60159c2340 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b/detail" status: 200 len: 916 microversion: 2.1 time: 0.161969 Jul 28 11:28:48.219008 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 543/1044] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:28:48 2022] GET /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b/detail => generated 916 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:48.230744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:48.235959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:48.264205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.264894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.266302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.266943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.297351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:48.532557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:48.541163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0864de37-1a03-4ff0-828b-c1e34d9c8087 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.777175 Jul 28 11:28:48.541767 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 502/1045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:47 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:48.571614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64e76bd0-5292-4fb1-9b99-eef81c265a72 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2915820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:48.623686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64e76bd0-5292-4fb1-9b99-eef81c265a72 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.059758 Jul 28 11:28:48.624545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 503/1046] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:48 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:48.629680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb2880310>, body: {"quota_set": {"ram": "2048"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:48.700752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.701909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.702892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.703350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.745325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.745773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.746585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:48.747029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:48.836224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea587757-b2f0-4f1a-9883-928d6511efa5 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b?user_id=a00e94b3a80747508e8bf6f80ae8c6c5" status: 200 len: 328 microversion: 2.1 time: 0.210289 Jul 28 11:28:48.837395 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 504/1047] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:28:48 2022] PUT /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b?user_id=a00e94b3a80747508e8bf6f80ae8c6c5 => generated 328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:48.849613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28722ca0-c7e4-475e-9a04-2722fd5909ad tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb289b040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:48.937039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28722ca0-c7e4-475e-9a04-2722fd5909ad tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b?user_id=a00e94b3a80747508e8bf6f80ae8c6c5" status: 200 len: 370 microversion: 2.1 time: 0.092249 Jul 28 11:28:48.937971 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 505/1048] 10.222.0.93 () {58 vars in 1323 bytes} [Thu Jul 28 11:28:48 2022] GET /compute/v2.1/os-quota-sets/5a7847197bcc457c87e348dc1883a59b?user_id=a00e94b3a80747508e8bf6f80ae8c6c5 => generated 370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:28:49.086042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:49.087431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:49.099954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:49.101992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:49.102830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:49.103918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:49.144405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:49.448843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:49.464134 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d23107f4-9d21-4bbf-84b3-399d660b9c39 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 1.241157 Jul 28 11:28:49.465488 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 544/1049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:48 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:49.483702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec2e0fe7-6acf-48c8-ba33-433e47576028 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Calling method '.version_select at 0x7f2eb2f01670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:49.827575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:49.830063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec2e0fe7-6acf-48c8-ba33-433e47576028 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.363126 Jul 28 11:28:49.830916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 545/1050] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:28:49 2022] GET /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb/defaults => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:49.836058 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47151374-8ce2-4f94-9678-a703223c9be8 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1517 microversion: 2.1 time: 0.762608 Jul 28 11:28:49.838076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:49.840862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:49.843534 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 506/1051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:49 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1517 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:49.848285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e25dc66-514e-4e97-ab1d-c78e7dfe33c7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb29151f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:49.849388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:49.850270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:49.851917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:49.854709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:49.915293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e25dc66-514e-4e97-ab1d-c78e7dfe33c7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.070524 Jul 28 11:28:49.927327 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 507/1052] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:49 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:49.944342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb28d5670>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:50.101361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.101896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.103680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.108936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.483321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00cc8bc4-2ad2-4fe1-8186-76a6fe127c31 tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb" status: 200 len: 329 microversion: 2.1 time: 0.552027 Jul 28 11:28:50.484318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 508/1053] 10.222.0.93 () {60 vars in 1263 bytes} [Thu Jul 28 11:28:49 2022] PUT /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb => generated 329 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:50.489487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:50.490231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:50.506059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.506584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.507507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.509138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.595731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:50.605039 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-236152ee-0862-442a-9aab-293294a46024 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.772413 Jul 28 11:28:50.619699 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 546/1054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:49 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:50.627580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb2996d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:50.714076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:50.739406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.740089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.741087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.742578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.898638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:50.911479 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b77fbe82-cc74-4b2c-9aab-913dac945688 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.425714 Jul 28 11:28:50.912826 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 509/1055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:50 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:50.917883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:50.918808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:50.941739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.942546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:50.947871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:50.948313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:51.048712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:51.057960 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43448b16-3f00-42f1-b5df-83b91cad8213 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 200 len: 1305 microversion: 2.1 time: 0.143842 Jul 28 11:28:51.059314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 510/1056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:50 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:51.065342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6ad0f7b5-cef4-43a9-a69e-37421977e371 req-78bb78ad-96fc-4e54-bd49-930d20f4707a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96684fb4-c980-47d4-be6b-1823d4a194a5", "name": "network-vif-deleted", "tag": "c91f74cf-0159-4743-b8ff-59387577efe9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:51.088191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6ad0f7b5-cef4-43a9-a69e-37421977e371 req-78bb78ad-96fc-4e54-bd49-930d20f4707a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:51.089623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6ad0f7b5-cef4-43a9-a69e-37421977e371 req-78bb78ad-96fc-4e54-bd49-930d20f4707a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:51.114124 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6ad0f7b5-cef4-43a9-a69e-37421977e371 req-78bb78ad-96fc-4e54-bd49-930d20f4707a service nova] Creating event network-vif-deleted:c91f74cf-0159-4743-b8ff-59387577efe9 for instance 96684fb4-c980-47d4-be6b-1823d4a194a5 on n-h2-851368-1 Jul 28 11:28:51.122282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6ad0f7b5-cef4-43a9-a69e-37421977e371 req-78bb78ad-96fc-4e54-bd49-930d20f4707a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061242 Jul 28 11:28:51.123673 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 511/1057] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:51.133456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0940985f-5f32-4a3f-8770-aedf7e5b0187 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28bbca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:51.252118 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0940985f-5f32-4a3f-8770-aedf7e5b0187 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.125784 Jul 28 11:28:51.253454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 512/1058] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:51 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:51.338563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d02b3e9-3833-43bb-9b12-50a5b1cc585c tempest-QuotasAdminTestJSON-63291576 tempest-QuotasAdminTestJSON-63291576-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb" status: 200 len: 329 microversion: 2.1 time: 0.717547 Jul 28 11:28:51.339573 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 547/1059] 10.222.0.93 () {60 vars in 1263 bytes} [Thu Jul 28 11:28:50 2022] PUT /compute/v2.1/os-quota-sets/83a407b62610408ba42f46a65507f6eb => generated 329 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:51.634225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:51.634640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:51.664234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:51.667549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:51.670328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:51.674575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:51.938544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:51.940307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:51.963771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:51.969377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:51.974860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:51.976647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:52.668878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:52.687298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c33aea9e-313b-48f0-8d0e-319f36ccb007 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.753807 Jul 28 11:28:52.687899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 548/1060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:51 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:52.692400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:52.693337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 96684fb4-c980-47d4-be6b-1823d4a194a5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:52.707154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:52.709265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:52.711385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:52.714645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:52.739936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:52.745631 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] HTTP exception thrown: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Request method failure captured: Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 HTTP/1.1 Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nKoFQ3-xYZT7a-8HsdDYMTaLj7vg8T5IJThMZORvPBL5m_2l3fbGmYeZyRr1yvwz_IizHVuaTo4z_LZtD762A5LL5nMvfEJkVvJDasgXau5bCpxniImcATaGyNLcnEuA7nOLzzpbEsqu5fnRMu2AJgzY2EwUvnW9UjZ0keFP59LPEg Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:28:52.747459 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}] Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 8efe0fe3f3db4805962d856d017f82de Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. Jul 28 11:28:52.748860 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '96684fb4-c980-47d4-be6b-1823d4a194a5'} Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:52.749665 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. Jul 28 11:28:52.751115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:28:52.753294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Returning 404 to user: Instance 96684fb4-c980-47d4-be6b-1823d4a194a5 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:52.755226 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4510f6b8-8724-467e-81a3-796a7f50f5eb tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5" status: 404 len: 111 microversion: 2.1 time: 0.065585 Jul 28 11:28:52.756441 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7788000-2b05-4c72-bfaf-09b5befc929b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 1.127395 Jul 28 11:28:52.757201 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 549/1061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:52 2022] GET /compute/v2.1/servers/96684fb4-c980-47d4-be6b-1823d4a194a5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:52.761451 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 513/1062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:51 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:52.768304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6c5c4d9-ab66-473d-9e2a-f64920a4b4ad tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb29b41f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:52.771146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:52.773513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:52.791576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:52.792287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:52.793100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:52.794689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:52.854991 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6c5c4d9-ab66-473d-9e2a-f64920a4b4ad tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.095697 Jul 28 11:28:52.855496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:28:52.855736 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 550/1063] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:52 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:52.983059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:53.019564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8c996e0-3333-4bf1-ab80-321059148911 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "DELETE /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 204 len: 0 microversion: 2.1 time: 0.256446 Jul 28 11:28:53.024691 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 514/1064] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:52 2022] DELETE /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:28:53.029591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:53.030199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:53.043456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.044469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:53.045274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.045711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:53.387651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:53.397683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-272f2105-92b5-4286-b0fb-ee11e0e969b4 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1517 microversion: 2.1 time: 0.371817 Jul 28 11:28:53.398313 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 551/1065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:53 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:53.713018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:53.716099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:53.799487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:53.799487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:53.799487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.799487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:53.800352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.800352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:53.802983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.803558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:53.804747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:53.805290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:54.733541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:54.742335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d0743e12-c402-4be6-80e6-ec1d1efa0b75 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 1.034545 Jul 28 11:28:54.746500 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 515/1066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:53 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:54.757422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba5b2ceb-f9ef-4da8-89f5-f785c019388d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2cd9670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:54.837800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba5b2ceb-f9ef-4da8-89f5-f785c019388d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1454 microversion: 2.1 time: 0.090088 Jul 28 11:28:54.850353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 516/1067] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:54 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:54.861323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:54.862867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:54.872193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:54.872910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:54.873861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:54.874463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:54.876928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:54.885057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42b65b1f-7a53-4e1c-b5ba-d78c5eb58ee1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 1.107414 Jul 28 11:28:54.888083 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 552/1068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:53 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:55.129196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:55.144896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e520aef0-9953-4ebc-8113-a4e12b68a62c tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1517 microversion: 2.1 time: 0.292587 Jul 28 11:28:55.152529 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 517/1069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:54 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:55.597890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-59f4ee55-5b8e-4188-ae02-337b02352610 req-18e0b5ed-6eaf-4ebc-a44a-248059cc637f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140f90ea-cf1f-4a2c-a8a2-a419968b33dd", "name": "network-vif-plugged", "status": "completed", "tag": "a5383228-6f70-4038-bd04-9cf4b28628a5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:55.614921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-59f4ee55-5b8e-4188-ae02-337b02352610 req-18e0b5ed-6eaf-4ebc-a44a-248059cc637f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:55.616769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-59f4ee55-5b8e-4188-ae02-337b02352610 req-18e0b5ed-6eaf-4ebc-a44a-248059cc637f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:55.652318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-59f4ee55-5b8e-4188-ae02-337b02352610 req-18e0b5ed-6eaf-4ebc-a44a-248059cc637f service nova] Creating event network-vif-plugged:a5383228-6f70-4038-bd04-9cf4b28628a5 for instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd on n-h1-851368-1 Jul 28 11:28:55.666309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-59f4ee55-5b8e-4188-ae02-337b02352610 req-18e0b5ed-6eaf-4ebc-a44a-248059cc637f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071845 Jul 28 11:28:55.667558 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 553/1070] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:55.763601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:55.764876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:55.784057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:55.786147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:55.793995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:55.794669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:55.857599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5376d7e6-6fc5-4c25-aa72-83a471a71eda tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb294faf0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:55.979654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5376d7e6-6fc5-4c25-aa72-83a471a71eda tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1463 microversion: 2.1 time: 0.126539 Jul 28 11:28:55.981501 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 554/1071] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:55 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1463 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:28:55.998212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:56.000940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:56.019546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.020297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.021268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.034198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.243637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:56.255420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4542a485-5893-4769-9af8-96de27b8880c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.495510 Jul 28 11:28:56.260768 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 518/1072] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:55 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:56.269604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54b652b9-af7a-4e10-a656-ba97fd24dd3b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:56.347214 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54b652b9-af7a-4e10-a656-ba97fd24dd3b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 200 len: 1463 microversion: 2.1 time: 0.085101 Jul 28 11:28:56.358058 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 519/1073] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:56 2022] GET /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 1463 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:56.365053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-65e5a7cf-3bb8-4cf2-a977-98bb57d46b1c req-fd012b54-93bc-451a-9863-326b9a8aefec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d7dcd2-34d5-433d-9797-0896e25304eb", "name": "network-vif-deleted", "tag": "4a2cfd99-9abc-455b-acfc-2f7ef408c1c5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:56.385733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-65e5a7cf-3bb8-4cf2-a977-98bb57d46b1c req-fd012b54-93bc-451a-9863-326b9a8aefec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.387015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-65e5a7cf-3bb8-4cf2-a977-98bb57d46b1c req-fd012b54-93bc-451a-9863-326b9a8aefec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.400477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:56.402542 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-65e5a7cf-3bb8-4cf2-a977-98bb57d46b1c req-fd012b54-93bc-451a-9863-326b9a8aefec service nova] Creating event network-vif-deleted:4a2cfd99-9abc-455b-acfc-2f7ef408c1c5 for instance 05d7dcd2-34d5-433d-9797-0896e25304eb on n-h1-851368-1 Jul 28 11:28:56.412954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13addb4a-89bb-4e99-94af-1cade73dd289 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.429513 Jul 28 11:28:56.415396 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 555/1074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:55 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:56.426125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:56.427038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:56.441656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-65e5a7cf-3bb8-4cf2-a977-98bb57d46b1c req-fd012b54-93bc-451a-9863-326b9a8aefec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080482 Jul 28 11:28:56.448099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 520/1075] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:56.463488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.465583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.468875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.469488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.618931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:56.629331 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e20a9462-e2b6-4eae-b115-673cb669de7b tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1305 microversion: 2.1 time: 0.212094 Jul 28 11:28:56.630105 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 556/1076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:56 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:56.636133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:56.636962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:56.643818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.644264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.646556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.647335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.859600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:56.866665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-37055164", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "8af4ed4a-dd6c-4e12-9a63-a2b3a5666ea8"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:56.869207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-321e644e-9f3d-4f0c-9ca5-be77be549997 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1467 microversion: 2.1 time: 0.237782 Jul 28 11:28:56.870429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 557/1077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:56 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:56.890895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-261767629"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:56.894097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:56.907117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.907836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.908810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:56.910335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:56.950332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] validate_networks() for [('8af4ed4a-dd6c-4e12-9a63-a2b3a5666ea8', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:57.138327 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8049ddd6-f0ff-4492-9faa-6c5f59b1d33b tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "POST /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e/action" status: 202 len: 0 microversion: 2.1 time: 0.252199 Jul 28 11:28:57.139926 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 558/1078] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:56 2022] POST /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:28:57.159903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed468dca-ff1c-4bcc-8be8-970882c53261 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb29eef70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:57.219118 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed468dca-ff1c-4bcc-8be8-970882c53261 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.071645 Jul 28 11:28:57.220262 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 559/1079] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:57 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:57.367355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1992090594", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:57.390188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:57.390619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:57.391108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:57.391527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:57.391941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:57.408095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.408548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.410133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.410575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.431763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:57.436322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:28:57.436480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for user 5df53556867f4caca1b5a531835db23b and project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:57.449754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:57.452494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:57.501679 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c8b8628-d18d-45af-bc99-363a11941db7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052221 Jul 28 11:28:57.502969 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 521/1080] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:57.508558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:57.509363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:57.515700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.516321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.517094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.517528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.738380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:28:57.739365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:28:57.740053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:28:57.741017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:28:57.741384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:57.742383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:28:57.751041 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b984b39d-d4ac-493a-b433-1c32cb7d9556 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1324 microversion: 2.1 time: 0.246652 Jul 28 11:28:57.751658 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 522/1081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:57 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:57.756520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:57.757970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:57.760899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.761462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.762340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.762833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.765033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.765676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.766837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.767498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.788897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:28:57.794646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:28:57.808766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:28:57.812560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:28:57.845611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=16,nova_api:UPDATE=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:57.895818 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16596dba-a13b-41e7-9976-55e1f502a17c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673395 Jul 28 11:28:57.896492 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 560/1082] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:28:57.923063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-daa41c72-af09-4069-84be-6c5cbd53b19d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:57.923721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-daa41c72-af09-4069-84be-6c5cbd53b19d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:57.939838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:57.957232 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5131482e-3550-4272-9df2-e79d4f547d19 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.204242 Jul 28 11:28:57.959640 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 523/1083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:57 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:57.975856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:57.977451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:57.994159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.997693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:57.998643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:57.999120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:58.089218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:58.090332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:58.091450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lazy-loading 'fault' on Instance uuid 05d7dcd2-34d5-433d-9797-0896e25304eb {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:28:58.094391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-daa41c72-af09-4069-84be-6c5cbd53b19d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:58.107936 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-daa41c72-af09-4069-84be-6c5cbd53b19d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1223 microversion: 2.1 time: 0.210337 Jul 28 11:28:58.118731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 561/1084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:57 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:58.125176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46d37506-8947-4117-ad19-2b1708ab4483 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:58.127033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46d37506-8947-4117-ad19-2b1708ab4483 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:58.219874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:58.232162 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0325a8a9-afe7-4f41-8792-bf22368866be tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 200 len: 1310 microversion: 2.1 time: 0.269843 Jul 28 11:28:58.233242 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 524/1085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:57 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:58.238479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4daeb847-f2e8-4628-b568-b9dcd83bd3fe tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28bb9d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:58.282199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46d37506-8947-4117-ad19-2b1708ab4483 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:58.291599 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46d37506-8947-4117-ad19-2b1708ab4483 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1217 microversion: 2.1 time: 0.178928 Jul 28 11:28:58.292692 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 562/1086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:58 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:58.365019 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4daeb847-f2e8-4628-b568-b9dcd83bd3fe tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.129487 Jul 28 11:28:58.365672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 525/1087] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:58 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:58.773894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:58.774988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:58.787895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:58.790213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:58.791235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:58.791878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:58.953093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:58.969213 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33d3d205-acfe-40d3-8216-501c8eca086c tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 200 len: 1520 microversion: 2.1 time: 0.199864 Jul 28 11:28:58.971699 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 563/1088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:58 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:58.987678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:58.989232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:58.993708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: .version_select at 0x7f2eb9ee81f0>, body: {"addFloatingIp": {"address": "172.25.3.220"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:58.996285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:58.997306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:58.998048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:58.998904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:58.999595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.002784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.003289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.004078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.004544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.091133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Acquired lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:28:59.406447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:59.417256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3528daf6-324e-412e-8798-63968d4f7ce8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.433688 Jul 28 11:28:59.432448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 526/1089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:58 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:59.439608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:59.440609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:59.458222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.458222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.458835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.459334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.562016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:59.570611 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc036de2-1534-4d1f-99d5-401b48365bdf tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1281 microversion: 2.1 time: 0.136375 Jul 28 11:28:59.571492 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 527/1090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:59 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:59.577566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:59.579382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 05d7dcd2-34d5-433d-9797-0896e25304eb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:59.590289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.590759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.591690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.592197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.607943 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] HTTP exception thrown: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Request method failure captured: Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb HTTP/1.1 Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKoFQ3-xYZT7a-8HsdDYMTaLj7vg8T5IJThMZORvPBL5m_2l3fbGmYeZyRr1yvwz_IizHVuaTo4z_LZtD762A5LL5nMvfEJkVvJDasgXau5bCpxniImcATaGyNLcnEuA7nOLzzpbEsqu5fnRMu2AJgzY2EwUvnW9UjZ0keFP59LPEg Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:28:59.609812 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}] Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 8efe0fe3f3db4805962d856d017f82de Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. Jul 28 11:28:59.611177 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '05d7dcd2-34d5-433d-9797-0896e25304eb'} Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:28:59.611936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. Jul 28 11:28:59.613146 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:28:59.615216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Returning 404 to user: Instance 05d7dcd2-34d5-433d-9797-0896e25304eb could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:28:59.616301 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8da737f4-1bc9-45a7-9966-2a90f41ca349 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb" status: 404 len: 111 microversion: 2.1 time: 0.042913 Jul 28 11:28:59.617513 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 528/1091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:59 2022] GET /compute/v2.1/servers/05d7dcd2-34d5-433d-9797-0896e25304eb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:28:59.622560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:59.623213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:59.629467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.629920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.630888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.631165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.647528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:28:59.725162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:28:59.733448 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da19acad-be91-460b-a049-3010998b7ddf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1269 microversion: 2.1 time: 0.114865 Jul 28 11:28:59.734257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 529/1092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:59 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:59.739271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b369c44-6e00-4ce1-bc61-440461490f20 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5ee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:59.787250 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b369c44-6e00-4ce1-bc61-440461490f20 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.051612 Jul 28 11:28:59.788016 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 530/1093] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:28:59 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:28:59.794959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-392a2e97-3f0b-4ac6-887f-01b15424d14a req-16a50548-6e1a-4345-a642-598b3cf17c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffe02a6-d004-4892-b66a-5ec170b6b039", "name": "network-vif-unplugged", "status": "completed", "tag": "4cd77d76-1baf-42eb-82a8-7cad5959f74a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:28:59.806439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-392a2e97-3f0b-4ac6-887f-01b15424d14a req-16a50548-6e1a-4345-a642-598b3cf17c0d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.806769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-392a2e97-3f0b-4ac6-887f-01b15424d14a req-16a50548-6e1a-4345-a642-598b3cf17c0d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.819030 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-392a2e97-3f0b-4ac6-887f-01b15424d14a req-16a50548-6e1a-4345-a642-598b3cf17c0d service nova] Creating event network-vif-unplugged:4cd77d76-1baf-42eb-82a8-7cad5959f74a for instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 on n-h1-851368-1 Jul 28 11:28:59.830137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-392a2e97-3f0b-4ac6-887f-01b15424d14a req-16a50548-6e1a-4345-a642-598b3cf17c0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039747 Jul 28 11:28:59.830938 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 531/1094] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:28:59.838262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:28:59.838860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:28:59.845405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.845784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.846558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:28:59.847000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:28:59.877629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:28:59.988888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b88d3d54-34d8-4706-a0e8-82f9cd8aa5c2 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 204 len: 0 microversion: 2.1 time: 0.155558 Jul 28 11:28:59.989781 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 532/1095] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:28:59 2022] DELETE /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:00.003405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:00.007798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:00.015307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:00.016095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:00.020417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:00.021110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:00.466605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:00.474192 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8c032ae-232d-432c-bfcf-475fb0589591 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1518 microversion: 2.1 time: 0.476506 Jul 28 11:29:00.474752 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 533/1096] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:28:59 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1518 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:00.479135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:00.479737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:00.485428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:00.485875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:00.486624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:00.487056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.108071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:01.116526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d600136e-a784-42b5-a832-bc09e33e2b7e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.640298 Jul 28 11:29:01.125128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 534/1097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:00 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:01.134919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:01.135641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:01.142035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.142500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.143376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.143819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.257626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:01.265120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7264e115-5cd6-40db-89b1-1ea3b5df2cbd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1281 microversion: 2.1 time: 0.138835 Jul 28 11:29:01.265700 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 535/1098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:01 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:01.283721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:01.284356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:01.290804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.291287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.292067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.292509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.416940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:01.425283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d0c3eba7-c6cd-41ea-968a-b0b31f3d4043 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1287 microversion: 2.1 time: 0.153103 Jul 28 11:29:01.426207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 536/1099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:01 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:01.431920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4a73a44-cc9b-4b21-ae11-6c1cbe170adc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2880160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:01.482177 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4a73a44-cc9b-4b21-ae11-6c1cbe170adc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.053997 Jul 28 11:29:01.482962 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 537/1100] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:01 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:01.499153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:01.501175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:01.512403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.515249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.517156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.517870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.570284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:01.904911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:01.914254 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f04ac974-b266-4da2-897e-3e103f83bffd tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1518 microversion: 2.1 time: 0.420738 Jul 28 11:29:01.915187 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 538/1101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:01 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:01.921172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f220b2d9-c56e-4d25-9fda-2da95017e653 req-0856b23c-76f2-475b-822f-8032f8c45322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:01.943055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f220b2d9-c56e-4d25-9fda-2da95017e653 req-0856b23c-76f2-475b-822f-8032f8c45322 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:01.945818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f220b2d9-c56e-4d25-9fda-2da95017e653 req-0856b23c-76f2-475b-822f-8032f8c45322 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:01.957787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f220b2d9-c56e-4d25-9fda-2da95017e653 req-0856b23c-76f2-475b-822f-8032f8c45322 service nova] Creating event network-changed:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:29:01.964460 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f220b2d9-c56e-4d25-9fda-2da95017e653 req-0856b23c-76f2-475b-822f-8032f8c45322 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047741 Jul 28 11:29:01.965486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 539/1102] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:02.139489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:02.140403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:02.146843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:02.147359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:02.148143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:02.148588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:02.573929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:02.585992 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-841dac6a-e258-4b47-a0ca-5fda03e2621b tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.452031 Jul 28 11:29:02.588422 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 540/1103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:02 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:02.594940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:02.595883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:02.605372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:02.605942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:02.607354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:02.607930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.261016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:03.269793 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de9dbfab-16c9-48c4-8a11-4fd44bf48459 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.680058 Jul 28 11:29:03.270375 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 541/1104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:02 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:03.286468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:03.287172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:03.298644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.299114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.300107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.303232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.466245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:03.479892 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e76cc72f-4f6f-4e3f-8134-16b496cd86f8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1275 microversion: 2.1 time: 0.203517 Jul 28 11:29:03.495157 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 542/1105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:03 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:03.510252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90210076-4077-431c-8164-c598a6846270 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb286e280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:03.569235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90210076-4077-431c-8164-c598a6846270 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.072902 Jul 28 11:29:03.571240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 543/1106] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:03 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:03.577307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:03.582253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Updating instance_info_cache with network_info: [{"id": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2", "address": "fa:16:3e:26:93:8e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc20d98c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:03.589253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:03.601446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.602695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.602863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Releasing lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:29:03.603998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.604214 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fdd711f4-bd90-435e-9114-2299a36b5989 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action" status: 202 len: 0 microversion: 2.1 time: 4.617264 Jul 28 11:29:03.604732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.606469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 564/1107] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:28:58 2022] POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action => generated 0 bytes in 4620 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:29:03.613896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-92fba8a4-fc88-41c2-8ea7-de1ee7d4b644 req-70034870-a4fe-4f78-9657-d97b098e4b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1eae57-5ddc-4644-b62e-7a5342ad0210", "name": "network-vif-deleted", "tag": "6cab6cba-9655-446a-bd21-2cf98735e092"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:03.628381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-92fba8a4-fc88-41c2-8ea7-de1ee7d4b644 req-70034870-a4fe-4f78-9657-d97b098e4b0e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.628826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-92fba8a4-fc88-41c2-8ea7-de1ee7d4b644 req-70034870-a4fe-4f78-9657-d97b098e4b0e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.644205 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-92fba8a4-fc88-41c2-8ea7-de1ee7d4b644 req-70034870-a4fe-4f78-9657-d97b098e4b0e service nova] Creating event network-vif-deleted:6cab6cba-9655-446a-bd21-2cf98735e092 for instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 on n-h2-851368-1 Jul 28 11:29:03.647511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.648787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.649588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lazy-loading 'fault' on Instance uuid 7f1eae57-5ddc-4644-b62e-7a5342ad0210 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:03.654562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-92fba8a4-fc88-41c2-8ea7-de1ee7d4b644 req-70034870-a4fe-4f78-9657-d97b098e4b0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045947 Jul 28 11:29:03.655840 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 565/1108] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:03.667676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e4ae2d97-275a-4de0-b519-e79f43398725 req-c5987aa5-108e-4da8-a7a6-bd23a151a57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-plugged", "status": "completed", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:03.677980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e4ae2d97-275a-4de0-b519-e79f43398725 req-c5987aa5-108e-4da8-a7a6-bd23a151a57f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.678420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e4ae2d97-275a-4de0-b519-e79f43398725 req-c5987aa5-108e-4da8-a7a6-bd23a151a57f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.696777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e4ae2d97-275a-4de0-b519-e79f43398725 req-c5987aa5-108e-4da8-a7a6-bd23a151a57f service nova] Creating event network-vif-plugged:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:29:03.715717 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e4ae2d97-275a-4de0-b519-e79f43398725 req-c5987aa5-108e-4da8-a7a6-bd23a151a57f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057935 Jul 28 11:29:03.716366 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 566/1109] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:03.732393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.220"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:03.739830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:03.761453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.763897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.764996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:03.769201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:03.841750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Acquired lock "refresh_cache-140f90ea-cf1f-4a2c-a8a2-a419968b33dd" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:29:04.175632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efe0fe3f3db4805962d856d017f82de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bdb9a00e7a45ad8fa087550f1a53ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:04.183292 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b317ce7e-9e92-4dfb-ae58-9caa08fb29c7 tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 200 len: 1311 microversion: 2.1 time: 0.610764 Jul 28 11:29:04.184718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 544/1110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:03 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 1311 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:04.193409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:04.195231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:04.201631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:04.202358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:04.203506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:04.204916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:04.805411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:04.824302 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3608efb4-649e-428c-90c6-b5da7964ce25 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.638189 Jul 28 11:29:04.825243 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 545/1111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:04 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:04.830765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:04.831695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:04.844462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:04.845204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:04.846167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:04.846759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:05.413716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:05.421287 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6628c38-04da-4db0-be18-02b884933f6a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.594984 Jul 28 11:29:05.421873 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 546/1112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:04 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:05.439383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:05.440006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:05.452517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:05.452973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:05.453761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:05.454228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:05.935694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:05.957715 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7969a35-c808-4940-989c-2d6e6336d930 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.523542 Jul 28 11:29:05.958367 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 547/1113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:05 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:05.977462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2fc36e45-bd86-4b48-8026-8a170c0bb572 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb285b0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:06.032126 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2fc36e45-bd86-4b48-8026-8a170c0bb572 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.064439 Jul 28 11:29:06.032985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 548/1114] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:05 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:06.038987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-415e2cba-a57f-437e-87df-55d6ca409e55 req-955e1fd5-b18b-4b2d-b85e-39cbecfee63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc2740-1b0d-43c0-995f-c853a755ec17", "tag": "7f9c885e-4294-4164-8773-322c6daaacc9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:06.053342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-415e2cba-a57f-437e-87df-55d6ca409e55 req-955e1fd5-b18b-4b2d-b85e-39cbecfee63b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.054601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-415e2cba-a57f-437e-87df-55d6ca409e55 req-955e1fd5-b18b-4b2d-b85e-39cbecfee63b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.066002 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-415e2cba-a57f-437e-87df-55d6ca409e55 req-955e1fd5-b18b-4b2d-b85e-39cbecfee63b service nova] Creating event network-changed:7f9c885e-4294-4164-8773-322c6daaacc9 for instance bbcc2740-1b0d-43c0-995f-c853a755ec17 on n-h2-851368-1 Jul 28 11:29:06.071864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-415e2cba-a57f-437e-87df-55d6ca409e55 req-955e1fd5-b18b-4b2d-b85e-39cbecfee63b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037246 Jul 28 11:29:06.072753 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 549/1115] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:06.077922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:06.079284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] [instance: 7f1eae57-5ddc-4644-b62e-7a5342ad0210] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:06.087344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.087905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.088682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.089117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.093396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:06.105576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] HTTP exception thrown: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Request method failure captured: Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 HTTP/1.1 Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKoFQ3-xYZT7a-8HsdDYMTaLj7vg8T5IJThMZORvPBL5m_2l3fbGmYeZyRr1yvwz_IizHVuaTo4z_LZtD762A5LL5nMvfEJkVvJDasgXau5bCpxniImcATaGyNLcnEuA7nOLzzpbEsqu5fnRMu2AJgzY2EwUvnW9UjZ0keFP59LPEg Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:06.107662 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4bdb9a00e7a45ad8fa087550f1a53ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4bdb9a00e7a45ad8fa087550f1a53ad"}]}] Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e4bdb9a00e7a45ad8fa087550f1a53ad Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-741886759 Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 8efe0fe3f3db4805962d856d017f82de Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServerFiltersTestJSON-741886759-project Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. Jul 28 11:29:06.108999 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7f1eae57-5ddc-4644-b62e-7a5342ad0210'} Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:06.109731 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. Jul 28 11:29:06.110997 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:06.118009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] Returning 404 to user: Instance 7f1eae57-5ddc-4644-b62e-7a5342ad0210 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:06.118009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9920ad3-95d9-4dad-a3f4-d8d9f600a22e tempest-ListServerFiltersTestJSON-741886759 tempest-ListServerFiltersTestJSON-741886759-project] 10.222.0.93 "GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210" status: 404 len: 111 microversion: 2.1 time: 0.035364 Jul 28 11:29:06.118009 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 550/1116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:06 2022] GET /compute/v2.1/servers/7f1eae57-5ddc-4644-b62e-7a5342ad0210 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:06.119253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:06.119876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:06.126040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.126491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.127318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.127756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.818275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:06.836512 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca554ef8-4bc0-465a-bc82-a5e048e2d540 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1542 microversion: 2.1 time: 0.725080 Jul 28 11:29:06.837449 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 551/1117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:06 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1542 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:06.842233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:06.842844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:06.860626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.861108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:06.861973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:06.862387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:07.419590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=23 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:07.445164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=70 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:07.503438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:07.523588 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a645aefe-480e-4394-bd1e-f5ac502a2526 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.684633 Jul 28 11:29:07.524311 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 552/1118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:06 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:07.542190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:07.542913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:07.549410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:07.559042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:07.560333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:07.561877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:07.776148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=27 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:08.289416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=62 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:08.513787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:08.529860 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53860dca-5df0-48ca-81e0-39bb9a3f7938 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.996695 Jul 28 11:29:08.531602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 553/1119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:07 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:08.537144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02cddb22-fecf-4431-9329-c93fa6d310ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb285b310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:08.610133 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02cddb22-fecf-4431-9329-c93fa6d310ff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.077151 Jul 28 11:29:08.611057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 554/1120] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:08 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:08.617301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:08.618223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:08.625544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:08.626540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:08.627459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:08.628130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:09.538224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:09.557125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a901a130-5253-4871-9032-fbf5ea0ea259 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1473 microversion: 2.1 time: 0.944558 Jul 28 11:29:09.557717 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 555/1121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:08 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1473 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:09.575930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-10194835-a7e2-46d8-b7d6-8c8c900b1c02 req-0d84388b-5506-4802-845f-99333e87de39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3a374f-7b2d-457c-866e-e6c033a0b067", "tag": "c2c3bcd5-83a8-4931-b369-848b92c34e36"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:09.587596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10194835-a7e2-46d8-b7d6-8c8c900b1c02 req-0d84388b-5506-4802-845f-99333e87de39 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:09.588303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10194835-a7e2-46d8-b7d6-8c8c900b1c02 req-0d84388b-5506-4802-845f-99333e87de39 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:09.600613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-10194835-a7e2-46d8-b7d6-8c8c900b1c02 req-0d84388b-5506-4802-845f-99333e87de39 service nova] Creating event network-changed:c2c3bcd5-83a8-4931-b369-848b92c34e36 for instance df3a374f-7b2d-457c-866e-e6c033a0b067 on n-h2-851368-1 Jul 28 11:29:09.606534 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-10194835-a7e2-46d8-b7d6-8c8c900b1c02 req-0d84388b-5506-4802-845f-99333e87de39 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034120 Jul 28 11:29:09.607778 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 556/1122] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:09.614485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:09.615491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:09.627459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:09.628509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:09.629982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:09.630880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:10.318879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:10.332007 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0d5226d-36ab-4c17-88a7-32624126e9d0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.722242 Jul 28 11:29:10.339501 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 557/1123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:09 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:10.357523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:10.361246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:10.374841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:10.395844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:10.399737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:10.400790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:10.401511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:10.789863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:10.820457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b93b508a-0fdb-4993-a597-123bac26d218 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.477455 Jul 28 11:29:10.824164 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 558/1124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:10 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:10.837887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-236d8147-fdac-4f60-a836-75b97f8c16e6 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2be6790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:10.923685 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-236d8147-fdac-4f60-a836-75b97f8c16e6 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.098198 Jul 28 11:29:10.924851 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 559/1125] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:10 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:10.930290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-unplugged", "status": "completed", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:10.944908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:10.945600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:10.961663 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] Creating event network-vif-unplugged:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:29:10.968244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] Instance 423746a7-ff5e-43cd-9673-ee1938331c29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:29:10.974917 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b1081100-bc5c-4d9e-bc11-df73fbde6a06 req-0a22f544-50de-4f1b-a95b-b33a873d40d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048264 Jul 28 11:29:10.975745 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 560/1126] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:10.982371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:10.985599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:10.992814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:10.993489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:10.994444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:10.994882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:11.045625 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.neutron [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] re-assign floating IP 172.25.3.220 from instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 Jul 28 11:29:11.111088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:11.365032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:11.388706 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d5ca972-6fdf-4de9-a62c-2ad4bb8ea93c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1473 microversion: 2.1 time: 0.411130 Jul 28 11:29:11.407294 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 561/1127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:10 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:11.409672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:11.414091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:11.457695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:11.458743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:11.460932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:11.462038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:11.890255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:11.917950 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69bebfb5-778c-4970-b486-6a4d1cdb406e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.521358 Jul 28 11:29:11.919852 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 562/1128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:11 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:11.926893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}, {"name": "network-changed", "server_uuid": "140f90ea-cf1f-4a2c-a8a2-a419968b33dd", "tag": "a5383228-6f70-4038-bd04-9cf4b28628a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:11.943825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:11.945049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:11.961591 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] Creating event network-changed:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:29:11.962359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] Creating event network-changed:a5383228-6f70-4038-bd04-9cf4b28628a5 for instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd on n-h1-851368-1 Jul 28 11:29:11.977858 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-164d1a2f-341e-40af-87f9-c277ec1ae1aa req-8659fd5e-d9a4-4076-bb73-9c45eef4e60e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056355 Jul 28 11:29:11.979202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 563/1129] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:11.986454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:11.987359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:11.994512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:11.995217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:11.996216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:11.996844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:12.638855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:12.648011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0de97d66-b601-42b4-809a-a77c35c410b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.667427 Jul 28 11:29:12.650978 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 564/1130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:11 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:12.659832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b5ed857-fed6-492f-9136-949a10753f7f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:12.681794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Updating instance_info_cache with network_info: [{"id": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2", "address": "fa:16:3e:26:93:8e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc20d98c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:12.705702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:12.714803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:12.766242 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7b5ed857-fed6-492f-9136-949a10753f7f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.112629 Jul 28 11:29:12.769002 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 565/1131] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:12 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:12.781205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:12.785709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:12.802366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:12.803002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:12.804509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:12.805106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:13.457073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:13.469843 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e05e87c3-d79f-4963-8d84-58f053c6f528 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1470 microversion: 2.1 time: 0.696577 Jul 28 11:29:13.496520 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 566/1132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:12 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1470 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:13.502001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:13.503270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:13.510727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:13.519327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:13.520428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:13.521161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:13.755714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:14.492986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:14.510933 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0764062-525a-43b9-853c-64a4e923f5ce tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 1.009200 Jul 28 11:29:14.511942 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 567/1133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:13 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:14.542658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d2f52cef-4c4d-45c4-9420-7f0579337a7d req-3ea43e1e-cda8-4218-9d85-4b754f173ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc2740-1b0d-43c0-995f-c853a755ec17", "name": "network-vif-plugged", "status": "completed", "tag": "7f9c885e-4294-4164-8773-322c6daaacc9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:14.560062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d2f52cef-4c4d-45c4-9420-7f0579337a7d req-3ea43e1e-cda8-4218-9d85-4b754f173ad2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.561841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d2f52cef-4c4d-45c4-9420-7f0579337a7d req-3ea43e1e-cda8-4218-9d85-4b754f173ad2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.578024 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d2f52cef-4c4d-45c4-9420-7f0579337a7d req-3ea43e1e-cda8-4218-9d85-4b754f173ad2 service nova] Creating event network-vif-plugged:7f9c885e-4294-4164-8773-322c6daaacc9 for instance bbcc2740-1b0d-43c0-995f-c853a755ec17 on n-h2-851368-1 Jul 28 11:29:14.583971 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d2f52cef-4c4d-45c4-9420-7f0579337a7d req-3ea43e1e-cda8-4218-9d85-4b754f173ad2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063274 Jul 28 11:29:14.585252 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 568/1134] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:14.592359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:14.593241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:14.601828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.602655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.603744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.604404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.691887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.693544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.694583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.695208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.725349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:14.731745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:14.823225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Updating instance_info_cache with network_info: [{"id": "a5383228-6f70-4038-bd04-9cf4b28628a5", "address": "fa:16:3e:ea:d5:1e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa5383228-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:14.831118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Releasing lock "refresh_cache-140f90ea-cf1f-4a2c-a8a2-a419968b33dd" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:29:14.832249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a1de07c-42e1-4b84-92b3-4c148758c5f2 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd/action" status: 202 len: 0 microversion: 2.1 time: 11.113259 Jul 28 11:29:14.839700 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 567/1135] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:03 2022] POST /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd/action => generated 0 bytes in 11121 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:29:14.853470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:14.855779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:14.864555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:14.875866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.876340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.877152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:14.881936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:14.888676 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31df0210-d79b-4f2d-a84e-01317d3514b2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29/action" status: 202 len: 0 microversion: 2.1 time: 0.301485 Jul 28 11:29:14.894450 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 569/1136] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:14 2022] POST /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:29:14.918672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9620e3bb-99d6-4cfe-80b6-35ee6b8b7e46 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:15.013653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9620e3bb-99d6-4cfe-80b6-35ee6b8b7e46 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.114185 Jul 28 11:29:15.020849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 570/1137] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:14 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:15.029837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: .version_select at 0x7f2eb99ba9d0>, body: {"removeFloatingIp": {"address": "172.25.3.220"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:15.178496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:15.190132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3625c919-b80b-44b2-b8ac-3972a63b5ca7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.346168 Jul 28 11:29:15.195337 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 568/1138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:14 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:15.211430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:15.219691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:15.247800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.248551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.249607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.250825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.258727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:15.268253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.269398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.270189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.270624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.641460 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] HTTP exception thrown: Floating IP 172.25.3.220 is not associated with instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32. Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Request method failure captured: Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action HTTP/1.1 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 49 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLNdshGa5Wp2xqT4ZMJFaP7jNSqSQH-pDQwRAht1cNiBkjpul8HuUY8TZM-qXW2ry4yw15RnwM_zTuy3KLZ5InKMRk4UvAI0Y3RkCdcVszalUevgm4N9UEn43t_eQYO4TR9m6mVUjFaBpA5jt5bB1W0xvCkYKAaR9ayhPFeLqNMFHo Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:15.644015 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}] Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2d4a96d2d92446baa9795668f555ae5f Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: {"removeFloatingIp": {"address": "172.25.3.220"}} Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:29:15.645601 n-d-851368-1 devstack@n-api.service[119235]: exception: Floating IP 172.25.3.220 is not associated with instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32. Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '4bbf0cf9-62c9-42f2-b40f-c216fb393b32', 'body': {'removeFloatingIp': {'address': '172.25.3.220'}}} Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.220 is not associated with instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32. Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:15.646606 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.220 is not associated with instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32. Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Returning 409 to user: Floating IP 172.25.3.220 is not associated with instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b70c9b1-04f6-4d7f-8452-da90d6bca7b7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action" status: 409 len: 146 microversion: 2.1 time: 0.628333 Jul 28 11:29:15.648291 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 571/1139] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:15 2022] POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action => generated 146 bytes in 632 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:29:15.651963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:15.653194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:15.683971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.684430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.685521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:15.685968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:15.782610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:15.796968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aebae921-383b-4e27-ac85-5435c5645f8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1469 microversion: 2.1 time: 0.598973 Jul 28 11:29:15.797591 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 569/1140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:15 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:15.812100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: .version_select at 0x7f2eb9ee84c0>, body: {"removeFloatingIp": {"address": "172.25.3.220"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:15.988701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:15.997128 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c25683c-c26d-4228-8c45-c70e508b10e9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1323 microversion: 2.1 time: 0.348726 Jul 28 11:29:16.000185 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 572/1141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:15 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:16.031636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22803e31-8f7a-406a-9fe1-8f4eb70ab190 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2822700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:16.113866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:16.122024 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22803e31-8f7a-406a-9fe1-8f4eb70ab190 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.096486 Jul 28 11:29:16.122245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:16.122582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:16.123239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 573/1142] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:16 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:16.130555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:16.131156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:16.243150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:16.243800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:16.269521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:16.269987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:16.270790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:16.271289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:16.653562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Acquired lock "refresh_cache-140f90ea-cf1f-4a2c-a8a2-a419968b33dd" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:29:17.000328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:17.017284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8e3a4ea-3858-45dd-a23e-21816791f3f6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.799528 Jul 28 11:29:17.032035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 574/1143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:16 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:17.044517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-plugged", "status": "completed", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:17.061122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:17.061602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:17.079587 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] Creating event network-vif-plugged:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:29:17.087122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] Instance 423746a7-ff5e-43cd-9673-ee1938331c29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:29:17.363585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4560d940-db71-490a-aff1-a13cdd89ad58 req-1100028e-6be6-432e-aa7b-98d9a79e1497 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326742 Jul 28 11:29:17.369801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 575/1144] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:17.395234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:17.395234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:17.420404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:17.421973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:17.423254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:17.423936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:17.686118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:17.703248 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34707e77-f5ca-4861-9a59-cd626af7e99d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1469 microversion: 2.1 time: 0.330501 Jul 28 11:29:17.719145 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 576/1145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:17 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1469 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:17.722390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:17.723028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:17.735557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:17.744648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:17.745730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:17.746188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:18.060435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:18.610319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:18.633226 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb4b5ffd-0c7f-4fb6-9cfa-ff8e2fafc926 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.918539 Jul 28 11:29:18.634053 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 577/1146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:17 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:18.648962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6f7a11d-769f-4eb8-b02f-3541bc9e94e3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:18.764584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6f7a11d-769f-4eb8-b02f-3541bc9e94e3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1454 microversion: 2.1 time: 0.128143 Jul 28 11:29:18.764584 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 578/1147] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:18 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:18.770663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:18.771321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:18.794018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:18.794167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:18.794944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:18.795437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.238635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:19.255127 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32d6521d-4fab-4766-98c3-7e3ea1c86775 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.484489 Jul 28 11:29:19.255127 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 579/1148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:18 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:19.264552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-544e7597-4499-459e-8fb1-fe567aab4720 req-164db5a2-1c56-478a-bc42-78768964d47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140f90ea-cf1f-4a2c-a8a2-a419968b33dd", "tag": "a5383228-6f70-4038-bd04-9cf4b28628a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:19.295694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-544e7597-4499-459e-8fb1-fe567aab4720 req-164db5a2-1c56-478a-bc42-78768964d47e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.296047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-544e7597-4499-459e-8fb1-fe567aab4720 req-164db5a2-1c56-478a-bc42-78768964d47e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.322962 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-544e7597-4499-459e-8fb1-fe567aab4720 req-164db5a2-1c56-478a-bc42-78768964d47e service nova] Creating event network-changed:a5383228-6f70-4038-bd04-9cf4b28628a5 for instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd on n-h1-851368-1 Jul 28 11:29:19.340174 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-544e7597-4499-459e-8fb1-fe567aab4720 req-164db5a2-1c56-478a-bc42-78768964d47e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087534 Jul 28 11:29:19.340770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 580/1149] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:19.356733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:19.362407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:19.378441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.379492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.380698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.381455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.711577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:19.734725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Updating instance_info_cache with network_info: [{"id": "a5383228-6f70-4038-bd04-9cf4b28628a5", "address": "fa:16:3e:ea:d5:1e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa5383228-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:19.746490 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64051d4f-8d89-4cab-92bd-10c3b0e37372 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.397538 Jul 28 11:29:19.749907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Releasing lock "refresh_cache-140f90ea-cf1f-4a2c-a8a2-a419968b33dd" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:29:19.751996 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 581/1150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:19 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:19.765712 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d610e6b1-8e03-45ea-8759-f56b7899fb8a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd/action" status: 202 len: 0 microversion: 2.1 time: 3.966335 Jul 28 11:29:19.769937 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 570/1151] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:15 2022] POST /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd/action => generated 0 bytes in 3971 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:29:19.773215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:19.776155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:19.779198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-27701bb8-eea0-40f8-8770-b27a9ada66b8 req-c7950d59-36ce-449b-844e-25b7bfccf29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3a374f-7b2d-457c-866e-e6c033a0b067", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3bcd5-83a8-4931-b369-848b92c34e36"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:19.784979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.785696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.786559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.787428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.798278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-27701bb8-eea0-40f8-8770-b27a9ada66b8 req-c7950d59-36ce-449b-844e-25b7bfccf29b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:19.798643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-27701bb8-eea0-40f8-8770-b27a9ada66b8 req-c7950d59-36ce-449b-844e-25b7bfccf29b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:19.829350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-27701bb8-eea0-40f8-8770-b27a9ada66b8 req-c7950d59-36ce-449b-844e-25b7bfccf29b service nova] Creating event network-vif-plugged:c2c3bcd5-83a8-4931-b369-848b92c34e36 for instance df3a374f-7b2d-457c-866e-e6c033a0b067 on n-h2-851368-1 Jul 28 11:29:19.840475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-27701bb8-eea0-40f8-8770-b27a9ada66b8 req-c7950d59-36ce-449b-844e-25b7bfccf29b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068037 Jul 28 11:29:19.846718 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 571/1152] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:19.856241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30a3fa05-ebb2-4a18-b7b2-5f1f4f62ea27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-796207810", "metadata": {"": ""}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30a3fa05-ebb2-4a18-b7b2-5f1f4f62ea27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action HTTP/1.1 Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 106 Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:29:19.861713 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-796207810", "metadata": {"": ""}}} Jul 28 11:29:19.863253 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-796207810', 'metadata': {'': ''}}}} Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'': ''} Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:19.864062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.865420 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:19.866756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:19.868928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30a3fa05-ebb2-4a18-b7b2-5f1f4f62ea27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:19.870034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30a3fa05-ebb2-4a18-b7b2-5f1f4f62ea27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action" status: 400 len: 170 microversion: 2.1 time: 0.020733 Jul 28 11:29:19.874154 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 572/1153] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 28 11:29:19 2022] POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:29:19.879617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41ce6ded-3f99-4fcf-9352-661bd1c8d33f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb29965e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:19.985527 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41ce6ded-3f99-4fcf-9352-661bd1c8d33f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1463 microversion: 2.1 time: 0.109772 Jul 28 11:29:19.994920 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 573/1154] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:19 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.007680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.008324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.032689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.035254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.038456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.040721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.092062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:20.101714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-30f5d945-e426-4692-af9f-af9d5523b6e0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1535 microversion: 2.1 time: 0.347067 Jul 28 11:29:20.107814 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 582/1155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:19 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1535 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.109435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:29:20.115624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.116282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.139567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.148810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.150079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.151662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.271884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ce092d0-b58a-4c35-862e-eed522b30a20 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "DELETE /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 204 len: 0 microversion: 2.1 time: 0.275358 Jul 28 11:29:20.277643 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 574/1156] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:19 2022] DELETE /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:20.281942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a37e83f8-41a7-4df2-85ab-3293ced0a68d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28be940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.351201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a37e83f8-41a7-4df2-85ab-3293ced0a68d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 200 len: 1463 microversion: 2.1 time: 0.076056 Jul 28 11:29:20.352639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 575/1157] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:20 2022] GET /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.358806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.359819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.369312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.369759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.370538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.371030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.382503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:20.394307 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fdf79009-4aa6-4760-a0ef-a6f990dbaddc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.282408 Jul 28 11:29:20.395634 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 583/1158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:20 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.402404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: .version_select at 0x7f2eb99baee0>, body: {"addFloatingIp": {"address": "172.25.3.220"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:20.405296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.426424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.427326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.428388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.429583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.485982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Acquired lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:29:20.665662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:20.673994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19c8fdd5-f08b-4be8-9627-4915cc7b025b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1317 microversion: 2.1 time: 0.319986 Jul 28 11:29:20.674813 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 576/1159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:20 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.680384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.681166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.690643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.691298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.692083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:20.692517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:20.972121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:20.981631 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df225cc1-35fd-4233-ac0e-8188545b622c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1468 microversion: 2.1 time: 0.305439 Jul 28 11:29:20.982302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 577/1160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:20 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:20.987851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:20.988456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:20.999646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.000744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:21.001720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.002314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:21.282711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:21.291760 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5607743-071f-4474-9c85-813d5127c15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.308235 Jul 28 11:29:21.294626 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 578/1161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:20 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:21.306287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:21.307277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:21.320794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.321169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:21.321940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.322367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:21.588438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:21.604190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60c938e7-7b1d-4f6a-afc8-a287aa9d7aaf tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 2345 microversion: 2.25 time: 0.302373 Jul 28 11:29:21.605024 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 579/1162] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:21 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 2345 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:21.609530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-070c3a93-4aa2-41f2-a748-8d00b824ad61 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2898430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:21.776309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-070c3a93-4aa2-41f2-a748-8d00b824ad61 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?changes-since=2022-07-28T11%3A27%3A18Z" status: 200 len: 2374 microversion: 2.1 time: 0.170396 Jul 28 11:29:21.776902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 580/1163] 10.222.0.93 () {58 vars in 1199 bytes} [Thu Jul 28 11:29:21 2022] GET /compute/v2.1/images?changes-since=2022-07-28T11%3A27%3A18Z => generated 2374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:21.794352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:21.795063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:21.803376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.803928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:21.804811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:21.805260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:22.219207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:22.239518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2c25db67-2e09-4c4e-a700-0a2d14655d4e tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1535 microversion: 2.1 time: 0.447202 Jul 28 11:29:22.240721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 581/1164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:21 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1535 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:22.262140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4037d9ef-ec94-4bf8-afc6-a2b8ca1bdcf7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1680726089", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4037d9ef-ec94-4bf8-afc6-a2b8ca1bdcf7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action HTTP/1.1 Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 619 Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:29:22.269010 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:22.270799 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:29:22.271618 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1680726089", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 28 11:29:22.271618 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:29:22.271618 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1680726089', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 28 11:29:22.272016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:22.272894 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.274805 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:29:22.275784 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:22.278109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4037d9ef-ec94-4bf8-afc6-a2b8ca1bdcf7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:22.279932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4037d9ef-ec94-4bf8-afc6-a2b8ca1bdcf7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action" status: 400 len: 938 microversion: 2.1 time: 0.037873 Jul 28 11:29:22.281047 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 582/1165] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 28 11:29:22 2022] POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action => generated 938 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:29:22.437169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Building network info cache for instance {{(pid=119235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:22.536756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-234192476", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:22.634539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] validate_networks() for [('ddfecbec-84cc-466e-9a74-32188ed83a6b', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:23.335318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Updating instance_info_cache with network_info: [{"id": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2", "address": "fa:16:3e:26:93:8e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc20d98c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:23.358102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Releasing lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:29:23.358985 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b9ffa42-474e-4db3-b773-81e468589625 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action" status: 202 len: 0 microversion: 2.1 time: 2.962120 Jul 28 11:29:23.360987 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 584/1166] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:20 2022] POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action => generated 0 bytes in 2965 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:29:23.374317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:23.379461 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:29:23.379461 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:29:23.382260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.383307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.397138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.397915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.454088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3930d0b1-dc56-4de0-8778-6460cc37c320 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.089522 Jul 28 11:29:23.466312 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 585/1167] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Jul 28 11:29:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:29:23.476184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:23.479019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:23.495300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.496002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.499679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.500315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.631531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:29:23.632926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:29:23.633414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:29:23.633833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:29:23.634254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:29:23.668892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.669591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.676454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.677422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.733100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Getting quotas for project c3e3111f193244edbdb62d786409040a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:23.738649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Getting quotas for user dccf1445753846ac929d677614481e5f and project c3e3111f193244edbdb62d786409040a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:23.753630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:29:23.757408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:23.816075 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3cc0f36-74c2-4da3-90e3-930d3f94eefa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533605 Jul 28 11:29:23.824420 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 583/1168] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:29:23.829770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5fe4265-435a-496a-b8e8-e5bcfefba6e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2f8b820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:23.836576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:23.852130 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-23c50510-fab7-41f9-8f0b-c550eecb9a46 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1466 microversion: 2.1 time: 0.384158 Jul 28 11:29:23.864364 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 586/1169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:23 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1466 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:23.871057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-unplugged", "status": "completed", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:23.885148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.885606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.900758 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] Creating event network-vif-unplugged:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:29:23.907459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] Instance 423746a7-ff5e-43cd-9673-ee1938331c29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:29:23.931612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5fe4265-435a-496a-b8e8-e5bcfefba6e5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-827518758" status: 200 len: 484 microversion: 2.1 time: 0.105699 Jul 28 11:29:23.932500 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 584/1170] 10.222.0.93 () {58 vars in 1229 bytes} [Thu Jul 28 11:29:23 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-827518758 => generated 484 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:23.940163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:23.940789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:23.943110 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b90bb3ec-5d6e-4e2d-b37c-f95fab83580e req-8bbfc254-859d-44a0-8032-6db9ef619984 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076080 Jul 28 11:29:23.945086 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 587/1171] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:23.957031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-abb0185b-064d-4d8e-bdd1-d4ee0b0ee890 req-b8562974-496a-45c7-b3e6-18ca0e096910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:23.971661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.972328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.973476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.974255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:23.989545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-abb0185b-064d-4d8e-bdd1-d4ee0b0ee890 req-b8562974-496a-45c7-b3e6-18ca0e096910 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:23.990060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-abb0185b-064d-4d8e-bdd1-d4ee0b0ee890 req-b8562974-496a-45c7-b3e6-18ca0e096910 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.030983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-abb0185b-064d-4d8e-bdd1-d4ee0b0ee890 req-b8562974-496a-45c7-b3e6-18ca0e096910 service nova] Creating event network-changed:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:29:24.044328 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-abb0185b-064d-4d8e-bdd1-d4ee0b0ee890 req-b8562974-496a-45c7-b3e6-18ca0e096910 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095148 Jul 28 11:29:24.052734 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 588/1172] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:24.066930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:24.067683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:24.106747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:24.109036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.111927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:24.113148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.472885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:24.501567 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ee8a98e-ce97-4e23-aef0-72030fb00471 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.567919 Jul 28 11:29:24.518454 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 585/1173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:23 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:24.523052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fec5ce61-9c5a-4fd6-9809-b59e7bc8d035 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '.version_select at 0x7f2eb2931a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:24.679298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:24.688053 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7426eede-2483-4237-8f11-cee931f7c1cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1535 microversion: 2.1 time: 0.632116 Jul 28 11:29:24.689490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 589/1174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:24 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1535 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:24.696578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-012dffca-efb0-44bc-a253-0d3b0a88b35b req-e4f86d0d-4a30-4017-8355-edca59e569c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140f90ea-cf1f-4a2c-a8a2-a419968b33dd", "name": "network-vif-deleted", "tag": "a5383228-6f70-4038-bd04-9cf4b28628a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:24.706969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-012dffca-efb0-44bc-a253-0d3b0a88b35b req-e4f86d0d-4a30-4017-8355-edca59e569c0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:24.707456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-012dffca-efb0-44bc-a253-0d3b0a88b35b req-e4f86d0d-4a30-4017-8355-edca59e569c0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.719343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-012dffca-efb0-44bc-a253-0d3b0a88b35b req-e4f86d0d-4a30-4017-8355-edca59e569c0 service nova] Creating event network-vif-deleted:a5383228-6f70-4038-bd04-9cf4b28628a5 for instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd on n-h1-851368-1 Jul 28 11:29:24.725762 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-012dffca-efb0-44bc-a253-0d3b0a88b35b req-e4f86d0d-4a30-4017-8355-edca59e569c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034124 Jul 28 11:29:24.733909 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 590/1175] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:24.739437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:24.742413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:24.751734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:24.753071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.754434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:24.755139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:24.917162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:24.934640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5a4a4ec-dc38-4f7f-9c8d-7bb0a9e375cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1220 microversion: 2.1 time: 0.195287 Jul 28 11:29:24.935503 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 591/1176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:24 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:25.082512 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fec5ce61-9c5a-4fd6-9809-b59e7bc8d035 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/eb1cafca-e070-41af-a32d-03ca1384ccf4" status: 200 len: 185 microversion: 2.1 time: 0.579144 Jul 28 11:29:25.084028 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 586/1177] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:29:24 2022] GET /compute/v2.1/os-floating-ips/eb1cafca-e070-41af-a32d-03ca1384ccf4 => generated 185 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:25.095028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a634f7ce-4a47-43f2-aee8-6a83285f58bb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb289f0d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:25.183305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:25.183933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:25.190812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.191584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.192574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.193179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.202760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:25.284325 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a634f7ce-4a47-43f2-aee8-6a83285f58bb tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?server=1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 956 microversion: 2.1 time: 0.198318 Jul 28 11:29:25.295320 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 587/1178] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Jul 28 11:29:25 2022] GET /compute/v2.1/images?server=1201727c-05e5-477b-b618-c8a0fbb4894e => generated 956 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:25.301071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:25.301909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:25.309176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.310012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.311037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.311734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.554475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:25.563607 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5b995d7-62ec-49f1-b030-6b9ebfe672fa tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.266768 Jul 28 11:29:25.564188 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 588/1179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:25 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:25.569799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.220"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:25.732426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-36095603-7613-4e56-9a71-fddf3a61bbb8 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1617 microversion: 2.1 time: 0.795527 Jul 28 11:29:25.733007 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 592/1180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:24 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1617 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:25.738130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec559d0f-7e95-478a-9dde-3eadbf2abbd8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2be6af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:25.782648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:25.790300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.790655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.792158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.792606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.801021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec559d0f-7e95-478a-9dde-3eadbf2abbd8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 484 microversion: 2.1 time: 0.066573 Jul 28 11:29:25.801609 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 593/1181] 10.222.0.93 () {58 vars in 1317 bytes} [Thu Jul 28 11:29:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 484 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:25.811116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5021ca5-35b7-4a8b-af90-d9c6cf66f23f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5021ca5-35b7-4a8b-af90-d9c6cf66f23f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action HTTP/1.1 Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 285 Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:25.813790 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:29:25.815511 n-d-851368-1 devstack@n-api.service[119235]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:29:25.816222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:29:25.816871 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:29:25.818088 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:29:25.818880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:29:25.818880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:25.818880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5021ca5-35b7-4a8b-af90-d9c6cf66f23f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:25.818880 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e5021ca5-35b7-4a8b-af90-d9c6cf66f23f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action" status: 400 len: 619 microversion: 2.1 time: 0.011730 Jul 28 11:29:25.819990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 594/1182] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 28 11:29:25 2022] POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:29:25.824897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:25.825165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:25.831866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.832410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:25.833270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:25.833772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:26.083809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:26.097191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea4559d5-d91a-4608-be46-63c5006d871f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1535 microversion: 2.1 time: 0.279046 Jul 28 11:29:26.098925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 595/1183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:25 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1535 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:26.110075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: .version_select at 0x7f2eb2be61f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1581513064", "policies": ["affinity"]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:26.135743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:26.140960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:26.164348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Acquired lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:29:26.223678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:26.226271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:26.228950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:26.255762 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed113681-bdd4-40f8-98d9-835ebeef4b99 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.155343 Jul 28 11:29:26.257094 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 596/1184] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Jul 28 11:29:26 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:26.286509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95c88b1a-a1db-4c3d-863b-adae9201e042 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2a74af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:26.362858 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95c88b1a-a1db-4c3d-863b-adae9201e042 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 484 microversion: 2.1 time: 0.087387 Jul 28 11:29:26.363487 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 597/1185] 10.222.0.93 () {58 vars in 1303 bytes} [Thu Jul 28 11:29:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 484 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:26.368987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:26.369610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:26.391734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:26.392459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:26.396321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:26.397965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.061393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:27.074900 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e9e7a56-0f18-4d42-b997-1f206e3c944b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.710348 Jul 28 11:29:27.075742 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 598/1186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:26 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:27.080890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:27.081756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:27.096113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:27.096670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.097545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:27.098072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.186790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:27.194918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5bb174d6-5e5e-4ff2-93e4-3ad3ea5edf22 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1268 microversion: 2.1 time: 0.117956 Jul 28 11:29:27.195600 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 599/1187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:27 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:27.200228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-91fc38b3-7895-4134-99e4-7f7f2e20b99e req-43cbcc8b-0ea8-437a-9683-1fa4ac353c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-unplugged", "status": "completed", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:27.214484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-91fc38b3-7895-4134-99e4-7f7f2e20b99e req-43cbcc8b-0ea8-437a-9683-1fa4ac353c72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:27.215169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-91fc38b3-7895-4134-99e4-7f7f2e20b99e req-43cbcc8b-0ea8-437a-9683-1fa4ac353c72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.229076 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-91fc38b3-7895-4134-99e4-7f7f2e20b99e req-43cbcc8b-0ea8-437a-9683-1fa4ac353c72 service nova] Creating event network-vif-unplugged:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:29:27.234572 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-91fc38b3-7895-4134-99e4-7f7f2e20b99e req-43cbcc8b-0ea8-437a-9683-1fa4ac353c72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037714 Jul 28 11:29:27.235194 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 600/1188] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:27.240540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2427667a-ef35-450e-950f-255c6dd325fc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb37ec280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:27.357016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2427667a-ef35-450e-950f-255c6dd325fc tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.120353 Jul 28 11:29:27.357604 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 601/1189] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:29:27 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:27.371802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-426880513", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a32fab36-7d9d-4fbc-b34e-ba2da46d10d5"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:27.425802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:29:27.429861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:27.434863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:27.853486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:29:27.855809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:29:27.856595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:29:27.857493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:29:27.858114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:29:27.894873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:27.895617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.897752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:27.898396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:27.934832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:27.944867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:27.969035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 2 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:29:27.971693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:28.013888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119235) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 28 11:29:28.056591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:28.061662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:28.109987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:28.114146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:28.126999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=96fa3a16-e75f-4867-99ec-2f1666e66fbb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:28.187929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:28.192108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:28.243878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:28.248233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:28.255179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Updating instance_info_cache with network_info: [{"id": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2", "address": "fa:16:3e:26:93:8e", "network": {"id": "6463dbe0-35eb-4a85-bdf5-82f35d1f6e3f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-545272147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "96f5ee2d77c24a0793c7b8dfe861c8f0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc20d98c0-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:29:28.268362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Releasing lock "refresh_cache-4bbf0cf9-62c9-42f2-b40f-c216fb393b32" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:29:28.269773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d2288e0-e149-4bc7-ac2a-605d94a06e78 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action" status: 202 len: 0 microversion: 2.1 time: 2.704255 Jul 28 11:29:28.270700 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 589/1190] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:25 2022] POST /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32/action => generated 0 bytes in 2706 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:29:28.277016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.277839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:28.284868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.285665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.286708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.287387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.300421 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6c163ec1-dbc6-4292-b038-34ddc38d43be tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.932407 Jul 28 11:29:28.307943 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 602/1191] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:29:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 950 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:29:28.315322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.316702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:28.326671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.327432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.328384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.328980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.568746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:28.572008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:28.581313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a098ccbd-fa4a-4194-8fa0-dee8d0da8c15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1528 microversion: 2.1 time: 0.271801 Jul 28 11:29:28.582468 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 603/1192] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:28 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:28.584563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-070db1d6-c50d-4ff8-ae71-15f27e1dbff7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.312409 Jul 28 11:29:28.588545 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 590/1193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:28 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:28.600446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7793ab95-db9a-46e3-b376-8f432ec9198d req-1b82e36a-77ef-49bf-99ba-5ed952602366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:28.601573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e66b4827-0e6b-4cd3-a300-28b94ab2f605 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb28d5790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.613757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7793ab95-db9a-46e3-b376-8f432ec9198d req-1b82e36a-77ef-49bf-99ba-5ed952602366 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.614322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7793ab95-db9a-46e3-b376-8f432ec9198d req-1b82e36a-77ef-49bf-99ba-5ed952602366 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.643359 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7793ab95-db9a-46e3-b376-8f432ec9198d req-1b82e36a-77ef-49bf-99ba-5ed952602366 service nova] Creating event network-changed:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:29:28.650781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7793ab95-db9a-46e3-b376-8f432ec9198d req-1b82e36a-77ef-49bf-99ba-5ed952602366 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060895 Jul 28 11:29:28.652022 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 591/1194] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:28.660251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44c54588-0613-41a3-b11a-a65a02f91963", "device": "/dev/xvdb"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:28.663903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:28.670643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.671165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.672167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.672803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.709713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e66b4827-0e6b-4cd3-a300-28b94ab2f605 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.115920 Jul 28 11:29:28.710769 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 604/1195] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:29:28 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:28.716893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.717678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:28.725728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.726320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.727294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.727834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.844614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:28.863503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a2b73d9-1ade-4cbf-a56a-103e5a6de4ef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1274 microversion: 2.1 time: 0.149234 Jul 28 11:29:28.866556 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 605/1196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:28 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:28.873517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.874192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:28.888203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.889282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.890103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:28.890547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:28.920436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] HTTP exception thrown: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Request method failure captured: Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd HTTP/1.1 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLNdshGa5Wp2xqT4ZMJFaP7jNSqSQH-pDQwRAht1cNiBkjpul8HuUY8TZM-qXW2ry4yw15RnwM_zTuy3KLZ5InKMRk4UvAI0Y3RkCdcVszalUevgm4N9UEn43t_eQYO4TR9m6mVUjFaBpA5jt5bB1W0xvCkYKAaR9ayhPFeLqNMFHo Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:28.933588 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}] Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2d4a96d2d92446baa9795668f555ae5f Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:28.935286 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '140f90ea-cf1f-4a2c-a8a2-a419968b33dd'} Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:28.936292 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:28.937826 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:28.941811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Returning 404 to user: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:28.943404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7d823173-6f21-4423-beb3-64b90b98e93e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "DELETE /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 404 len: 111 microversion: 2.1 time: 0.073434 Jul 28 11:29:28.949977 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 606/1197] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:28 2022] DELETE /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:28.965712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:28.974408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:28.978890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Searching by: {'deleted': False, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:29:29.019965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.023835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.024953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.026631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.083549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:29:29.165347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9fe5a012-3cb9-4464-b838-586049257f1b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.214053 Jul 28 11:29:29.166782 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 607/1198] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:29:28 2022] GET /compute/v2.1/servers => generated 1002 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:29.174431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.175697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:29.184906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.185864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.187344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.189369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.239320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7e8d6b3-9f1b-4e71-873a-a57574483554 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.584558 Jul 28 11:29:29.243521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 592/1199] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Jul 28 11:29:28 2022] POST /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:29:29.278703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-99343030"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:29.285852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:29.294923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.295810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.297008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.297679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.468443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:29.480068 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d69de71-c301-4144-b93b-52e77a9b7bf2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1528 microversion: 2.1 time: 0.311823 Jul 28 11:29:29.480704 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 608/1200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:29 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:29.487963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a3a50d1-378b-44dd-9899-9605c225105c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2cd9e50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.598377 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a3a50d1-378b-44dd-9899-9605c225105c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.115931 Jul 28 11:29:29.603129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 609/1201] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:29:29 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:29.608655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.609522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 140f90ea-cf1f-4a2c-a8a2-a419968b33dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:29.616448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.616992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.617847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.618405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.639222 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1461efe-217d-461b-8eac-f2f401a6df91 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action" status: 202 len: 0 microversion: 2.1 time: 0.392426 Jul 28 11:29:29.650510 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 593/1202] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:29 2022] POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:29:29.650510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.651847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:29.656892 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] HTTP exception thrown: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:29.663836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.664320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Request method failure captured: Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd HTTP/1.1 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLNdshGa5Wp2xqT4ZMJFaP7jNSqSQH-pDQwRAht1cNiBkjpul8HuUY8TZM-qXW2ry4yw15RnwM_zTuy3KLZ5InKMRk4UvAI0Y3RkCdcVszalUevgm4N9UEn43t_eQYO4TR9m6mVUjFaBpA5jt5bB1W0xvCkYKAaR9ayhPFeLqNMFHo Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:29.664918 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}] Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2d4a96d2d92446baa9795668f555ae5f Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:29.666480 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '140f90ea-cf1f-4a2c-a8a2-a419968b33dd'} Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:29.667569 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. Jul 28 11:29:29.669425 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.671683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.671683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.671961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Returning 404 to user: Instance 140f90ea-cf1f-4a2c-a8a2-a419968b33dd could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:29.671961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eec3de65-27ec-482a-8b11-0404c0331a4e tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd" status: 404 len: 111 microversion: 2.1 time: 0.069513 Jul 28 11:29:29.672223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 610/1203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:29 2022] GET /compute/v2.1/servers/140f90ea-cf1f-4a2c-a8a2-a419968b33dd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:29.686447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd89bb1a-9bbe-49a0-872a-ad486fc9b426 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.687419 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:29:29.687419 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:29:29.702991 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-cd89bb1a-9bbe-49a0-872a-ad486fc9b426 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] HTTP exception thrown: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd89bb1a-9bbe-49a0-872a-ad486fc9b426 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Request method failure captured: Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/flavors/706ea037-14f6-4f51-bbe0-1cdda0448f2f HTTP/1.1 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIfJhvjtIICaUVllulCeq4EwKQuVEQ3D4C_f8R2OLH_c1-E19PPJABBA1lgUs4C-D4MJI_Dt_QB1wvpV4IUWwng2NUiWF-mEFF1cuLaFdB_0hk2oMgzUtDfq4dGrEnrt1i1tiHDr6iUPWsjOsso2_1LKhOt-bwTgkWuCGxas56afBA Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: b38e0f11dd884d94b75382e2f88ff6a6 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MigrationsAdminTest-592836818 Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:29:29.713771 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b38e0f11dd884d94b75382e2f88ff6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b38e0f11dd884d94b75382e2f88ff6a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b38e0f11dd884d94b75382e2f88ff6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b38e0f11dd884d94b75382e2f88ff6a6"}]}] Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MigrationsAdminTest-592836818 Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: b38e0f11dd884d94b75382e2f88ff6a6 Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MigrationsAdminTest-592836818 Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MigrationsAdminTest-592836818-project-admin Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 1a9dff9b8c214fe88a7fdbf14fc954cf Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MigrationsAdminTest-592836818-project-admin Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: exception: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. Jul 28 11:29:29.715386 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '706ea037-14f6-4f51-bbe0-1cdda0448f2f'} Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.716369 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. Jul 28 11:29:29.717968 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:29.719403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd89bb1a-9bbe-49a0-872a-ad486fc9b426 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Returning 404 to user: Flavor 706ea037-14f6-4f51-bbe0-1cdda0448f2f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:29.719403 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd89bb1a-9bbe-49a0-872a-ad486fc9b426 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/706ea037-14f6-4f51-bbe0-1cdda0448f2f" status: 404 len: 109 microversion: 2.1 time: 0.039984 Jul 28 11:29:29.719403 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 611/1204] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:29 2022] DELETE /compute/v2.1/flavors/706ea037-14f6-4f51-bbe0-1cdda0448f2f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:29.726999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e875936-4da1-4930-b784-ed45e0b386d5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2d1a8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:29.845401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:29.856656 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d5f2e4f-e8d8-4d2a-adf8-b14646857e22 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1222 microversion: 2.1 time: 0.212862 Jul 28 11:29:29.861082 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 594/1205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:29 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:29.873422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195601648"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:29.882144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:29.905902 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e875936-4da1-4930-b784-ed45e0b386d5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?changes-since=2022-07-28T11%3A27%3A13Z" status: 200 len: 6332 microversion: 2.1 time: 0.188730 Jul 28 11:29:29.919099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 612/1206] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Jul 28 11:29:29 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-28T11%3A27%3A13Z => generated 6332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:29.919475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.919475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.919475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:29.919475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:29.927428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aca8f3bd-f86f-46dd-bbd9-5f8a3db6cd3f tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '.version_select at 0x7f2eb31fa0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:30.053967 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Cannot 'createImage' instance bbcc2740-1b0d-43c0-995f-c853a755ec17 while it is in task_state image_snapshot_pending Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action HTTP/1.1 Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 84 Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:29:30.056690 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195601648"}} Jul 28 11:29:30.058425 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'createImage' instance bbcc2740-1b0d-43c0-995f-c853a755ec17 while it is in task_state image_snapshot_pending Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-195601648'}}} Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 153, in inner Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:30.059444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance bbcc2740-1b0d-43c0-995f-c853a755ec17 while it is in task_state image_snapshot_pending Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance bbcc2740-1b0d-43c0-995f-c853a755ec17 while it is in task_state image_snapshot_pending Jul 28 11:29:30.060985 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:30.062504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 409 to user: Cannot 'createImage' instance bbcc2740-1b0d-43c0-995f-c853a755ec17 while it is in task_state image_snapshot_pending {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:30.062504 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88c11772-bfd3-44c5-904a-4be305ad0045 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action" status: 409 len: 167 microversion: 2.1 time: 0.199127 Jul 28 11:29:30.069037 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 595/1207] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:29 2022] POST /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17/action => generated 167 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:29:30.079503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:30.082319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:30.099611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:30.100044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:30.101390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:30.101830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:30.470091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:30.480889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c2e0113-fd6d-4176-9f49-92fe47ad0686 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.410592 Jul 28 11:29:30.481619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 596/1208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:30 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:30.500626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a80fe53e-22bf-4523-bd25-df1781ed0577 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb27f10d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:30.551575 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a80fe53e-22bf-4523-bd25-df1781ed0577 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-827518758" status: 200 len: 664 microversion: 2.1 time: 0.055975 Jul 28 11:29:30.552551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 597/1209] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 28 11:29:30 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-827518758 => generated 664 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:30.557412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1300496426", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:30.618209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:31.083931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:29:31.085293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:29:31.085860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:29:31.086359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:29:31.086935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:29:31.104740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.110056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.111648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.112347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.132411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:31.137054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Getting quotas for user 2a4e1d0d7b5b4f2c884579f3475d0c31 and project 4ff7b70fd6634e5c839709aeb3decee2. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:31.148878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:29:31.152647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:31.204104 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-597c7f31-2c55-4044-8d23-187c1c91691a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650190 Jul 28 11:29:31.205507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 598/1210] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:29:31.210657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a982344-fe00-4c94-adfb-a0abf9149b99 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb2838af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.375140 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a982344-fe00-4c94-adfb-a0abf9149b99 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/images/3fd728bd-d439-435e-b203-c7e08ecaa037" status: 204 len: 0 microversion: 2.1 time: 0.167919 Jul 28 11:29:31.376757 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 599/1211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:31 2022] DELETE /compute/v2.1/images/3fd728bd-d439-435e-b203-c7e08ecaa037 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:31.382769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3f0df3b2-5237-471e-9d5d-ffd3ab77b7dd req-5138f759-dd28-4528-b227-1289fb417dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-plugged", "status": "completed", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:31.410722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3f0df3b2-5237-471e-9d5d-ffd3ab77b7dd req-5138f759-dd28-4528-b227-1289fb417dde service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.411307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3f0df3b2-5237-471e-9d5d-ffd3ab77b7dd req-5138f759-dd28-4528-b227-1289fb417dde service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.434944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3f0df3b2-5237-471e-9d5d-ffd3ab77b7dd req-5138f759-dd28-4528-b227-1289fb417dde service nova] Creating event network-vif-plugged:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:29:31.440593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3f0df3b2-5237-471e-9d5d-ffd3ab77b7dd req-5138f759-dd28-4528-b227-1289fb417dde service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062247 Jul 28 11:29:31.441548 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 600/1212] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:31.447356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ee473ed2-ca64-4069-890a-b2fd4930430d req-c22efd75-9f34-4b8c-b9e8-4179139885b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:31.458949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee473ed2-ca64-4069-890a-b2fd4930430d req-c22efd75-9f34-4b8c-b9e8-4179139885b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.459496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee473ed2-ca64-4069-890a-b2fd4930430d req-c22efd75-9f34-4b8c-b9e8-4179139885b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.471474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ee473ed2-ca64-4069-890a-b2fd4930430d req-c22efd75-9f34-4b8c-b9e8-4179139885b4 service nova] Creating event network-changed:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:29:31.478331 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ee473ed2-ca64-4069-890a-b2fd4930430d req-c22efd75-9f34-4b8c-b9e8-4179139885b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Jul 28 11:29:31.479306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 601/1213] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:31.486485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00dbf9d3-c0b6-45bb-a04c-52643b67797c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2838820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.639465 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00dbf9d3-c0b6-45bb-a04c-52643b67797c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1466 microversion: 2.1 time: 0.156459 Jul 28 11:29:31.650766 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 602/1214] 10.222.0.93 () {58 vars in 1338 bytes} [Thu Jul 28 11:29:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:31.656840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.657951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:31.667047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.667992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.668967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.669593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.704592 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aca8f3bd-f86f-46dd-bbd9-5f8a3db6cd3f tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/eb1cafca-e070-41af-a32d-03ca1384ccf4" status: 202 len: 0 microversion: 2.1 time: 1.793508 Jul 28 11:29:31.705211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 613/1215] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:29:29 2022] DELETE /compute/v2.1/os-floating-ips/eb1cafca-e070-41af-a32d-03ca1384ccf4 => generated 0 bytes in 1795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:29:31.720687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3174e926-310c-4745-a808-a28cc359eab8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.721427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3174e926-310c-4745-a808-a28cc359eab8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:31.743715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:31.793818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:31.802313 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd6c2cf2-c67f-4c70-b109-87bf9522d08d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1276 microversion: 2.1 time: 0.149991 Jul 28 11:29:31.802895 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 603/1216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:31 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:31.813809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.818633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:31.827306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.827762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.828549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.828987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.848851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3174e926-310c-4745-a808-a28cc359eab8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:31.867538 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3174e926-310c-4745-a808-a28cc359eab8 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1213 microversion: 2.1 time: 0.161133 Jul 28 11:29:31.880797 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 614/1217] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:31 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:31.886256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:31.886885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:31.896639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.897866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:31.898873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:31.899576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.098961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:32.108407 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd7520bc-0aca-4042-98ea-0430a134d0cc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1537 microversion: 2.1 time: 0.301624 Jul 28 11:29:32.108975 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 604/1218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:31 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.115169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76e3812e-2cd9-4673-b8c3-b712bcfafa06 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb27f19d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.150620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:32.177991 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2eae62ab-6737-48e8-9e4e-868137cda6c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.295383 Jul 28 11:29:32.180076 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 615/1219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:31 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.192088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76e3812e-2cd9-4673-b8c3-b712bcfafa06 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1466 microversion: 2.1 time: 0.080213 Jul 28 11:29:32.193033 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 605/1220] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2F2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1466 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.201269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.204531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:32.213912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37fe440c-52d2-45ca-92fa-4d74416ffac8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2838550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.215224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.215938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.216915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.217357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.250558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:29:32.423603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37fe440c-52d2-45ca-92fa-4d74416ffac8 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.215595 Jul 28 11:29:32.425314 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 606/1221] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.442952 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-08cbe285-88b4-49d8-b729-04e4796c196a tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 204 len: 0 microversion: 2.1 time: 0.249927 Jul 28 11:29:32.446361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 616/1222] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:32 2022] DELETE /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:32.453200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c81f5700-1072-4dcb-a75e-759009710f9e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2b98160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.455451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.456170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:32.465081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.465550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.467006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.467696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.562024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c81f5700-1072-4dcb-a75e-759009710f9e tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.113219 Jul 28 11:29:32.566927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 607/1223] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:32.584256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76618d3c-06e6-4daa-b65f-15e2a89307d1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb282caf0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.641251 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76618d3c-06e6-4daa-b65f-15e2a89307d1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e" status: 200 len: 784 microversion: 2.1 time: 0.061782 Jul 28 11:29:32.643056 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 608/1224] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:32.661289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-224afa52-58af-4850-af8b-b5bfaa658c7c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2c0f430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.705252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:32.715246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ce630fb-cfcb-4c2a-922f-0fea6ab5d5ef tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1525 microversion: 2.1 time: 0.263979 Jul 28 11:29:32.715843 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 617/1225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1525 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.795381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-224afa52-58af-4850-af8b-b5bfaa658c7c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.140320 Jul 28 11:29:32.796187 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 609/1226] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:32.812184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce020043-4be2-4cef-ba91-e59f967522fd tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb368a5e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.826228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.827118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:32.834287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.835050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.836053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.836690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.911115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:32.919688 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5015c5f6-84f4-46ae-ae67-6ba7dc5ce421 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1276 microversion: 2.1 time: 0.098262 Jul 28 11:29:32.920278 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 610/1227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:32.927893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:32.929315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:32.943982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.944525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:32.945316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:32.945751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.074786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:33.088562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84971ee0-3211-4a05-bdfd-dc4628316854 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1265 microversion: 2.1 time: 0.167204 Jul 28 11:29:33.096128 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 611/1228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:32 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:33.140978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:33.142770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:33.151850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.152344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.153282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.153789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.447056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:33.469180 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc4456de-fe9f-499a-bd8c-068499dbdc8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1537 microversion: 2.1 time: 0.338867 Jul 28 11:29:33.470555 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 612/1229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:33 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:33.485631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:33.486472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:33.513798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.514762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.515778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.516448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.739466 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce020043-4be2-4cef-ba91-e59f967522fd tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56" status: 204 len: 0 microversion: 2.1 time: 0.931017 Jul 28 11:29:33.741186 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 618/1230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:32 2022] DELETE /compute/v2.1/images/41b93fbd-378e-4bec-8cb8-7dc0020b0d56 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:29:33.750400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:33.751466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:33.758545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.759442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:33.760504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:33.761189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.003942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:34.010535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:34.013009 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b0e2d76-e3aa-4e39-800e-cf0d50757a5e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.539509 Jul 28 11:29:34.014110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 613/1231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:33 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:34.019135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5279a2bc-39aa-429d-a046-20e367644df7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb288ed30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:34.027466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:34.036973 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6039135e-f76a-4c7e-bdf6-2251032f8999 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1525 microversion: 2.1 time: 0.290579 Jul 28 11:29:34.038021 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 619/1232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:33 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1525 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:34.043422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:34.044207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:34.050927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.051551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.052366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.052977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.200649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:34.208797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14ff1400-0b20-4697-b0a6-34f9f0735963 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.169397 Jul 28 11:29:34.209752 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 620/1233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:34 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:34.227535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:34.228684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:34.236628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.237095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.237980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.238425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.260589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:34.312383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:34.321039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f8f31c3-47ba-42db-b5eb-f03dddf99502 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1265 microversion: 2.1 time: 0.109583 Jul 28 11:29:34.322229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 621/1234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:34 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:34.479443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5279a2bc-39aa-429d-a046-20e367644df7 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043" status: 204 len: 0 microversion: 2.1 time: 0.463907 Jul 28 11:29:34.480308 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 614/1235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:34 2022] DELETE /compute/v2.1/images/2df04a7f-964d-430c-b98b-f3d547292043 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:34.488246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72b5acdb-8be5-4bcf-8438-37a1ba69595a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb325e4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:34.493801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:34.494488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:34.502908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.503397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.504234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:34.504644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:34.792331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:34.801074 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e26c5bc2-2f93-4c30-8201-f7c2884c81e0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1537 microversion: 2.1 time: 0.312033 Jul 28 11:29:34.815582 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 615/1236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:34 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:35.039499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:35.040048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:35.052559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.053197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.053964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.054703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.309143 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72b5acdb-8be5-4bcf-8438-37a1ba69595a tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b" status: 204 len: 0 microversion: 2.1 time: 0.824062 Jul 28 11:29:35.310392 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 622/1237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:34 2022] DELETE /compute/v2.1/images/7f5f3b09-2f16-4f45-a395-1ea8491bbd6b => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:35.318397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:35.320386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:35.330573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.332458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.334125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.339986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.500832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:35.509432 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6479fd3d-b9f7-4cd0-b976-c833481b492d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.476050 Jul 28 11:29:35.522880 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 616/1238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:35 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:35.528372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-44548c97-73e2-403f-89bd-5f397c4bb865 req-b4148bb2-6233-4c0f-adca-dc0b22017faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc2740-1b0d-43c0-995f-c853a755ec17", "name": "network-vif-plugged", "status": "completed", "tag": "7f9c885e-4294-4164-8773-322c6daaacc9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:35.534697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:35.539124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-44548c97-73e2-403f-89bd-5f397c4bb865 req-b4148bb2-6233-4c0f-adca-dc0b22017faa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.539770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-44548c97-73e2-403f-89bd-5f397c4bb865 req-b4148bb2-6233-4c0f-adca-dc0b22017faa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.551759 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-44548c97-73e2-403f-89bd-5f397c4bb865 req-b4148bb2-6233-4c0f-adca-dc0b22017faa service nova] Creating event network-vif-plugged:7f9c885e-4294-4164-8773-322c6daaacc9 for instance bbcc2740-1b0d-43c0-995f-c853a755ec17 on n-h2-851368-1 Jul 28 11:29:35.557990 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-44548c97-73e2-403f-89bd-5f397c4bb865 req-b4148bb2-6233-4c0f-adca-dc0b22017faa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033490 Jul 28 11:29:35.559265 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 617/1239] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:35.565255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:35.566154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:35.573171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.573828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:35.574773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:35.575423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.156453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:36.172413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ee6b770-fa12-475e-97a9-64ca7a8114f7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1525 microversion: 2.1 time: 0.860365 Jul 28 11:29:36.173738 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 623/1240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:35 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1525 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:36.181942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:36.183984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:36.194872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.195562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.196587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.197226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.236044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:36.244132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8076e5f-6247-4406-87a2-38e2dbef4e5a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.683511 Jul 28 11:29:36.247495 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 618/1241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:35 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:36.259735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:29:36.262118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:36.263448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:36.271527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.275210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.277638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.278328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.431981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:36.442574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e792ce8a-5e59-4008-8214-cbb465013ce1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1271 microversion: 2.1 time: 0.193842 Jul 28 11:29:36.444621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 619/1242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:36 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:36.454335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:36.462921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:36.469898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.470705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.473009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.475689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.510422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-650dcb54-0cb7-4d5a-933b-5aa5fc102ac0 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 204 len: 0 microversion: 2.1 time: 0.334969 Jul 28 11:29:36.512031 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 624/1243] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:36 2022] DELETE /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:36.521654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:36.524113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:36.540191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.540559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.541350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.541792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.894045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:36.901938 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f348ee5-abe7-4a3c-96fc-e6ee71b2cf26 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1519 microversion: 2.1 time: 0.456022 Jul 28 11:29:36.906228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 620/1244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:36 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:36.923890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:36.924795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:36.932059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.932772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:36.933787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:36.934399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.001630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:37.018500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-165c6846-b209-46e6-8a31-329d22588294 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1473 microversion: 2.1 time: 0.498667 Jul 28 11:29:37.031106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 625/1245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:36 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1473 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:37.036036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fd48570b-222c-4bc6-8735-028df87962cb req-ed8d8fcd-2ce5-41b2-aaa0-1aa19237d051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbf0cf9-62c9-42f2-b40f-c216fb393b32", "name": "network-vif-deleted", "tag": "c20d98c0-fd38-4fd6-83eb-aa6282404ac2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:37.059157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd48570b-222c-4bc6-8735-028df87962cb req-ed8d8fcd-2ce5-41b2-aaa0-1aa19237d051 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.061610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd48570b-222c-4bc6-8735-028df87962cb req-ed8d8fcd-2ce5-41b2-aaa0-1aa19237d051 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.108104 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fd48570b-222c-4bc6-8735-028df87962cb req-ed8d8fcd-2ce5-41b2-aaa0-1aa19237d051 service nova] Creating event network-vif-deleted:c20d98c0-fd38-4fd6-83eb-aa6282404ac2 for instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 on n-h2-851368-1 Jul 28 11:29:37.122883 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fd48570b-222c-4bc6-8735-028df87962cb req-ed8d8fcd-2ce5-41b2-aaa0-1aa19237d051 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097399 Jul 28 11:29:37.129980 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 626/1246] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:37.141970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:37.143031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:37.165795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.171587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.172579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.173149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.243123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:29:37.437247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-adc6c0af-ccfa-4a4c-81ee-b860b4ccc051 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 204 len: 0 microversion: 2.1 time: 0.299257 Jul 28 11:29:37.441546 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 627/1247] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:37 2022] DELETE /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:37.447110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:37.447811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:37.464072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.465089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.466360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.466815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.494905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:37.502924 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa332e77-6a8c-4a53-b558-68a988a2bc19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.595412 Jul 28 11:29:37.509484 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 621/1248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:36 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:37.520866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:37.521497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:37.534243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.535053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.535646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lazy-loading 'fault' on Instance uuid 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:37.541496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.541970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.542801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.543454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.605473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:37.618717 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67b6d552-44f0-4822-8263-fe222d18c4d9 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1313 microversion: 2.1 time: 0.175824 Jul 28 11:29:37.631137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 628/1249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:37 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:37.631137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-89ed33f7-8d65-4dc9-a058-1d8718273a3d req-bfeb7c44-8613-4c20-bb30-e38691823e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9740f5b7-e39a-4690-b748-715b4f068524", "tag": "40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:37.638541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-89ed33f7-8d65-4dc9-a058-1d8718273a3d req-bfeb7c44-8613-4c20-bb30-e38691823e72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.639379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-89ed33f7-8d65-4dc9-a058-1d8718273a3d req-bfeb7c44-8613-4c20-bb30-e38691823e72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.660139 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-89ed33f7-8d65-4dc9-a058-1d8718273a3d req-bfeb7c44-8613-4c20-bb30-e38691823e72 service nova] Creating event network-changed:40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9 for instance 9740f5b7-e39a-4690-b748-715b4f068524 on n-h1-851368-1 Jul 28 11:29:37.667240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-89ed33f7-8d65-4dc9-a058-1d8718273a3d req-bfeb7c44-8613-4c20-bb30-e38691823e72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045870 Jul 28 11:29:37.668089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 629/1250] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:37.674472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:37.675614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:37.682689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.683361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.684984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.687010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.918934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:37.932209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-18e8bff3-78a5-4b54-87b8-bf3c4ae97a41 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.420370 Jul 28 11:29:37.933922 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 622/1251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:37 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:37.939356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:37.940126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:37.948828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.949279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.950379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:37.950979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:37.966074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:37.980802 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa385470-8e4e-4bb2-bd72-4147e154420e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1525 microversion: 2.1 time: 0.311496 Jul 28 11:29:37.996350 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 630/1252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:37 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1525 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:38.044728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:38.045505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:38.055986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.057445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.059349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.063524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.203645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:38.212418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be4656d7-1ae3-4237-bffd-e4ed2a91b865 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.277428 Jul 28 11:29:38.223820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 623/1253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:37 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:38.265742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-166abb0e-87bd-4ce1-8fca-fb5816eadf39 req-d4e1db96-672a-40e6-90e5-ecb64fca9c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "name": "network-vif-plugged", "status": "completed", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:38.281369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-166abb0e-87bd-4ce1-8fca-fb5816eadf39 req-d4e1db96-672a-40e6-90e5-ecb64fca9c8c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.281823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-166abb0e-87bd-4ce1-8fca-fb5816eadf39 req-d4e1db96-672a-40e6-90e5-ecb64fca9c8c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.298340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-166abb0e-87bd-4ce1-8fca-fb5816eadf39 req-d4e1db96-672a-40e6-90e5-ecb64fca9c8c service nova] Creating event network-vif-plugged:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:29:38.305293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-166abb0e-87bd-4ce1-8fca-fb5816eadf39 req-d4e1db96-672a-40e6-90e5-ecb64fca9c8c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043107 Jul 28 11:29:38.306195 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 624/1254] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:38.312585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:38.321213 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee6ef04c-f270-410d-90a8-de5a6a87d3a1 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1473 microversion: 2.1 time: 0.281338 Jul 28 11:29:38.322107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 631/1255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:38 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:38.530889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:38.531745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:38.538126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.538658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.539536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.540105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.641972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:38.642742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:38.650109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.650581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.651421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.651980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.682009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:38.686742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.687212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.687665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lazy-loading 'fault' on Instance uuid 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:38.690964 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f18b640-6c82-4b56-8296-568a2b562233 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.164423 Jul 28 11:29:38.691817 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 625/1256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:38 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:38.733852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4a96d2d92446baa9795668f555ae5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f5ee2d77c24a0793c7b8dfe861c8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:38.744283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41d3aa6c-e71a-4d56-9384-f0ece19b3e26 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 200 len: 1313 microversion: 2.1 time: 0.106438 Jul 28 11:29:38.745050 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 632/1257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:38 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 1313 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:38.953697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:38.955102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:38.962580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.963064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:38.963870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:38.964486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.002550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:39.003396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:39.015115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.015710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.016604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.017250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.053827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=9 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:39.258235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:39.276062 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f7a932c-a4b7-475b-b3ac-93925d76dd0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.325603 Jul 28 11:29:39.287177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 626/1258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:38 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:39.287177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:39.287177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:39.297902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.299006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.300022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.300671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.322418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:39.336794 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56dc03a6-7609-4e31-818d-741fb4bef8d3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1525 microversion: 2.1 time: 0.336412 Jul 28 11:29:39.339325 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 633/1259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:38 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1525 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:39.363240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:39.364066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:39.379850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.380522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.382045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.383310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.509758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:39.517985 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d37e5889-2661-4170-9f4b-ac0d7e33f20d tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1431 microversion: 2.1 time: 0.162550 Jul 28 11:29:39.520261 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 634/1260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:39 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1431 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:39.686776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96fa3a16-e75f-4867-99ec-2f1666e66fbb", "tag": "ea211130-4770-46fd-a1c2-05084c85eda1"}, {"server_uuid": "2ffe02a6-d004-4892-b66a-5ec170b6b039", "name": "network-vif-deleted", "tag": "4cd77d76-1baf-42eb-82a8-7cad5959f74a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:39.697937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.698405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.709161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:39.717815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3220016-09d5-421b-8612-c22d8b981cee tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.438678 Jul 28 11:29:39.718632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 627/1261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:39 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:39.720930 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] Creating event network-changed:ea211130-4770-46fd-a1c2-05084c85eda1 for instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb on n-h1-851368-1 Jul 28 11:29:39.721443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] Creating event network-vif-deleted:4cd77d76-1baf-42eb-82a8-7cad5959f74a for instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 on n-h1-851368-1 Jul 28 11:29:39.733746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-582a2137-2593-444d-81c9-6114ad6f2616 req-df808505-e82b-49f7-bc3b-8e8a69411f0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050666 Jul 28 11:29:39.734532 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 635/1262] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:39.737480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:39.738130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:39.745520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.745975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.747098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.747631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.768973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:39.769826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] [instance: 4bbf0cf9-62c9-42f2-b40f-c216fb393b32] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:39.779334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.779794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.780981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:39.781424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:39.796220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] HTTP exception thrown: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Request method failure captured: Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 HTTP/1.1 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nLNdshGa5Wp2xqT4ZMJFaP7jNSqSQH-pDQwRAht1cNiBkjpul8HuUY8TZM-qXW2ry4yw15RnwM_zTuy3KLZ5InKMRk4UvAI0Y3RkCdcVszalUevgm4N9UEn43t_eQYO4TR9m6mVUjFaBpA5jt5bB1W0xvCkYKAaR9ayhPFeLqNMFHo Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:39.797951 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_96f5ee2d77c24a0793c7b8dfe861c8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/96f5ee2d77c24a0793c7b8dfe861c8f0"}]}] Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 96f5ee2d77c24a0793c7b8dfe861c8f0 Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629852503 Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2d4a96d2d92446baa9795668f555ae5f Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629852503-project Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. Jul 28 11:29:39.799590 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '4bbf0cf9-62c9-42f2-b40f-c216fb393b32'} Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:39.804537 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. Jul 28 11:29:39.805851 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:39.807009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] Returning 404 to user: Instance 4bbf0cf9-62c9-42f2-b40f-c216fb393b32 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:39.807009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-485e75a0-d5d4-4d85-a54d-dc92edf17dd7 tempest-FloatingIPsAssociationTestJSON-629852503 tempest-FloatingIPsAssociationTestJSON-629852503-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32" status: 404 len: 111 microversion: 2.1 time: 0.037843 Jul 28 11:29:39.807009 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 636/1263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:39 2022] GET /compute/v2.1/servers/4bbf0cf9-62c9-42f2-b40f-c216fb393b32 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:29:40.060987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:40.074465 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5662b327-2575-4213-83a2-c5c0715ec7da tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.351285 Jul 28 11:29:40.079134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 628/1264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:39 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:40.298383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:40.298969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:40.309307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.311350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.313066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.314167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.323055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e6b8c593-9057-42c9-a07c-404978319795 req-6dd579bd-89f2-491f-be5c-4e24bb11b950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc2740-1b0d-43c0-995f-c853a755ec17", "name": "network-vif-unplugged", "status": "completed", "tag": "7f9c885e-4294-4164-8773-322c6daaacc9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:40.334863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e6b8c593-9057-42c9-a07c-404978319795 req-6dd579bd-89f2-491f-be5c-4e24bb11b950 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.335796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e6b8c593-9057-42c9-a07c-404978319795 req-6dd579bd-89f2-491f-be5c-4e24bb11b950 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.350907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e6b8c593-9057-42c9-a07c-404978319795 req-6dd579bd-89f2-491f-be5c-4e24bb11b950 service nova] Creating event network-vif-unplugged:7f9c885e-4294-4164-8773-322c6daaacc9 for instance bbcc2740-1b0d-43c0-995f-c853a755ec17 on n-h2-851368-1 Jul 28 11:29:40.358381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e6b8c593-9057-42c9-a07c-404978319795 req-6dd579bd-89f2-491f-be5c-4e24bb11b950 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042886 Jul 28 11:29:40.359703 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 629/1265] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:29:40.366191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:40.367131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:40.383278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.383759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.389531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.391575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.543246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:40.554960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-823bbbec-d0a0-440c-b334-6e8f2a677c81 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 200 len: 1483 microversion: 2.1 time: 0.193611 Jul 28 11:29:40.555507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 630/1266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:40 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 1483 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:40.563941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e709e67a-eb2c-4dd1-9b6f-89d86411ce0f req-d8b3afcf-1ae8-4bf6-8a89-0e377175eaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc2740-1b0d-43c0-995f-c853a755ec17", "name": "network-vif-deleted", "tag": "7f9c885e-4294-4164-8773-322c6daaacc9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:40.590762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e709e67a-eb2c-4dd1-9b6f-89d86411ce0f req-d8b3afcf-1ae8-4bf6-8a89-0e377175eaf7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.591247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e709e67a-eb2c-4dd1-9b6f-89d86411ce0f req-d8b3afcf-1ae8-4bf6-8a89-0e377175eaf7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.610889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e709e67a-eb2c-4dd1-9b6f-89d86411ce0f req-d8b3afcf-1ae8-4bf6-8a89-0e377175eaf7 service nova] Creating event network-vif-deleted:7f9c885e-4294-4164-8773-322c6daaacc9 for instance bbcc2740-1b0d-43c0-995f-c853a755ec17 on n-h2-851368-1 Jul 28 11:29:40.623507 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e709e67a-eb2c-4dd1-9b6f-89d86411ce0f req-d8b3afcf-1ae8-4bf6-8a89-0e377175eaf7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063010 Jul 28 11:29:40.624143 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 631/1267] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:40.629398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:40.630108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:40.649005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.651715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.652742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.653174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.688799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:40.697603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:40.702953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1e39cb5-d5a4-4664-b055-ea8e3db8f72d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.408572 Jul 28 11:29:40.717322 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 637/1268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:40 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:40.740125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:40.741488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:40.754710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.757507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.758375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:40.758888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:40.781243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:40.805148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be620126-5fcd-4efa-9224-0bd88e2bcf0f tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1302 microversion: 2.1 time: 0.179439 Jul 28 11:29:40.805668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 632/1269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:40 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1302 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:40.978573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:40.987778 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b71cd88-7535-4952-b77d-f9883fef5f2f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.251685 Jul 28 11:29:40.988677 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 638/1270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:40 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:41.096460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:41.097083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:41.120730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.121373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.122323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.122928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.123711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:41.146385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:41.362996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:41.372057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48bfbb83-0291-4112-9d52-26ee4f96aa1b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.279884 Jul 28 11:29:41.372737 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 633/1271] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:41 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:41.575725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:41.576259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:41.583437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.583884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.585189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.585629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.599795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 HTTP/1.1 Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:41.602162 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:29:41.603861 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17'} Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:41.604718 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:29:41.605934 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:41.607036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:41.607036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14c12722-11f1-40ff-ab1a-3643744e699e tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 404 len: 111 microversion: 2.1 time: 0.032132 Jul 28 11:29:41.607036 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 639/1272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:41 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:41.616627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5090f0a8-0fbb-40a1-ac1f-5bd155d744c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'create', calling method: .version_select at 0x7f2eb2836790>, body: {"keypair": {"name": "tempest-keypair-314336467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDAEyV0hDLbxe5VhAjfp3pZI7gphvjVxrdsZkrHA7lx+C3xEZWNKZj1LN3xgMABgK4zQ7OWGAVBwIiG4ltsaPeI977PaHPjaGP6YIDXDJMKCcTpG2qfzP1A1wUGPdRbuQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:41.633808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5090f0a8-0fbb-40a1-ac1f-5bd155d744c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for project 926026a387b041dbbb68332685f6884c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:41.638171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5090f0a8-0fbb-40a1-ac1f-5bd155d744c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for user 5df53556867f4caca1b5a531835db23b and project 926026a387b041dbbb68332685f6884c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:41.661580 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5090f0a8-0fbb-40a1-ac1f-5bd155d744c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048800 Jul 28 11:29:41.662218 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 634/1273] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:29:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:41.726649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:41.728121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:41.735974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.736607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.737554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.739504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.826540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:41.827673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:41.853389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=32 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:41.860273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.864078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.865084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:41.865548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:41.871527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:41.953445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:41.986235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8e7e420-1c35-428a-8566-9336a35761ca tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1302 microversion: 2.1 time: 0.164150 Jul 28 11:29:41.986858 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 635/1274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:41 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:42.010666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:42.011469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:42.020922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:42.021137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:42.021481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:42.022339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:42.022783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:42.031111 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a27eb96b-3596-4ea6-820d-dbad07befde9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.309934 Jul 28 11:29:42.044469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 640/1275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:41 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:42.181877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:42.194888 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc2b7243-51f1-48fe-8ccf-77def51174e2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.188682 Jul 28 11:29:42.196101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 636/1276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:42 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:42.392804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:42.393689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:42.401763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:42.402226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:42.403013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:42.403931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:42.651851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-16a63908-0809-4c6b-a74d-328629c7a8c6 req-946cf433-b5bd-4a57-b8c4-02bcc1aaedf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:42.657870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:42.667036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0a66975a-cd4e-4ea3-abe8-61fc6d4fde80 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1316 microversion: 2.1 time: 0.277995 Jul 28 11:29:42.672997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-16a63908-0809-4c6b-a74d-328629c7a8c6 req-946cf433-b5bd-4a57-b8c4-02bcc1aaedf4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:42.673469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-16a63908-0809-4c6b-a74d-328629c7a8c6 req-946cf433-b5bd-4a57-b8c4-02bcc1aaedf4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:42.685141 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 641/1277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:42 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:42.689392 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-16a63908-0809-4c6b-a74d-328629c7a8c6 req-946cf433-b5bd-4a57-b8c4-02bcc1aaedf4 service nova] Creating event network-changed:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:29:42.702848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-16a63908-0809-4c6b-a74d-328629c7a8c6 req-946cf433-b5bd-4a57-b8c4-02bcc1aaedf4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054541 Jul 28 11:29:42.703981 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 637/1278] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:29:43.009952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:43.012765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:43.019479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.019935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.020731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.021173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.056892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:43.057904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:43.068277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.069032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.070057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.070646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.072130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.072665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.073262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lazy-loading 'fault' on Instance uuid 2ffe02a6-d004-4892-b66a-5ec170b6b039 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:43.175495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:43.183291 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-459ef4ea-3205-4f3a-a78e-3cf82b4f9c64 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 200 len: 1307 microversion: 2.1 time: 0.178106 Jul 28 11:29:43.198436 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 642/1279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:43 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 1307 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:43.218733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:43.219691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:43.243681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.244354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.245348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.245824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.950207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:43.960459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55d51476-0f51-45e9-ba67-9850e1c20d2e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.912058 Jul 28 11:29:43.973179 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 638/1280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:43 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:43.973179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:43.973179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:43.977328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.977824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:43.979026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:43.979642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.010117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:44.020677 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d12c941-9031-49fa-b3bf-053d131f3d8a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.806747 Jul 28 11:29:44.021854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 643/1281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:43 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:44.205106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:44.205644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 2ffe02a6-d004-4892-b66a-5ec170b6b039] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:44.212410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.212880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.213964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.214650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.236723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] HTTP exception thrown: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Request method failure captured: Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 HTTP/1.1 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKQ9of9FwqFI0H4TDhBNw9ZhRJJqv5VBmtZQvOJyl2YJdguDdJN0H2lKQvtLbM3cR9yM4LjxJMt8rX-t3PAA7gd0NZmT-RFS4KQ3TlJXaOUkk-VCRCZF7F5-dDh7q2K-z7k3za1peMBCFJ94rTB_wYzN6XHSLifHF37CY2_bwdhvU4 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: b13821299b7647b6b6d508fa1c1bfd07 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:44.239366 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b13821299b7647b6b6d508fa1c1bfd07"}]}] Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: b13821299b7647b6b6d508fa1c1bfd07 Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListImageFiltersTestJSON-1641513646-project Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c2681b19d364fa69126e05da24c4bac Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListImageFiltersTestJSON-1641513646-project Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. Jul 28 11:29:44.241492 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '2ffe02a6-d004-4892-b66a-5ec170b6b039'} Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:44.242540 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. Jul 28 11:29:44.244024 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:44.245304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Returning 404 to user: Instance 2ffe02a6-d004-4892-b66a-5ec170b6b039 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:44.245304 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3ae5f2b-c6ac-4fc6-9c5f-2ae9b9cc9e3c tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039" status: 404 len: 111 microversion: 2.1 time: 0.042995 Jul 28 11:29:44.248985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 644/1282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:44 2022] GET /compute/v2.1/servers/2ffe02a6-d004-4892-b66a-5ec170b6b039 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:29:44.254050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:44.254567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:44.261532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.261999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.262792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.263264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.281753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:44.291447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5a49c54-76f2-4515-bc00-ed29bbeac78c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.328921 Jul 28 11:29:44.301033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:29:44.307935 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 639/1283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:43 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:44.389106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-492571071", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:44.429831 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be71c519-f74c-4b13-8a0d-ff0b68f9d466 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 204 len: 0 microversion: 2.1 time: 0.177726 Jul 28 11:29:44.432983 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 645/1284] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:29:44 2022] DELETE /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:29:44.444819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:44.445976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:44.455648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.456355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.457666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.458278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.477671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] validate_networks() for [('ddfecbec-84cc-466e-9a74-32188ed83a6b', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:44.862674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:44.872455 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8155ed86-9b11-4aba-8983-244be81072c5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1474 microversion: 2.1 time: 0.433811 Jul 28 11:29:44.887704 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 646/1285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:44 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1474 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:44.981174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:44.981979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:44.989327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.989978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:44.992166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:44.992772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:45.256297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:45.272404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b47c10b-a370-4bfd-a6df-16b4f11a7459 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.294657 Jul 28 11:29:45.283621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 647/1286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:44 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:45.298631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1668812027", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:45.317202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:29:45.318170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:29:45.318850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:29:45.319454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:29:45.320075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:29:45.338474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:45.339225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:45.340248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:45.344281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:45.370439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Getting quotas for project c3e3111f193244edbdb62d786409040a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:45.380668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Getting quotas for user dccf1445753846ac929d677614481e5f and project c3e3111f193244edbdb62d786409040a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:45.392950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] validate_networks() for [('8af4ed4a-dd6c-4e12-9a63-a2b3a5666ea8', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:45.401748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:29:45.404297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:45.460104 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb6b8884-8215-4c92-b46f-3fd317141db9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073907 Jul 28 11:29:45.461076 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 640/1287] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:29:45.465929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:45.467062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:45.475463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:45.476242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:45.477238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:45.477849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:45.835528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:45.843753 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bab47a44-be96-4a64-9f27-2c371455c8dc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.381631 Jul 28 11:29:45.857550 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 641/1288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:45 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:45.862710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-52776b17-f6e3-42ad-a5ff-10179a19b306 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:45.869897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-52776b17-f6e3-42ad-a5ff-10179a19b306 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:45.974373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-52776b17-f6e3-42ad-a5ff-10179a19b306 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:45.993477 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-52776b17-f6e3-42ad-a5ff-10179a19b306 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1216 microversion: 2.1 time: 0.126019 Jul 28 11:29:46.008473 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 642/1289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:45 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:46.013506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:46.014142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.027782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.031035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.031971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.032447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.378183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:29:46.378685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:29:46.379089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:29:46.379506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:29:46.379918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:29:46.391043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.391868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.392910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.393508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.398937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:46.410149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d64aa96d-6cde-455f-8ba3-caafa543de33 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1474 microversion: 2.1 time: 0.400534 Jul 28 11:29:46.412014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:46.415840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:46.418807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for user 5df53556867f4caca1b5a531835db23b and project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:46.420652 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 643/1290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:46 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:46.430377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:46.432384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.445921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.446879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.447579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:29:46.449184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.450049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.451411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:29:46.524006 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-762c102f-2ba3-4ffa-9a49-db48c088094d tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.238914 Jul 28 11:29:46.525018 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 648/1291] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:29:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:29:46.529972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:46.530858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.538396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.538851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.539806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.540250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.827288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:46.855535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3215bdd-298f-4f55-af17-d31b72e4dba8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 2423 microversion: 2.25 time: 0.433351 Jul 28 11:29:46.856259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 644/1292] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:46 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 2423 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:46.861126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3aa85f81-743d-4a70-965f-d84ee397ea5a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:46.861743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3aa85f81-743d-4a70-965f-d84ee397ea5a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.884860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:46.893002 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b92f013-9456-454c-a66b-a487b446d54e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.366939 Jul 28 11:29:46.893570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 649/1293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:46 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:46.898769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ff2a9599-5ef1-4ac1-863c-06644aa1e627 req-a3296a37-072d-40d1-a094-7d6fd119379f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96fa3a16-e75f-4867-99ec-2f1666e66fbb", "name": "network-vif-plugged", "status": "completed", "tag": "ea211130-4770-46fd-a1c2-05084c85eda1"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:46.909109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ff2a9599-5ef1-4ac1-863c-06644aa1e627 req-a3296a37-072d-40d1-a094-7d6fd119379f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.909821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ff2a9599-5ef1-4ac1-863c-06644aa1e627 req-a3296a37-072d-40d1-a094-7d6fd119379f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.922737 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ff2a9599-5ef1-4ac1-863c-06644aa1e627 req-a3296a37-072d-40d1-a094-7d6fd119379f service nova] Creating event network-vif-plugged:ea211130-4770-46fd-a1c2-05084c85eda1 for instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb on n-h1-851368-1 Jul 28 11:29:46.928813 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ff2a9599-5ef1-4ac1-863c-06644aa1e627 req-a3296a37-072d-40d1-a094-7d6fd119379f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Jul 28 11:29:46.930154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 650/1294] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:46.936556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:46.937249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.945326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3aa85f81-743d-4a70-965f-d84ee397ea5a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:46.945535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.946052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.946843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.947489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.956427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3aa85f81-743d-4a70-965f-d84ee397ea5a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1225 microversion: 2.1 time: 0.099067 Jul 28 11:29:46.957282 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 645/1295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:46 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:46.964524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": "auto"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:46.987813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:46.996354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.997346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:46.998476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:46.999260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.036294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'flavor' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:47.051598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Going to try to live migrate instance to n-h1-851368-1 {{(pid=119236) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:29:47.166783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:47.175742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df7412fe-8a39-494c-bf30-e55ce58c4026 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.244243 Jul 28 11:29:47.176369 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 651/1296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:46 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:47.345150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] Calling method '.version_select at 0x7f2eb3331c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:47.359222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.359678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.360511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.360951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.397274 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec592cbd-0061-40c7-a4b6-d0fab0b39850 tempest-AbsoluteLimitsTestJSON-1434652785 tempest-AbsoluteLimitsTestJSON-1434652785-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.219757 Jul 28 11:29:47.397942 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 652/1297] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Jul 28 11:29:47 2022] GET /compute/v2.1/limits => generated 511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:47.402970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:47.403884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:47.419482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.424940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.426038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.427450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.528331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:47.536928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5bb339f5-4787-444b-8cd7-6dc6dd62462b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1220 microversion: 2.1 time: 0.137748 Jul 28 11:29:47.537716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 653/1298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:47 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:47.542691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:47.543545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:47.557670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.558912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.559977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.560312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.746215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:47.755116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad70b059-959b-4649-84c1-e01eddfecdb5 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1474 microversion: 2.1 time: 0.216383 Jul 28 11:29:47.756008 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 654/1299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:47 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1474 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:47.914858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:47.915730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:47.935388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.935882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:47.936735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:47.937236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.122146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:48.126692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:48.131927 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3006dc18-d377-466d-be07-3155f991db35 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.221893 Jul 28 11:29:48.132659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 655/1300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:47 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:48.137548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:48.138351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:48.166222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.166917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.168171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.168619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.239314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:48.247518 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-533b60e7-5877-4ab0-a2ff-31bca9b9607b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1277 microversion: 2.1 time: 0.113508 Jul 28 11:29:48.259808 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 656/1301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:48 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:48.266269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:48.268191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:48.275719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.276183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.277135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.277592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.468636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:48.477017 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b683696-065e-4541-8053-7b71058119ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.220665 Jul 28 11:29:48.477820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 657/1302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:48 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:48.560717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:48.561257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:48.571830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.572844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.573896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.574668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.773095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:48.785681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aefe2e98-a01b-44f3-8149-7cf0b97cbf8e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1268 microversion: 2.1 time: 0.229257 Jul 28 11:29:48.786302 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 658/1303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:48 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:48.807888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:48.808790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:48.820969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.821851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:48.822999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:48.823969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.653945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:49.664606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd4e059c-19e9-46a3-a20a-5868b1d6f222 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1474 microversion: 2.1 time: 0.862861 Jul 28 11:29:49.665889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6108af4b-d6fe-4906-91e7-4c76da3f0032 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/action" status: 202 len: 0 microversion: 2.25 time: 2.707273 Jul 28 11:29:49.666424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 659/1304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:48 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1474 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:49.670554 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 646/1305] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:29:46 2022] POST /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/action => generated 0 bytes in 2713 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:49.678816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:49.681625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:49.682732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-33db1399-50f8-4da1-a7a7-61d0374436e0 req-c92c77d7-9b3d-4852-9f7c-de4adea01e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-plugged", "status": "completed", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:49.693584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:49.694338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.695521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:49.696184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.702542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-33db1399-50f8-4da1-a7a7-61d0374436e0 req-c92c77d7-9b3d-4852-9f7c-de4adea01e5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:49.703923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-33db1399-50f8-4da1-a7a7-61d0374436e0 req-c92c77d7-9b3d-4852-9f7c-de4adea01e5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.728422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-33db1399-50f8-4da1-a7a7-61d0374436e0 req-c92c77d7-9b3d-4852-9f7c-de4adea01e5a service nova] Creating event network-vif-plugged:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:29:49.735992 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-33db1399-50f8-4da1-a7a7-61d0374436e0 req-c92c77d7-9b3d-4852-9f7c-de4adea01e5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067614 Jul 28 11:29:49.745494 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 660/1306] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:49.755289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:49.756505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:49.764965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:49.765881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.766945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:49.768208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:49.945651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:49.958095 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f215c69c-94c8-4cd3-819f-f2da35c8d797 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1283 microversion: 2.1 time: 0.210784 Jul 28 11:29:49.958944 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 661/1307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:49 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:50.130534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Calling method '.version_select at 0x7f2eb325c160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:50.144817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.145514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.146524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.147739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.168328 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0085d16-aaac-4fa5-b986-913bdd96225a tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.195593 Jul 28 11:29:50.169169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 662/1308] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Jul 28 11:29:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:50.183462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:50.183462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:50.187211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.187753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.188619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.189367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.291357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:50.301303 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a530f028-ef08-42db-b7ad-5a64c8fca0e4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.627738 Jul 28 11:29:50.315603 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 647/1309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:49 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:50.321694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:50.322321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:50.328894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.329351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.330322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.331153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.643121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:50.650806 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee20e7bd-7085-4339-ab9d-e3dfd163dbd2 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.478531 Jul 28 11:29:50.651417 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 663/1310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:50 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:50.659852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:50.663960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:50.684148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:50.694219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:50.696161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.697010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.697811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:50.702197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:50.705756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:50.707318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6148c3a9-4529-45df-bde2-3f8e567735ec tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.389926 Jul 28 11:29:50.729930 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 648/1311] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:50 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:50.741565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1965456064", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:50.877696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:29:51.005582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:51.016746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51e93d9b-3682-41ca-8fc7-12c8d891ef45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.359410 Jul 28 11:29:51.017854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 664/1312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:50 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:51.024048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7b2f6c87-ef7d-4c2c-a4d8-28f0d54f4f17 req-ee66db7b-745d-41e1-a5eb-5009f8df450f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1201727c-05e5-477b-b618-c8a0fbb4894e", "name": "network-vif-deleted", "tag": "42d74b9c-3982-4eb5-ac93-e6182a10e7ff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:51.035130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7b2f6c87-ef7d-4c2c-a4d8-28f0d54f4f17 req-ee66db7b-745d-41e1-a5eb-5009f8df450f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.035833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7b2f6c87-ef7d-4c2c-a4d8-28f0d54f4f17 req-ee66db7b-745d-41e1-a5eb-5009f8df450f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.054569 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7b2f6c87-ef7d-4c2c-a4d8-28f0d54f4f17 req-ee66db7b-745d-41e1-a5eb-5009f8df450f service nova] Creating event network-vif-deleted:42d74b9c-3982-4eb5-ac93-e6182a10e7ff for instance 1201727c-05e5-477b-b618-c8a0fbb4894e on n-h2-851368-1 Jul 28 11:29:51.061078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7b2f6c87-ef7d-4c2c-a4d8-28f0d54f4f17 req-ee66db7b-745d-41e1-a5eb-5009f8df450f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041771 Jul 28 11:29:51.062206 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 665/1313] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:51.070646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:51.071553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:51.080122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.080589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.081454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.082238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.220246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:51.233612 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c5c94c1-57f3-4341-8879-4c5f6e7b14ae tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1303 microversion: 2.1 time: 0.168529 Jul 28 11:29:51.234338 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 666/1314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:51 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:51.248198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:51.248786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:51.256777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.257426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.258318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.259298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.384456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Getting quotas for project 42dc9a303dea4361ae2bca38810b7989. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:29:51.389382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Getting quotas for user e3adbdd5072b4f15bb6e83bd6723e01e and project 42dc9a303dea4361ae2bca38810b7989. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:29:51.392017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:51.430107 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Request method failure captured: Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 1752 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMtpGeLa2-aIglH-g9zu_Dw1QC6dl3Yj35BN0WX3h8hQOaw1eNwMQiW16m9C1wxIRj6AjtBtLIgRsAlpqK_H27cz4EHli4RzDPswWeTrI-N6uYXURlzwnIIXMnmsf9aOHDqHwM4iF4_g9WseGObnxZyWiTADZftYIpSaonVEmVsnqM Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 42dc9a303dea4361ae2bca38810b7989 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-756243229 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42dc9a303dea4361ae2bca38810b7989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/42dc9a303dea4361ae2bca38810b7989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_42dc9a303dea4361ae2bca38810b7989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42dc9a303dea4361ae2bca38810b7989"}]}] Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-756243229 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 42dc9a303dea4361ae2bca38810b7989 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-756243229 Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-756243229-project Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e3adbdd5072b4f15bb6e83bd6723e01e Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-756243229-project Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1965456064", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:29:51.433412 n-d-851368-1 devstack@n-api.service[119236]: exception: Maximum number of metadata items exceeds 128 Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1965456064', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 465, in _check_metadata_properties_quota Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1670, in _create_instance Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 472, in _check_metadata_properties_quota Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:51.436952 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:51.441262 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-475e3e90-a304-4162-be39-6fe26e9aa4cd tempest-AbsoluteLimitsNegativeTestJSON-756243229 tempest-AbsoluteLimitsNegativeTestJSON-756243229-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.704008 Jul 28 11:29:51.443296 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 649/1315] 10.222.0.93 () {60 vars in 1148 bytes} [Thu Jul 28 11:29:50 2022] POST /compute/v2.1/servers => generated 87 bytes in 712 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:29:51.449377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:51.450269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:51.458257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.458538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.460033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.460670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.645110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:51.654313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4fca29db-3b97-4bd9-9d4f-fc0e0f64bf8a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.418540 Jul 28 11:29:51.659722 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 667/1316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:51 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:51.672360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:51.673650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:51.703552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.704485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:51.705511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:51.706180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.108969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.126369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.127857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-74b44627-501f-4038-a510-87e127774eca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.683169 Jul 28 11:29:52.129299 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 650/1317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:51 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:52.141106 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f578af7-f132-4ab1-b744-b7a1aa021329 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1313 microversion: 2.1 time: 0.472409 Jul 28 11:29:52.141975 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 668/1318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:51 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:29:52.145981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:52.146620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:52.147870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0412edf8-c515-408c-86dd-ffb73c39ed40 req-65073415-07e8-474d-a0af-59a53d987674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740f5b7-e39a-4690-b748-715b4f068524", "name": "network-vif-plugged", "status": "completed", "tag": "40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:52.158363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.159010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.159713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.163945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.179412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0412edf8-c515-408c-86dd-ffb73c39ed40 req-65073415-07e8-474d-a0af-59a53d987674 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.179938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0412edf8-c515-408c-86dd-ffb73c39ed40 req-65073415-07e8-474d-a0af-59a53d987674 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.203281 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0412edf8-c515-408c-86dd-ffb73c39ed40 req-65073415-07e8-474d-a0af-59a53d987674 service nova] Creating event network-vif-plugged:40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9 for instance 9740f5b7-e39a-4690-b748-715b4f068524 on n-h1-851368-1 Jul 28 11:29:52.212848 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0412edf8-c515-408c-86dd-ffb73c39ed40 req-65073415-07e8-474d-a0af-59a53d987674 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069154 Jul 28 11:29:52.217827 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 669/1319] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:52.230731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9d87c1f5-3a04-4077-97e1-3372704b4353 req-46a739da-322e-4a1b-a28f-7d8ab30a9dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33daecce-0fef-495a-a0bd-cdb1ab7683ee", "tag": "fb422efd-8657-439e-97c7-9c732a314ecc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:52.245147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9d87c1f5-3a04-4077-97e1-3372704b4353 req-46a739da-322e-4a1b-a28f-7d8ab30a9dd5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.246180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9d87c1f5-3a04-4077-97e1-3372704b4353 req-46a739da-322e-4a1b-a28f-7d8ab30a9dd5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.264262 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9d87c1f5-3a04-4077-97e1-3372704b4353 req-46a739da-322e-4a1b-a28f-7d8ab30a9dd5 service nova] Creating event network-changed:fb422efd-8657-439e-97c7-9c732a314ecc for instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee on n-h2-851368-1 Jul 28 11:29:52.270536 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9d87c1f5-3a04-4077-97e1-3372704b4353 req-46a739da-322e-4a1b-a28f-7d8ab30a9dd5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051153 Jul 28 11:29:52.271407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 670/1320] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:52.277393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:52.278587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:52.286935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.288384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.290225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.290907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.620916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.632827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.634446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.639195 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ce1378d-04a7-4c16-a1a7-c2ebc0b0f811 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.508627 Jul 28 11:29:52.643220 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 651/1321] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:52 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:52.648929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:52.654487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:52.664532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.665241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.666250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.666918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.718789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.719759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.721178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lazy-loading 'fault' on Instance uuid 1201727c-05e5-477b-b618-c8a0fbb4894e {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:29:52.809914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.824682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2681b19d364fa69126e05da24c4bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13821299b7647b6b6d508fa1c1bfd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:52.828804 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-718c104b-f2e1-4ba6-b9c5-d7838a60c1e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.555697 Jul 28 11:29:52.829426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 671/1322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:52 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:52.857111 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dda93c66-7260-4c78-96a5-1e780eb54619 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 200 len: 1308 microversion: 2.1 time: 0.205407 Jul 28 11:29:52.871825 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 652/1323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:52 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:52.873386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:52.874028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:52.883148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.883877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:52.884849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:52.885842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.109509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-89db348e-94bf-45a7-93af-881c7fd350c7 req-ac95777b-02cf-4e82-99b9-d7e1195b681b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e036573-1882-4c1e-9368-443955b1d3a4", "tag": "ad9022ef-c547-45e7-bcbf-e3dfaf723220"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:53.144950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-89db348e-94bf-45a7-93af-881c7fd350c7 req-ac95777b-02cf-4e82-99b9-d7e1195b681b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.145421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-89db348e-94bf-45a7-93af-881c7fd350c7 req-ac95777b-02cf-4e82-99b9-d7e1195b681b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.171287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-89db348e-94bf-45a7-93af-881c7fd350c7 req-ac95777b-02cf-4e82-99b9-d7e1195b681b service nova] Creating event network-changed:ad9022ef-c547-45e7-bcbf-e3dfaf723220 for instance 6e036573-1882-4c1e-9368-443955b1d3a4 on n-h2-851368-1 Jul 28 11:29:53.177387 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-89db348e-94bf-45a7-93af-881c7fd350c7 req-ac95777b-02cf-4e82-99b9-d7e1195b681b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072672 Jul 28 11:29:53.179233 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 653/1324] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:29:53.194888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.196064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.207503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.209825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.211033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.211756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.237282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:53.370785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.381594 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f59aea95-8857-4e89-b220-cff1968d3ce0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.529115 Jul 28 11:29:53.383602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 672/1325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:52 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:53.389220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.390318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.398577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.399417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.400298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.401546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.487591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.496136 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ffd3abc-caf5-40cd-956f-bdd1cb19314b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1318 microversion: 2.1 time: 0.315280 Jul 28 11:29:53.511776 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 654/1326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:53.587630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.597250 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21b13ac1-58c1-4b1d-8ccb-295715bd4a6c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1461 microversion: 2.1 time: 0.211909 Jul 28 11:29:53.598452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 673/1327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1461 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:53.618968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.619628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.626085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.626558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.627360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.628238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.666185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.667301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.675778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.676235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.677280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.678795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.860289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5403aaa-460c-4571-89a9-e2fa714fb7c2 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1612 microversion: 2.1 time: 0.245589 Jul 28 11:29:53.861631 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 655/1328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1612 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:53.867087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.868247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.874777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.875728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.876704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.877255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.878574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.891106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.893348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:53.895516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b5a9a03-ffe0-4a9f-99dd-a5810e4bd258 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.233580 Jul 28 11:29:53.907093 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 674/1329] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:53.913239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:53.913966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] [instance: 1201727c-05e5-477b-b618-c8a0fbb4894e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.921076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.921720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.922931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.923625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.940805 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] HTTP exception thrown: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Request method failure captured: Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e HTTP/1.1 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nKQ9of9FwqFI0H4TDhBNw9ZhRJJqv5VBmtZQvOJyl2YJdguDdJN0H2lKQvtLbM3cR9yM4LjxJMt8rX-t3PAA7gd0NZmT-RFS4KQ3TlJXaOUkk-VCRCZF7F5-dDh7q2K-z7k3za1peMBCFJ94rTB_wYzN6XHSLifHF37CY2_bwdhvU4 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: b13821299b7647b6b6d508fa1c1bfd07 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b13821299b7647b6b6d508fa1c1bfd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b13821299b7647b6b6d508fa1c1bfd07"}]}] Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: b13821299b7647b6b6d508fa1c1bfd07 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1641513646 Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListImageFiltersTestJSON-1641513646-project Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c2681b19d364fa69126e05da24c4bac Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListImageFiltersTestJSON-1641513646-project Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1201727c-05e5-477b-b618-c8a0fbb4894e'} Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:29:53.942750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. Jul 28 11:29:53.947941 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:29:53.959202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Returning 404 to user: Instance 1201727c-05e5-477b-b618-c8a0fbb4894e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:29:53.960328 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9398788-2ff4-4121-bd47-469fee2dfdf2 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e" status: 404 len: 111 microversion: 2.1 time: 0.057166 Jul 28 11:29:53.961070 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 675/1330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/1201727c-05e5-477b-b618-c8a0fbb4894e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:29:53.977354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:29:53.978147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:53.985453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.985969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:53.986781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:53.987322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.015113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:54.027710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1a9dff9b8c214fe88a7fdbf14fc954cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38e0f11dd884d94b75382e2f88ff6a6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:54.028591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] flavor_id is None. Assuming migration. {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4145}} Jul 28 11:29:54.029232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 11:29:54.054985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:54.064263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-68996a46-829e-4573-b5e9-7e8ebbd0f484 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.201446 Jul 28 11:29:54.078229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 656/1331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:53 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:54.083642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ab303a0-2498-4288-8789-bd5f6850eeb3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2931820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:54.208767 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54833450-5be1-4dc7-913a-379d7105e76b tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107/action" status: 202 len: 0 microversion: 2.1 time: 0.246431 Jul 28 11:29:54.209927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 676/1332] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:29:53 2022] POST /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:29:54.223613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:54.225295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:54.234339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.235301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.236184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.237085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.488133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:54.503777 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c302396-bc1a-4eea-b912-70cdc66cab78 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1470 microversion: 2.1 time: 0.287027 Jul 28 11:29:54.504299 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 677/1333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:54 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:54.518480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:54.519151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:54.538376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.539157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.540149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.540974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.741805 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ab303a0-2498-4288-8789-bd5f6850eeb3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19" status: 204 len: 0 microversion: 2.1 time: 0.662109 Jul 28 11:29:54.742502 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 657/1334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:54 2022] DELETE /compute/v2.1/images/3b59c35e-ce74-45ba-86f1-6d2882a5cf19 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:54.751443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:54.753186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:54.767488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.773756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:54.775161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:54.777065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.010647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:55.023727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e7dea71-bfa9-4452-8998-b2b517d6f764 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.515314 Jul 28 11:29:55.043236 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 678/1335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:54 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:55.054395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-821da2f8-42b2-4019-b52a-a8b31bda08b3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb2a5f8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:55.222484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:55.236593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b23a8497-32b1-4929-8a5e-fb55ebd75a14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1468 microversion: 2.1 time: 0.490712 Jul 28 11:29:55.260306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 658/1336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:54 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1468 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:55.269313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:55.270524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:55.282693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.283626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.284890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.287528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.358156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:55.400313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-821da2f8-42b2-4019-b52a-a8b31bda08b3 tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85" status: 204 len: 0 microversion: 2.1 time: 0.355466 Jul 28 11:29:55.400977 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 679/1337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:55 2022] DELETE /compute/v2.1/images/f910c5fc-b989-49b9-8a92-241a05851d85 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:55.406380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:55.407157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:55.415269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.416332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.417077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.417531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.588691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:55.607684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:55.613258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:55.617010 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c20c8d54-938a-4368-8b12-d15ea1af0634 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.353484 Jul 28 11:29:55.617913 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 659/1338] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:55 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:55.622974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:55.624078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:55.639717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.640494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:55.641287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:55.641726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.042011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.056797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70e1da20-86ab-4d70-9012-dc7566f48ef8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.649163 Jul 28 11:29:56.068167 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 680/1339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:55 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:56.080753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7689aeb5-a0dd-497c-944d-6887e3206dff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] Calling method '.version_select at 0x7f2eb3675c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:56.126155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.134290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c549d53-8893-417d-abc5-8e44fa831f8b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 200 len: 1468 microversion: 2.1 time: 0.514810 Jul 28 11:29:56.135575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 660/1340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:55 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 1468 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:56.143297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:56.144080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:56.151694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.154309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.154309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.154309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.343241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.353158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de43cc2f-ccf4-414c-bece-69f84ed8e224 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1470 microversion: 2.1 time: 0.216349 Jul 28 11:29:56.366965 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 661/1341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:56 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:56.366965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:56.366965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:56.366965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.366965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.368300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.369398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.536342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.546544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d2a3ee9-db36-4d15-b968-926a92b4b86b tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.190985 Jul 28 11:29:56.548273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 662/1342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:56 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:56.550910 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7689aeb5-a0dd-497c-944d-6887e3206dff tempest-ListImageFiltersTestJSON-1641513646 tempest-ListImageFiltersTestJSON-1641513646-project] 10.222.0.93 "DELETE /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a" status: 204 len: 0 microversion: 2.1 time: 0.481034 Jul 28 11:29:56.551517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 681/1343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:56 2022] DELETE /compute/v2.1/images/de4959c2-31a2-4f7c-9d5a-98829605972a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:29:56.554714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:56.561064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.562151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Searching by: {'reservation_id': 'r-pcl0rxob', 'deleted': False, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:29:56.569059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.569745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.571148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.571778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.644623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:56.646239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:56.667843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.674502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.677963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.679856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:56.722170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:29:56.855847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:56.867974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:56.868432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:57.258610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:57.278793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:57.280574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:57.284794 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7cb42ee3-1c08-46cd-bb02-3c44c22b837f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.641731 Jul 28 11:29:57.286357 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 682/1344] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:56 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:57.303804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:57.304494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:57.314780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:57.315278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:57.316084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:57.316527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.095287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4012508-d236-4edf-ae57-28d034424d14 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-pcl0rxob" status: 200 len: 2929 microversion: 2.1 time: 1.545604 Jul 28 11:29:58.097301 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 663/1345] 10.222.0.93 () {58 vars in 1197 bytes} [Thu Jul 28 11:29:56 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pcl0rxob => generated 2929 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:58.102822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:58.104707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:58.120547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.121326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.123672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.124744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.431053 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df40667c-6a31-4806-9c74-d8562d8c242f tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1809 microversion: 2.1 time: 1.141668 Jul 28 11:29:58.443348 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 683/1346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:57 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1809 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:58.443348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:58.443348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:58.462348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.463320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.463645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.464094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.657207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:58.666287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ee20e2c-c4d6-4d13-a301-ef2f3496e513 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.567418 Jul 28 11:29:58.686426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 664/1347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:58 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:58.691529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:58.704312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:58.723742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.724925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:58.725881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:58.726480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.154838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:59.169955 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dbf569fe-ca8d-4395-8a96-839c6540644d tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1470 microversion: 2.1 time: 0.729637 Jul 28 11:29:59.173030 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 684/1348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:58 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:59.183556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00af9962-4d09-446a-9629-95bc3898afc4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:59.248997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.compute.server_groups [None req-00af9962-4d09-446a-9629-95bc3898afc4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Querying cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) for 2 instances {{(pid=119235) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 11:29:59.252020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00af9962-4d09-446a-9629-95bc3898afc4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.252504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00af9962-4d09-446a-9629-95bc3898afc4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.314678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:59.329099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d06c073b-6c55-4237-9daa-7736ebe975b7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.641220 Jul 28 11:29:59.334477 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 665/1349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:58 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:29:59.336959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00af9962-4d09-446a-9629-95bc3898afc4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/a32fab36-7d9d-4fbc-b34e-ba2da46d10d5" status: 200 len: 266 microversion: 2.1 time: 0.162718 Jul 28 11:29:59.343945 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 685/1350] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:29:59 2022] GET /compute/v2.1/os-server-groups/a32fab36-7d9d-4fbc-b34e-ba2da46d10d5 => generated 266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:59.350274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:59.351227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:59.355753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:59.362533 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:29:59.362533 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:29:59.368954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.369734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.371965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.375439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.376979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.380011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.381149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.381794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.445161 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-752a3fda-85f5-4dae-8a30-ffff42777978 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094757 Jul 28 11:29:59.446676 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 686/1351] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:29:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:29:59.468300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:59.475555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:59.495740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.499658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.500660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.503744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.718834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:59.732864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:59.734384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:29:59.740292 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ddb1519-e32b-42df-b172-5fc9bbcc8fa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.402604 Jul 28 11:29:59.741924 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 666/1352] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:29:59 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:29:59.768035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:29:59.768935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:29:59.795770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.796238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:29:59.797048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:29:59.797485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.154268 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f56c48c-f642-4436-9626-7476e087ebcd tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 200 len: 1619 microversion: 2.1 time: 0.702512 Jul 28 11:30:00.178352 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 687/1353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:59 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 1619 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:00.218319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:00.218968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:00.255187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:00.266152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.266622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.275508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.283233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.416005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:00.431791 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aecdc274-cc35-4b06-af3a-c7e1bc677ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.688415 Jul 28 11:30:00.446552 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 667/1354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:29:59 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:00.451725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:00.452432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:00.471584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.478582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.480785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.481309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.505316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:00.515046 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd518cfa-fd72-4b16-82cf-3524df80dd9f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.320025 Jul 28 11:30:00.531800 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 688/1355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:00 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:00.540779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:00.541813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:00.544907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:00.549174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.550932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.551993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.553129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.900837 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d96334fa-dd6d-44d4-9bb3-20382bed38c0 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 200 len: 1619 microversion: 2.1 time: 0.463451 Jul 28 11:30:00.910617 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 668/1356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:00 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 1619 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:00.934523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:00.934523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:00.940023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.940591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.942105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:00.943581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:00.992054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.004211 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e895da83-f56c-414f-9995-c4b47a901c27 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.470130 Jul 28 11:30:01.005019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 689/1357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:00 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:01.159317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.178062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.180731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.181960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6716bdec-a20f-4fa6-a885-f0ba4959ae42 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.270327 Jul 28 11:30:01.192133 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 669/1358] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:00 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:01.207307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: .version_select at 0x7f2eb34c2820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-909735616", "policies": ["anti-affinity"]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:01.226622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90a4abb2-967e-4ca1-9ba8-689445aab803 tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] Calling method '.version_select at 0x7f2eb31fa940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:01.236571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:01.242642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:01.296419 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90a4abb2-967e-4ca1-9ba8-689445aab803 tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] 10.222.0.93 "GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e" status: 200 len: 784 microversion: 2.1 time: 0.290113 Jul 28 11:30:01.297004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 690/1359] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:30:01 2022] GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e => generated 784 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:01.299816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:01.301818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-04aba3ba-4adc-4637-8a87-dd80e332dc6a req-cd740a25-5f84-46ae-bc38-a1187dd604c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e036573-1882-4c1e-9368-443955b1d3a4", "name": "network-vif-plugged", "status": "completed", "tag": "ad9022ef-c547-45e7-bcbf-e3dfaf723220"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:01.304584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:01.318892 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-695b8322-d912-457a-bda5-51709bb1d338 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.125258 Jul 28 11:30:01.320001 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 670/1360] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Jul 28 11:30:01 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:01.325396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef69a6f2-a7e3-498a-a070-66750ac49965 tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] Calling method '.version_select at 0x7f2eb35480d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:01.325979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-04aba3ba-4adc-4637-8a87-dd80e332dc6a req-cd740a25-5f84-46ae-bc38-a1187dd604c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:01.326439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-04aba3ba-4adc-4637-8a87-dd80e332dc6a req-cd740a25-5f84-46ae-bc38-a1187dd604c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:01.347014 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-04aba3ba-4adc-4637-8a87-dd80e332dc6a req-cd740a25-5f84-46ae-bc38-a1187dd604c3 service nova] Creating event network-vif-plugged:ad9022ef-c547-45e7-bcbf-e3dfaf723220 for instance 6e036573-1882-4c1e-9368-443955b1d3a4 on n-h2-851368-1 Jul 28 11:30:01.358852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-04aba3ba-4adc-4637-8a87-dd80e332dc6a req-cd740a25-5f84-46ae-bc38-a1187dd604c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060570 Jul 28 11:30:01.365848 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 691/1361] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:01.389034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef69a6f2-a7e3-498a-a070-66750ac49965 tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] 10.222.0.93 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.067525 Jul 28 11:30:01.391249 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 671/1362] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Jul 28 11:30:01 2022] GET /compute/v2.1/images => generated 445 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:01.405433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-702de204-4c3f-406f-8dd9-b19cb646927c tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] Calling method '.version_select at 0x7f2eb320e550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:01.453836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:01.454662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:01.464703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:01.466735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:01.468000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:01.468696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:01.492288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-702de204-4c3f-406f-8dd9-b19cb646927c tempest-ListImagesTestJSON-1264377621 tempest-ListImagesTestJSON-1264377621-project] 10.222.0.93 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.086213 Jul 28 11:30:01.493558 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 692/1363] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:30:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:30:01.538202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:01.538955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:01.551042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:01.551531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:01.552331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:01.553343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:01.958179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.973246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:01.973522 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc422cca-cfed-4488-b6e0-4fdb534326c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.521648 Jul 28 11:30:01.974191 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 672/1364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:01 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:02.004027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c03cfbc7-171f-4701-bfb2-14ffcfce7082 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.470759 Jul 28 11:30:02.004376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-154096297", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f91feeaa-dd48-41cf-96ad-b7a28361e987"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:02.010057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 693/1365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:01 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:02.030318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:02.031393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:02.060328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.069095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.070051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.070516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.105588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:02.475583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:02.485859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c684114b-7f7c-4573-960b-629e18cedc3c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1325 microversion: 2.1 time: 0.459606 Jul 28 11:30:02.486457 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 694/1366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:02 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1325 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:02.492672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:02.494165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:02.501969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.502652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.504609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.505244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.629083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:30:02.629547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:30:02.630104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:30:02.631158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:30:02.631650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:30:02.663459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.663972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.664819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:02.665256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:02.672676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:02.686513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:02.690827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:02.703762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 2 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:30:02.706774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:02.763863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119236) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 28 11:30:02.781136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:02.783266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:02.786192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:02.799120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:02.800828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:02.800979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:02.802937 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6f50642-5af0-4bd9-af51-bfc5fc67ffa2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.314250 Jul 28 11:30:02.816839 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 695/1367] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:02 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:02.863273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:02.870634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:02.890151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=0ee0637e-0188-44d7-90da-07a152c97d73,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:02.945922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:02.958416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:02.978721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Calling method '.version_select at 0x7f2eb27c53a0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.018855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:30:03.019838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Neutron security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:30:03.020606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] HTTP exception thrown: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.020606 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.026884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:03.031207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Request method failure captured: Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/90509bf9-eb81-4e98-abcb-66e9cc1d5513 HTTP/1.1 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nM6G0D7j3IqytJoMcB3BjmCz7ot7u7dYRtIxQP8xQ27FLL_XtbmwFJiPPOuGddymIt5bj36M8cMmlzUBlZxmK91n2Q6L4Bvv0DdjkFQ0O02i1IZ8GftVrb6Xs1Q-ACOFlyldULCaZGo4ArLRlNMWjXrZfqZoFUOiPZqhgrYSrWM8ys Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}] Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0b795366dff043cc8fe0eb5b9b3d76d7 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '90509bf9-eb81-4e98-abcb-66e9cc1d5513'} Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:30:03.047827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Returning 404 to user: Security group 90509bf9-eb81-4e98-abcb-66e9cc1d5513 does not exist Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-0e734736-777d-4bcb-a2bf-e7bb6ad4fea3'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db1f48bc-0835-46e1-9aef-dc6d6ea6bcf6 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/90509bf9-eb81-4e98-abcb-66e9cc1d5513" status: 404 len: 194 microversion: 2.1 time: 0.235894 Jul 28 11:30:03.052751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 696/1368] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:30:02 2022] DELETE /compute/v2.1/os-security-groups/90509bf9-eb81-4e98-abcb-66e9cc1d5513 => generated 194 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:03.059217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.060482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:03.077357 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea5e0241-3766-4251-991b-c61dd087c4f4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.091382 Jul 28 11:30:03.081494 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 673/1369] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:03.082858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.083480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.084898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.085598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.087044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63fa7c14-bd08-432f-b1bd-bb26ec0e4b86", "device": "/dev/xvdb"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:03.090177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:03.098173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.098989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.100994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.101838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.315814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:03.346005 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-638761c2-d14e-4958-9cc7-4562d92a66ee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.293819 Jul 28 11:30:03.346861 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 697/1370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:03 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:03.352491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.376029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:03.392466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.394646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.396022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.397282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.431999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:03.602223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79c47afa-e76e-4e28-868c-673df671c663 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518510 Jul 28 11:30:03.603896 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 674/1371] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:30:03 2022] POST /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 194 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:03.610002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1a4f24e-bed6-47e8-b82d-039e4b0ca807 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004537 Jul 28 11:30:03.616007 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 675/1372] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Jul 28 11:30:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 11:30:03.623956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.632877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:03.634635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Searching by: {'deleted': False, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:30:03.653379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.653911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.654804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.655340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.696700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:30:03.757604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:03.768513 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec745097-c072-4704-8b4a-847593d13eed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.419953 Jul 28 11:30:03.769700 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 698/1373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:03 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:03.776755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9616220c-d533-4e98-a02f-9f473aefa555 req-702b27f3-e597-4e53-881b-589c771e3279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33daecce-0fef-495a-a0bd-cdb1ab7683ee", "name": "network-vif-plugged", "status": "completed", "tag": "fb422efd-8657-439e-97c7-9c732a314ecc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:03.788046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9616220c-d533-4e98-a02f-9f473aefa555 req-702b27f3-e597-4e53-881b-589c771e3279 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.804067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9616220c-d533-4e98-a02f-9f473aefa555 req-702b27f3-e597-4e53-881b-589c771e3279 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.827559 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9616220c-d533-4e98-a02f-9f473aefa555 req-702b27f3-e597-4e53-881b-589c771e3279 service nova] Creating event network-vif-plugged:fb422efd-8657-439e-97c7-9c732a314ecc for instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee on n-h2-851368-1 Jul 28 11:30:03.835036 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0642ad1-1b20-43a6-8a5d-b0e136761156 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.217633 Jul 28 11:30:03.835883 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 676/1374] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:30:03 2022] GET /compute/v2.1/servers => generated 1662 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:03.836855 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9616220c-d533-4e98-a02f-9f473aefa555 req-702b27f3-e597-4e53-881b-589c771e3279 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063198 Jul 28 11:30:03.842423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.843303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:03.843921 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 699/1375] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:03.853941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa7e4bbc-833a-4742-b4b4-91496b078669 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Calling method '.version_select at 0x7f2eb285bb80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:03.856674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.857343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:03.858152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:03.858755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.356882 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa7e4bbc-833a-4742-b4b4-91496b078669 tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.510899 Jul 28 11:30:04.357960 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 700/1376] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:30:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:04.362908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:04.364068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:04.378807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.386232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.387369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.388042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.396968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.412508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a68b78b0-3c5b-4f9b-989b-99449add51cd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1521 microversion: 2.1 time: 0.575225 Jul 28 11:30:04.440550 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 677/1377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:03 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1521 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:04.451558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:04.452543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:04.472064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.472819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.478956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.483550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.596940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.611158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51ee1bc3-4abc-49fc-a873-4882042eabd3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1214 microversion: 2.1 time: 0.169080 Jul 28 11:30:04.611757 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 678/1378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:04 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:04.622681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:04.623627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:04.631192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.631832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.632772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.633363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.753084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.763470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.765227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.766545 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a2b6439f-5faa-42eb-9479-143dd29e0946 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.407413 Jul 28 11:30:04.770678 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 701/1379] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:04 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:04.775787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Calling method '.version_select at 0x7f2eb26865e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:04.881280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:04.891330 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6a6bd27-f6a7-49cd-91ac-79394e80c41d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1316 microversion: 2.1 time: 0.277352 Jul 28 11:30:04.892556 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 679/1380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:04 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:04.900554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:04.902104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:04.911056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.913470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.914439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:04.915874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:04.956817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:30:04.957860 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 28 11:30:04.957860 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Request method failure captured: Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/5a8a6360-31d4-46d9-ba2a-7716e7e5d52c HTTP/1.1 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nM6G0D7j3IqytJoMcB3BjmCz7ot7u7dYRtIxQP8xQ27FLL_XtbmwFJiPPOuGddymIt5bj36M8cMmlzUBlZxmK91n2Q6L4Bvv0DdjkFQ0O02i1IZ8GftVrb6Xs1Q-ACOFlyldULCaZGo4ArLRlNMWjXrZfqZoFUOiPZqhgrYSrWM8ys Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}] Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0b795366dff043cc8fe0eb5b9b3d76d7 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: exception: Insufficient rights for removing default security group. Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5a8a6360-31d4-46d9-ba2a-7716e7e5d52c'} Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:30:04.961800 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-620596e6-fd69-4267-acd4-33624f3cc1cf'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebb31fab-b94a-4491-8bb8-fe6dcab057bc tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/5a8a6360-31d4-46d9-ba2a-7716e7e5d52c" status: 400 len: 182 microversion: 2.1 time: 0.191767 Jul 28 11:30:04.965816 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 702/1381] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:30:04 2022] DELETE /compute/v2.1/os-security-groups/5a8a6360-31d4-46d9-ba2a-7716e7e5d52c => generated 182 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:05.095005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:05.104312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b3b810e-c51a-4199-bbdd-3df134fb2003 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1521 microversion: 2.1 time: 0.209687 Jul 28 11:30:05.104936 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 680/1382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:04 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:05.115225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.115225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:05.115989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.116450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.117213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.117649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.143027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc93f2de-f4f9-4f71-b9df-0f0dcc076c8a tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb26f0550>, body: {"keypair": {"name": "tempest-keypair-132048915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9O6968NUJWyRT0FFfxnT+xQggMalYIhCR2DZOEds8qstYke8xSaGon66erwtey1VmWiUpDc9cy6yv9VuHvJHJqDL6ARgXcyTE6xDwzgR3N4yQTB9YluXKzJeHLntVwEw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:05.160716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-dc93f2de-f4f9-4f71-b9df-0f0dcc076c8a tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:05.165252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-dc93f2de-f4f9-4f71-b9df-0f0dcc076c8a tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:05.190180 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc93f2de-f4f9-4f71-b9df-0f0dcc076c8a tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.223633 Jul 28 11:30:05.190888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 703/1383] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:05.195682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Calling method '.version_select at 0x7f2eb26860d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.236548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:30:05.237294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Neutron security group f29fa630-4225-4968-b4aa-73f396204c2c not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:30:05.237819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] HTTP exception thrown: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.237819 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Request method failure captured: Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-security-groups/f29fa630-4225-4968-b4aa-73f396204c2c HTTP/1.1 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nM6G0D7j3IqytJoMcB3BjmCz7ot7u7dYRtIxQP8xQ27FLL_XtbmwFJiPPOuGddymIt5bj36M8cMmlzUBlZxmK91n2Q6L4Bvv0DdjkFQ0O02i1IZ8GftVrb6Xs1Q-ACOFlyldULCaZGo4ArLRlNMWjXrZfqZoFUOiPZqhgrYSrWM8ys Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}] Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0b795366dff043cc8fe0eb5b9b3d76d7 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f29fa630-4225-4968-b4aa-73f396204c2c'} Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:30:05.239901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] Jul 28 11:30:05.244494 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.251881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Returning 404 to user: Security group f29fa630-4225-4968-b4aa-73f396204c2c does not exist Jul 28 11:30:05.251881 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-ce872ac0-0dac-4610-87c2-b58927269406'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:05.257746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21e70a7e-615c-4d26-8895-42ca298deebf tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/f29fa630-4225-4968-b4aa-73f396204c2c" status: 404 len: 194 microversion: 2.1 time: 0.061345 Jul 28 11:30:05.258724 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 704/1384] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/os-security-groups/f29fa630-4225-4968-b4aa-73f396204c2c => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:05.266901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-75104491"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:05.270429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:05.297354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.298125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.299151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.299906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.321371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:05.330255 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13d0e749-9eb3-40c0-94d0-d8ca381f49ac tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.224287 Jul 28 11:30:05.330853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 681/1385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:05.342421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-799e7cdd-afb7-46eb-893f-84f7836d2ae9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb28c3310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.386986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-799e7cdd-afb7-46eb-893f-84f7836d2ae9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-132048915" status: 200 len: 511 microversion: 2.2 time: 0.054821 Jul 28 11:30:05.387437 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 682/1386] 10.222.0.93 () {60 vars in 1255 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-132048915 => generated 511 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:05.401811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Action: 'update', calling method: .version_select at 0x7f2eb2f01940>, body: {"security_group": {"name": "tempest-sg-583774391", "description": "tempest-description-110043288"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:05.427812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:30:05.428611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Neutron security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:30:05.429296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] HTTP exception thrown: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.429296 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Request method failure captured: Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-security-groups/78f86c4c-8ca5-467a-bf3b-3545ddc503b2 HTTP/1.1 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 100 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nM6G0D7j3IqytJoMcB3BjmCz7ot7u7dYRtIxQP8xQ27FLL_XtbmwFJiPPOuGddymIt5bj36M8cMmlzUBlZxmK91n2Q6L4Bvv0DdjkFQ0O02i1IZ8GftVrb6Xs1Q-ACOFlyldULCaZGo4ArLRlNMWjXrZfqZoFUOiPZqhgrYSrWM8ys Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3adce83d8f99463daa66ed14ced91c32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3adce83d8f99463daa66ed14ced91c32"}]}] Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 3adce83d8f99463daa66ed14ced91c32 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0b795366dff043cc8fe0eb5b9b3d76d7 Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1268784687-project Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: {"security_group": {"name": "tempest-sg-583774391", "description": "tempest-description-110043288"}} Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '78f86c4c-8ca5-467a-bf3b-3545ddc503b2', 'body': {'security_group': {'name': 'tempest-sg-583774391', 'description': 'tempest-description-110043288'}}} Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:30:05.432273 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] Jul 28 11:30:05.436991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.442539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] Returning 404 to user: Security group 78f86c4c-8ca5-467a-bf3b-3545ddc503b2 does not exist Jul 28 11:30:05.442539 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c65871a8-32ad-4004-b9d5-8b7d1466a609'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:05.442539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fad4c642-589b-4b40-80b9-37b7a0ab601e tempest-SecurityGroupsNegativeTestJSON-1268784687 tempest-SecurityGroupsNegativeTestJSON-1268784687-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/78f86c4c-8ca5-467a-bf3b-3545ddc503b2" status: 404 len: 194 microversion: 2.1 time: 0.053233 Jul 28 11:30:05.442539 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 683/1387] 10.222.0.93 () {60 vars in 1290 bytes} [Thu Jul 28 11:30:05 2022] PUT /compute/v2.1/os-security-groups/78f86c4c-8ca5-467a-bf3b-3545ddc503b2 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:05.454753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-348cd536-f294-4965-a240-1bcde118c889 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2836040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.483106 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-348cd536-f294-4965-a240-1bcde118c889 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132048915" status: 204 len: 0 microversion: 2.2 time: 0.038066 Jul 28 11:30:05.484064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 684/1388] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 28 11:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132048915 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:05.496990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af50b916-eeee-4f32-9bac-6d4582119707 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb2f8b670>, body: {"keypair": {"name": "tempest-keypair-975445143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0iQII7IRfwDG/Y5ZH+BkDM+xVLPfvdV4ndN0s/kBf50efMcahRNsOjYSucFrDOeD+juj/WWFjRTSlIlvqop0KOy7i9/NVQO0VCm4gIAObMSHH0h6Ozt3SSJ7+cvGqtzw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:05.522768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-af50b916-eeee-4f32-9bac-6d4582119707 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:05.528364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-af50b916-eeee-4f32-9bac-6d4582119707 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:05.572468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af50b916-eeee-4f32-9bac-6d4582119707 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.079555 Jul 28 11:30:05.580074 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 685/1389] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 28 11:30:05.587006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2fe5bb14-98dd-426e-a749-f2e0daa60329 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb339cee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.631668 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2fe5bb14-98dd-426e-a749-f2e0daa60329 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975445143" status: 204 len: 0 microversion: 2.2 time: 0.049347 Jul 28 11:30:05.634402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 686/1390] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 28 11:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975445143 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:05.647132 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d2454d7-ae03-4ca0-a1cc-531dcfb8912f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4/action" status: 202 len: 0 microversion: 2.1 time: 0.383789 Jul 28 11:30:05.652963 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 705/1391] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:30:05 2022] POST /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:30:05.653118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.653118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:05.659931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2a2888d-623a-469a-a9ca-b35c7d2d1394 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb2686b80>, body: {"keypair": {"name": "tempest-keypair-126524452", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:05.672200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.672658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.674022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.674643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.677966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e2a2888d-623a-469a-a9ca-b35c7d2d1394 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:05.683353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e2a2888d-623a-469a-a9ca-b35c7d2d1394 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:05.713829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2a2888d-623a-469a-a9ca-b35c7d2d1394 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.064223 Jul 28 11:30:05.718013 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 706/1392] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:05 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:05.730104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06bcbb42-b473-45fc-9c6f-a73f7eab8fb2 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb26f09d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.785739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:05.818791 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0de046c0-0179-4af9-8004-1da2feb3cfc3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1270 microversion: 2.1 time: 0.178267 Jul 28 11:30:05.821065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 687/1393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:05.842658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04ab09ef-6965-4144-af73-d87e662816a3 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2ec4c10>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.887297 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06bcbb42-b473-45fc-9c6f-a73f7eab8fb2 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8" status: 204 len: 0 microversion: 2.1 time: 0.168013 Jul 28 11:30:05.888321 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 707/1394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:05 2022] DELETE /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:05.897043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.900611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04ab09ef-6965-4144-af73-d87e662816a3 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126524452" status: 204 len: 0 microversion: 2.2 time: 0.077320 Jul 28 11:30:05.900985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:05.901202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 688/1395] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 28 11:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126524452 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:05.917207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.920045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.921169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:05.922571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16409120-9427-448e-9ada-8d60f54a710a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb33893a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:05.923369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:05.970174 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-16409120-9427-448e-9ada-8d60f54a710a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Image not found. Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16409120-9427-448e-9ada-8d60f54a710a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8 HTTP/1.1 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'ef2df93c-1787-4308-bbfb-0f803b97ead8'} Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ef2df93c-1787-4308-bbfb-0f803b97ead8 Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:30:05.979483 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef2df93c-1787-4308-bbfb-0f803b97ead8 could not be found. Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:05.983926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16409120-9427-448e-9ada-8d60f54a710a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:05.994242 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16409120-9427-448e-9ada-8d60f54a710a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8" status: 404 len: 62 microversion: 2.1 time: 0.078579 Jul 28 11:30:05.995181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 689/1396] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:30:06.014931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cddc1655-260c-472e-ae4d-12486500491b tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb33893a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1320948242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhZBFKSaCIw8svap3wohl1A2iNsmsqvqzUxO4Vgm6djSMIceXu38HwtE6EIT3V3m5NEz3Lst8CEnfzRao/3jB2cOLDUhpmM6LTE+9+tHxOgOcVgbm6h87Np6VpUrfrnPw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:06.058744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-cddc1655-260c-472e-ae4d-12486500491b tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:06.070022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-cddc1655-260c-472e-ae4d-12486500491b tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:06.127526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cddc1655-260c-472e-ae4d-12486500491b tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.129291 Jul 28 11:30:06.129676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 690/1397] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:06.137230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:06.138261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:06.149371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:06.152121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.152692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:06.154081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.155809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:06.448432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:06.458215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:06.464524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:06.472208 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebe90a85-88f4-4a3d-9e9a-44d5e639279f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.582300 Jul 28 11:30:06.473020 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 708/1398] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:05 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:06.477832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:06.481727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:06.506920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.507663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:06.508662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.510885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:06.841001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:06.854717 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1d61acb-cfb8-466a-95e1-ea00ad82cd73 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1506 microversion: 2.1 time: 0.720588 Jul 28 11:30:06.857569 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 691/1399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:06 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:06.867199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5326ee3e-f63b-415d-adce-007a8e8e6101 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb32dd550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1770724847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE23Atn39hOfHPQbq6zkbNsxLzP8wvMt35W3N42dAUBlQZ1uy5vjCWk80JGOvxaqJUCcIBy1s5M7m/TbI5YD75rKcvxyUqjiOVG6f7r9C3adE6cKUyNN9Z1OgbItbAiJw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:06.901085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:06.911555 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce6e7f52-8e95-45b7-88f0-52e30ec63a64 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1533 microversion: 2.1 time: 0.437287 Jul 28 11:30:06.918659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 709/1400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:06 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1533 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:06.928420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5326ee3e-f63b-415d-adce-007a8e8e6101 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:06.932884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:06.941732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:06.946700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5326ee3e-f63b-415d-adce-007a8e8e6101 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:06.954300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.954756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:06.960967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:06.964085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:07.008103 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5326ee3e-f63b-415d-adce-007a8e8e6101 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.148073 Jul 28 11:30:07.010605 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 692/1401] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:07.027589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:07.028760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:07.052221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:07.053238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:07.054186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:07.054732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:07.837448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:07.854307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5975699-825d-445f-ba6c-827911bc41f2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1276 microversion: 2.1 time: 0.842261 Jul 28 11:30:07.872209 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 693/1402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:07 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1276 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:07.886169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:07.886968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:07.913487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:07.914463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:07.915781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:07.917562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:07.996951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:30:08.166023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:08.186579 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b594fa53-475b-48cc-89f3-713ed88fa874 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 1.266403 Jul 28 11:30:08.189749 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 710/1403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:06 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:08.198721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71c9f9c2-0db6-4cbd-8390-28c13cf1f531 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb2686e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-592038959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwr4wQCTISJsJP/54RRdKRXjUR/P55Zq+fjtAL+DlUyOID/fjEt+sGPcqEl3lcM4WRpKnV9OGg15FSG9DNCAZEHB2iir3mzHih+nkOOlm334pIeMJBZNDtyXWr7pSoFkw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:08.229414 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f98b0fb0-88ad-4183-ae23-d19dd91114fd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 204 len: 0 microversion: 2.1 time: 0.355284 Jul 28 11:30:08.233323 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 694/1404] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:07 2022] DELETE /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:08.252160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:08.258611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:08.271928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-71c9f9c2-0db6-4cbd-8390-28c13cf1f531 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:08.272944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:08.273379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:08.274167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:08.274593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:08.289891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-71c9f9c2-0db6-4cbd-8390-28c13cf1f531 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:08.344960 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71c9f9c2-0db6-4cbd-8390-28c13cf1f531 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.153712 Jul 28 11:30:08.345490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 711/1405] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:08 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:08.353743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:08.354619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:08.363910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:08.364619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:08.366206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:08.367247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.024483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.025326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.032028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-914676a8-4114-4ed6-8a86-a6f7a15ce67f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1539 microversion: 2.1 time: 0.685020 Jul 28 11:30:09.033764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 712/1406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:08 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1539 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:09.038656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.042916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.044108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:09.044493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.053122 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3082b03-0f4e-48f4-93af-df389b9ca1d1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.815281 Jul 28 11:30:09.054190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 695/1407] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:08 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:09.063615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd6264c8-31ef-414f-b35a-ad250cb906fb tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2ec4790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.064867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.065561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.066822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.067788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.075952 n-d-851368-1 devstack@n-api.service[119236]: WARNING oslo_db.sqlalchemy.utils [None req-fd6264c8-31ef-414f-b35a-ad250cb906fb tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:30:09.112972 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd6264c8-31ef-414f-b35a-ad250cb906fb tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.057279 Jul 28 11:30:09.113572 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 696/1408] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Jul 28 11:30:09 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:09.128255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.128919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:09.155571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.156619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.157584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.158194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.389634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:09.467952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.510751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0253fcf-7802-4425-8fa8-ea8411848e7a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1276 microversion: 2.1 time: 0.394824 Jul 28 11:30:09.519025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 697/1409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:09 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1276 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:09.535185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e56a1253-b802-44bf-8272-1b944872813f tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2f014c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.552155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:09.569397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2cf4d7d3-a828-4ecb-aa1c-302367006932 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1512 microversion: 2.1 time: 0.533580 Jul 28 11:30:09.576619 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 713/1410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:09 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1512 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:09.591316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.591952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:09.601030 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e56a1253-b802-44bf-8272-1b944872813f tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-592038959" status: 204 len: 0 microversion: 2.2 time: 0.080471 Jul 28 11:30:09.601653 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 698/1411] 10.222.0.93 () {60 vars in 1318 bytes} [Thu Jul 28 11:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-592038959 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:09.611946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0352d079-6655-43d6-85e5-7bd0dc33c7ca tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb339c820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:09.624584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.630067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.631349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.631890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.678595 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0352d079-6655-43d6-85e5-7bd0dc33c7ca tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1770724847" status: 204 len: 0 microversion: 2.2 time: 0.072519 Jul 28 11:30:09.682564 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 699/1412] 10.222.0.93 () {60 vars in 1321 bytes} [Thu Jul 28 11:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1770724847 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:09.888771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-975bee86-adb3-43af-bc1e-fcd20439a8dc req-08643a32-9b9e-492a-95a3-0057f022582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee0637e-0188-44d7-90da-07a152c97d73", "tag": "5c32a1b6-4881-4e74-a4c9-73f3059f269f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:09.910575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-975bee86-adb3-43af-bc1e-fcd20439a8dc req-08643a32-9b9e-492a-95a3-0057f022582b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:09.911028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-975bee86-adb3-43af-bc1e-fcd20439a8dc req-08643a32-9b9e-492a-95a3-0057f022582b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:09.914280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:09.979007 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-975bee86-adb3-43af-bc1e-fcd20439a8dc req-08643a32-9b9e-492a-95a3-0057f022582b service nova] Creating event network-changed:5c32a1b6-4881-4e74-a4c9-73f3059f269f for instance 0ee0637e-0188-44d7-90da-07a152c97d73 on n-h1-851368-1 Jul 28 11:30:09.991469 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-975bee86-adb3-43af-bc1e-fcd20439a8dc req-08643a32-9b9e-492a-95a3-0057f022582b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304408 Jul 28 11:30:09.994866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 700/1413] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:10.014563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d736d36f-1ea6-49f6-bee2-1dd964876f71 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2f59160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:10.081452 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d736d36f-1ea6-49f6-bee2-1dd964876f71 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1320948242" status: 204 len: 0 microversion: 2.2 time: 0.085061 Jul 28 11:30:10.091866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 701/1414] 10.222.0.93 () {60 vars in 1321 bytes} [Thu Jul 28 11:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1320948242 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:10.101350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:10.114557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:10.124025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.124482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.127060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.127561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.295335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:10.304341 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f750c587-0626-432c-b1a3-076614d3245a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.726450 Jul 28 11:30:10.318611 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 714/1415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:09 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:10.326206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:10.327220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:10.340574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.342218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.343978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.347637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.856408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:10.874063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4492818f-e351-4de0-95eb-cd40c2b20bb7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1534 microversion: 2.1 time: 0.779635 Jul 28 11:30:10.887095 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 702/1416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:10 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1534 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:10.887095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a915bbf-e7c8-4054-9d51-6c2bfc6342c9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb3166550>, body: {"keypair": {"name": "tempest-keypair-1095876608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrag1gK9l/KURxYygSGw7O6f8pt4eOd6wpCxMyEydYynNjyxuwQ5b26hVCS1niep8qZoE/8yOGNiKJeMINTwdNCd0hgdCQ9gdeiCPoPz8TJKv0Bb6ZQrj2kmQ8Jq0b0CQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:10.905396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:10.918738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2a915bbf-e7c8-4054-9d51-6c2bfc6342c9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:10.923510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2a915bbf-e7c8-4054-9d51-6c2bfc6342c9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:10.940737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:10.954854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:10.958032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9af0b2bc-be3f-4922-aa14-74ca3e4da07b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.637628 Jul 28 11:30:10.959448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 715/1417] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:10 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:10.960648 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a915bbf-e7c8-4054-9d51-6c2bfc6342c9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.081388 Jul 28 11:30:10.969159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 703/1418] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 28 11:30:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:30:10.975027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:10.976090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:10.992685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.993141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.994117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:10.994560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:10.994962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:10.995808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:11.008631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:11.009777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:11.012209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:11.013090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:11.823180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:11.833240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-686caf2c-fb00-453e-8f64-d51cd5e3e603 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.849518 Jul 28 11:30:11.848468 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 716/1419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:10 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:11.859022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9369512-2f93-4318-86d2-52f963ebd5a9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb30b39d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:11.869080 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9369512-2f93-4318-86d2-52f963ebd5a9 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1095876608" status: 200 len: 513 microversion: 2.2 time: 0.019502 Jul 28 11:30:11.870907 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 717/1420] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 28 11:30:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1095876608 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:11.875941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:11.877187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:11.886043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:11.887486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:11.888412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:11.888981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:11.930284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:11.941630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4615e9aa-900b-4e33-be3d-1a454c46a715 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1512 microversion: 2.1 time: 0.970894 Jul 28 11:30:11.955813 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 704/1421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:10 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1512 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:11.965349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2aa1554-deb2-4421-b702-df9f2fe2e2a3 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2f59940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:11.979483 n-d-851368-1 devstack@n-api.service[119236]: WARNING oslo_db.sqlalchemy.utils [None req-c2aa1554-deb2-4421-b702-df9f2fe2e2a3 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:30:11.988181 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2aa1554-deb2-4421-b702-df9f2fe2e2a3 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.030917 Jul 28 11:30:11.994647 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 705/1422] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Jul 28 11:30:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:11.999857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:12.000661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:12.010477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.011265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.019328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.020076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.453096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:12.471922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0a0cffd-938c-4520-9f8a-4566466125fa tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.594130 Jul 28 11:30:12.474864 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 718/1423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:11 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:12.489271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:12.492050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:12.493486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:12.502956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a7b4164-945a-4d4d-9127-c6e69978408f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1521 microversion: 2.1 time: 0.506988 Jul 28 11:30:12.507363 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 706/1424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:11 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:12.512295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-82a30aab-71d3-4ca9-acad-382c34268af7 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2f014c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:12.521721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.522538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.523654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.524344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.601193 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-82a30aab-71d3-4ca9-acad-382c34268af7 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095876608" status: 204 len: 0 microversion: 2.2 time: 0.092298 Jul 28 11:30:12.602155 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 707/1425] 10.222.0.93 () {60 vars in 1261 bytes} [Thu Jul 28 11:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095876608 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:12.615693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e136674d-52b8-4587-b731-21134272b802", "name": "network-vif-unplugged", "status": "completed", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}, {"name": "network-changed", "server_uuid": "e136674d-52b8-4587-b731-21134272b802", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:12.651331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.651780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.685835 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] Creating event network-vif-unplugged:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:30:12.687001 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] Creating event network-changed:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:30:12.706147 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1503e009-270f-448a-8f64-59f7a0a26bf4 req-5986cb37-0956-4383-b5cf-886425e02fd7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.102644 Jul 28 11:30:12.715348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 708/1426] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:12.727590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3b5ef799-398b-4ad3-b2e5-7276d30f50d9 req-57369016-2f7e-4683-86b9-b6e5190f2135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33daecce-0fef-495a-a0bd-cdb1ab7683ee", "name": "network-vif-deleted", "tag": "fb422efd-8657-439e-97c7-9c732a314ecc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:12.744457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3b5ef799-398b-4ad3-b2e5-7276d30f50d9 req-57369016-2f7e-4683-86b9-b6e5190f2135 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.744991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3b5ef799-398b-4ad3-b2e5-7276d30f50d9 req-57369016-2f7e-4683-86b9-b6e5190f2135 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.768447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3b5ef799-398b-4ad3-b2e5-7276d30f50d9 req-57369016-2f7e-4683-86b9-b6e5190f2135 service nova] Creating event network-vif-deleted:fb422efd-8657-439e-97c7-9c732a314ecc for instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee on n-h2-851368-1 Jul 28 11:30:12.779105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3b5ef799-398b-4ad3-b2e5-7276d30f50d9 req-57369016-2f7e-4683-86b9-b6e5190f2135 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060696 Jul 28 11:30:12.781358 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 709/1427] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:12.792769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:12.795893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:12.817600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.818581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.819401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:12.819840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:12.874296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:30:13.128594 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a62a295b-da26-4427-9b04-ddd9b2232898 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 204 len: 0 microversion: 2.1 time: 0.334341 Jul 28 11:30:13.135661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 710/1428] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:12 2022] DELETE /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:13.158317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Action: 'create', calling method: .version_select at 0x7f2eb31451f0>, body: {"keypair": {"name": "tempest-keypair-558981492", "type": "x509"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:13.196468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=67 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:13.205547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:13.215728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:13.252398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.processutils [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmprrx09b44/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmprrx09b44/temp.key -subj /CN=1a70b6f8ef0d47d1bf4d577467f0fe3a -extensions v3_req_client {{(pid=119236) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 11:30:13.386685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:13.399834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:13.404740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:13.408004 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b63496f-278f-4db5-905f-5c293bb772d0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.930421 Jul 28 11:30:13.412293 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 719/1429] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:12 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:13.426797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:13.428375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:13.451177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:13.454635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:13.461853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:13.462335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:13.678717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:13.811410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.processutils [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmprrx09b44/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmprrx09b44/temp.key -subj /CN=1a70b6f8ef0d47d1bf4d577467f0fe3a -extensions v3_req_client" returned: 0 in 0.561s {{(pid=119236) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 11:30:13.813936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.processutils [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmprrx09b44/temp.key -password pass: {{(pid=119236) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 11:30:13.895043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.processutils [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] CMD "openssl pkcs12 -export -inkey /tmp/tmprrx09b44/temp.key -password pass:" returned: 0 in 0.080s {{(pid=119236) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 11:30:13.966953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:13.972097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:13.976965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Getting quotas for user 1a70b6f8ef0d47d1bf4d577467f0fe3a and project 9d4883c56df745479ac488f2926556cd. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:13.983390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3902c583-01dd-463d-aa10-1aaeb7225044 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.560257 Jul 28 11:30:13.984427 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 720/1430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:13 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:13.988824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:14.004146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.007412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:14.021778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.022354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.024663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.025281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.040304 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79887823-dda8-4ba4-a604-69e3b6aae304 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.898105 Jul 28 11:30:14.055251 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 711/1431] 10.222.0.93 () {62 vars in 1198 bytes} [Thu Jul 28 11:30:13 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 919 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:14.079014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9d968b29-7392-467e-b006-7402000cd47d req-a496eddc-e77e-469f-9244-0fd49e5e41a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e036573-1882-4c1e-9368-443955b1d3a4", "name": "network-vif-plugged", "status": "completed", "tag": "ad9022ef-c547-45e7-bcbf-e3dfaf723220"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:14.101964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.102528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.103503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'fault' on Instance uuid 33daecce-0fef-495a-a0bd-cdb1ab7683ee {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:14.121094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d968b29-7392-467e-b006-7402000cd47d req-a496eddc-e77e-469f-9244-0fd49e5e41a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.121459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d968b29-7392-467e-b006-7402000cd47d req-a496eddc-e77e-469f-9244-0fd49e5e41a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.161568 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9d968b29-7392-467e-b006-7402000cd47d req-a496eddc-e77e-469f-9244-0fd49e5e41a6 service nova] Creating event network-vif-plugged:ad9022ef-c547-45e7-bcbf-e3dfaf723220 for instance 6e036573-1882-4c1e-9368-443955b1d3a4 on n-h2-851368-1 Jul 28 11:30:14.167521 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9d968b29-7392-467e-b006-7402000cd47d req-a496eddc-e77e-469f-9244-0fd49e5e41a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110432 Jul 28 11:30:14.168323 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 712/1432] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:14.173223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.173973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:14.181479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.181935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.182721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.183181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.279302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:14.285766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:14.297875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-15ddf40e-b5c6-4ba1-b203-adffd68aad69 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 200 len: 1306 microversion: 2.1 time: 0.308137 Jul 28 11:30:14.315586 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 721/1433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:13 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 1306 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:14.325632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.326483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:14.335435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.336121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.336987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.337590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.588985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:14.616090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a52fe1f8-3a95-4333-8b0d-d7b7839b2275 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1527 microversion: 2.1 time: 0.446702 Jul 28 11:30:14.627902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 713/1434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1527 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:14.649784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cbad765b-de41-4578-8e81-24cd10bb4c99 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb35480d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.680361 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cbad765b-de41-4578-8e81-24cd10bb4c99 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-558981492" status: 200 len: 1533 microversion: 2.2 time: 0.050262 Jul 28 11:30:14.682867 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 714/1435] 10.222.0.93 () {60 vars in 1255 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-558981492 => generated 1533 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:14.689433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.692699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:14.703627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.704505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.707601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:14.712029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:14.828267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:14.861273 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ab05b50-4a2c-4f88-a712-28fa561caab0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.544207 Jul 28 11:30:14.862396 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 722/1436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:14.872541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-537f0127-bc1b-40f3-ab7f-e29cf7ab7ce4 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb2690c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.878238 n-d-851368-1 devstack@n-api.service[119235]: WARNING oslo_db.sqlalchemy.utils [None req-537f0127-bc1b-40f3-ab7f-e29cf7ab7ce4 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:30:14.893679 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-537f0127-bc1b-40f3-ab7f-e29cf7ab7ce4 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.029964 Jul 28 11:30:14.894543 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 723/1437] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:14.906502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa459320-454f-4a5e-a39b-00051b3a6f86 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] Calling method '.version_select at 0x7f2eb26f09d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:14.936085 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa459320-454f-4a5e-a39b-00051b3a6f86 tempest-KeyPairsV22TestJSON-1890189240 tempest-KeyPairsV22TestJSON-1890189240-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558981492" status: 204 len: 0 microversion: 2.2 time: 0.034328 Jul 28 11:30:14.941114 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 724/1438] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 28 11:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558981492 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:30:15.004771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:15.005648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:15.017862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.017862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.025055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.025055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.209154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:15.223895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:15.230210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:15.231553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47906d08-a2c7-4259-a54b-d3d8827cfb18 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.547484 Jul 28 11:30:15.246532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 715/1439] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:15.495016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bb69d26c-7c8c-4600-b107-c69d813efc0f req-0a132db6-42ba-49ab-8277-af51940d3cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f03201-c90f-409e-8402-4db44eb5b4b1", "tag": "359191e4-9eb6-4c86-a501-026cd96c15ed"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:15.523627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bb69d26c-7c8c-4600-b107-c69d813efc0f req-0a132db6-42ba-49ab-8277-af51940d3cf8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.524378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bb69d26c-7c8c-4600-b107-c69d813efc0f req-0a132db6-42ba-49ab-8277-af51940d3cf8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.543526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bb69d26c-7c8c-4600-b107-c69d813efc0f req-0a132db6-42ba-49ab-8277-af51940d3cf8 service nova] Creating event network-changed:359191e4-9eb6-4c86-a501-026cd96c15ed for instance f9f03201-c90f-409e-8402-4db44eb5b4b1 on n-h2-851368-1 Jul 28 11:30:15.546890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:15.556702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9a1d2f8-0370-4db9-b575-bba2f5ca4184 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.555725 Jul 28 11:30:15.557299 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 725/1440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:14 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:15.560510 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bb69d26c-7c8c-4600-b107-c69d813efc0f req-0a132db6-42ba-49ab-8277-af51940d3cf8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310895 Jul 28 11:30:15.562008 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 716/1441] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:15.586936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:15.587805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:15.594533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.600888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.601905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.602357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.636320 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee HTTP/1.1 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '33daecce-0fef-495a-a0bd-cdb1ab7683ee'} Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:15.638030 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-12a6f683-e5e0-4c58-8e99-47a71e5a497b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 404 len: 111 microversion: 2.1 time: 0.057381 Jul 28 11:30:15.647566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 726/1442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:15 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:15.648216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:15.648216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:15.654835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:15.655514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:15.660003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.660463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.661253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.662253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.662564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.663050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:15.664196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:15.664647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.196611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.214040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4155616-a16c-4e70-abd7-3823e5937ba6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1527 microversion: 2.1 time: 0.577409 Jul 28 11:30:16.229170 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 717/1443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:15 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1527 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:16.235603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:16.236327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:16.245735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.247683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.248664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.249120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.293452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.301891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1063452-75e9-4482-a3a3-9042fab15f38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.653595 Jul 28 11:30:16.307920 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 727/1444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:15 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:16.319353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b16a28d0-556a-414f-9f08-ed185b6cb38d req-6da9fd05-296c-415e-8be0-03d7684d2d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e036573-1882-4c1e-9368-443955b1d3a4", "name": "network-vif-unplugged", "status": "completed", "tag": "ad9022ef-c547-45e7-bcbf-e3dfaf723220"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:16.338780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b16a28d0-556a-414f-9f08-ed185b6cb38d req-6da9fd05-296c-415e-8be0-03d7684d2d35 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.339355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b16a28d0-556a-414f-9f08-ed185b6cb38d req-6da9fd05-296c-415e-8be0-03d7684d2d35 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.362919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b16a28d0-556a-414f-9f08-ed185b6cb38d req-6da9fd05-296c-415e-8be0-03d7684d2d35 service nova] Creating event network-vif-unplugged:ad9022ef-c547-45e7-bcbf-e3dfaf723220 for instance 6e036573-1882-4c1e-9368-443955b1d3a4 on n-h2-851368-1 Jul 28 11:30:16.382645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b16a28d0-556a-414f-9f08-ed185b6cb38d req-6da9fd05-296c-415e-8be0-03d7684d2d35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072551 Jul 28 11:30:16.383325 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 728/1445] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:16.390261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:16.391035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:16.404385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:16.418709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.419510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.421038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.421680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.740560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.748481 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eda3642e-a22a-47d6-b75b-70dc435a2d98 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.517024 Jul 28 11:30:16.760073 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 718/1446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:16 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:16.770315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0415b13e-f85a-47f4-90f0-ef36d86d9520 req-6c2a9828-3324-4faa-b468-4ee12068b921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e036573-1882-4c1e-9368-443955b1d3a4", "name": "network-vif-deleted", "tag": "ad9022ef-c547-45e7-bcbf-e3dfaf723220"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:16.783473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0415b13e-f85a-47f4-90f0-ef36d86d9520 req-6c2a9828-3324-4faa-b468-4ee12068b921 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.784249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0415b13e-f85a-47f4-90f0-ef36d86d9520 req-6c2a9828-3324-4faa-b468-4ee12068b921 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.798116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0415b13e-f85a-47f4-90f0-ef36d86d9520 req-6c2a9828-3324-4faa-b468-4ee12068b921 service nova] Creating event network-vif-deleted:ad9022ef-c547-45e7-bcbf-e3dfaf723220 for instance 6e036573-1882-4c1e-9368-443955b1d3a4 on n-h2-851368-1 Jul 28 11:30:16.804033 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0415b13e-f85a-47f4-90f0-ef36d86d9520 req-6c2a9828-3324-4faa-b468-4ee12068b921 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042588 Jul 28 11:30:16.805229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 719/1447] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:16.807657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.810832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa87ffea-3f43-430e-96b9-5d20a9dd8775 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa87ffea-3f43-430e-96b9-5d20a9dd8775 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 163 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": 12345, "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 12345 Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:30:16.816105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 11:30:16.821285 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:16.823005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa87ffea-3f43-430e-96b9-5d20a9dd8775 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:16.824660 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aa87ffea-3f43-430e-96b9-5d20a9dd8775 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017722 Jul 28 11:30:16.825699 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 720/1448] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:16 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:16.827315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.829311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:16.830850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:16.831229 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e61905a6-e211-4dd8-9d62-0e1bf066ebb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.444758 Jul 28 11:30:16.831613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:16.833251 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 729/1449] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:16 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:16.844188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:16.844904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:16.853699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.854495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.855952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.857358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.872322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.876546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:16.877717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:16.878524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.141799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:17.148497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:17.153846 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b06d2391-f951-4176-8ad9-7e199bb6eb3d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.326951 Jul 28 11:30:17.154801 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 721/1450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:16 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:17.171165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5dea439-2b95-49be-9ae0-dc18088b7f79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.336305 Jul 28 11:30:17.171912 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 730/1451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:16 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:17.193872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:17.194773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:17.201983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.202438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.203449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.203886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.236079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:17.236924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:17.244086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.244843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.245892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.246536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.301673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.302317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.302667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lazy-loading 'fault' on Instance uuid 6e036573-1882-4c1e-9368-443955b1d3a4 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:17.361887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:17.373900 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-813082b8-a615-4cce-a0e6-c83b9b919b90 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 200 len: 1315 microversion: 2.1 time: 0.141963 Jul 28 11:30:17.379120 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 731/1452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:17 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:17.389438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:17.397766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89239f45-800b-4817-a3e3-2726bbe26665 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.209140 Jul 28 11:30:17.398803 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 722/1453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:17 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:17.773137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:17.773777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:17.791470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.792099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.792971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.793821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.858702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:17.859375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:17.876844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.877313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:17.878116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:17.878559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.040302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:18.055245 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b95f1642-2ab5-4eae-97a7-7a26e3f6f447 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.286410 Jul 28 11:30:18.056392 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 732/1454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:17 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:18.121935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:18.136703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:18.144864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:18.148199 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-974286b9-557f-467f-b356-d45c6e8793a7 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.294050 Jul 28 11:30:18.159165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 723/1455] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:17 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:30:18.178860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:18.180066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:18.188570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:18.189359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.190640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:18.191449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.318559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:18.399196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:18.400788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:18.415363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:18.416257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.417700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:18.418553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.438624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 HTTP/1.1 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6e036573-1882-4c1e-9368-443955b1d3a4'} Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:18.440683 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-381aab67-8b26-4c98-8ba8-f853b02bc50a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 404 len: 111 microversion: 2.1 time: 0.051980 Jul 28 11:30:18.462232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 724/1456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:18 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:18.551599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:18.581382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-72d2d053-9a86-4951-8efe-8aacdadde126 req-6a254c81-918f-40cf-b8ea-26cf652f4f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee0637e-0188-44d7-90da-07a152c97d73", "name": "network-vif-plugged", "status": "completed", "tag": "5c32a1b6-4881-4e74-a4c9-73f3059f269f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:18.582703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7052731b-1452-45a1-9e02-79cb82a41ff2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.408419 Jul 28 11:30:18.590245 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 733/1457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:18 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:18.620326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-72d2d053-9a86-4951-8efe-8aacdadde126 req-6a254c81-918f-40cf-b8ea-26cf652f4f93 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:18.621026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-72d2d053-9a86-4951-8efe-8aacdadde126 req-6a254c81-918f-40cf-b8ea-26cf652f4f93 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:18.642419 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-72d2d053-9a86-4951-8efe-8aacdadde126 req-6a254c81-918f-40cf-b8ea-26cf652f4f93 service nova] Creating event network-vif-plugged:5c32a1b6-4881-4e74-a4c9-73f3059f269f for instance 0ee0637e-0188-44d7-90da-07a152c97d73 on n-h1-851368-1 Jul 28 11:30:18.648106 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-72d2d053-9a86-4951-8efe-8aacdadde126 req-6a254c81-918f-40cf-b8ea-26cf652f4f93 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070444 Jul 28 11:30:18.649297 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 725/1458] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:30:18.661916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1067002361", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:18.773634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] validate_networks() for [('8af4ed4a-dd6c-4e12-9a63-a2b3a5666ea8', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:19.080303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:19.081023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:19.090116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.090841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.091872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.092588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.477826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:19.486492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-866f7d85-1e57-4735-b0c7-6201cf0fd5fb tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.412456 Jul 28 11:30:19.487785 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 726/1459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:19 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:19.493768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:19.495300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:19.508663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.509584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.510528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.511166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.531255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:19.758986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:30:19.759576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:30:19.760187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:30:19.760646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:30:19.761274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:30:19.771655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.772405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.773220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.773667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.791889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:19.796614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Getting quotas for user 5df53556867f4caca1b5a531835db23b and project 926026a387b041dbbb68332685f6884c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:19.810378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:30:19.812955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:19.813659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:19.832672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:19.835805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:19.847689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16df5607-1ea1-466c-a879-b91f6b8f2e24 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.358379 Jul 28 11:30:19.872215 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 727/1460] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:19 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:19.877251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:19.877792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:19.885084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.885900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.887100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:19.887708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:19.932398 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72ee879e-fcc3-4b14-8dd7-97424d3c33be tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.275491 Jul 28 11:30:19.933720 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 734/1461] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:30:19.952546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cda9f32c-34ca-4612-b4d9-992fed86d7bd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:19.953557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cda9f32c-34ca-4612-b4d9-992fed86d7bd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:20.133224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cda9f32c-34ca-4612-b4d9-992fed86d7bd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:20.142591 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cda9f32c-34ca-4612-b4d9-992fed86d7bd tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1225 microversion: 2.1 time: 0.201531 Jul 28 11:30:20.148125 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 735/1462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:19 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:20.200556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:20.209613 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-791f38db-6ea2-418e-98c8-58c4933a9127 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.336224 Jul 28 11:30:20.223293 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 728/1463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:19 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:20.316502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81fa5b96-53c8-4b9c-99b0-69a7f32bb1ab tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1622083414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a8c602e3-cb57-4bd7-87d5-817a698ee22f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:20.479705 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-81fa5b96-53c8-4b9c-99b0-69a7f32bb1ab tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81fa5b96-53c8-4b9c-99b0-69a7f32bb1ab tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 358 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1622083414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a8c602e3-cb57-4bd7-87d5-817a698ee22f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: exception: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1622083414', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a8c602e3-cb57-4bd7-87d5-817a698ee22f'}], 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1625, in _create_instance Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:20.496329 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. Jul 28 11:30:20.500654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:20.504862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81fa5b96-53c8-4b9c-99b0-69a7f32bb1ab tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Block Device a8c602e3-cb57-4bd7-87d5-817a698ee22f is not bootable. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:20.506772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81fa5b96-53c8-4b9c-99b0-69a7f32bb1ab tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.200132 Jul 28 11:30:20.507917 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 736/1464] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:20.519532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:20.526590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:20.538700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.541501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:20.544370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.544370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:20.798694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:20.809129 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6dff5f20-3c8a-4817-b002-99c261056939 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.296288 Jul 28 11:30:20.809967 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 737/1465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:20 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:20.833692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:20.834643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:20.843174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.843956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:20.847476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.851228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:20.854965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:20.857426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:20.877726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.878265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:20.880193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:20.883677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.102766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.111638 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93492752-d80e-4dea-b019-86400c7552fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.281949 Jul 28 11:30:21.131784 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 738/1466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:20 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:21.141357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:21.141922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:21.157312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.157767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.158571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.159017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.193608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.209346 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-90b511e5-4ff0-4443-be28-504a77a33389 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.702029 Jul 28 11:30:21.211891 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 729/1467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:20 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:21.223155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:21.224811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:21.233505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.234357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.237000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.238672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.356235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.358322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.380885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.382925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:21.384347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3708cd5e-a8e4-45a5-af69-06fbf8f47a55 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.251505 Jul 28 11:30:21.386888 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea2e0ef6-ff7a-4a86-ae76-934352cc41c6 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1277 microversion: 2.1 time: 0.171288 Jul 28 11:30:21.390042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 730/1468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:21 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:21.401026 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 739/1469] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:21 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:21.408234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:21.409960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:21.421663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.422127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.422922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.423478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.637546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:21.638179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:21.652216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.659551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:21.666106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:21.670460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:22.511361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:22.522931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6d8a317-143e-458f-8576-1eaa1403b254 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 1.127497 Jul 28 11:30:22.537521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 731/1470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:21 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:22.551174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:22.552601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:22.562879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:22.563573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:22.564690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:22.565280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:22.626683 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a842b313-f1cb-46b2-9981-c4fde086b354 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1855 microversion: 2.1 time: 0.993538 Jul 28 11:30:22.630303 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 740/1471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:21 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1855 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:22.648115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:22.648747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:22.666523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:22.667015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:22.667870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:22.672979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.061062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.073958 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ee7c555-781b-4f59-92c2-02bcb58f2b07 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.535100 Jul 28 11:30:23.078188 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 732/1472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:22 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:23.084670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:23.088643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:23.098358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.099738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.101251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.101933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.152010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.162983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.164953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.166769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c012c81a-81cf-4d53-9f7f-b02bc2dc099b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.535178 Jul 28 11:30:23.167395 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 741/1473] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:22 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:23.177730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851368-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:23.180996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:23.188179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.188633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.189627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.190232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.203443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.217570 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3689d6ff-8bbf-40c9-bae4-aa317a44fedc tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1283 microversion: 2.1 time: 0.132976 Jul 28 11:30:23.219787 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 733/1474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:23 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:23.244038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lazy-loading 'flavor' on Instance uuid 54d4c426-667d-481c-a22b-13db36383d0c {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:23.260192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Going to try to live migrate instance to n-h2-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:30:23.337762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:23.559474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:23.560101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:23.567412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.573490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.574409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:23.574869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:23.904150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:23.915146 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40239f16-c9e3-454a-97ed-25511a57d328 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 0.359388 Jul 28 11:30:23.919262 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 734/1475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:23 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:24.065957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec2d3d4e-7bfb-4dfc-811b-bc335ec314fa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146659725", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "destination_type": "local"}, {"source_type": "volume", "uuid": "f6219924-9586-4ec2-badf-f098fcf3b49f", "destination_type": "invalid"}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec2d3d4e-7bfb-4dfc-811b-bc335ec314fa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 495 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146659725", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "destination_type": "local"}, {"source_type": "volume", "uuid": "f6219924-9586-4ec2-badf-f098fcf3b49f", "destination_type": "invalid"}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1146659725', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f6219924-9586-4ec2-badf-f098fcf3b49f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:24.075929 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 11:30:24.081744 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:24.088517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec2d3d4e-7bfb-4dfc-811b-bc335ec314fa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:24.093357 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec2d3d4e-7bfb-4dfc-811b-bc335ec314fa tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031631 Jul 28 11:30:24.103410 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 735/1476] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:24 2022] POST /compute/v2.1/servers => generated 155 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:30:24.108343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:24.116966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:24.126626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=7 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:24.142606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:24.143417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:24.144435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:24.148110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:25.085892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:25.098992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0df9753-9643-4cda-a85d-bb7ebe2730ea tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1475 microversion: 2.1 time: 0.994199 Jul 28 11:30:25.102479 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 736/1477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:24 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1475 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:25.117583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:25.119900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:25.134986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:25.135761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:25.138714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:25.139414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:25.593310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:25.601757 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-77198078-4d10-483e-a6a3-f41f2ad72d38 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.497174 Jul 28 11:30:25.605810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 737/1478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:25 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:25.611419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:25.612038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:25.629502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:25.629502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:25.630192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:25.630631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.223678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:26.240091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:26.247634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:26.250669 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d97fd9d-42af-415e-a3b2-5f6418f87d27 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.643795 Jul 28 11:30:26.254188 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 738/1479] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:25 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:26.268811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:26.272616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:26.290472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:26.292263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.297081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:26.297870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.345999 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28112dc6-7aef-48f0-912b-8151f5831b44 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/action" status: 202 len: 0 microversion: 2.1 time: 3.173174 Jul 28 11:30:26.350656 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 742/1480] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:30:23 2022] POST /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/action => generated 0 bytes in 3179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:30:26.356616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:26.359601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:26.398664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:26.401112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.402964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:26.407019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.750635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:26.770633 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4296b836-36be-4ce3-949f-008f26fc64ed tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1325 microversion: 2.1 time: 0.510487 Jul 28 11:30:26.779701 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 739/1481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:26 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1325 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:26.940984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-65dd917a-834a-4af9-b074-04e18c64376f req-bd96f82d-aa04-4d8f-8a7c-303f6f8123d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f03201-c90f-409e-8402-4db44eb5b4b1", "name": "network-vif-plugged", "status": "completed", "tag": "359191e4-9eb6-4c86-a501-026cd96c15ed"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:26.954236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-65dd917a-834a-4af9-b074-04e18c64376f req-bd96f82d-aa04-4d8f-8a7c-303f6f8123d7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:26.955120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-65dd917a-834a-4af9-b074-04e18c64376f req-bd96f82d-aa04-4d8f-8a7c-303f6f8123d7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:26.976489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-65dd917a-834a-4af9-b074-04e18c64376f req-bd96f82d-aa04-4d8f-8a7c-303f6f8123d7 service nova] Creating event network-vif-plugged:359191e4-9eb6-4c86-a501-026cd96c15ed for instance f9f03201-c90f-409e-8402-4db44eb5b4b1 on n-h2-851368-1 Jul 28 11:30:26.988432 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-65dd917a-834a-4af9-b074-04e18c64376f req-bd96f82d-aa04-4d8f-8a7c-303f6f8123d7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202365 Jul 28 11:30:26.989938 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 740/1482] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:26.996962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:27.002178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:27.010228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:27.011131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:27.012214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:27.013195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:27.617139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:27.626714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aef28589-2480-4fe3-9aef-bcd3999251d9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1318 microversion: 2.1 time: 1.274521 Jul 28 11:30:27.627620 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 743/1483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:26 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1318 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:27.635619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9f06f2a7-543e-45e2-9a8f-bbca25fb906a req-a6ea62c9-1887-4091-8b78-ce98d11201b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17d3945-60af-4695-ac5d-5e3a330bf8c4", "tag": "5a37fc6a-65c1-445d-9bdc-51beafbd7f64"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:27.664979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9f06f2a7-543e-45e2-9a8f-bbca25fb906a req-a6ea62c9-1887-4091-8b78-ce98d11201b9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:27.667886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9f06f2a7-543e-45e2-9a8f-bbca25fb906a req-a6ea62c9-1887-4091-8b78-ce98d11201b9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:27.718538 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9f06f2a7-543e-45e2-9a8f-bbca25fb906a req-a6ea62c9-1887-4091-8b78-ce98d11201b9 service nova] Creating event network-changed:5a37fc6a-65c1-445d-9bdc-51beafbd7f64 for instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 on n-h2-851368-1 Jul 28 11:30:27.731617 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9f06f2a7-543e-45e2-9a8f-bbca25fb906a req-a6ea62c9-1887-4091-8b78-ce98d11201b9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102407 Jul 28 11:30:27.734765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 744/1484] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:27.747587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:27.749707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:27.766440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:27.767941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:27.769930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:27.772406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:28.090113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:28.101015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1867c197-2316-4671-b9bc-d8409e8e0fd0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.109511 Jul 28 11:30:28.101618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 741/1485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:26 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:28.152930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:28.153833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:28.191804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:28.192261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:28.193102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:28.193537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:28.213453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:28.221420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-16faceb1-e23c-4499-bdeb-a551a5cc21db tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1474 microversion: 2.1 time: 0.485228 Jul 28 11:30:28.221991 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 745/1486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:27 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:28.230384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:28.230997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:28.251249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:28.251759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:28.253905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:28.255726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:29.430064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:29.467322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f8a410e5-ed22-488c-8cd3-c3a316ab0c89 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 1.319496 Jul 28 11:30:29.468699 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 742/1487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:28 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:29.489837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:29.494699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:29.530717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:29.532495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:29.535251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:29.538611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:29.789752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:30.056439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:30.077608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:30.080158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:30.081613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e9b7b9c-77bc-49c9-ac42-c185306104cf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 1.858687 Jul 28 11:30:30.082956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 746/1488] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:28 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:30.092690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fc5d009-fb66-4287-9ece-d12066071219 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-823137046", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fc5d009-fb66-4287-9ece-d12066071219 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 491 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-823137046", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-823137046', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 28 11:30:30.102862 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 11:30:30.106735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:30.120033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fc5d009-fb66-4287-9ece-d12066071219 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:30.121173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1fc5d009-fb66-4287-9ece-d12066071219 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.035926 Jul 28 11:30:30.132522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 747/1489] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:30.141913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:30.143432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:30.159545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:30.165305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:30.165997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:30.168257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:30.168917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:31.154303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:31.169381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9429406-e660-4765-aa88-3532fc3364cb tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1325 microversion: 2.1 time: 1.697767 Jul 28 11:30:31.171887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 743/1490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:29 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1325 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:31.182826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:31.189550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:31.210480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:31.212483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:31.213522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:31.214421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:31.834820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:31.856128 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-42a9b179-823d-4c5a-80fb-adf171c912b7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1467 microversion: 2.1 time: 1.721698 Jul 28 11:30:31.856726 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 748/1491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:30 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1467 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:31.886799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-unplugged", "status": "completed", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:31.908466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:31.909543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:31.932919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] Creating event network-vif-unplugged:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h1-851368-1 Jul 28 11:30:31.951476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:30:31.982283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e3377bac-143f-4085-9eda-044fc57baf38 req-1d97173f-02de-466a-a483-d0d987b04216 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102514 Jul 28 11:30:31.993991 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 749/1492] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:32.000985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:32.001747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:32.009613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.011036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.012049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.012637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.121440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:32.139629 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb96aab8-8271-4b36-9487-7891675559cc tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1474 microversion: 2.1 time: 0.964337 Jul 28 11:30:32.140625 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 744/1493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:31 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1474 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:32.153199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:32.154260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:32.164404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.165575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.166580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.167049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.744692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:32.757905 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bc7a1a3-7be1-4b1a-b7fb-ae4c156b028c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.762505 Jul 28 11:30:32.771686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 750/1494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:31 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:32.771686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5ea164f1-731e-4fe5-9475-ef6587078855 req-caae24dd-a095-4a7a-888a-e8348de51f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e136674d-52b8-4587-b731-21134272b802", "name": "network-vif-unplugged", "status": "completed", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:32.793914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5ea164f1-731e-4fe5-9475-ef6587078855 req-caae24dd-a095-4a7a-888a-e8348de51f7d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.794389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5ea164f1-731e-4fe5-9475-ef6587078855 req-caae24dd-a095-4a7a-888a-e8348de51f7d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.827979 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5ea164f1-731e-4fe5-9475-ef6587078855 req-caae24dd-a095-4a7a-888a-e8348de51f7d service nova] Creating event network-vif-unplugged:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:30:32.836445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5ea164f1-731e-4fe5-9475-ef6587078855 req-caae24dd-a095-4a7a-888a-e8348de51f7d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076536 Jul 28 11:30:32.843660 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 751/1495] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:32.854215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:32.858790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:32.874283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.874861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:32.876140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:32.878201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:33.043309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:33.045998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:33.058560 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c92e9a90-97b1-4c92-9f36-8c763ee3d46a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.916212 Jul 28 11:30:33.059790 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 745/1496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:32 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:33.189127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-841211927", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:33.276102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:33.850777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:33.866873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:33.868400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:33.869593 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aaee9ebd-e34f-45cc-b24d-b6ae3d25a27f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 1.022840 Jul 28 11:30:33.870150 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 752/1497] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:32 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:33.880599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b303136b-a87a-4732-88d4-0cc360432917 req-1bf3002f-a902-470c-a73c-c6cc3169d194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e136674d-52b8-4587-b731-21134272b802", "name": "network-vif-unplugged", "status": "completed", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:33.907673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b303136b-a87a-4732-88d4-0cc360432917 req-1bf3002f-a902-470c-a73c-c6cc3169d194 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:33.908111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b303136b-a87a-4732-88d4-0cc360432917 req-1bf3002f-a902-470c-a73c-c6cc3169d194 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:33.937240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b303136b-a87a-4732-88d4-0cc360432917 req-1bf3002f-a902-470c-a73c-c6cc3169d194 service nova] Creating event network-vif-unplugged:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h2-851368-1 Jul 28 11:30:33.960072 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b303136b-a87a-4732-88d4-0cc360432917 req-1bf3002f-a902-470c-a73c-c6cc3169d194 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084987 Jul 28 11:30:33.961246 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 753/1498] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:33.975143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:33.976033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:33.985185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:33.986837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:33.990492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:33.992340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:34.662613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:34.676318 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a9b268b6-1355-49ba-8473-6b50a0cc28b9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 200 len: 1468 microversion: 2.1 time: 0.710627 Jul 28 11:30:34.677904 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 754/1499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:33 2022] GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 1468 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:34.692780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:34.701884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:34.734934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:34.735750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:34.736730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:34.737607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.245977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:35.270002 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-477bbd8a-760b-453c-8eeb-690e48e47ba9 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1325 microversion: 2.1 time: 0.586779 Jul 28 11:30:35.275872 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 755/1500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:34 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:35.295707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:30:35.299764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:35.300580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:30:35.301697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:30:35.306372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:30:35.309553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:30:35.311853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:35.328803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.331763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.332743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.333965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.335795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.335956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.336371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.336831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.393365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:35.403764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:35.434929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:30:35.440813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:35.577061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70299662-a54b-4933-ab33-48a641229b06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.515941 Jul 28 11:30:35.578256 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 746/1501] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:30:35.590178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:35.609396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:35.623750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.624366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.625205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.626316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.686043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:35.700068 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-adef03a9-5570-4804-bb70-a101056c46d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.422734 Jul 28 11:30:35.705535 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 756/1502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:35 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:35.714530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:35.745164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.746323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.763775 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] Creating event network-changed:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h1-851368-1 Jul 28 11:30:35.774670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:30:35.793734 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c3f6fb08-0811-4172-acf3-a094230b6edb req-8100f0a2-1219-45a3-b14d-67f5b615b799 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086674 Jul 28 11:30:35.799772 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 757/1503] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:35.810809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:35.812089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:35.850792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.851706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:35.852711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:35.853136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:36.264279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:36.279195 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07230647-6e6b-4868-b7b6-13b791d8a98f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1472 microversion: 2.1 time: 0.696822 Jul 28 11:30:36.279944 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 747/1504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:35 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1472 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:36.296983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:36.303861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:36.304797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Searching by: {'reservation_id': 'r-zxvi7oud', 'deleted': False, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:30:36.318981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:36.319476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:36.320267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:36.324901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:36.626623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:30:36.697528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:36.713263 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff07200a-8ef9-44ea-ba76-7093b7499beb tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.909981 Jul 28 11:30:36.715619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:36.716091 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 758/1505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:35 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:36.723442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:36.724290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:36.911601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61dcc287-795a-4e79-af6c-3da983e7d558 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Action: 'create', calling method: .version_select at 0x7f2eb26614c0>, body: {"keypair": {"name": "tempest-keypair-1091146497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPPo91YE7WM0prCafR2QUEF3GFA8jF59wXpw4TKyp6VjXDZJQyu4PFMMpRM8TXRvN8cqc9krQP6Gg8KpbjMQ6Bqec2v4xOcH2cbmxBWZFBEUkVGO9ltIaLeYyWE5k0FXg=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:36.968578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-61dcc287-795a-4e79-af6c-3da983e7d558 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Getting quotas for project a3654b0deb60473f9fe209d63bbc0468. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:36.985774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-61dcc287-795a-4e79-af6c-3da983e7d558 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Getting quotas for user 590a62b1aba54d538a4e86480a79f38a and project a3654b0deb60473f9fe209d63bbc0468. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:37.047314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61dcc287-795a-4e79-af6c-3da983e7d558 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329167 Jul 28 11:30:37.047954 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 759/1506] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:30:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:37.066466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:37.067479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:37.084353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.085188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.086436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.087685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.235984 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16325902-7452-4d83-ad36-42666bfd3479 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-zxvi7oud" status: 200 len: 2928 microversion: 2.1 time: 0.955043 Jul 28 11:30:37.247311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 748/1507] 10.222.0.93 () {58 vars in 1197 bytes} [Thu Jul 28 11:30:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zxvi7oud => generated 2928 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:37.257026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:37.257026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:37.265509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.266029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.266887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.267814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.612510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:37.632680 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f64d4b65-ea94-4226-8411-d3127fed57b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1210 microversion: 2.1 time: 0.387420 Jul 28 11:30:37.634887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 749/1508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:37 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1210 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:37.648409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0215a989-5a3b-4430-8ee2-57f4dbb7e8d5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0215a989-5a3b-4430-8ee2-57f4dbb7e8d5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 416 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:37.665140 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:30:37.668708 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:37.671990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0215a989-5a3b-4430-8ee2-57f4dbb7e8d5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:37.674046 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0215a989-5a3b-4430-8ee2-57f4dbb7e8d5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.036740 Jul 28 11:30:37.683241 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 750/1509] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:37 2022] POST /compute/v2.1/servers => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:37.691865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:37.692845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:37.701130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.701954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.703001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:37.704246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:37.980700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.012009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.021256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.023023 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb776005-8871-4786-b920-da7a36cf8303 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.968800 Jul 28 11:30:38.033216 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 760/1510] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:37 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:38.038731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f179adc-7b59-4d6c-b8cc-7cdc3ce2af80 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:38.078344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.compute.server_groups [None req-1f179adc-7b59-4d6c-b8cc-7cdc3ce2af80 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Querying cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) for 2 instances {{(pid=119235) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 11:30:38.086075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f179adc-7b59-4d6c-b8cc-7cdc3ce2af80 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.086954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f179adc-7b59-4d6c-b8cc-7cdc3ce2af80 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.150071 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f179adc-7b59-4d6c-b8cc-7cdc3ce2af80 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/f91feeaa-dd48-41cf-96ad-b7a28361e987" status: 200 len: 270 microversion: 2.1 time: 0.115071 Jul 28 11:30:38.167716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 761/1511] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:30:38 2022] GET /compute/v2.1/os-server-groups/f91feeaa-dd48-41cf-96ad-b7a28361e987 => generated 270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:38.172873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:38.179921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.185938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:38.191914 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d9f20e7-ab2d-4b01-8668-5f4c4160179f tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1325 microversion: 2.1 time: 0.506963 Jul 28 11:30:38.193419 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 751/1512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:37 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:38.201538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.202960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:38.206184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:38.208701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.212154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.212611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.219050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.222819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.224544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.225136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.741681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.759797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82b6549b-50ad-4bd6-98db-8190fe500b72 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1469 microversion: 2.1 time: 0.590552 Jul 28 11:30:38.760713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 762/1513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:38 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1469 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:38.765586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:38.766478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:38.793373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.794129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.795271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.795946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.803134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:38.814622 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-713b888b-0bd7-436b-9bd4-72c767ac2d79 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.619610 Jul 28 11:30:38.821375 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 752/1514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:38 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:38.835510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:38.836368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:38.872246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.877071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:38.878569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:38.880700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.138961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:39.155614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:39.167744 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8106add2-b97a-4bb2-927a-592717e00ba8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.405350 Jul 28 11:30:39.170432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 763/1515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:38 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:39.178008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:39.179034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:39.186063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:39.188156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.188740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.189932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.190508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d0e8b62-0c8c-4423-99da-69b09af33335 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 200 len: 1619 microversion: 2.1 time: 0.367752 Jul 28 11:30:39.191138 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 753/1516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:38 2022] GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 1619 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:39.203500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:39.203500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:39.204629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.229081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.229567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.234660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.235827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.328562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:39.346797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43174aec-d116-43e3-bdc9-499482859366 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1272 microversion: 2.1 time: 0.174408 Jul 28 11:30:39.350207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 764/1517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:39 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:39.366692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:39.367317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:39.368280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:39.386703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.387551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.392178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.392975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.503544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5dbdeb45-e4d1-451d-bb29-c76810c14940 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "POST /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107/action" status: 202 len: 0 microversion: 2.1 time: 0.311085 Jul 28 11:30:39.509531 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 754/1518] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:30:39 2022] POST /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:30:39.519402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9f40a908-ff66-4a01-9819-bc4a2fe6e9b6 req-80ae89e3-50af-46ac-a546-2501b75a74a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17d3945-60af-4695-ac5d-5e3a330bf8c4", "name": "network-vif-plugged", "status": "completed", "tag": "5a37fc6a-65c1-445d-9bdc-51beafbd7f64"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:39.555671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9f40a908-ff66-4a01-9819-bc4a2fe6e9b6 req-80ae89e3-50af-46ac-a546-2501b75a74a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.556447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9f40a908-ff66-4a01-9819-bc4a2fe6e9b6 req-80ae89e3-50af-46ac-a546-2501b75a74a6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.591965 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9f40a908-ff66-4a01-9819-bc4a2fe6e9b6 req-80ae89e3-50af-46ac-a546-2501b75a74a6 service nova] Creating event network-vif-plugged:5a37fc6a-65c1-445d-9bdc-51beafbd7f64 for instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 on n-h2-851368-1 Jul 28 11:30:39.599537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9f40a908-ff66-4a01-9819-bc4a2fe6e9b6 req-80ae89e3-50af-46ac-a546-2501b75a74a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088091 Jul 28 11:30:39.602026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 755/1519] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:39.616112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:39.620823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:39.622031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:39.624359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b810fc8b-0e27-4fd0-a8da-0aab25479e27 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.271877 Jul 28 11:30:39.628654 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 765/1520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:39 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:39.645012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.649155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.653167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.653662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.660068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:39.660776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:39.694286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.694746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:39.702408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:39.702890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.237444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:40.254289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:40.260971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:40.268739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-588d7f2f-19a6-464d-9377-0de946c875e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1814 microversion: 2.25 time: 0.664871 Jul 28 11:30:40.269497 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 756/1521] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:39 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1814 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:40.279521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:40.281948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:40.282574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:40.296973 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0994d347-7865-4f15-ac3e-9d7166e74e48 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1325 microversion: 2.1 time: 0.653776 Jul 28 11:30:40.297522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.297676 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 766/1522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:39 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:40.298417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.299412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.306626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:40.307500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:40.310050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.317649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.318952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.321034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.321666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.773941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:40.779516 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e312cdc9-b5bb-4b91-a5b2-e62fbab20b3c tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 200 len: 1618 microversion: 2.1 time: 0.507982 Jul 28 11:30:40.781894 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 757/1523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:40 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 1618 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:40.786827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-50bc7eb8-7c4f-413a-a358-e79ff672c184 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.487652 Jul 28 11:30:40.803105 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 767/1524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:40 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:40.803493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:40.804467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:40.819628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff7a544b-7e5f-4560-9362-ab8d7848dc4e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-579390277", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": -1, "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:40.836054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.838636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.841318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.842977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.858931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ff7a544b-7e5f-4560-9362-ab8d7848dc4e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Flavor -1 could not be found. Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff7a544b-7e5f-4560-9362-ab8d7848dc4e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 205 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-579390277", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": -1, "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor -1 could not be found. Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-579390277', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': -1, 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:40.863624 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 28 11:30:40.869567 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:40.872524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff7a544b-7e5f-4560-9362-ab8d7848dc4e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:40.878084 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff7a544b-7e5f-4560-9362-ab8d7848dc4e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.063499 Jul 28 11:30:40.879245 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 758/1525] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:40 2022] POST /compute/v2.1/servers => generated 73 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:30:40.887715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:40.891415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:40.906937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.908142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:40.909135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:40.912614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:41.091653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:41.105258 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff9d8401-ee40-47d1-ad73-81c09bc6a4bb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1272 microversion: 2.1 time: 0.224613 Jul 28 11:30:41.106470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 759/1526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:40 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:41.113997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:41.114880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:41.137897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:41.138848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:41.141429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:41.142086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:41.409727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:41.422585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea7d4f5b-a5eb-4a9d-aea3-377f22e91edf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.632171 Jul 28 11:30:41.442686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 768/1527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:40 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:41.448022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1032827384", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "df3a374f-7b2d-457c-866e-e6c033a0b067"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:41.619827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:42.176033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:42.199727 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71e6fffb-4128-4609-8de2-10673ba826dc tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.091469 Jul 28 11:30:42.200798 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 760/1528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:41 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:42.209911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:42.210533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:42.239619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.240079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.240877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.241319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.335975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:30:42.336612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:30:42.337251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:30:42.337872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:30:42.338576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:30:42.353401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.356429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.357285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.357732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.376647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:42.382250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:42.409318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:30:42.412561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:42.504462 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55e7ad98-24d7-42c3-86ea-4eeba4aaa377 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060131 Jul 28 11:30:42.513285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 769/1529] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:30:42.521189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:42.522109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:42.529920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.530564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.531551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.532434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.696595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:42.705767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:42.708670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:42.710059 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01765273-e692-487b-9da2-570591d62f38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1804 microversion: 2.25 time: 0.508162 Jul 28 11:30:42.727529 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 761/1530] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:42 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1804 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:42.733788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:42.734696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:42.741299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.741966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.742918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.743816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.759136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:42.768836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8db17977-24d4-4200-b22c-f9240b8baff3 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1521 microversion: 2.1 time: 0.253618 Jul 28 11:30:42.773677 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 770/1531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:42 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:42.784593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:42.785228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:42.835054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.841292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:42.842648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:42.844796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.004325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:43.019386 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5e602917-ed72-448f-892a-0ef79d4626b7 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.289946 Jul 28 11:30:43.035026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 762/1532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:42 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:43.037725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-plugged", "status": "completed", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:43.050792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.051303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.055685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:43.063754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:43.064589 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] Creating event network-vif-plugged:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h1-851368-1 Jul 28 11:30:43.071930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:30:43.076407 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2519d20c-9a9f-438d-91e9-81d890535158 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.300731 Jul 28 11:30:43.077626 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 771/1533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:42 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:43.092225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.094005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.104228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.104845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.105848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.106409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.116206 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-252e8b87-a511-4bcb-b5b8-5fc125a63114 req-7342f5f5-d175-4613-bbfa-d643eba18f6c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087431 Jul 28 11:30:43.117254 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 763/1534] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:43.124961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.125984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.133930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.134707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.135729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.136329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.349025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:43.352358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:43.361077 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa279bde-8174-4561-be4f-c262c6723758 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.242204 Jul 28 11:30:43.361412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6477767d-6d88-4522-9ed9-2379db3d7618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.273035 Jul 28 11:30:43.375803 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 764/1535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:43.376006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 772/1536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.376096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.382328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "2c8fbf6a-7d99-4fcf-b7a4-cdbb3ce09e10"}], "security_groups": [{"name": "tempest-securitygroup--701781665"}], "key_name": "tempest-keypair-1091146497", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:43.447472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:43.455169 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2fcedcb-c17e-4d27-b653-aa6c5ff3c6bf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1221 microversion: 2.1 time: 0.091924 Jul 28 11:30:43.455881 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 765/1537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:43.460775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b398fec-83c5-4cbd-9f72-5ea2a38cb856 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '.version_select at 0x7f2eb26335e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.475361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b398fec-83c5-4cbd-9f72-5ea2a38cb856 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.475866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b398fec-83c5-4cbd-9f72-5ea2a38cb856 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.489920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b398fec-83c5-4cbd-9f72-5ea2a38cb856 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 4718 microversion: 2.25 time: 0.032437 Jul 28 11:30:43.490526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 766/1538] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/os-migrations => generated 4718 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:43.495458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.496135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.503175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.503839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.504893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.505546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.535715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:30:43.560235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] validate_networks() for [('2c8fbf6a-7d99-4fcf-b7a4-cdbb3ce09e10', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:43.638941 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cfd03f6-073b-4220-95cd-c27a952bdef7 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 204 len: 0 microversion: 2.1 time: 0.146578 Jul 28 11:30:43.640135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 767/1539] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:43 2022] DELETE /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:43.654343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdc2af73-517f-47f6-8f49-183e80cda938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1595178286", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdc2af73-517f-47f6-8f49-183e80cda938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 173 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1595178286", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1595178286', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi -1 Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:30:43.663008 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdc2af73-517f-47f6-8f49-183e80cda938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:43.667464 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fdc2af73-517f-47f6-8f49-183e80cda938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.023146 Jul 28 11:30:43.669932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 768/1540] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:43.673448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-621580ba-0006-44e4-9dea-dd7b80f40cd1 req-e0ef7d75-fa7d-43e6-a560-2e7a3e7553bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca86860-f570-459e-9250-ea5ab4f49488", "tag": "d78aa704-5e78-4e48-a7eb-bac3c9ff3859"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:43.684891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-621580ba-0006-44e4-9dea-dd7b80f40cd1 req-e0ef7d75-fa7d-43e6-a560-2e7a3e7553bf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.687579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-621580ba-0006-44e4-9dea-dd7b80f40cd1 req-e0ef7d75-fa7d-43e6-a560-2e7a3e7553bf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.699019 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-621580ba-0006-44e4-9dea-dd7b80f40cd1 req-e0ef7d75-fa7d-43e6-a560-2e7a3e7553bf service nova] Creating event network-changed:d78aa704-5e78-4e48-a7eb-bac3c9ff3859 for instance cca86860-f570-459e-9250-ea5ab4f49488 on n-h1-851368-1 Jul 28 11:30:43.704010 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-621580ba-0006-44e4-9dea-dd7b80f40cd1 req-e0ef7d75-fa7d-43e6-a560-2e7a3e7553bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034200 Jul 28 11:30:43.704997 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 769/1541] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:43.710554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.711486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.718154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.718604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.719401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.719838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.879135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:43.893551 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9fbcce99-7d75-42e9-b85d-ca9eb6e44f31 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 2423 microversion: 2.25 time: 0.187288 Jul 28 11:30:43.899689 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 770/1542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 2423 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:43.903482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:43.904523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:43.912555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.913006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:43.913773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:43.914251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.110353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:30:44.111016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:30:44.111608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:30:44.112027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:30:44.112448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:30:44.124057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.124966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.125464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.126351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.127040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.134234 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-308e2c35-f534-4dba-be03-cba364e6987a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1527 microversion: 2.1 time: 0.238007 Jul 28 11:30:44.134741 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 771/1543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:43 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1527 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.142585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.143242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.149394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.149852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.150639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.151121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.151524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Getting quotas for project a3654b0deb60473f9fe209d63bbc0468. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:30:44.155636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Getting quotas for user 590a62b1aba54d538a4e86480a79f38a and project a3654b0deb60473f9fe209d63bbc0468. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:30:44.169335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:30:44.171621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:30:44.222338 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2998c425-10c9-43ac-86c0-7d47be5275ac tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.856319 Jul 28 11:30:44.229080 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 773/1544] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:30:44.233990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.234697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.242053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.242465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.243305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.243741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.363341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.374632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6db4f911-d3fd-4fbd-bee7-bc849451190a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.238648 Jul 28 11:30:44.376181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 772/1545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.382989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.383691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.390070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.390705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.391846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.392284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.436024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:44.453765 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8162c03f-6d99-4152-9dd2-f03878c9fcab tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 2423 microversion: 2.25 time: 0.223461 Jul 28 11:30:44.454417 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 774/1546] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 2423 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:30:44.459514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.460304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.466989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.467703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.468826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.469733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.568552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.579883 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88725669-5c16-4357-b9ff-8e0b9f939eae tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.202250 Jul 28 11:30:44.581626 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 773/1547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.587378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04d9e24d-5e4d-4c21-bd51-f694ada41b9f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.588207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04d9e24d-5e4d-4c21-bd51-f694ada41b9f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.663189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04d9e24d-5e4d-4c21-bd51-f694ada41b9f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.673980 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04d9e24d-5e4d-4c21-bd51-f694ada41b9f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1226 microversion: 2.1 time: 0.090967 Jul 28 11:30:44.674678 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 774/1548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.679883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.680787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.693448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.694041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.694966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.695609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.703198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.714104 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c803d993-95b6-40a3-9d88-33aaf4fde196 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.258410 Jul 28 11:30:44.715172 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 775/1549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.719804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.720860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.727211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.727577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.728545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.728982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.922891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.929388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:44.932904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34b01300-2d34-48e7-bdd3-82ff51e80256 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.257091 Jul 28 11:30:44.933616 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 775/1550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.937574 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec41d2b0-bb2f-460a-a94d-28b80a5755eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.221229 Jul 28 11:30:44.938149 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 776/1551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:44.940266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.941112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.945652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:44.947652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:44.952594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.953048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.953869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.954305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.959305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.959668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:44.960448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:44.960883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.045320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:45.053995 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-90e0d553-22d6-4853-b92a-4f9fb552a132 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1269 microversion: 2.1 time: 0.118588 Jul 28 11:30:45.054660 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 776/1552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:44 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:45.059211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3af7c384-946f-438a-83f4-bde0cbbb4aa4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-190322050", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:45.064118 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3af7c384-946f-438a-83f4-bde0cbbb4aa4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3af7c384-946f-438a-83f4-bde0cbbb4aa4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 215 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-190322050", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-190322050', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:45.065738 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3af7c384-946f-438a-83f4-bde0cbbb4aa4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3af7c384-946f-438a-83f4-bde0cbbb4aa4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011480 Jul 28 11:30:45.070650 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 777/1553] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:45.076549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.077173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.084941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.085406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.086196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.086638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.112422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lazy-loading 'services' on Instance uuid e136674d-52b8-4587-b731-21134272b802 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:30:45.226916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:45.246885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-088c111a-a1ee-4c32-ac40-4e8500793177 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.174117 Jul 28 11:30:45.250285 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 778/1554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:45.259051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.261278 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f81e0cb8-38c6-4696-9059-117d2e9f0f28 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments/44c54588-0613-41a3-b11a-a65a02f91963" status: 202 len: 0 microversion: 2.25 time: 0.321752 Jul 28 11:30:45.267729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 777/1555] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Jul 28 11:30:44 2022] DELETE /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments/44c54588-0613-41a3-b11a-a65a02f91963 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:45.283211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.288168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.296650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.297494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.299900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.301676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.303762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.306903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.307087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.308037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.308630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.360103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5af6c6b-64a1-4d6f-81c6-f7b70191a827 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090986 Jul 28 11:30:45.361055 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 778/1556] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:30:45.366162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.366968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.373425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.374592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.375267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.375910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.853850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:45.862077 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb0045e6-6eed-4053-b6c0-1a3a051c581a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1527 microversion: 2.1 time: 0.610714 Jul 28 11:30:45.863300 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 779/1557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1527 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:45.868392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.869008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.875899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.876357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.877319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.877958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.880986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:45.890800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de47dee4-4708-4ac5-841e-8d4a0400fd41 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.528615 Jul 28 11:30:45.891490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 779/1558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:45.896932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:45.897725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:45.905874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.906545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:45.907551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:45.908159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.118727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:46.123158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:46.128062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e80cd3e-61f5-4bf2-afa3-fe46081c2436 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1222 microversion: 2.1 time: 0.235387 Jul 28 11:30:46.128857 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 780/1559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:46.143612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:46.144377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:46.153181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.153759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.155538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.156069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.195660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:46.203547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b625410-e550-4121-ad2b-16e086c6ceed tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.338954 Jul 28 11:30:46.204150 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 780/1560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:45 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:46.221292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:46.222073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:46.228247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.228817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.229681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.230212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.477207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:46.527642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:46.538783 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e1682d1-3cac-44b2-87cc-48863c2e19c5 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.399244 Jul 28 11:30:46.540540 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 781/1561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:46 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:46.548192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187745739", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-key-39314469", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:46.570992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:46.589996 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80bd890c-c0c2-455b-92a4-f8d434b2c85a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.372709 Jul 28 11:30:46.591952 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 781/1562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:46 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:46.599928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:46.601445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:46.609825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.610603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.612150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.612596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.648384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:46.654974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] validate_networks() for [('ddfecbec-84cc-466e-9a74-32188ed83a6b', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:30:46.913085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:46.935440 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-14837115-cd27-4cfd-abc0-46f522835cc9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1287 microversion: 2.1 time: 0.337991 Jul 28 11:30:46.936356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 782/1563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:46 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1287 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:46.960594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:46.964006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:46.982042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.983256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:46.984136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:46.984582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.061275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0115d6bc-dbca-4b6a-b446-259fd2a0604e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123620 Jul 28 11:30:47.063729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 783/1564] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:30:46 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:30:47.069380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:47.075573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:47.093795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.099694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.100608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.101068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.362406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df53556867f4caca1b5a531835db23b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926026a387b041dbbb68332685f6884c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:47.380764 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7ccaf93-723a-4816-ba5a-7e8916614d44 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 200 len: 1485 microversion: 2.1 time: 0.315840 Jul 28 11:30:47.381381 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 784/1565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:47 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 1485 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:47.395036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:47.395942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:47.402049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.402852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.403499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.403976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.638346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:47.647624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-feee5c63-ad0e-4ff4-acd9-408e5df64480 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1284 microversion: 2.1 time: 0.265131 Jul 28 11:30:47.661799 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 785/1566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:47 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:47.677344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e4bd1aeb-525f-463a-8a2a-ae6a091a6c05 req-8b2e01eb-75ec-41be-b684-ba3096260b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17d3945-60af-4695-ac5d-5e3a330bf8c4", "name": "network-vif-deleted", "tag": "5a37fc6a-65c1-445d-9bdc-51beafbd7f64"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:47.688412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e4bd1aeb-525f-463a-8a2a-ae6a091a6c05 req-8b2e01eb-75ec-41be-b684-ba3096260b6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.688412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e4bd1aeb-525f-463a-8a2a-ae6a091a6c05 req-8b2e01eb-75ec-41be-b684-ba3096260b6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.705270 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e4bd1aeb-525f-463a-8a2a-ae6a091a6c05 req-8b2e01eb-75ec-41be-b684-ba3096260b6f service nova] Creating event network-vif-deleted:5a37fc6a-65c1-445d-9bdc-51beafbd7f64 for instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 on n-h2-851368-1 Jul 28 11:30:47.711323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e4bd1aeb-525f-463a-8a2a-ae6a091a6c05 req-8b2e01eb-75ec-41be-b684-ba3096260b6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048004 Jul 28 11:30:47.713277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 786/1567] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:47.721661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:47.724111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:47.731473 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Invalid key_name provided. Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 244 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187745739", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-key-39314469", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid key_name provided. Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-187745739', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'key_name': 'tempest-key-39314469', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1635, in _create_instance Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1078, in _validate_and_build_base_options Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-39314469 not found for user dccf1445753846ac929d677614481e5f Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:47.737043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid key_name provided. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:47.742348 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e55ef49f-f410-4437-b31b-c3bd0fd497e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.196077 Jul 28 11:30:47.744887 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 782/1568] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 1202 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:30:47.744989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.746801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.746801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.746801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.753930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:47.754545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:47.780449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.781189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:47.782150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:47.782600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.133991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:48.145290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3cdfcf94-be0f-445d-8cd5-624422fa1c77 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.429738 Jul 28 11:30:48.149225 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 787/1569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:47 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:48.169851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:48.170940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:48.178372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.179198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.183990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.184762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.361563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:48.370397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-994859d1-1ff9-4a40-8c28-cf23d3fa679f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.626138 Jul 28 11:30:48.371284 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 783/1570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:47 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:48.403950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:48.408012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:48.421712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.422709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.424059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.425449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.742858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:48.752777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd453436-ea53-498e-9704-d9071c70fb82 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.601325 Jul 28 11:30:48.754080 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 788/1571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:48 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:48.760264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-unplugged", "status": "completed", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:48.778433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.780878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.803020 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] Creating event network-vif-unplugged:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:30:48.810792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:30:48.840857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-295883f2-197b-4350-88f7-9f07ea889aa1 req-62b298b5-0a73-4f81-9ccf-768e9bf9e096 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084454 Jul 28 11:30:48.841937 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 789/1572] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:48.855524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:48.857351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:48.884508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.900206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:48.901807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:48.902483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.466571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:49.474397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4a227d9c-67bd-4785-8037-856fae8976d3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.101475 Jul 28 11:30:49.474982 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 784/1573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:48 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:49.487025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:49.489880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:49.510895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.511390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.514009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.514468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.612451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a667c2d-31d4-484c-bfe0-70e35844c9ae tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127620 Jul 28 11:30:49.613472 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 785/1574] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:30:49 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:30:49.619862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:49.622663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: c17d3945-60af-4695-ac5d-5e3a330bf8c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:49.637800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.638252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.639041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.639495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.660142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:49.663366 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 HTTP/1.1 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c17d3945-60af-4695-ac5d-5e3a330bf8c4'} Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:49.675705 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. Jul 28 11:30:49.681767 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:49.682411 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a020c94-9bee-4435-9f83-259f5dc8706a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.828863 Jul 28 11:30:49.683167 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 790/1575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:48 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:49.684051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance c17d3945-60af-4695-ac5d-5e3a330bf8c4 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:49.686253 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0ed2a14e-e64c-4ffc-8023-aaeda5eef506 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4" status: 404 len: 111 microversion: 2.1 time: 0.070895 Jul 28 11:30:49.690020 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 786/1576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:49 2022] GET /compute/v2.1/servers/c17d3945-60af-4695-ac5d-5e3a330bf8c4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:49.695377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:49.696159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:49.696394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:49.697837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:49.703836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.704757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.705746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.706373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.710810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.713739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.715575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.721889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.889104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:49.906538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e854809-4231-4f5a-91ab-2f7a486303df tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1284 microversion: 2.1 time: 0.220372 Jul 28 11:30:49.909924 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 791/1577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:49 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:49.919148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:49.920387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:49.932021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.933194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:49.935354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:49.936220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.425426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:50.433585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7145ff9d-de96-4e15-b3f8-a12c041342dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1468 microversion: 2.1 time: 0.742285 Jul 28 11:30:50.447101 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 787/1578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:49 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:50.447101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:50.447101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:50.460891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:50.461341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.462198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:50.462701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.722672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:50.732086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-981af7e7-b1c1-4565-b623-9cb18615f731 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.819158 Jul 28 11:30:50.733316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 792/1579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:49 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:50.738451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-953202ba-e89a-401d-8cf0-8559646ebb80 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb2f01e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:50.801014 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-953202ba-e89a-401d-8cf0-8559646ebb80 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Image not found. Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-953202ba-e89a-401d-8cf0-8559646ebb80 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8 HTTP/1.1 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'ef2df93c-1787-4308-bbfb-0f803b97ead8'} Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef2df93c-1787-4308-bbfb-0f803b97ead8 to delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef2df93c-1787-4308-bbfb-0f803b97ead8 could not be found. Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:50.804970 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:30:50.810126 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:50.814571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-953202ba-e89a-401d-8cf0-8559646ebb80 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:50.815677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-953202ba-e89a-401d-8cf0-8559646ebb80 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8" status: 404 len: 62 microversion: 2.1 time: 0.080966 Jul 28 11:30:50.817060 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 793/1580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:50 2022] DELETE /compute/v2.1/images/ef2df93c-1787-4308-bbfb-0f803b97ead8 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:30:50.824334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:50.825237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:50.834540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:50.835316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.836294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:50.836898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.920535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:50.930366 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-146ca3bd-7e00-4cdf-9cb8-7a8f6a9ecec4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.494450 Jul 28 11:30:50.930981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 788/1581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:50 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:50.935569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-299897db-9104-45e4-b864-1d60c41b8c89 req-8f06b67a-5dea-43bf-8e4e-5eb4d192a8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:50.962044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-299897db-9104-45e4-b864-1d60c41b8c89 req-8f06b67a-5dea-43bf-8e4e-5eb4d192a8ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:50.962494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-299897db-9104-45e4-b864-1d60c41b8c89 req-8f06b67a-5dea-43bf-8e4e-5eb4d192a8ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:50.997476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-299897db-9104-45e4-b864-1d60c41b8c89 req-8f06b67a-5dea-43bf-8e4e-5eb4d192a8ea service nova] Creating event network-vif-unplugged:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:30:51.014283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-299897db-9104-45e4-b864-1d60c41b8c89 req-8f06b67a-5dea-43bf-8e4e-5eb4d192a8ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081563 Jul 28 11:30:51.015029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 789/1582] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:51.022707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:51.028347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:51.036601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.037393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.039811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.040759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.072245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:51.084140 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-088e06a5-4f14-4ccc-81f2-832696a7e2ab tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.265226 Jul 28 11:30:51.084941 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37b72917-bcbf-4add-8e49-6aebe890ce8c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068372 Jul 28 11:30:51.086108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 790/1584] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:30:51 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:30:51.086259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 794/1584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:50 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:51.091044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:51.091687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:51.092125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:51.092829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:51.100045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.100498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.101278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.101506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.101706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.102342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.103294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.103830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.124463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 HTTP/1.1 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6e036573-1882-4c1e-9368-443955b1d3a4'} Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:51.126311 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:51.131856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:51.133325 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70273410-e740-40d8-b1de-8f751af033c0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 404 len: 111 microversion: 2.1 time: 0.045910 Jul 28 11:30:51.134300 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 791/1585] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:51 2022] DELETE /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:51.141294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:51.153361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.154033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.176972 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] Creating event network-changed:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:30:51.191653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 11:30:51.214881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f488849a-8e7b-4eb9-997d-61ebdca7ea53 req-6ed8c90c-bcad-4593-9238-35fb296b6b02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078271 Jul 28 11:30:51.217570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 792/1586] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:51.228509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:51.232935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:51.248690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.249308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.250091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:51.250528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:51.586907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:51.599722 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-570fb17e-2086-494e-991c-f510bb663a3c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.512326 Jul 28 11:30:51.600331 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 795/1587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:51 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:51.617653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-96806151", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:52.092191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Neutron security group does_not_exist not found {{(pid=119236) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 28 11:30:52.092809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:52.094137 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 256 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-96806151", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-96806151', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 28 11:30:52.103331 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2152, in create Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1635, in _create_instance Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1063, in _validate_and_build_base_options Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 510, in _check_requested_secgroups Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 28 11:30:52.109705 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.114629 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54ca79d3-3a8c-4815-930a-88e324f73287 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.887398 Jul 28 11:30:52.114629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 793/1588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:51 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:52.115102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:52.116375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc20f7cf-9573-4a21-8b65-54e2974908bd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.503035 Jul 28 11:30:52.117985 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 796/1589] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:30:51 2022] POST /compute/v2.1/servers => generated 106 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:30:52.120182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.121020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: 6e036573-1882-4c1e-9368-443955b1d3a4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.131362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.131991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.132933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.133102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.135389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.136572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.151731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.153010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.153973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.154428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.155414 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 HTTP/1.1 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6e036573-1882-4c1e-9368-443955b1d3a4'} Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.157573 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. Jul 28 11:30:52.162144 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:52.164332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance 6e036573-1882-4c1e-9368-443955b1d3a4 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:52.165466 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ed4f290-3c1e-46f3-8a0c-a0775a96c6ae tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4" status: 404 len: 111 microversion: 2.1 time: 0.050405 Jul 28 11:30:52.166751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 794/1590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/6e036573-1882-4c1e-9368-443955b1d3a4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:52.171734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.172660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.186877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.188013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.189046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.189720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.576705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:52.587232 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c24f4ea8-e772-4dcc-acf9-8919d5e7f779 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1461 microversion: 2.1 time: 0.467819 Jul 28 11:30:52.600686 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 797/1591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1461 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:52.600686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.605162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.614759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.615572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.617240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.617922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.694166 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5998728-850a-4f47-b0d7-d08f443bd325 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.100106 Jul 28 11:30:52.701356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 798/1592] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:52.722810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.724346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.724993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:52.734582 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60d460c9-ba20-4cbb-8c8c-02bb97fc5dbb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.566450 Jul 28 11:30:52.735193 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 795/1593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:52.748096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:52.760461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.760620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:52.761234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.766722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.772885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.773048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.773314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:52.774100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:52.774538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.192761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:53.208841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9cdcae0f-9224-4b90-8ada-a3995e20af28 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.472559 Jul 28 11:30:53.209741 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 796/1594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:53.214713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-420f7bea-2dd7-49b4-8bc3-7b5534f7e02a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb2547790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:53.234840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:53.244116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67578fd4-a954-435d-b0ea-a5e9672bd2a3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.547713 Jul 28 11:30:53.257963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:53.260746 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 799/1595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:52 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:53.284849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-420f7bea-2dd7-49b4-8bc3-7b5534f7e02a tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314336467" status: 202 len: 0 microversion: 2.1 time: 0.073752 Jul 28 11:30:53.285445 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 797/1596] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314336467 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:30:53.294980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:53.300395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:53.322739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.323242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.324043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.324482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.448556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:53.449174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:53.455544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.455996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.456983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.457477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.851640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:53.864170 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22bc78d7-fbd5-4c1e-a545-e06daea959fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.573022 Jul 28 11:30:53.864772 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 798/1597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:53 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:53.869896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c4a0c3f1-a5ee-4041-9749-4e3d2968098c req-dd65be2d-ab1b-4a05-bdee-9197896c3da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:53.871001 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb36d42f-e5e9-4069-8ab1-ed8275183854 tempest-MigrationsAdminTest-592836818 tempest-MigrationsAdminTest-592836818-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1612 microversion: 2.1 time: 0.607188 Jul 28 11:30:53.883104 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 800/1598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:53 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1612 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:53.883104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:53.883104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:53.885258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.885903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.886846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.887474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.930731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c4a0c3f1-a5ee-4041-9749-4e3d2968098c req-dd65be2d-ab1b-4a05-bdee-9197896c3da8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.931314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c4a0c3f1-a5ee-4041-9749-4e3d2968098c req-dd65be2d-ab1b-4a05-bdee-9197896c3da8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.960611 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c4a0c3f1-a5ee-4041-9749-4e3d2968098c req-dd65be2d-ab1b-4a05-bdee-9197896c3da8 service nova] Creating event network-changed:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:30:53.969116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c4a0c3f1-a5ee-4041-9749-4e3d2968098c req-dd65be2d-ab1b-4a05-bdee-9197896c3da8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102905 Jul 28 11:30:53.974458 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 799/1599] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:53.979859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:53.980576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:53.989179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.989660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:53.990461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:53.990901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.137934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:54.163443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:54.283552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:54.304668 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6598be2a-6f7f-41e6-aa74-e1ee93693b87 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.429523 Jul 28 11:30:54.306030 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 801/1600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:53 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:54.321052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-93756f57-d9f2-4b78-a81b-d32b5494c392 req-d2183e9c-cc2d-4efc-9bde-9116a0dd1626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21948ab3-5b81-48fc-bda3-4b2d6ac2fbca", "tag": "ab7adb52-69e9-48de-8fff-507aa26d7fab"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:54.334669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:54.346345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-93756f57-d9f2-4b78-a81b-d32b5494c392 req-d2183e9c-cc2d-4efc-9bde-9116a0dd1626 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.347288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3da03873-4c5a-4f14-85af-5cf8ca6ceeeb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.371078 Jul 28 11:30:54.348667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-93756f57-d9f2-4b78-a81b-d32b5494c392 req-d2183e9c-cc2d-4efc-9bde-9116a0dd1626 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.349400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 800/1601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:53 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:54.359639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:54.377596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:54.378211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:54.380207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-93756f57-d9f2-4b78-a81b-d32b5494c392 req-d2183e9c-cc2d-4efc-9bde-9116a0dd1626 service nova] Creating event network-changed:ab7adb52-69e9-48de-8fff-507aa26d7fab for instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca on n-h1-851368-1 Jul 28 11:30:54.392054 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-93756f57-d9f2-4b78-a81b-d32b5494c392 req-d2183e9c-cc2d-4efc-9bde-9116a0dd1626 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084184 Jul 28 11:30:54.392671 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 802/1602] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:54.395263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.397186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.398978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.401934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.409315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:54.409913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:54.418557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.419333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.420366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.421005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.451179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:30:54.584710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:54.647193 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b61fa76-8e29-4476-a48e-6c8a7a766530 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 204 len: 0 microversion: 2.1 time: 0.248808 Jul 28 11:30:54.648458 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 803/1603] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:54 2022] DELETE /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:30:54.661800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:54.666869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:54.675999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:54.688377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.689067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.690823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.692545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.847554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:54.856638 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25a6c108-dca4-4767-8cb3-05afbaafa200 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.494642 Jul 28 11:30:54.857338 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 801/1604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:54 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:54.863328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:54.864133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 49de3d08-0bd6-46ea-b80c-680cdb914d48] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:54.870441 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/49de3d08-0bd6-46ea-b80c-680cdb914d48 HTTP/1.1 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '49de3d08-0bd6-46ea-b80c-680cdb914d48'} Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:54.872211 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. Jul 28 11:30:54.876566 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:54.877040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 49de3d08-0bd6-46ea-b80c-680cdb914d48 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:54.878451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3b0c2be-117f-45bc-93cd-984676389028 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/49de3d08-0bd6-46ea-b80c-680cdb914d48" status: 404 len: 111 microversion: 2.1 time: 0.019500 Jul 28 11:30:54.879106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 802/1605] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:54 2022] DELETE /compute/v2.1/servers/49de3d08-0bd6-46ea-b80c-680cdb914d48 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:54.885576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:54.886334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:54.893835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.895015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.896472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.897021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:54.955842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:54.966103 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-929a45cf-2f12-4a9d-bc9a-2dfb0ea3e338 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.313654 Jul 28 11:30:54.967949 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 804/1606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:54 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:54.975026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-69d27e0d-8b0f-45a5-a2ca-ff05b8a77c1e req-df1c332a-1f57-4635-8635-a52800d7e4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-plugged", "status": "completed", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:54.985765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-69d27e0d-8b0f-45a5-a2ca-ff05b8a77c1e req-df1c332a-1f57-4635-8635-a52800d7e4b0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:54.986498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-69d27e0d-8b0f-45a5-a2ca-ff05b8a77c1e req-df1c332a-1f57-4635-8635-a52800d7e4b0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.002710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-69d27e0d-8b0f-45a5-a2ca-ff05b8a77c1e req-df1c332a-1f57-4635-8635-a52800d7e4b0 service nova] Creating event network-vif-plugged:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:30:55.009247 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-69d27e0d-8b0f-45a5-a2ca-ff05b8a77c1e req-df1c332a-1f57-4635-8635-a52800d7e4b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039865 Jul 28 11:30:55.009855 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 805/1607] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:55.016976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2467ef1-2757-481a-9c6f-a922fc5e9ea0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '.version_select at 0x7f2eb24e0ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.045472 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c2467ef1-2757-481a-9c6f-a922fc5e9ea0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Image not found. Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2467ef1-2757-481a-9c6f-a922fc5e9ea0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/3fd728bd-d439-435e-b203-c7e08ecaa037 HTTP/1.1 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '3fd728bd-d439-435e-b203-c7e08ecaa037'} Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3fd728bd-d439-435e-b203-c7e08ecaa037 to delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fd728bd-d439-435e-b203-c7e08ecaa037 could not be found. Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.047857 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2467ef1-2757-481a-9c6f-a922fc5e9ea0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2467ef1-2757-481a-9c6f-a922fc5e9ea0 tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/images/3fd728bd-d439-435e-b203-c7e08ecaa037" status: 404 len: 62 microversion: 2.1 time: 0.037863 Jul 28 11:30:55.053322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 806/1608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] DELETE /compute/v2.1/images/3fd728bd-d439-435e-b203-c7e08ecaa037 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:30:55.055727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.055959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:55.056082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.065723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86fae7d3-acce-492a-a57a-4c0476bb52dd tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1467 microversion: 2.1 time: 0.184196 Jul 28 11:30:55.066399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 803/1609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:54 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1467 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:55.066705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.067988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.069051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.069495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.072393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.073006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.078898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.079524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.080498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.080942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.085534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:30:55.273355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:55.284028 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0819026b-ecda-49be-ba74-752f843933df tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.232739 Jul 28 11:30:55.286577 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 807/1610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:55.293730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.294683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.302583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:55.303439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.305214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.305214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.305528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.311661 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53cc8176-489a-491f-8730-67c707df26a7 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.242952 Jul 28 11:30:55.320447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 HTTP/1.1 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17'} Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:55.322030 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:55.326573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef21a75f-12fa-4d7a-8b3d-1406d54cd33c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 404 len: 111 microversion: 2.1 time: 0.035158 Jul 28 11:30:55.328255 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 804/1611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:55.328366 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 808/1612] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:30:55 2022] DELETE /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:55.332321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.333215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] [instance: bbcc2740-1b0d-43c0-995f-c853a755ec17] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.334544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.335235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.339469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.340039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.340692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.341127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.341626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.342085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.342862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.343608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.358016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] HTTP exception thrown: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Request method failure captured: Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 HTTP/1.1 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL3L_IfP66XK7SSoRa7qXA19R6i6pGypSmMk6fbp0v_ncyJWK6rmbtlLyIgXeB23TDKBfkdlew_pXDcdaiGmHutsrqtQI2rKRtt6KGmB21rRJ2hDg8lfKbOI_9RZsXJrKkURwTkm9nqd5QiuwiMLJv8B2mhmL53X6raknZ4-OYSxVE Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/926026a387b041dbbb68332685f6884c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_926026a387b041dbbb68332685f6884c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/926026a387b041dbbb68332685f6884c"}]}] Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 926026a387b041dbbb68332685f6884c Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-979309435 Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5df53556867f4caca1b5a531835db23b Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-979309435-project Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bbcc2740-1b0d-43c0-995f-c853a755ec17'} Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.359574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] Returning 404 to user: Instance bbcc2740-1b0d-43c0-995f-c853a755ec17 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7981537b-b603-48a8-93a8-fc64ffdbb15c tempest-ImagesOneServerNegativeTestJSON-979309435 tempest-ImagesOneServerNegativeTestJSON-979309435-project] 10.222.0.93 "GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17" status: 404 len: 111 microversion: 2.1 time: 0.032392 Jul 28 11:30:55.366035 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 809/1613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] GET /compute/v2.1/servers/bbcc2740-1b0d-43c0-995f-c853a755ec17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:30:55.371126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:55.371744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:55.378458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.378906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.383601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:55.383601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:55.986660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:55.994804 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff622466-4bb2-4003-b0f2-1f00838ce97c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.666197 Jul 28 11:30:56.003669 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 805/1614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:56.012259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.013241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:56.022941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.023924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.025066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.025739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.032046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:56.040185 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c1bb5a7-1a0a-45b7-a0d4-d20d2b9a3dbf tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.673015 Jul 28 11:30:56.041057 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 810/1615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:55 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:56.059865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.060813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:56.067345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.068096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.069104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.069756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.391261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:56.400153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:56.400891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee4185e6-6f7a-49c5-a443-c7d9ce4e07bf tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.396215 Jul 28 11:30:56.401693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 806/1616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:56 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:56.416024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7ebe8077-00e3-4de5-8960-6af6677bafd6 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.359874 Jul 28 11:30:56.417357 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 811/1617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:56 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:56.419919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.420409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:30:56.420931 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 9223372036854775808 could not be found. Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '9223372036854775808'} Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:56.422562 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea545cba-24a3-4639-9baa-9679b7793722 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012024 Jul 28 11:30:56.428820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 807/1618] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Jul 28 11:30:56 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:30:56.429985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.429985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:56.433648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-83b2354b-531d-4119-b340-3ecf0d918445 req-8a7b4832-1564-40b5-a7e8-58ff288ebd2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ff8452-7708-412c-a4b5-9e967f4f394d", "tag": "db1aaf79-0487-4df2-a3e8-ebea156a1269"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:56.438042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.439481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.443009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.443825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.448700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-83b2354b-531d-4119-b340-3ecf0d918445 req-8a7b4832-1564-40b5-a7e8-58ff288ebd2c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.450566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-83b2354b-531d-4119-b340-3ecf0d918445 req-8a7b4832-1564-40b5-a7e8-58ff288ebd2c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.465446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-83b2354b-531d-4119-b340-3ecf0d918445 req-8a7b4832-1564-40b5-a7e8-58ff288ebd2c service nova] Creating event network-changed:db1aaf79-0487-4df2-a3e8-ebea156a1269 for instance 24ff8452-7708-412c-a4b5-9e967f4f394d on n-h2-851368-1 Jul 28 11:30:56.470914 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-83b2354b-531d-4119-b340-3ecf0d918445 req-8a7b4832-1564-40b5-a7e8-58ff288ebd2c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051802 Jul 28 11:30:56.472313 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 812/1619] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:56.479148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.480968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:56.490879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.491602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.493121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:56.493908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:56.974714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:56.987103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68cb28e3-5533-49bc-afc7-2790809507b9 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1467 microversion: 2.1 time: 0.561348 Jul 28 11:30:56.987964 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 808/1620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:56 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1467 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:56.995103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:56.995947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:57.002284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.002965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.003946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.005127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.018679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:57.032683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b85ec52-b1d2-495d-89bc-887701442295 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.558455 Jul 28 11:30:57.033810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 813/1621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:56 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:57.063013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:57.063937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:57.072828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.073291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.074345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.074788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.464185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:57.480314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70207c93-0263-41fb-ba1d-1ceb46726618 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.490574 Jul 28 11:30:57.481021 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 809/1622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:56 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:57.485896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:57.486764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:57.492948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.493656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.494520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.495028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.530120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:57.539268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c013c49c-1093-4ad3-9c9d-a94ee5a5e4e4 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.481548 Jul 28 11:30:57.539839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 814/1623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:57 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:30:57.556640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:57.557704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:57.564665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.565114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.566312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.567894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.881136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:57.892605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3396c54d-275d-46a0-b570-7198391368d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.409969 Jul 28 11:30:57.893228 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 810/1624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:57 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:57.904015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:57.904644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:57.929590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.930121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.931022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:57.931501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:57.960041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:57.968397 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7af3b5b3-45db-45e2-a9f4-0730e088a02a tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.426789 Jul 28 11:30:57.968990 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 815/1625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:57 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:57.994112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-481cccb4-8971-4fb2-aa11-0b7b124b0f1b req-483d1b32-6896-4ed3-9050-1c3d26c4db67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca86860-f570-459e-9250-ea5ab4f49488", "name": "network-vif-plugged", "status": "completed", "tag": "d78aa704-5e78-4e48-a7eb-bac3c9ff3859"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:58.008916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-481cccb4-8971-4fb2-aa11-0b7b124b0f1b req-483d1b32-6896-4ed3-9050-1c3d26c4db67 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.009399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-481cccb4-8971-4fb2-aa11-0b7b124b0f1b req-483d1b32-6896-4ed3-9050-1c3d26c4db67 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.031539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-481cccb4-8971-4fb2-aa11-0b7b124b0f1b req-483d1b32-6896-4ed3-9050-1c3d26c4db67 service nova] Creating event network-vif-plugged:d78aa704-5e78-4e48-a7eb-bac3c9ff3859 for instance cca86860-f570-459e-9250-ea5ab4f49488 on n-h1-851368-1 Jul 28 11:30:58.037800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-481cccb4-8971-4fb2-aa11-0b7b124b0f1b req-483d1b32-6896-4ed3-9050-1c3d26c4db67 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067036 Jul 28 11:30:58.039352 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 816/1626] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:58.046297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:58.049319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:58.062072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.063694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.064704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.065367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.210730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:58.231388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e7dfa433-812a-4895-a3b5-ee1061ea6312 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 200 len: 1425 microversion: 2.1 time: 0.189492 Jul 28 11:30:58.232392 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 817/1627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:58 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 1425 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:58.239916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:58.241066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:58.254204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.255686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.257125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.257769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.538184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:58.575902 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e707a446-9b41-45bf-81ed-0adc588b7fd1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.681458 Jul 28 11:30:58.595773 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 811/1628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:57 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:58.612069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8dbf5d59-bbca-48da-932c-4dc89c16ad6f req-74d5f640-c54c-4526-a74c-4797072d31a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c8b830-ae4f-4f1f-b926-6e744ecad107", "name": "network-vif-deleted", "tag": "751af1d9-0e43-4476-a43c-32a6ec7ee519"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:30:58.670664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8dbf5d59-bbca-48da-932c-4dc89c16ad6f req-74d5f640-c54c-4526-a74c-4797072d31a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.672191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8dbf5d59-bbca-48da-932c-4dc89c16ad6f req-74d5f640-c54c-4526-a74c-4797072d31a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.698284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8dbf5d59-bbca-48da-932c-4dc89c16ad6f req-74d5f640-c54c-4526-a74c-4797072d31a3 service nova] Creating event network-vif-deleted:751af1d9-0e43-4476-a43c-32a6ec7ee519 for instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 on n-h2-851368-1 Jul 28 11:30:58.716539 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8dbf5d59-bbca-48da-932c-4dc89c16ad6f req-74d5f640-c54c-4526-a74c-4797072d31a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119202 Jul 28 11:30:58.717166 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 812/1629] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:30:58.725359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:58.726077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:58.741034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.741493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.743168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:58.743623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:58.964731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:58.975336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e40b4e6-21c8-46e7-8a1f-f645116db706 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.741048 Jul 28 11:30:58.976584 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 818/1630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:58 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:58.981152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:58.981648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Failed to fetch instance by id -1 {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:30:58.982150 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance -1 could not be found. Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance -1 could not be found. Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '-1'} Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:30:58.983752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63f26bf0-c598-497d-9b92-cb05606df1eb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.007565 Jul 28 11:30:58.989380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 819/1631] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:30:58 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:30:58.993588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:58.994306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:59.002640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.003271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:59.004201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.005292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:59.598964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:59.611035 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-513bb557-afd6-4d53-b625-dd3d1a38e3d9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.891721 Jul 28 11:30:59.640678 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 813/1632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:58 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:59.648426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:59.650804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:59.658914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:30:59.666965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.668292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:59.669340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.669968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:59.673822 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33786803-d512-4e46-b949-da17ee51936d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1314 microversion: 2.1 time: 0.686698 Jul 28 11:30:59.677575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 820/1633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:58 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:30:59.687952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:30:59.692546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:30:59.712355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.713248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:30:59.714478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:30:59.715187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.265158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:00.274310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b465ef88-2739-4b0f-b854-dc2b4bf1e4ba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.631365 Jul 28 11:31:00.290818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 814/1634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:59 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:00.302158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:00.309045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:00.315372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 84c8b830-ae4f-4f1f-b926-6e744ecad107] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:00.330725 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afbb4db7-0d3e-47ef-8554-68900fcb768f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.646520 Jul 28 11:31:00.344727 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 821/1635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:30:59 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:00.344727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:00.344727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:00.345163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.345163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.345163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.345163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.374598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.375281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.376179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.383448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.384099 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] HTTP exception thrown: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Request method failure captured: Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 HTTP/1.1 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIelSytcfqXenCW8a4e2RIA4tox5xTbXYyOaj-376BG5oZ84TKkMgAhk88m8l54moMSsJ-Kc8w0xkEKM_KofEmc2JD6s8qYgc0dVgKur8JnfJGH-E4mI6e1RdN_SI_RRc1dWq-VL7jrZoB89FUJcCwFAzqG_I6xs84pM4JYE04GVfI Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}] Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2a4e1d0d7b5b4f2c884579f3475d0c31 Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '84c8b830-ae4f-4f1f-b926-6e744ecad107'} Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:00.399385 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Returning 404 to user: Instance 84c8b830-ae4f-4f1f-b926-6e744ecad107 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5937037-1ab5-4f8f-b501-d62cbb430f02 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107" status: 404 len: 111 microversion: 2.1 time: 0.108410 Jul 28 11:31:00.405072 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 815/1636] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:00 2022] GET /compute/v2.1/servers/84c8b830-ae4f-4f1f-b926-6e744ecad107 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:00.434192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:00.435132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:00.446573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.452161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.453211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.454715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.810146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:00.827488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e49706b-04dd-48b5-954d-052a353c2b12 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.492094 Jul 28 11:31:00.828556 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 822/1637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:00 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:00.833584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:00.836647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:00.837615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:00.846200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.847062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.849394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.850136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.852497 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05ecafc4-f635-42c0-91a4-2e6d0c0fac8c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.446468 Jul 28 11:31:00.867129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 816/1638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:00 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:00.874034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:00.875678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:00.879352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:00.892646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.895313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.897713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:00.900536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:00.941859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:01.135017 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13913aa5-2aae-489f-981a-4a8a8d92088c tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 204 len: 0 microversion: 2.1 time: 0.303554 Jul 28 11:31:01.140516 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 823/1639] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:00 2022] DELETE /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:01.153505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.154513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.168862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.173048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.174004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.174538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.262835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:01.281576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-782ff0f7-383d-4de3-9111-28f433bb666f tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.420937 Jul 28 11:31:01.282392 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 817/1640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:00 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:01.296520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:01.297071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 173f134c-3f45-42ec-93b1-d15d6c75b427] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.320230 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/173f134c-3f45-42ec-93b1-d15d6c75b427/action HTTP/1.1 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 19 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: {"forceDelete": {}} Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '173f134c-3f45-42ec-93b1-d15d6c75b427', 'body': {'forceDelete': {}}} Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:01.327368 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 173f134c-3f45-42ec-93b1-d15d6c75b427 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:01.334397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd7785d7-b9db-4666-8f75-835f72b55784 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/173f134c-3f45-42ec-93b1-d15d6c75b427/action" status: 404 len: 111 microversion: 2.1 time: 0.044848 Jul 28 11:31:01.335791 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 818/1641] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:01 2022] POST /compute/v2.1/servers/173f134c-3f45-42ec-93b1-d15d6c75b427/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:01.351511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.355404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.371219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.374301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.375411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.376110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.489276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:01.507546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-20ee1686-d0f9-4ace-97da-ee64c4a58873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1501 microversion: 2.1 time: 0.361482 Jul 28 11:31:01.519098 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 824/1642] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:01 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:01.519098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.519098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.539534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.540731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.543479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.555843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.677885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:01.697669 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb33df00-b3ad-4912-ba4c-a7f6c3a17605 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1534 microversion: 2.1 time: 0.355464 Jul 28 11:31:01.699551 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 819/1643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:01 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1534 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:01.704686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.705516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.714259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.714915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.715745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.716190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.845506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:01.855526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a81b1620-4b3a-45d4-ae82-a98865d5c307 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.345733 Jul 28 11:31:01.856277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 825/1644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:01 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:01.861207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.861839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.870306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.870939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.871855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.872405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.907353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:01.921787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:01.939339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85d54498-dca5-4678-a674-694b7be32b1c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.238230 Jul 28 11:31:01.953352 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 820/1645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:01 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:01.953352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:01.953352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:01.958888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.959404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:01.960472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:01.960920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.044664 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6bd27386-520a-4e1c-ad1a-8edf0d6cec53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 204 len: 0 microversion: 2.1 time: 0.186535 Jul 28 11:31:02.045938 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 826/1646] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:01 2022] DELETE /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:02.053393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:02.054458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.062740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.064162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.064998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.065440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.262854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:02.274622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37ab1736-4bae-413a-a42f-c83a50ce5deb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.331910 Jul 28 11:31:02.275589 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 821/1647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:01 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:02.281110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:02.281988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.296520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.296520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.296520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.296520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.297116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:02.308449 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b17f380-e325-47b0-a3f3-9897bb66e6ae tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.260796 Jul 28 11:31:02.319617 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 827/1648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:02 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:02.319617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:02.319617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.336009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.336473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.337343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.337791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.538016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:02.585979 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb7fe062-1a81-48fe-9196-3787f2a84273 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1507 microversion: 2.1 time: 0.308790 Jul 28 11:31:02.592932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:02.595755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 822/1649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:02 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:02.613874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95ea8097-04f9-4299-a96f-a8dc1d7c3c69 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.302210 Jul 28 11:31:02.614827 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 828/1650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:02 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:02.625997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:02.633406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 135b039d-9190-4694-b974-080bab169561] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.647819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/135b039d-9190-4694-b974-080bab169561/action HTTP/1.1 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 39 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: {"os-getConsoleOutput": {"length": 10}} Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '135b039d-9190-4694-b974-080bab169561', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:02.651448 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. Jul 28 11:31:02.659272 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:02.664868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 135b039d-9190-4694-b974-080bab169561 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:02.665828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a0dbc32-57fc-4b70-9964-35419849ccba tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/135b039d-9190-4694-b974-080bab169561/action" status: 404 len: 111 microversion: 2.1 time: 0.064650 Jul 28 11:31:02.667530 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 823/1651] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:02 2022] POST /compute/v2.1/servers/135b039d-9190-4694-b974-080bab169561/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:02.674542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:02.675608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.683175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.684147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.684997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.685785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.731987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:02.733718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:02.751154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.752996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:02.754059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:02.755878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.006770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.010197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.021534 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1138dc69-74be-4983-a392-d07d9794e148 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1534 microversion: 2.1 time: 0.304194 Jul 28 11:31:03.022135 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 824/1652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:02 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1534 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.029475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8b98d66-7fc3-4d9a-9822-b8e86db462d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.357582 Jul 28 11:31:03.032860 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 829/1653] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:02 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.045904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-174c991e-5518-46a0-9095-7714e918cf8f req-947a3244-943a-4769-ba3b-58160177de25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ff8452-7708-412c-a4b5-9e967f4f394d", "name": "network-vif-plugged", "status": "completed", "tag": "db1aaf79-0487-4df2-a3e8-ebea156a1269"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:03.050049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-174c991e-5518-46a0-9095-7714e918cf8f req-947a3244-943a-4769-ba3b-58160177de25 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.059262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-174c991e-5518-46a0-9095-7714e918cf8f req-947a3244-943a-4769-ba3b-58160177de25 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.060166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.060386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.065459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:03.076605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-174c991e-5518-46a0-9095-7714e918cf8f req-947a3244-943a-4769-ba3b-58160177de25 service nova] Creating event network-vif-plugged:db1aaf79-0487-4df2-a3e8-ebea156a1269 for instance 24ff8452-7708-412c-a4b5-9e967f4f394d on n-h2-851368-1 Jul 28 11:31:03.083576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-174c991e-5518-46a0-9095-7714e918cf8f req-947a3244-943a-4769-ba3b-58160177de25 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045993 Jul 28 11:31:03.084482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 825/1654] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:03.088036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.089360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.089966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.090691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.092018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.093245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.098566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.099029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.099869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.100313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.518944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.529724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-359d832e-d6aa-4ce5-9e20-005faee73795 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.442719 Jul 28 11:31:03.544407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 826/1655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.552169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.552789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.573779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.574232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.575036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.575512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.584206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.603327 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-adc45641-2f51-4a9a-8adf-185d74086743 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.552249 Jul 28 11:31:03.604634 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 830/1656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.610885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.611727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 17674770-9d90-4074-bc74-0c6d51eff40c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.620025 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/17674770-9d90-4074-bc74-0c6d51eff40c HTTP/1.1 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '17674770-9d90-4074-bc74-0c6d51eff40c'} Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:03.624955 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 17674770-9d90-4074-bc74-0c6d51eff40c could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fee1d91-8b07-4f9e-9383-c77b840bb1fb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/17674770-9d90-4074-bc74-0c6d51eff40c" status: 404 len: 111 microversion: 2.1 time: 0.020746 Jul 28 11:31:03.630777 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 831/1657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/17674770-9d90-4074-bc74-0c6d51eff40c => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:03.634953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.635649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.647888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.648473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.649745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.651026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.872691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.883643 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b25cb260-1b93-42de-aa01-bbd72d692703 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.337943 Jul 28 11:31:03.885197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 827/1658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.890008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.892479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.916772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.918054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.920397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.922613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.946477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:03.965153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b26f161-0e9f-4ee3-8b69-1917e4669271 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1507 microversion: 2.1 time: 0.333083 Jul 28 11:31:03.966874 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 832/1659] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:03.986432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:03.987922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:03.995043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.995647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:03.996780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:03.997240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.150666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:04.165567 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b7cf13b-47bc-4c92-847c-e7c22a67936e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.279061 Jul 28 11:31:04.166170 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 828/1660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:04.172410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:04.173315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:04.189795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.191307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.192788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:04.198052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.201239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.206932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3187a0f6-69e2-40cb-8517-84d126b54c6d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1351 microversion: 2.1 time: 0.232741 Jul 28 11:31:04.208267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 833/1661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:03 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1351 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:04.223310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:04.223868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:04.233055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.233604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.235054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.235721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.485910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:04.496630 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7e7aaa3-7734-407b-b272-7b9521273f13 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1534 microversion: 2.1 time: 0.328357 Jul 28 11:31:04.500046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:04.500846 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 829/1662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:04 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1534 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:04.522192 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-489a3d5b-8ae2-4d1a-8326-4b9a86f3e99d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.312860 Jul 28 11:31:04.523415 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 834/1663] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:04 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:04.629685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:04.630820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:04.638348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.639094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.640167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.640764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.735117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247e03cc-7b71-4173-91dc-5c39f2bf47cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-294264270", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247e03cc-7b71-4173-91dc-5c39f2bf47cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 237 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-294264270", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-294264270', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.755308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247e03cc-7b71-4173-91dc-5c39f2bf47cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-247e03cc-7b71-4173-91dc-5c39f2bf47cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027288 Jul 28 11:31:04.762304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 835/1664] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:04.765578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:04.766202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:04.781037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.781497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.782638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.782777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.833213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:04.854231 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b848286e-9197-437c-b133-317af99a08e0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.226476 Jul 28 11:31:04.868759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 830/1665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:04 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:04.905878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:04.907175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:04.927506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.928055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:04.928882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:04.930886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.008046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:05.032492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fdaca6aa-5be6-4c52-af15-c0b9c7df5b10 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.268099 Jul 28 11:31:05.033943 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 836/1666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:04 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:05.049089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:05.049864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:05.061619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.062083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.062888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.063365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.217756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:05.231858 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-351407c6-6236-4527-9b91-312251fcff4f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.330927 Jul 28 11:31:05.232454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 831/1667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:04 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:05.237877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:05.238620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:05.257466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.258344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.259339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.259954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.288098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:05.302730 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98e1221b-9a43-4dba-b865-c05b72cf25d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1507 microversion: 2.1 time: 0.267299 Jul 28 11:31:05.303659 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 837/1668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:05 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:05.308541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21948ab3-5b81-48fc-bda3-4b2d6ac2fbca", "name": "network-vif-plugged", "status": "completed", "tag": "ab7adb52-69e9-48de-8fff-507aa26d7fab"}, {"server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:05.320458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.321482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.365356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] Creating event network-vif-plugged:ab7adb52-69e9-48de-8fff-507aa26d7fab for instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca on n-h1-851368-1 Jul 28 11:31:05.365963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] Creating event network-vif-unplugged:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h1-851368-1 Jul 28 11:31:05.382135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2a9f749f-8431-47a3-a6bd-b27d0bd70f48 req-99a86252-0625-48be-b12f-9edefdcdf66f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.076702 Jul 28 11:31:05.383493 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 838/1669] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:05.390672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:05.392094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:05.399245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.399898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.400851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.401729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.406636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:05.680523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:05.702480 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b7a2eac-4843-49b7-9d30-b6882881d46b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.456859 Jul 28 11:31:05.725546 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 832/1670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:05 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:05.743795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:05.744745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:05.763002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.767710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.772020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.772716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.838619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:05.846230 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85fdd619-82ef-4997-a3c5-cd3a434a4c5b tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1541 microversion: 2.1 time: 0.461344 Jul 28 11:31:05.846985 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 839/1671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:05 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1541 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:05.876938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:05.877526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:05.884379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.884824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:05.885599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:05.886144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.040673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62918096-faf6-4ff8-b6ed-c9dcfa1665a0 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167912 Jul 28 11:31:06.041275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 840/1672] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:31:05 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:06.045915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:06.046714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:06.060398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.060848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.061932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.062545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.196587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:06.205772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1011dd5f-f87f-44dc-b308-b7ee6a5fdb3a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1534 microversion: 2.1 time: 0.478506 Jul 28 11:31:06.207229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 833/1673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:05 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1534 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:06.213407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ca5f7eb-3a93-40b3-8da5-be381c575e2d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1425391737", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ca5f7eb-3a93-40b3-8da5-be381c575e2d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 235 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1425391737", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1425391737', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.219247 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.225159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ca5f7eb-3a93-40b3-8da5-be381c575e2d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:06.227990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ca5f7eb-3a93-40b3-8da5-be381c575e2d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015956 Jul 28 11:31:06.230256 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 834/1674] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:06 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:06.278216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:06.298510 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f72a0715-5bfb-4886-a115-ae2093242424 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.255743 Jul 28 11:31:06.299962 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 841/1675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:06 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:06.310913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:06.313107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:06.321341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.322529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.323947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.324561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.418186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2289af3a-44fd-4923-9906-78cecdb3534a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb2547dc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6FfSDaHrAgV/v56yR0ePQ214bnzMLYKRvsBI74wtvw6zcJSUfOKvYY2jK6qetOxjLadEn/aREWJ1p9w+jOdErAcyZ7yziLp/MPEp7NnIWQQqbpJX5YdFHPYd3FhUMUvA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:06.429864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2289af3a-44fd-4923-9906-78cecdb3534a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2289af3a-44fd-4923-9906-78cecdb3534a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 257 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6FfSDaHrAgV/v56yR0ePQ214bnzMLYKRvsBI74wtvw6zcJSUfOKvYY2jK6qetOxjLadEn/aREWJ1p9w+jOdErAcyZ7yziLp/MPEp7NnIWQQqbpJX5YdFHPYd3FhUMUvA=="}} Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6FfSDaHrAgV/v56yR0ePQ214bnzMLYKRvsBI74wtvw6zcJSUfOKvYY2jK6qetOxjLadEn/aREWJ1p9w+jOdErAcyZ7yziLp/MPEp7NnIWQQqbpJX5YdFHPYd3FhUMUvA=='}}} Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6723, in import_key_pair Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6701, in _validate_new_key_pair Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:06.438403 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2289af3a-44fd-4923-9906-78cecdb3534a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:06.443047 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2289af3a-44fd-4923-9906-78cecdb3534a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.208574 Jul 28 11:31:06.444697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 835/1676] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:06.459049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:06.460319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:06.467832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.468306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.469141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.469526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.693424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:06.709446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97113894-1c2e-4dd0-9b79-8271b018a0b6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.408184 Jul 28 11:31:06.710040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 842/1677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:06 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:06.721721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:06.722339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:06.739688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.740662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.741657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.742258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.776783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:06.789700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7dde1385-c1ba-47f9-b454-9843ffc6067a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1317 microversion: 2.1 time: 0.343708 Jul 28 11:31:06.792351 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 836/1678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:06 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:06.799241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb24cb160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1579091702", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:06.824843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:06.829576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for user 0a88397b433e4da8a6e3638799cf46b0 and project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:06.849454 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 2167 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1579091702", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:06.861484 n-d-851368-1 devstack@n-api.service[119235]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1579091702', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:06.864367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bf78537-470f-44af-b836-6b6a7a01e20f tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069869 Jul 28 11:31:06.867360 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 837/1679] 10.222.0.93 () {60 vars in 1160 bytes} [Thu Jul 28 11:31:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:31:06.877311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:06.877311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:06.887789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.888238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:06.889028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:06.889466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.048055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:07.064236 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5aa7d71-0a61-4def-a78c-87ffc822945f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1507 microversion: 2.1 time: 0.351252 Jul 28 11:31:07.081448 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 843/1680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:06 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:07.091147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dce3b12e-1f76-408a-930e-5c175a976dff tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb2480820>, body: {"keypair": {"name": "tempest-keypair-2045645685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLyS/Y4/GkDN9BZigN7VM9gLh/n23n3dZ7UwUQu6vfN6o4YkyR6hbClyTRQFWeM08Pa7oE0Hlucb8/InxKY0THlSmhBljBzN+ErO2Fzajg1yjNde6rj8BNjB4/YPU+2hw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:07.137688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-dce3b12e-1f76-408a-930e-5c175a976dff tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:07.150436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-dce3b12e-1f76-408a-930e-5c175a976dff tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for user 0a88397b433e4da8a6e3638799cf46b0 and project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:07.171424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:07.198904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dce3b12e-1f76-408a-930e-5c175a976dff tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114435 Jul 28 11:31:07.207652 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 844/1681] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:07.218113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-83209890-ef18-4fff-8f73-a1b349c56e23 req-ddcd0fba-70ba-4de0-815a-ffe515eaef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423746a7-ff5e-43cd-9673-ee1938331c29", "name": "network-vif-deleted", "tag": "3edd1f57-8498-4c01-a152-59773f5d64cd"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:07.259692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-83209890-ef18-4fff-8f73-a1b349c56e23 req-ddcd0fba-70ba-4de0-815a-ffe515eaef0a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.259692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-83209890-ef18-4fff-8f73-a1b349c56e23 req-ddcd0fba-70ba-4de0-815a-ffe515eaef0a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.283370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-83209890-ef18-4fff-8f73-a1b349c56e23 req-ddcd0fba-70ba-4de0-815a-ffe515eaef0a service nova] Creating event network-vif-deleted:3edd1f57-8498-4c01-a152-59773f5d64cd for instance 423746a7-ff5e-43cd-9673-ee1938331c29 on n-h1-851368-1 Jul 28 11:31:07.296617 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-83209890-ef18-4fff-8f73-a1b349c56e23 req-ddcd0fba-70ba-4de0-815a-ffe515eaef0a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089634 Jul 28 11:31:07.297755 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 845/1682] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:07.305373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb2510160>, body: {"keypair": {"name": "tempest-keypair-2045645685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmGdJQuf4/XLXCq6BP2TUnxCfKIuZaODypJvliiJDn3nbfhaqz87HRo0KxhhP+Hr/9jxFGf1A+9QbQpd0WpSANDlxW8SN3Io8jW1eKXoQE5DAT3mj8rGe+Y/SUXI2zLzQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:07.339108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:07.345022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for user 0a88397b433e4da8a6e3638799cf46b0 and project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:07.368378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:07.394552 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46369764-ad74-40a6-ae90-51273013ac09 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.523372 Jul 28 11:31:07.398651 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 838/1683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:06 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:07.411437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:07.412747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:07.418391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Key pair 'tempest-keypair-2045645685' already exists. Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 273 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: {"keypair": {"name": "tempest-keypair-2045645685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmGdJQuf4/XLXCq6BP2TUnxCfKIuZaODypJvliiJDn3nbfhaqz87HRo0KxhhP+Hr/9jxFGf1A+9QbQpd0WpSANDlxW8SN3Io8jW1eKXoQE5DAT3mj8rGe+Y/SUXI2zLzQ=="}} Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: exception: Key pair 'tempest-keypair-2045645685' already exists. Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2045645685', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmGdJQuf4/XLXCq6BP2TUnxCfKIuZaODypJvliiJDn3nbfhaqz87HRo0KxhhP+Hr/9jxFGf1A+9QbQpd0WpSANDlxW8SN3Io8jW1eKXoQE5DAT3mj8rGe+Y/SUXI2zLzQ=='}}} Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0a88397b433e4da8a6e3638799cf46b0-tempest-keypair-2045645685' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 11:31:07.432237 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result.read() Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 11:31:07.437160 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0a88397b433e4da8a6e3638799cf46b0-tempest-keypair-2045645685' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 11, 31, 7, 402924), 'updated_at': None, 'name': 'tempest-keypair-2045645685', 'user_id': '0a88397b433e4da8a6e3638799cf46b0', 'fingerprint': '4c:3e:7a:b2:57:19:22:a5:96:18:95:bf:8e:66:4c:6e', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmGdJQuf4/XLXCq6BP2TUnxCfKIuZaODypJvliiJDn3nbfhaqz87HRo0KxhhP+Hr/9jxFGf1A+9QbQpd0WpSANDlxW8SN3Io8jW1eKXoQE5DAT3mj8rGe+Y/SUXI2zLzQ==', 'type': 'ssh'}] Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi keypair.create() Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._create() Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2045645685' already exists. Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 28 11:31:07.441737 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2045645685' already exists. Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2045645685' already exists. Jul 28 11:31:07.450602 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.451490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.451616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 409 to user: Key pair 'tempest-keypair-2045645685' already exists. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:07.451724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.451828 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b4b2d1a-80d4-490a-ab32-c39e9a920b21 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.144898 Jul 28 11:31:07.451924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.452016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 846/1684] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:07 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:31:07.452202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.464861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:07.469051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:07.485169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.489418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.491906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.494503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.541014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.542585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.543142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lazy-loading 'fault' on Instance uuid 423746a7-ff5e-43cd-9673-ee1938331c29 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:07.642434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:07.656483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55868a96-2b64-45af-9579-24ed6b9b16d1 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 200 len: 1369 microversion: 2.1 time: 0.256449 Jul 28 11:31:07.657073 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 839/1685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:07 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:07.662225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:07.663104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: d3dd0cd7-98e6-46a1-a509-4849ffe39832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:07.668761 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/d3dd0cd7-98e6-46a1-a509-4849ffe39832/action HTTP/1.1 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 13 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: {"pause": {}} Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd3dd0cd7-98e6-46a1-a509-4849ffe39832', 'body': {'pause': {}}} Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.684897 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance d3dd0cd7-98e6-46a1-a509-4849ffe39832 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c11e60a8-9fd0-4002-b2e9-f8385e45f09b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/d3dd0cd7-98e6-46a1-a509-4849ffe39832/action" status: 404 len: 111 microversion: 2.1 time: 0.028661 Jul 28 11:31:07.689849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 840/1686] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:07 2022] POST /compute/v2.1/servers/d3dd0cd7-98e6-46a1-a509-4849ffe39832/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:07.698946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3be5a7f-9a99-410c-9838-e7d2a920da13 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Calling method '.version_select at 0x7f2eb24cb670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:07.752417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3be5a7f-9a99-410c-9838-e7d2a920da13 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045645685" status: 202 len: 0 microversion: 2.1 time: 0.059262 Jul 28 11:31:07.754997 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 841/1687] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045645685 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:07.764775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:07.765917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:07.780664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.781180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.782081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.782508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.923163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:07.938449 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6dc3dd76-b645-4f19-87c9-1fae0d8602c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1714 microversion: 2.1 time: 0.485053 Jul 28 11:31:07.952186 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 847/1688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:07 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1714 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:07.957689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-039bd22c-0b73-4bc2-a77c-ebc68b1d536a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb2f59a60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgnntzy+J1b/u9yiZE4QP8stXePrHS3ohrWJBW9uummLD6w5SLBriDP6vbtpG2ZL6bvM2hDXiGBdVwsSqIrsF0VLsZakcYYlv3DMqyRJcgq2WuEOdF/j7KPy9uMDtGcjg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-039bd22c-0b73-4bc2-a77c-ebc68b1d536a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 247 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgnntzy+J1b/u9yiZE4QP8stXePrHS3ohrWJBW9uummLD6w5SLBriDP6vbtpG2ZL6bvM2hDXiGBdVwsSqIrsF0VLsZakcYYlv3DMqyRJcgq2WuEOdF/j7KPy9uMDtGcjg=="}} Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgnntzy+J1b/u9yiZE4QP8stXePrHS3ohrWJBW9uummLD6w5SLBriDP6vbtpG2ZL6bvM2hDXiGBdVwsSqIrsF0VLsZakcYYlv3DMqyRJcgq2WuEOdF/j7KPy9uMDtGcjg=='}}} Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '' Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:31:07.962312 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-039bd22c-0b73-4bc2-a77c-ebc68b1d536a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-039bd22c-0b73-4bc2-a77c-ebc68b1d536a tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010055 Jul 28 11:31:07.968797 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 848/1689] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:07.977195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:07.978998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:07.995988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.996719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:07.997714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:07.999654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.052314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:08.063950 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2468e313-8519-4ae5-bb3a-62e5461eb32b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.306155 Jul 28 11:31:08.068101 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 842/1690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:07 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:08.086796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb24cbca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1743588512", "public_key": " "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:08.122872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:08.129983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:08.136176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for user 0a88397b433e4da8a6e3638799cf46b0 and project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:08.160083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 95 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1743588512", "public_key": " "}} Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1743588512', 'public_key': ' '}}} Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.162592 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.167852 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.171006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:08.172103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6e7bc9d-d2a3-4638-bfc5-f380f5d01ea1 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.102578 Jul 28 11:31:08.172856 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 843/1691] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 28 11:31:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:31:08.178299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:08.179167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:08.187769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.188557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.189503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.190103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.228655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.229195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.229820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'fault' on Instance uuid cca86860-f570-459e-9250-ea5ab4f49488 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:08.318482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:08.326371 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f42ddcd7-a440-4337-b01a-476470c6407c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 200 len: 1304 microversion: 2.1 time: 0.152363 Jul 28 11:31:08.326943 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 844/1692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:08 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:08.332019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:08.333169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:08.339769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.340458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.341413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.342010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.410034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:08.425357 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec792a0c-2c90-41e7-a725-6a4360b493e3 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1467 microversion: 2.1 time: 0.460109 Jul 28 11:31:08.426503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 849/1693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:07 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1467 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:08.436338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e42e56d-304b-473b-9988-b824530963b3 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb24d6670>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ/xqFYdxBbNT8QbrRcxzFsBYD1EKcoWMx19nOiOFdmLrpEuRLBQwm1G5+kxEKi1h7fLbAPY2kdDUhFVQaWfCw5E7rBLmP0QbFV+rRuhKauQrhVTOhJ5zX7gxiZbvxdXw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e42e56d-304b-473b-9988-b824530963b3 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 507 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ/xqFYdxBbNT8QbrRcxzFsBYD1EKcoWMx19nOiOFdmLrpEuRLBQwm1G5+kxEKi1h7fLbAPY2kdDUhFVQaWfCw5E7rBLmP0QbFV+rRuhKauQrhVTOhJ5zX7gxiZbvxdXw=="}} Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ/xqFYdxBbNT8QbrRcxzFsBYD1EKcoWMx19nOiOFdmLrpEuRLBQwm1G5+kxEKi1h7fLbAPY2kdDUhFVQaWfCw5E7rBLmP0QbFV+rRuhKauQrhVTOhJ5zX7gxiZbvxdXw=='}}} Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 28 11:31:08.447202 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e42e56d-304b-473b-9988-b824530963b3 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:08.451502 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3e42e56d-304b-473b-9988-b824530963b3 tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023420 Jul 28 11:31:08.459658 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 850/1694] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:08.470616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:08.472399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:08.492334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.492897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.494026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.494350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.616346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:08.624497 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2fa9a6b-c7e1-4ee0-be41-bb3e8cf5d0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.295943 Jul 28 11:31:08.655113 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 845/1695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:08 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:08.661405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Action: 'create', calling method: .version_select at 0x7f2eb264a550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1739900575", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:08.690813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:08.695093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Getting quotas for user 0a88397b433e4da8a6e3638799cf46b0 and project 8f3c7c0d3d724b2fa86d676025189c80. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:08.719750 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 118 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1739900575", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1739900575', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Jul 28 11:31:08.721655 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:08.727336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45b62f63-943f-47e3-9c98-db8f89f1ef0b tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071640 Jul 28 11:31:08.730766 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 846/1696] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:31:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:31:08.732884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:08.733430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:08.745117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.745579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.746390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.746830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.844208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:08.855808 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-893bb48a-f4a3-419e-92eb-0e5d767f2029 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.126459 Jul 28 11:31:08.857340 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 847/1697] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:08 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:08.866571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:08.867883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 423746a7-ff5e-43cd-9673-ee1938331c29] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:08.875830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.876285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.877098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:08.877688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:08.901340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] HTTP exception thrown: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Request method failure captured: Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 HTTP/1.1 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIelSytcfqXenCW8a4e2RIA4tox5xTbXYyOaj-376BG5oZ84TKkMgAhk88m8l54moMSsJ-Kc8w0xkEKM_KofEmc2JD6s8qYgc0dVgKur8JnfJGH-E4mI6e1RdN_SI_RRc1dWq-VL7jrZoB89FUJcCwFAzqG_I6xs84pM4JYE04GVfI Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}] Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2a4e1d0d7b5b4f2c884579f3475d0c31 Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '423746a7-ff5e-43cd-9673-ee1938331c29'} Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.903382 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. Jul 28 11:31:08.909567 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.912056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Returning 404 to user: Instance 423746a7-ff5e-43cd-9673-ee1938331c29 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:08.913472 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b9877ae-8ef4-4591-a0de-e9c7adadf91f tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29" status: 404 len: 111 microversion: 2.1 time: 0.054851 Jul 28 11:31:08.919986 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 848/1698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:08 2022] GET /compute/v2.1/servers/423746a7-ff5e-43cd-9673-ee1938331c29 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:08.926561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4220871a-37db-41ce-9575-edcd51223ddb tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Calling method '.version_select at 0x7f2eb264a550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:08.974830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4220871a-37db-41ce-9575-edcd51223ddb tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4220871a-37db-41ce-9575-edcd51223ddb tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Request method failure captured: Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1598371407 HTTP/1.1 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nN6B3rHAKCSFXbckusgYgPezgkrmL2usmjz6QdmwX5JafZn1kTJQDDy3b3z6Xb6Pl8JN3KJNCG4esVAfZeA8A45MsaOf-nnhBmbC5Eyf_8as70i5zoBGOb_NoHWchlyXADNitm_vNygHrFSiU5XbNhLEZSo3icBEVt7J5Uv7unBV2g Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f3c7c0d3d724b2fa86d676025189c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f3c7c0d3d724b2fa86d676025189c80"}]}] Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f3c7c0d3d724b2fa86d676025189c80 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-161242176 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-KeyPairsNegativeTestJSON-161242176-project Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: exception: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'tempest-keypair-non-existent-1598371407'} Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.977100 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 Jul 28 11:31:08.981709 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:08.986874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4220871a-37db-41ce-9575-edcd51223ddb tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1598371407 not found for user 0a88397b433e4da8a6e3638799cf46b0 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:08.989989 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4220871a-37db-41ce-9575-edcd51223ddb tempest-KeyPairsNegativeTestJSON-161242176 tempest-KeyPairsNegativeTestJSON-161242176-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1598371407" status: 404 len: 145 microversion: 2.1 time: 0.068595 Jul 28 11:31:08.991514 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 849/1699] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1598371407 => generated 145 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:09.001721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:09.008474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:09.046268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.046849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.048220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.048700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.237742 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97e47503-fc78-447d-9134-227507ca7a1e tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1618 microversion: 2.1 time: 0.780489 Jul 28 11:31:09.238409 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 851/1700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:08 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1618 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:09.245615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf5de2dd-291c-4485-bac6-276019774b15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '.version_select at 0x7f2eb24a4d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:09.304711 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf5de2dd-291c-4485-bac6-276019774b15 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533695898" status: 202 len: 0 microversion: 2.1 time: 0.064779 Jul 28 11:31:09.306367 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 852/1701] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533695898 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:09.488099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:09.504080 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f5b0151-67df-4010-a67f-679d2d30acc1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1511 microversion: 2.1 time: 0.510445 Jul 28 11:31:09.504666 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 850/1702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:08 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:09.532904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:09.534846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:09.544658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.545479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.546581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.547308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.565952 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 HTTP/1.1 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cca86860-f570-459e-9250-ea5ab4f49488'} Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:09.568019 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:31:09.572797 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:09.575306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:09.576449 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39b435c1-ae6a-4732-8612-8393b08aa11a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 404 len: 111 microversion: 2.1 time: 0.054773 Jul 28 11:31:09.577539 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 851/1703] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:09 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:09.583170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca86860-f570-459e-9250-ea5ab4f49488", "name": "network-vif-deleted", "tag": "d78aa704-5e78-4e48-a7eb-bac3c9ff3859"}, {"name": "network-changed", "server_uuid": "24ff8452-7708-412c-a4b5-9e967f4f394d", "tag": "db1aaf79-0487-4df2-a3e8-ebea156a1269"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:09.594821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.595707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.611202 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] Creating event network-vif-deleted:d78aa704-5e78-4e48-a7eb-bac3c9ff3859 for instance cca86860-f570-459e-9250-ea5ab4f49488 on n-h1-851368-1 Jul 28 11:31:09.612122 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] Creating event network-changed:db1aaf79-0487-4df2-a3e8-ebea156a1269 for instance 24ff8452-7708-412c-a4b5-9e967f4f394d on n-h2-851368-1 Jul 28 11:31:09.623196 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-582b8c5a-5a09-49a0-a20e-8b97fddb440c req-3f903ba7-3871-4222-8ad9-8c50e0982439 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044099 Jul 28 11:31:09.625169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 852/1704] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:09.632880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-385203706", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["df3a374f-7b2d-457c-866e-e6c033a0b067"]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:09.727762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:09.913961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:09.914748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:09.936699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.937204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:09.938027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:09.938469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:10.384037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:10.398281 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aeec5a5f-1b13-4885-b20a-cd9518e46176 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1704 microversion: 2.1 time: 1.090077 Jul 28 11:31:10.400092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 853/1705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:09 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1704 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:10.408004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1143868072", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:10.416991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:10.417418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:10.417900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:10.418317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:10.418738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:10.434817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:10.442209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:10.443460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:10.443965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:10.490483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:10.498309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:10.509846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:10.542766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:10.545375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:10.626439 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d27ca461-2cfa-45f4-b519-a1a4cff0b6b2 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999817 Jul 28 11:31:10.627447 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 853/1706] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:10.632634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8f2e710-dd9e-437b-bcbe-bd727e19f3e2 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '.version_select at 0x7f2eb2577dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:10.637210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8f2e710-dd9e-437b-bcbe-bd727e19f3e2 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:10.638040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8f2e710-dd9e-437b-bcbe-bd727e19f3e2 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:10.651165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8f2e710-dd9e-437b-bcbe-bd727e19f3e2 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3105 microversion: 2.1 time: 0.022557 Jul 28 11:31:10.652089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 854/1707] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:31:10 2022] GET /compute/v2.1/os-migrations => generated 3105 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:10.672263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:10.672897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:10.683763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:10.684506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:10.686136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:10.687244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.096448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:11.111451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4023fc61-e5f2-46a4-bbc6-5fa3592e6045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1491 microversion: 2.1 time: 0.441826 Jul 28 11:31:11.112588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 855/1708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:10 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1491 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:11.121374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b26f500f-dc35-4728-bcc2-1b5975cd4bb9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:11.125972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b26f500f-dc35-4728-bcc2-1b5975cd4bb9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:11.268526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b26f500f-dc35-4728-bcc2-1b5975cd4bb9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:11.278795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b26f500f-dc35-4728-bcc2-1b5975cd4bb9 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1216 microversion: 2.1 time: 0.164809 Jul 28 11:31:11.279427 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 856/1709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:11 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:11.283808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:11.292394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:11.299134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.299602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.300385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.307035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.658294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32f1ef55-fd1e-4b98-ba17-4f678a46c15a tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1855 microversion: 2.1 time: 0.377794 Jul 28 11:31:11.663959 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 857/1710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:11 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1855 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:11.685671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:11.686192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:11.693592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.694050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.694853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.695325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.701024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:11.701024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:11.701755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:11.702179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:11.702629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:11.721019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.721019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.721019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.721019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.739792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:11.740443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:11.745273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:11.760204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:11.762963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:11.835875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-74bae29f-8bd6-462d-a788-1f473011c8c7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434029 Jul 28 11:31:11.843118 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 854/1711] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:11.847694 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-faec4ccc-e451-47ae-8d87-86d8d631bfff tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 204 len: 0 microversion: 2.1 time: 0.166818 Jul 28 11:31:11.849113 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 858/1712] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:11 2022] DELETE /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:11.850615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:11.851661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:11.859746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:11.860671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:11.861979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.862629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.863790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.864405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.870912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.871483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.872453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:11.873098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:11.896011 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'pause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state paused Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 13 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: {"pause": {}} Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'pause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state paused Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'pause': {}}} Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state paused. Cannot pause while the instance is in this state. Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state paused Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:11.899005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:11.904510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:11.904510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:11.904510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:11.904510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state paused Jul 28 11:31:11.904510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:11.908523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'pause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state paused {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:11.911839 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f245e900-b3c9-48d3-8b27-640456702621 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 143 microversion: 2.1 time: 0.064582 Jul 28 11:31:11.917905 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 855/1713] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:11 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 143 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:31:11.923467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f981fe20-0621-45e1-99a8-7dfec550a375 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:11.924390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f981fe20-0621-45e1-99a8-7dfec550a375 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.013635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f981fe20-0621-45e1-99a8-7dfec550a375 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:12.022757 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f981fe20-0621-45e1-99a8-7dfec550a375 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1215 microversion: 2.1 time: 0.103402 Jul 28 11:31:12.024489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 856/1714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:11 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:12.038844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:12.039811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.053130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.055358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.057417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.059351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.122841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6651ed04-dd8f-4e1b-bbb1-4ce9e447ebf7 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1855 microversion: 2.1 time: 0.269181 Jul 28 11:31:12.135615 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 859/1715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:11 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1855 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:12.135615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:12.135615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.146013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.146455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.148447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.161893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.339084 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ae37587-c421-477e-aad9-4cfdfe9f91e3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.211594 Jul 28 11:31:12.342200 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 860/1716] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:12 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:12.356872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:12.358915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.375488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.375953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.380718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.381210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.395526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:12.409379 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-512a4f69-915f-4c6f-bac2-5905446eb359 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1469 microversion: 2.1 time: 0.375107 Jul 28 11:31:12.410025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 857/1717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:12 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:12.428071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:12.428962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.438124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.443162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.444352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.444961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.506625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:12.516693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d7d03c6-6e8e-4bc4-8650-acca6df44c4a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1286 microversion: 2.1 time: 0.170433 Jul 28 11:31:12.517885 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 861/1718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:12 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:12.535349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:12.536239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.543664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.544373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.545400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.546050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.722744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:12.727860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lazy-loading 'services' on Instance uuid 54d4c426-667d-481c-a22b-13db36383d0c {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:12.732431 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d651492f-7b1a-4c80-8e14-1293a5a4fb40 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1498 microversion: 2.1 time: 0.212848 Jul 28 11:31:12.733289 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 862/1719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:12 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1498 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:12.885848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94e4ec50-3796-4c9c-a4bd-66ffd304e7c3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments/63fa7c14-bd08-432f-b1bd-bb26ec0e4b86" status: 202 len: 0 microversion: 2.1 time: 0.474320 Jul 28 11:31:12.886717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 858/1720] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:31:12 2022] DELETE /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments/63fa7c14-bd08-432f-b1bd-bb26ec0e4b86 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:12.895686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:12.897981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:12.920058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.921361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.922190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:12.922625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:12.966256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-345fd57e-8caa-4908-af2c-d9509851959b tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075043 Jul 28 11:31:12.967197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 863/1721] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:12 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:31:13.048779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:13.049775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:13.072154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.072822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.074202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.075711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.293832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:13.314988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b74a1ec-4958-4564-8533-7258037e5e5f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1219 microversion: 2.1 time: 0.272249 Jul 28 11:31:13.320658 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 859/1722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:13 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1219 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:13.438914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:13.439879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:13.449439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.449948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.450943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.451727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.542238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:13.543016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:13.552249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.553046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.554027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.554632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.886845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:13.900514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9d423dd-1134-49e0-9317-de04515c3994 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1469 microversion: 2.1 time: 0.465699 Jul 28 11:31:13.901363 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 864/1723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:13 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:13.913710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:13.914615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:13.930165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.930626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:13.933249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:13.933844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.078176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:14.088685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ca0f1e9-7be4-4412-bdf5-bc1bad08b58e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.551530 Jul 28 11:31:14.091537 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 860/1724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:13 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:14.103456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:14.107311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:14.125091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.125540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.126319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.132131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.195141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-72d031ec-a78c-47a0-bce9-c437c2dd7cb3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101530 Jul 28 11:31:14.196036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 861/1725] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:14 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:14.342418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:14.343038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:14.353421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.353872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.354655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.368512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.738994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:14.755652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb161a7c-5b69-4720-a9d7-4933ab838404 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1275 microversion: 2.1 time: 0.417217 Jul 28 11:31:14.756562 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 862/1726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:14 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1275 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:14.921777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:14.922682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:14.934313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.934766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.940204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:14.940672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:14.944247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:14.945857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:14.972416 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-546fb735-23a8-45f8-b362-7e38390db428 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.069301 Jul 28 11:31:14.993859 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 865/1727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:13 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:15.000197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:15.001070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.008427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.009130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.011449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.012112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.124352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:15.133644 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f36af8e5-157c-4017-b081-d3a7390859c0 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 200 len: 1427 microversion: 2.1 time: 0.215623 Jul 28 11:31:15.151167 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 863/1728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:14 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 1427 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:15.156165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:15.168064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.174894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.180116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.181181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.181787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.512747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:15.524015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6c2c1cc-12e5-44c9-b82a-5f4d46ee6a91 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.371599 Jul 28 11:31:15.526283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 864/1729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:15 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:15.533623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-81bfa6e7-8c4a-438b-8bc6-3173f3ab1031 req-dc5799b8-d7e2-486e-a162-20d982aa8ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09408043-13e3-4390-8f50-8c8703ae3b3e", "name": "network-vif-deleted", "tag": "8ab5457d-92c5-4026-b5a0-c4fd917e4792"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:15.563200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-81bfa6e7-8c4a-438b-8bc6-3173f3ab1031 req-dc5799b8-d7e2-486e-a162-20d982aa8ae2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.563865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-81bfa6e7-8c4a-438b-8bc6-3173f3ab1031 req-dc5799b8-d7e2-486e-a162-20d982aa8ae2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.592238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:15.611961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d754001f-7c95-4823-944a-aaacad5317f1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.615802 Jul 28 11:31:15.617556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-81bfa6e7-8c4a-438b-8bc6-3173f3ab1031 req-dc5799b8-d7e2-486e-a162-20d982aa8ae2 service nova] Creating event network-vif-deleted:8ab5457d-92c5-4026-b5a0-c4fd917e4792 for instance 09408043-13e3-4390-8f50-8c8703ae3b3e on n-h2-851368-1 Jul 28 11:31:15.625374 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 866/1730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:14 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:15.637197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:15.640962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-81bfa6e7-8c4a-438b-8bc6-3173f3ab1031 req-dc5799b8-d7e2-486e-a162-20d982aa8ae2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109159 Jul 28 11:31:15.645985 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 865/1731] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:15.657057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.667708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:15.675529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.683963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.684863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.687779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.689859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.702751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:15.705733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.706625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.708579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.712532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.765596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action HTTP/1.1 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 28 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: {"reboot": {"type": "SOFT"}} Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '33daecce-0fef-495a-a0bd-cdb1ab7683ee', 'body': {'reboot': {'type': 'SOFT'}}} Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:15.771305 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:15.776308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:15.783024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:15.785798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7fdf1854-65bd-4211-94f8-5aa594d5f440 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action" status: 404 len: 111 microversion: 2.1 time: 0.138226 Jul 28 11:31:15.786789 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 866/1732] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:15 2022] POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:15.798115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:15.800478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.809801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff1f7d01-d326-4f53-b423-9e595a51abe0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178755 Jul 28 11:31:15.815368 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 867/1733] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:15 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:15.820685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.822395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.826237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.827655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.836369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:15.837560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:15.869101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.870142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:15.871301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:15.872011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.114047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:16.121933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-417e2fdc-7dad-46a0-a08b-64c0f5865d54 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1273 microversion: 2.1 time: 0.333740 Jul 28 11:31:16.122719 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 867/1734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:15 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:16.158715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:16.159357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 09408043-13e3-4390-8f50-8c8703ae3b3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:16.174743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.177566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.179766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.189725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.224684 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] HTTP exception thrown: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Request method failure captured: Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e HTTP/1.1 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nIelSytcfqXenCW8a4e2RIA4tox5xTbXYyOaj-376BG5oZ84TKkMgAhk88m8l54moMSsJ-Kc8w0xkEKM_KofEmc2JD6s8qYgc0dVgKur8JnfJGH-E4mI6e1RdN_SI_RRc1dWq-VL7jrZoB89FUJcCwFAzqG_I6xs84pM4JYE04GVfI Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}] Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 2a4e1d0d7b5b4f2c884579f3475d0c31 Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '09408043-13e3-4390-8f50-8c8703ae3b3e'} Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:16.228919 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. Jul 28 11:31:16.233960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:16.242025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Returning 404 to user: Instance 09408043-13e3-4390-8f50-8c8703ae3b3e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:16.243467 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed262e29-4e87-43f9-bbcc-b3029647c8c3 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e" status: 404 len: 111 microversion: 2.1 time: 0.089288 Jul 28 11:31:16.249140 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 868/1735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:16 2022] GET /compute/v2.1/servers/09408043-13e3-4390-8f50-8c8703ae3b3e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:31:16.270744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:16.271917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:16.280178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.283400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.285660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.289207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.348498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:16.357988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:16.363211 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c9f18d5-c347-4101-be73-524d19fb4938 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.545697 Jul 28 11:31:16.364194 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 868/1736] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:15 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:16.375849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a7402c16-5dee-464e-a592-19c2dacc5624 req-f08ec1f1-6366-42f4-bd99-a810aa3765bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3983adb-07cc-49b4-bc78-20facbe1f015", "tag": "725657b1-8bbf-4cb7-b055-74a36543395d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:16.408880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a7402c16-5dee-464e-a592-19c2dacc5624 req-f08ec1f1-6366-42f4-bd99-a810aa3765bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.420209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a7402c16-5dee-464e-a592-19c2dacc5624 req-f08ec1f1-6366-42f4-bd99-a810aa3765bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.465060 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a7402c16-5dee-464e-a592-19c2dacc5624 req-f08ec1f1-6366-42f4-bd99-a810aa3765bb service nova] Creating event network-changed:725657b1-8bbf-4cb7-b055-74a36543395d for instance d3983adb-07cc-49b4-bc78-20facbe1f015 on n-h1-851368-1 Jul 28 11:31:16.482105 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a7402c16-5dee-464e-a592-19c2dacc5624 req-f08ec1f1-6366-42f4-bd99-a810aa3765bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116215 Jul 28 11:31:16.483930 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 869/1737] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:16.502913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:16.505697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:16.526928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.531889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.532897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.536083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.594070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6e810405-e00d-4bf8-840f-9cd2bd579606 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 204 len: 0 microversion: 2.1 time: 0.340219 Jul 28 11:31:16.595319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 869/1738] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:16 2022] DELETE /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:31:16.606560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:16.607787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:16.622123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.622858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.627611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:16.629029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:16.964932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:16.985811 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-870f6956-23db-4ee7-b8d0-efbe95ee9473 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.500092 Jul 28 11:31:16.991589 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 870/1739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:16 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:16.998723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:17.010997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:17.031873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.032602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.033574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.034174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.148638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:17.160932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f387444c-4d42-4663-9d03-b42c681939fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.563550 Jul 28 11:31:17.167001 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 870/1740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:16 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:17.176835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:17.179448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:17.204920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.205558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.207799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.208774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.281918 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ee69c68-3049-4cad-86f6-02908ed13d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109048 Jul 28 11:31:17.282852 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 871/1741] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:17 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:17.290205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:17.292858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: c09c05fb-05ef-4845-9b2d-fb3115e2384c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:17.301210 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/c09c05fb-05ef-4845-9b2d-fb3115e2384c/action HTTP/1.1 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 28 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: {"reboot": {"type": "SOFT"}} Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c09c05fb-05ef-4845-9b2d-fb3115e2384c', 'body': {'reboot': {'type': 'SOFT'}}} Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. Jul 28 11:31:17.303604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance c09c05fb-05ef-4845-9b2d-fb3115e2384c could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4a46cfa-9246-43bd-88b5-e4392bc008c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/c09c05fb-05ef-4845-9b2d-fb3115e2384c/action" status: 404 len: 111 microversion: 2.1 time: 0.021429 Jul 28 11:31:17.308184 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 872/1742] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:17 2022] POST /compute/v2.1/servers/c09c05fb-05ef-4845-9b2d-fb3115e2384c/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:17.312420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:17.313051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:17.322993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.323706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.325074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.325532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.442842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:17.459537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5af8288-a7ac-45f8-9223-dfab6f1feb2a tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1468 microversion: 2.1 time: 0.464177 Jul 28 11:31:17.478213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 871/1743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:16 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:17.483306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:17.494446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:17.501566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.502017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:17.502809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:17.503275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:18.355775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:18.374126 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d321c0ac-96fd-4138-87ca-7d03eadb59c3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 1.067073 Jul 28 11:31:18.380143 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 873/1744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:17 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:18.393090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:18.394610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:18.422533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:18.425518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:18.429802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:18.431928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:18.762242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:18.797747 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e87908c-47a7-49b9-9231-bfd65f6990e4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.314092 Jul 28 11:31:18.801218 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 872/1745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:17 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:18.849629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:18.859374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:18.882641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:18.884635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:18.889023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:18.891042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:18.973101 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7927ce6-9019-4a73-8bb1-97da8c016efa tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145675 Jul 28 11:31:18.976810 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 873/1746] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:18 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:18.981744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:18.992017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:19.002743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.003385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:19.004317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.004885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:19.352060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:19.366326 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9129b12c-a724-4155-92e6-522b88a5c9ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.979118 Jul 28 11:31:19.379591 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 874/1747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:18 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:19.384701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:19.385313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:19.393111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.393555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:19.394910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.403680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:19.814551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4e1d0d7b5b4f2c884579f3475d0c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7b70fd6634e5c839709aeb3decee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:19.829699 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9691dd74-11bb-4dad-90fa-a6ea7498c941 tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 200 len: 1468 microversion: 2.1 time: 0.851609 Jul 28 11:31:19.830320 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 874/1748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:18 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 1468 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:19.842438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:19.845241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:19.855740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:19.877815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.879314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:19.880582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:19.881372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.051211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:20.059380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4d338f5-8d9d-48b4-8f39-3a3c8c80cdd6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.678570 Jul 28 11:31:20.063672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 875/1749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:19 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:20.072480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:20.078202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:20.090700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.093362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.107181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.108239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.165544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb6d2589-913a-45a9-a6a8-3e95e1e50403 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100655 Jul 28 11:31:20.176432 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 876/1750] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:20 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:20.184192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:20.187330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:20.218927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.219791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.220837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.221498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.250506 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action HTTP/1.1 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 65 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '33daecce-0fef-495a-a0bd-cdb1ab7683ee', 'body': {'rebuild': {'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e'}}} Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 11:31:20.263901 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:31:20.268402 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:20.271761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:20.272909 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-308c7cab-7b22-4724-9186-f74edbfa6b8d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action" status: 404 len: 111 microversion: 2.1 time: 0.095356 Jul 28 11:31:20.277113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 877/1751] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:20 2022] POST /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:20.282231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ad052d7a-d071-4422-990b-734268841f5b req-504f1408-6e00-4304-a8cd-6c8daaa7e868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0cacf-222b-4265-b429-5c4f2578553f", "name": "network-vif-deleted", "tag": "4af8c048-86cf-4c6c-9f8c-48c401967558"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:20.293747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:20.302603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ad052d7a-d071-4422-990b-734268841f5b req-504f1408-6e00-4304-a8cd-6c8daaa7e868 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.303526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ad052d7a-d071-4422-990b-734268841f5b req-504f1408-6e00-4304-a8cd-6c8daaa7e868 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.318184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ad052d7a-d071-4422-990b-734268841f5b req-504f1408-6e00-4304-a8cd-6c8daaa7e868 service nova] Creating event network-vif-deleted:4af8c048-86cf-4c6c-9f8c-48c401967558 for instance 62b0cacf-222b-4265-b429-5c4f2578553f on n-h2-851368-1 Jul 28 11:31:20.323594 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ad052d7a-d071-4422-990b-734268841f5b req-504f1408-6e00-4304-a8cd-6c8daaa7e868 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044792 Jul 28 11:31:20.324677 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 878/1752] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:20.330811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:20.331718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:20.339140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.339736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.340628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.341322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.439769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:20.452646 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06e2ba62-2a18-4b13-a4d8-50329efc4350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.621238 Jul 28 11:31:20.453239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 875/1753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:19 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:20.465736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:20.481207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:20.503420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:20.506368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.506820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:20.507656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:20.516629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.139125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:21.153445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c8a94f2-e436-4a53-9f3b-99d70eb45a11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.698912 Jul 28 11:31:21.162422 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 876/1754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:20 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:21.176457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:21.183471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] [instance: 62b0cacf-222b-4265-b429-5c4f2578553f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:21.193212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.198409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.199550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.200165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.230408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:21.233511 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] HTTP exception thrown: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Request method failure captured: Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f HTTP/1.1 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nIelSytcfqXenCW8a4e2RIA4tox5xTbXYyOaj-376BG5oZ84TKkMgAhk88m8l54moMSsJ-Kc8w0xkEKM_KofEmc2JD6s8qYgc0dVgKur8JnfJGH-E4mI6e1RdN_SI_RRc1dWq-VL7jrZoB89FUJcCwFAzqG_I6xs84pM4JYE04GVfI Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ff7b70fd6634e5c839709aeb3decee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ff7b70fd6634e5c839709aeb3decee2"}]}] Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 4ff7b70fd6634e5c839709aeb3decee2 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MigrationsAdminTest-849873368 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2a4e1d0d7b5b4f2c884579f3475d0c31 Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MigrationsAdminTest-849873368-project Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '62b0cacf-222b-4265-b429-5c4f2578553f'} Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:21.239298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. Jul 28 11:31:21.244798 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:21.246177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] Returning 404 to user: Instance 62b0cacf-222b-4265-b429-5c4f2578553f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:21.250009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-26b03d50-ef05-4b28-a855-727bc6586fad tempest-MigrationsAdminTest-849873368 tempest-MigrationsAdminTest-849873368-project] 10.222.0.93 "GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f" status: 404 len: 111 microversion: 2.1 time: 0.083749 Jul 28 11:31:21.251219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 877/1755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:21 2022] GET /compute/v2.1/servers/62b0cacf-222b-4265-b429-5c4f2578553f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:21.256182 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b52745ae-8d4b-4145-a71b-0682caef5a31 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.923362 Jul 28 11:31:21.256952 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 879/1756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:20 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:21.280868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:21.281841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:21.292339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.293764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.293977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:21.296236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.296805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.298701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:21.315350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=20 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:21.320396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.321028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.324769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.325294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.405197 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a5157de-321c-4e8b-b128-d9ea96cb51f9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128566 Jul 28 11:31:21.408675 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 878/1757] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:21 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:21.418001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1135092680", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b93dd60e-eebc-4156-8fe1-0460817e9901"}], "block_device_mapping_v2": [{"uuid": "44a08b2c-7eb0-409c-b090-5a090a14ed41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:21.523423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] validate_networks() for [('b93dd60e-eebc-4156-8fe1-0460817e9901', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:21.731206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:21.802423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:21.812649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b64f474-a51f-4f23-a91a-0bb134561976 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.535959 Jul 28 11:31:21.817846 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 880/1758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:21 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:21.837272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:21.838046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:21.853105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.854660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:21.857098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:21.857687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:22.021267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:22.390483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:22.399637 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5d9f4d8-2552-421f-9484-5924fd784db8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.579781 Jul 28 11:31:22.406729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 881/1759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:21 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:22.423328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:22.428508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 118e9b26-823a-488b-abe0-8d9ba1c0ed71] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:22.451857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/118e9b26-823a-488b-abe0-8d9ba1c0ed71/action HTTP/1.1 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 65 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '118e9b26-823a-488b-abe0-8d9ba1c0ed71', 'body': {'rebuild': {'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e'}}} Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:31:22.454150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:22.459571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 118e9b26-823a-488b-abe0-8d9ba1c0ed71 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:22.460667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-23856ec8-90ff-48c9-aab0-f80cead80705 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/118e9b26-823a-488b-abe0-8d9ba1c0ed71/action" status: 404 len: 111 microversion: 2.1 time: 0.052236 Jul 28 11:31:22.460752 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 882/1760] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:22 2022] POST /compute/v2.1/servers/118e9b26-823a-488b-abe0-8d9ba1c0ed71/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:22.480763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:22.481431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:22.510022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:22.510479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:22.511326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:22.511768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:22.568571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:23.027176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:23.042177 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b775d23-43c3-498b-999a-baffb80bd41e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.580359 Jul 28 11:31:23.043890 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 883/1761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:22 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:23.060310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-df3230d7-2f2a-4373-bd73-ff6870dc66bd req-4dc4bf8d-0f6e-4f68-b89a-ab89c4fe2c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8401aefb-db11-41da-9b69-503f6d0ac0e8", "tag": "16648b64-4f4f-483f-b22f-bd9432ed8766"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:23.084144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-df3230d7-2f2a-4373-bd73-ff6870dc66bd req-4dc4bf8d-0f6e-4f68-b89a-ab89c4fe2c49 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.087528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-df3230d7-2f2a-4373-bd73-ff6870dc66bd req-4dc4bf8d-0f6e-4f68-b89a-ab89c4fe2c49 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.105868 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-df3230d7-2f2a-4373-bd73-ff6870dc66bd req-4dc4bf8d-0f6e-4f68-b89a-ab89c4fe2c49 service nova] Creating event network-changed:16648b64-4f4f-483f-b22f-bd9432ed8766 for instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 on n-h2-851368-1 Jul 28 11:31:23.112648 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-df3230d7-2f2a-4373-bd73-ff6870dc66bd req-4dc4bf8d-0f6e-4f68-b89a-ab89c4fe2c49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066382 Jul 28 11:31:23.114334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 884/1762] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:23.122594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:23.127554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:23.138642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.140403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.141549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.142292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.198668 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-810a2b78-f937-4789-9ef1-514830327195 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081664 Jul 28 11:31:23.205302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 885/1763] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:31:23 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:31:23.206496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:23.207754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:23.215373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.215959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.216950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.217587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.370014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:23.371145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:23.371878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:23.372498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:23.373118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:23.393735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.394190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.400896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.401478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.452471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:23.469781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Getting quotas for user ccea87d21921492f8544e0e81ea485d5 and project 2367458a06b245769d5851becc658136. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:23.580848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:23.584584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44a08b2c-7eb0-409c-b090-5a090a14ed41',volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:23.617662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:23.625622 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81cff041-5619-4d97-8bf7-c10d17f6830e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.423895 Jul 28 11:31:23.629717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 886/1764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:23 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:23.843326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be0d4da7-c4dc-4e7e-9451-372c665e1a2d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.433336 Jul 28 11:31:23.855352 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 879/1765] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:31:23.868047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:23.868835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:23.875647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.877158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.878169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:23.879042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:23.934708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f68b1ab8-0bb4-46e9-bac8-bccc1c9ead3e tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb2479ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1962003779", "description": "tempest-description-389264423"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:24.209511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:24.221231 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-092f87dd-9de8-4766-ab8c-501c3213da78 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.363324 Jul 28 11:31:24.227215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 880/1766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:23 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:24.250442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:24.251178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:24.267999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.269900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.272217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.273267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.508176 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f68b1ab8-0bb4-46e9-bac8-bccc1c9ead3e tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.877021 Jul 28 11:31:24.509310 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 887/1767] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:24.522198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:24.522794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:24.530928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.531417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.532210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.532652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.658185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:24.669613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce4162a8-1814-45d7-b23f-80bff22d9620 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.438897 Jul 28 11:31:24.671536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 881/1768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:24 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:24.678467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:24.679419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:24.698341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.699521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.700880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:24.701567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:24.776662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:24.792503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:24.799529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:24.804384 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aa7a0a3d-7550-482a-8adf-e6cc716b6dce tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1185 microversion: 2.25 time: 0.293212 Jul 28 11:31:24.806731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 888/1769] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:24 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1185 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:24.820382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38063df5-9886-40bf-a78a-f52c322fcab6 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb23a9af0>, body: {"security_group_rule": {"parent_group_id": "93fa5377-63d0-44e3-9786-d4146f4aa717", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:25.113149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:25.127700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e40d11e-6f00-43de-871b-72dbacaba6b1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.454605 Jul 28 11:31:25.128387 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 882/1770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:24 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:25.133783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:25.134323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: c331aaba-b34c-42b8-ae25-72531435535e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:25.147164 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/c331aaba-b34c-42b8-ae25-72531435535e/action HTTP/1.1 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: {"restore": {}} Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c331aaba-b34c-42b8-ae25-72531435535e', 'body': {'restore': {}}} Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:25.149304 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:25.154231 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:25.154231 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:25.154231 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. Jul 28 11:31:25.154231 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:25.156037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance c331aaba-b34c-42b8-ae25-72531435535e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:25.157402 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be16ffb1-d417-471e-88a8-ed746a0cc59a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/c331aaba-b34c-42b8-ae25-72531435535e/action" status: 404 len: 111 microversion: 2.1 time: 0.027406 Jul 28 11:31:25.158236 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 883/1771] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:25 2022] POST /compute/v2.1/servers/c331aaba-b34c-42b8-ae25-72531435535e/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:25.171818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:25.172796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:25.185016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:25.189651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:25.192109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:25.198517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:25.475413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38063df5-9886-40bf-a78a-f52c322fcab6 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.664223 Jul 28 11:31:25.477529 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 889/1772] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:25.492721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:25.516996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:25.536965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:25.538329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:25.542083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:25.543944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:25.620014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:25.642190 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c13327c3-fdce-4d53-8f8d-4eea2caa6edf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.479260 Jul 28 11:31:25.642800 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 884/1773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:25 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:25.648787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-288f7b4c-3807-4e7d-a1c8-7a7db66143d8 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb249ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2010977928", "description": "tempest-description-326836155"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:26.708897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:26.723885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3d9a9f57-0d60-4af8-8712-4f2d416d8e08 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 1.242689 Jul 28 11:31:26.724827 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 890/1774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:25 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:26.733673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:26.734302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:26.744614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-288f7b4c-3807-4e7d-a1c8-7a7db66143d8 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.099890 Jul 28 11:31:26.746316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 885/1775] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:26.751792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:26.752477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:26.753272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:26.753738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9e10eedb-0989-4beb-b13c-5033e67341e5 req-8760ba11-77ed-449f-afde-9fc5b5e48e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3983adb-07cc-49b4-bc78-20facbe1f015", "name": "network-vif-plugged", "status": "completed", "tag": "725657b1-8bbf-4cb7-b055-74a36543395d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:26.753884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:26.793343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e10eedb-0989-4beb-b13c-5033e67341e5 req-8760ba11-77ed-449f-afde-9fc5b5e48e38 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:26.795380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e10eedb-0989-4beb-b13c-5033e67341e5 req-8760ba11-77ed-449f-afde-9fc5b5e48e38 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:26.819177 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e10eedb-0989-4beb-b13c-5033e67341e5 req-8760ba11-77ed-449f-afde-9fc5b5e48e38 service nova] Creating event network-vif-plugged:725657b1-8bbf-4cb7-b055-74a36543395d for instance d3983adb-07cc-49b4-bc78-20facbe1f015 on n-h1-851368-1 Jul 28 11:31:26.834761 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9e10eedb-0989-4beb-b13c-5033e67341e5 req-8760ba11-77ed-449f-afde-9fc5b5e48e38 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087021 Jul 28 11:31:26.836197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 886/1776] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:26.855679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:26.859561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:26.887438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:26.890763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:26.894492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:26.894962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.052840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:27.062878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:27.069627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:27.072751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f0ddc8e-f6a2-4894-b5b4-1679acb83929 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.346506 Jul 28 11:31:27.073798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:27.074664 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 891/1777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:26 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:27.090077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:27.091063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:27.093693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-675d3331-a64f-4294-8ec2-887d5f846dcb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1251 microversion: 2.25 time: 0.236750 Jul 28 11:31:27.095440 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 887/1778] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:26 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1251 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:27.111421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.111945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.112872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.113990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.398637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:27.410966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f73e65bc-4956-4483-9794-13a757a40f9e tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] Calling method '.version_select at 0x7f2eb249db80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:27.413914 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-935a3c3e-7323-469d-8811-e7ebfb46ddce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.334289 Jul 28 11:31:27.415902 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:31:27.415902 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:31:27.416500 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 892/1779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:27 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:27.431156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae9dd2f3-124c-4448-bdda-cf17f4c9d898 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb23434c0>, body: {"security_group_rule": {"parent_group_id": "8b144f4c-1ce5-4781-aa4a-002e6ef8fb8b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:27.440873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f73e65bc-4956-4483-9794-13a757a40f9e tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.343956 Jul 28 11:31:27.447257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 888/1780] 10.222.0.93 () {60 vars in 1226 bytes} [Thu Jul 28 11:31:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:31:27.462907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:27.463496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:27.472356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.473322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.474543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.475059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.498269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:27.527591 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'restore' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: {"restore": {}} Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: exception: Cannot 'restore' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'restore': {}}} Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state active. Cannot restore while the instance is in this state. Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:27.529277 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'restore' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:27.533736 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f806c8d8-5606-47d1-a134-8f9ffb133d6a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 145 microversion: 2.1 time: 0.087568 Jul 28 11:31:27.537507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 889/1781] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:27 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 145 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:31:27.544745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc1b796a-97cf-43e2-8593-f01debcc7f94 tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb249daf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:27.549955 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:31:27.549955 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:31:27.875111 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae9dd2f3-124c-4448-bdda-cf17f4c9d898 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.456351 Jul 28 11:31:27.883951 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 893/1782] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:27 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:27.890694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:27.893178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:27.910593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.912298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:27.913990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:27.915755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.033261 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc1b796a-97cf-43e2-8593-f01debcc7f94 tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.494558 Jul 28 11:31:28.037337 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 890/1783] 10.222.0.93 () {62 vars in 1247 bytes} [Thu Jul 28 11:31:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:31:28.050340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:28.053949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:28.072204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.074993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.077060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.078057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.220913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:28.243658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ba9bb690-0e1e-4dbf-bd8b-ac814364ac07 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.358360 Jul 28 11:31:28.244265 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 894/1784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:27 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:28.274257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-245e842b-440c-42fa-b9d4-c552889adde4 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb2343790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1596223787", "description": "tempest-description-930767559"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:28.604661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:28.614392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e21f81e0-6fc0-4342-bb57-ed8961013ded tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.575721 Jul 28 11:31:28.614984 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 891/1785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:28 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:28.621746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6092e93c-7b86-4e6f-a19f-ddba4cdb254c tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] Calling method '.version_select at 0x7f2eb249dc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:28.622535 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:31:28.622535 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:31:28.671061 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6092e93c-7b86-4e6f-a19f-ddba4cdb254c tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.054937 Jul 28 11:31:28.674841 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 892/1786] 10.222.0.93 () {60 vars in 1226 bytes} [Thu Jul 28 11:31:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:31:28.690277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:28.692077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:28.707780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.712353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.713322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.716635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.933968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-245e842b-440c-42fa-b9d4-c552889adde4 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.672127 Jul 28 11:31:28.935503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 895/1787] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:28.946745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:28.949213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:28.971974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.972996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:28.983012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:28.983514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:29.333897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:29.351460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:29.356084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:29.361296 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd10e946-4c9c-425b-b0e5-3f7711760fb0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1293 microversion: 2.25 time: 0.680953 Jul 28 11:31:29.368798 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 893/1788] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:28 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1293 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:29.381826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:29.393860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:29.395519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e104de8d-6439-467f-acde-36ae2d07e7d4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.458823 Jul 28 11:31:29.407672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 896/1789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:28 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:29.407672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55229041-64cf-4f36-8996-2bdb18b93f35 tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb23b6040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:29.407672 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:31:29.407672 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:31:29.445810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:29.499570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:29.505200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:29.509980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:29.510855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:29.528049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55229041-64cf-4f36-8996-2bdb18b93f35 tempest-QuotaClassesAdmin257Test-776941317 tempest-QuotaClassesAdmin257Test-776941317-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.128752 Jul 28 11:31:29.533043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 897/1790] 10.222.0.93 () {62 vars in 1247 bytes} [Thu Jul 28 11:31:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:31:29.553943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6356171-d782-4cb2-bfa1-cf154c925183 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb2344f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-899874751", "description": "tempest-description-981452383"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:30.111685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c6356171-d782-4cb2-bfa1-cf154c925183 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.577197 Jul 28 11:31:30.122006 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 898/1791] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:29 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:30.128342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:30.129899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 2a9ea6b9-a489-468e-a69a-06afcc006970] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:30.148466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. Jul 28 11:31:30.149294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/2a9ea6b9-a489-468e-a69a-06afcc006970/action HTTP/1.1 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 14 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: {"resume": {}} Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2a9ea6b9-a489-468e-a69a-06afcc006970', 'body': {'resume': {}}} Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:30.157097 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 2a9ea6b9-a489-468e-a69a-06afcc006970 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fb96571-c16f-48cf-9172-470f1c979b7a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/2a9ea6b9-a489-468e-a69a-06afcc006970/action" status: 404 len: 111 microversion: 2.1 time: 0.035363 Jul 28 11:31:30.162981 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 899/1792] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:30 2022] POST /compute/v2.1/servers/2a9ea6b9-a489-468e-a69a-06afcc006970/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:30.167839 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4da67edf-cf2c-41cc-bf8d-5156c4b4b7f1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1316 microversion: 2.1 time: 0.797592 Jul 28 11:31:30.172004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 894/1793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:29 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:30.177401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d8567565-4202-498e-949b-04d22a839280 req-367f0f3c-9a78-4609-a071-5ee4f6481e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8401aefb-db11-41da-9b69-503f6d0ac0e8", "name": "network-vif-plugged", "status": "completed", "tag": "16648b64-4f4f-483f-b22f-bd9432ed8766"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:30.196725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e16800e0-9c17-4a41-8d19-b7969d31a305 req-6c92ab00-ba7a-461d-85ec-a8b54087c7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:30.201760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d8567565-4202-498e-949b-04d22a839280 req-367f0f3c-9a78-4609-a071-5ee4f6481e01 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.203023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d8567565-4202-498e-949b-04d22a839280 req-367f0f3c-9a78-4609-a071-5ee4f6481e01 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.220305 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d8567565-4202-498e-949b-04d22a839280 req-367f0f3c-9a78-4609-a071-5ee4f6481e01 service nova] Creating event network-vif-plugged:16648b64-4f4f-483f-b22f-bd9432ed8766 for instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 on n-h2-851368-1 Jul 28 11:31:30.224968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e16800e0-9c17-4a41-8d19-b7969d31a305 req-6c92ab00-ba7a-461d-85ec-a8b54087c7ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.224968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e16800e0-9c17-4a41-8d19-b7969d31a305 req-6c92ab00-ba7a-461d-85ec-a8b54087c7ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.230163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d8567565-4202-498e-949b-04d22a839280 req-367f0f3c-9a78-4609-a071-5ee4f6481e01 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056611 Jul 28 11:31:30.231326 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 895/1794] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:30.238615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:30.239708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:30.248277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.249539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.250693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.251350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.260820 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e16800e0-9c17-4a41-8d19-b7969d31a305 req-6c92ab00-ba7a-461d-85ec-a8b54087c7ea service nova] Creating event network-changed:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h1-851368-1 Jul 28 11:31:30.273876 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e16800e0-9c17-4a41-8d19-b7969d31a305 req-6c92ab00-ba7a-461d-85ec-a8b54087c7ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109405 Jul 28 11:31:30.276276 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 900/1795] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:30.290299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4613274d-1ab1-446d-a242-2cb3a62108f2 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb28c3c10>, body: {"security_group_rule": {"parent_group_id": "40e50c83-d8a5-4585-869d-9fd96d382358", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "21f68a77-a75f-4c5e-944c-d9c742217387"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:30.667266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:30.676968 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e20419a7-da7d-453e-9b1c-7b28d2fc6128 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.444175 Jul 28 11:31:30.680328 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 896/1796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:30 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:30.689775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:30.690829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:30.725977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.726355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.728073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:30.728905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:30.980514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:30.988509 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d26d7cee-27b5-4326-ad4e-909ab4aba91d tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.302341 Jul 28 11:31:30.989114 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 897/1797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:30 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:31.011214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:31.011843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:31.021124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.022522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.028200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.028665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.045314 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4613274d-1ab1-446d-a242-2cb3a62108f2 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.767323 Jul 28 11:31:31.046576 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 901/1798] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:30 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:31.052784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:31.053651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:31.062188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.062712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.063853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.064572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.337478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:31.345604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:31.352745 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3306b109-2378-4a4c-9289-864650fd07c8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.302868 Jul 28 11:31:31.355423 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 902/1799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:31 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:31.366919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de617b0f-cec3-4eed-b30e-d46ae868e16c tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb2526e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1416092058", "description": "tempest-description-1537077153"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:31.372064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:31.373879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:31.375028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-301feb34-908b-440b-86ac-20cfdb1288c0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1293 microversion: 2.25 time: 0.384970 Jul 28 11:31:31.375808 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 898/1800] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:30 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1293 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:31.396846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:31.397953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:31.407142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.407602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.409535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.410647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.666329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:31.678066 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de617b0f-cec3-4eed-b30e-d46ae868e16c tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.321380 Jul 28 11:31:31.678697 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 903/1801] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:31.687349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:31.687349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:31.692275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-082ae105-924a-4434-8b15-697af1be02fc tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1466 microversion: 2.1 time: 0.302701 Jul 28 11:31:31.696611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.697297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.697586 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 899/1802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:31 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1466 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:31.698562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.699250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.704856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e9028f0-add9-487c-af1f-bdbd5f19ad27 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb249dc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-612276361", "description": "tempest-description-464343829"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:31.750055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'resume' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 14 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: {"resume": {}} Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'resume' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'resume': {}}} Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state active. Cannot resume while the instance is in this state. Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:31.753634 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'resume' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:31.760789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27356532-8f18-4218-930a-d857055a98c0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 144 microversion: 2.1 time: 0.074926 Jul 28 11:31:31.765197 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 904/1803] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:31 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 144 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:31:31.777853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:31.778725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:31.790908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.795847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:31.796921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:31.799479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.061014 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e9028f0-add9-487c-af1f-bdbd5f19ad27 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.361405 Jul 28 11:31:32.062057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 900/1804] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:31 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:32.076961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:32.077914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:32.082464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:32.091831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bbeb3553-c29f-4bc1-ae49-a9e116130dd0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1315 microversion: 2.1 time: 0.325086 Jul 28 11:31:32.093073 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 905/1805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:31 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:32.099906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.100593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.101831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.102547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.103488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:32.107559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:32.134888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.135677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.136963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.137714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.446379 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00c65978-555d-47f3-86eb-adf15f7bc1de tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1617 microversion: 2.1 time: 0.373726 Jul 28 11:31:32.448270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:32.467046 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 901/1806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:32 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1617 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:32.483864 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9bfcea36-c6ff-4548-8a9f-e0b0cfc9b5de tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.389060 Jul 28 11:31:32.487519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac07bb09-2a80-4ed4-b7e5-0ce59cf73dc4 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb24d1dc0>, body: {"security_group_rule": {"parent_group_id": "f0c44356-086c-4cc0-aebc-1915b21ac8b7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ce40ad11-3f7e-4c9f-896f-2f1a5362feb7"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:32.495452 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 906/1807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:32 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:32.514612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:32.522749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:32.551918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.556708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.558743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.560481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.833827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:32.844879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:32.846859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:32.849568 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b3a317d2-5072-42eb-9bb6-688e84d2b888 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1293 microversion: 2.25 time: 0.351576 Jul 28 11:31:32.868711 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 907/1808] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:32 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1293 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:32.875267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:32.876185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:32.884014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.884809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:32.885821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:32.886486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:33.079634 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac07bb09-2a80-4ed4-b7e5-0ce59cf73dc4 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.611093 Jul 28 11:31:33.088496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 902/1809] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:32 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:33.100716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1179655657", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "df3a374f-7b2d-457c-866e-e6c033a0b067"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:33.126826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:33.139911 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4aba2f1a-e21b-4ebe-a76e-a3d82825a6f2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.269174 Jul 28 11:31:33.141366 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 908/1810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:32 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:33.197129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b3e6b78-06d0-44fa-b704-418ba7a90a10 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb247bdc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:33.228594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:33.413854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:33.639994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:33.640435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:33.642401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:33.642510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:33.642851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:33.645433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:UPDATE=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:33.660555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:33.661272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:33.662613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:33.663278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:33.686258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:33.692235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Getting quotas for user 64884e3fb37a4b5eb5967b843b7b5e6b and project 864dc3b3e25847ac9c2bb27cb726cbdc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:33.692885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b3e6b78-06d0-44fa-b704-418ba7a90a10 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ce40ad11-3f7e-4c9f-896f-2f1a5362feb7" status: 202 len: 0 microversion: 2.1 time: 0.501315 Jul 28 11:31:33.698812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 909/1811] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:33 2022] DELETE /compute/v2.1/os-security-groups/ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:33.704264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:33.704995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:33.710573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:33.712963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:33.721312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:33.723340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:33.724150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:33.724596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:33.786282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8735950c-1890-4229-bdb2-5d5a576f09fa tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696250 Jul 28 11:31:33.787242 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 903/1812] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:33.792904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e833762-8992-4666-96d5-df98b65f5083 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e833762-8992-4666-96d5-df98b65f5083 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 160 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "ddfecbec-84cc-466e-9a74-32188ed83a6b"}]}} Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'networks': [{'uuid': 'ddfecbec-84cc-466e-9a74-32188ed83a6b'}]}}} Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi '' Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:31:33.797724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:31:33.802666 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:33.813013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e833762-8992-4666-96d5-df98b65f5083 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:33.816750 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e833762-8992-4666-96d5-df98b65f5083 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027064 Jul 28 11:31:33.823781 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 904/1813] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:33 2022] POST /compute/v2.1/servers => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:31:33.831251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0343cd7-bb54-455c-8c84-b70050a1ac74 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb244fd30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:33.942224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0343cd7-bb54-455c-8c84-b70050a1ac74 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/f0c44356-086c-4cc0-aebc-1915b21ac8b7" status: 200 len: 248 microversion: 2.1 time: 0.116497 Jul 28 11:31:33.943774 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 905/1814] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:31:33 2022] GET /compute/v2.1/os-security-groups/f0c44356-086c-4cc0-aebc-1915b21ac8b7 => generated 248 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:33.956213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9164794c-8e0a-4ebf-92f2-a83ea2e9999d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:33.957565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9164794c-8e0a-4ebf-92f2-a83ea2e9999d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:34.043537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9164794c-8e0a-4ebf-92f2-a83ea2e9999d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.051373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9164794c-8e0a-4ebf-92f2-a83ea2e9999d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1217 microversion: 2.1 time: 0.106232 Jul 28 11:31:34.051833 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 906/1815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:33 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:34.056437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:34.057058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:34.066509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.079201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.079658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.082199 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d5b104c-6414-480a-bea2-9dbe7cf829d8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1503 microversion: 2.1 time: 0.381248 Jul 28 11:31:34.083031 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 910/1816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:33 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:34.088246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.089000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.093920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:34.094791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:34.116092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.118174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.126863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.129312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.485953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.498077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:34.503197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.511863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.513134 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63d07ff0-1422-4858-b298-801d97154412 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1293 microversion: 2.25 time: 0.428642 Jul 28 11:31:34.513713 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 911/1817] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:34 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1293 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:34.533491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.542203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-945034a7-4ee5-44ce-b5a6-34b06e5f3340 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb235cca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1466704776", "description": "tempest-description-1542329479"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:34.559458 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df72a710-1f07-4d0d-b4af-28baa095a8e6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.506483 Jul 28 11:31:34.560067 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 907/1818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:34 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:34.584530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:34.585915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:34.593542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.594226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.595296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:34.595995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:34.928567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:34.937240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffeab4ed-b56d-4461-ae34-e219e8d6cb99 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.357162 Jul 28 11:31:34.938673 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 908/1819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:34 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:34.965669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:34.966516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: d505bd75-8a22-4e5d-96f8-dbd6ef908418] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:34.977575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/d505bd75-8a22-4e5d-96f8-dbd6ef908418/action HTTP/1.1 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 14 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: {"shelve": {}} Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd505bd75-8a22-4e5d-96f8-dbd6ef908418', 'body': {'shelve': {}}} Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:34.990520 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:34.995281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:34.995281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:34.995281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. Jul 28 11:31:34.995281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:34.997123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance d505bd75-8a22-4e5d-96f8-dbd6ef908418 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:34.998512 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-421c3856-2c07-44ea-a6fa-485d46774ae2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/d505bd75-8a22-4e5d-96f8-dbd6ef908418/action" status: 404 len: 111 microversion: 2.1 time: 0.038352 Jul 28 11:31:34.999711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 909/1820] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:34 2022] POST /compute/v2.1/servers/d505bd75-8a22-4e5d-96f8-dbd6ef908418/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:35.007474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:35.009486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:35.018277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.018727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.020461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.020677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.193690 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-945034a7-4ee5-44ce-b5a6-34b06e5f3340 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.673210 Jul 28 11:31:35.201821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 912/1821] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:31:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:35.207737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:35.208927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:35.216217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.216961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.217968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.218629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.254928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:35.265770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b23bb55-2f21-420c-a06c-c4d03ba73ad1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.262133 Jul 28 11:31:35.267147 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 910/1822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:35 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:35.273748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1530629b-5efd-40a8-9ad5-866b79169315 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb24cb310>, body: {"security_group_rule": {"parent_group_id": "5fd4a0a0-1c81-43e0-a394-d63061b68886", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:35.418137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:35.426774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c8a1dcc3-d4be-4cbb-b875-5b19f17b240f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1269 microversion: 2.1 time: 0.223361 Jul 28 11:31:35.430104 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 913/1823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:35 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:35.437735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:35.438554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:35.454805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.455563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.463041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.463846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.914819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1530629b-5efd-40a8-9ad5-866b79169315 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.646197 Jul 28 11:31:35.915745 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 911/1824] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:35.920717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:35.921590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:35.931857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.939655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.940933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:35.942256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:35.982838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:35.992291 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fab7219b-17aa-4934-89e7-244c2378b5fe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.560555 Jul 28 11:31:35.997621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 914/1825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:35 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:36.172383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-594805619", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:36.211043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:36.220654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:36.222225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:36.225932 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7af971f9-fba6-477e-a47d-c1eb4cc084bf tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.308882 Jul 28 11:31:36.226732 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 912/1826] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:35 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:36.230276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:36.238258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a70b772c-8596-49cb-83de-7a745912a44d tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Action: 'create', calling method: .version_select at 0x7f2eb2465c10>, body: {"security_group_rule": {"parent_group_id": "5fd4a0a0-1c81-43e0-a394-d63061b68886", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:36.620472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:36.621156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:36.621720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:36.622623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:36.623249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:36.633667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.634165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.634978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.635448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.659992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:36.668000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for user 84e1308406bc4870967e9d826c14e68e and project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:36.683702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:36.686737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:36.722770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a70b772c-8596-49cb-83de-7a745912a44d tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.494693 Jul 28 11:31:36.723420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 913/1827] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:31:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:36.731888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:36.732456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:36.741810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.742823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.743903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.744774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.752049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fb938ed-66f9-409b-afdd-43c9da277f10 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753196 Jul 28 11:31:36.754590 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 915/1828] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:36.777204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:36.779664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:36.789800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.790306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.791801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:36.792192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:36.809500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'flavor' on Instance uuid 037232de-716c-4380-9033-c2c3d8c09598 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:36.906156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:36.920928 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d963130a-4f5e-4198-8d0d-44f0142f42ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1275 microversion: 2.1 time: 0.164294 Jul 28 11:31:36.921711 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 916/1829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:36 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:36.953266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0650984a-6861-4d48-933c-f0dd48959e58 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb23a9790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:37.076002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0650984a-6861-4d48-933c-f0dd48959e58 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/5fd4a0a0-1c81-43e0-a394-d63061b68886" status: 200 len: 665 microversion: 2.1 time: 0.143066 Jul 28 11:31:37.089026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 917/1830] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:31:36 2022] GET /compute/v2.1/os-security-groups/5fd4a0a0-1c81-43e0-a394-d63061b68886 => generated 665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:37.096766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-68198619", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:37.121175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10077535-19f3-48fc-b846-e5ed5a43dbd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.396009 Jul 28 11:31:37.122363 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 914/1831] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:31:36 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:37.128927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf0a49f4-adba-4299-9e79-4d55b215c33b tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb24d1790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:37.214981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:37.653726 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf0a49f4-adba-4299-9e79-4d55b215c33b tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/5490214c-9bb9-4aa8-b7e9-30a16c33c2c7" status: 202 len: 0 microversion: 2.1 time: 0.529709 Jul 28 11:31:37.666091 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 915/1832] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Jul 28 11:31:37 2022] DELETE /compute/v2.1/os-security-group-rules/5490214c-9bb9-4aa8-b7e9-30a16c33c2c7 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:37.678477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:37.681933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:37.712706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:37.713546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:37.714568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:37.715412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:37.851778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:37.853071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:37.854009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:37.854879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:37.855511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:37.868987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:37.872272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:37.875879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:37.877274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:37.933701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:37.941607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for user 84e1308406bc4870967e9d826c14e68e and project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:37.966078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:37.974158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:37.992083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=7,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:38.055596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-196f19e3-d8c6-4845-af03-e47b79381b20 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961896 Jul 28 11:31:38.057087 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 918/1833] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:38.083656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cee434-ea84-41f2-aa0e-6912ba305c0b"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:38.089100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:38.095634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:38.100341 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d38acb88-40ef-4984-b343-97296d1bc6c6 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.429462 Jul 28 11:31:38.103149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:38.106499 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 916/1834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:37 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:38.122780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:38.126354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.130632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:38.132582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:38.134773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.136478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:38.145650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.148737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:38.150098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.151131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:38.453366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:38.493286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:38.502605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:38.508247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-caf0fd0b-ff4e-4fc6-8c3c-499879741b32 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.397151 Jul 28 11:31:38.514956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 917/1835] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:38 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:38.524937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c31195f5-f1ef-4161-bfce-43d93fb824ca tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb24bb430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:38.608760 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e91ebfb5-b93a-4019-ba36-816227b67a53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550195 Jul 28 11:31:38.614486 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 919/1836] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:31:38 2022] POST /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:38.630437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:38.633063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:38.648167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.651417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:38.652486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:38.655462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.077396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:39.089657 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28bcf5dd-67c7-4f69-ab53-f47028bb19d1 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.471728 Jul 28 11:31:39.091376 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 920/1837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:38 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:39.109138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:39.110780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:39.119704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.121987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.123566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.124309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.782440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:39.793811 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae609fd8-9773-451c-a62d-133ae2989572 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1208 microversion: 2.1 time: 0.701064 Jul 28 11:31:39.797033 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 921/1838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:39 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1208 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:39.808353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:39.808976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:39.830019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.833644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.834973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.837941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.919165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c31195f5-f1ef-4161-bfce-43d93fb824ca tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/5fd4a0a0-1c81-43e0-a394-d63061b68886" status: 202 len: 0 microversion: 2.1 time: 1.402544 Jul 28 11:31:39.920152 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 918/1839] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:38 2022] DELETE /compute/v2.1/os-security-groups/5fd4a0a0-1c81-43e0-a394-d63061b68886 => generated 0 bytes in 1404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:39.928296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:39.929753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:39.944820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.945275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:39.946089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:39.951649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:40.588332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:40.599626 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6d24413-4460-44e9-afcc-22c9357176a0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.801404 Jul 28 11:31:40.602139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 922/1840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:39 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:40.617963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:40.619730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b32c40d2-bffd-4022-b184-aa93c04767fb req-7354b6a0-e7ce-4e3a-a261-48bf9e7caf97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5582e54-46f5-4b1f-916e-8f095a0678bf", "tag": "8807d135-32bc-4d25-b541-aa007b66eb87"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:40.630649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:40.632180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:40.639253 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ae398f2-3b4f-4046-9ea6-abd883b5cad0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.717375 Jul 28 11:31:40.639849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 919/1841] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:39 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:40.651807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb244fd30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:40.662923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b32c40d2-bffd-4022-b184-aa93c04767fb req-7354b6a0-e7ce-4e3a-a261-48bf9e7caf97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:40.666008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b32c40d2-bffd-4022-b184-aa93c04767fb req-7354b6a0-e7ce-4e3a-a261-48bf9e7caf97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:40.695153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:31:40.695630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b32c40d2-bffd-4022-b184-aa93c04767fb req-7354b6a0-e7ce-4e3a-a261-48bf9e7caf97 service nova] Creating event network-changed:8807d135-32bc-4d25-b541-aa007b66eb87 for instance d5582e54-46f5-4b1f-916e-8f095a0678bf on n-h2-851368-1 Jul 28 11:31:40.695774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Neutron security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:31:40.696262 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] HTTP exception thrown: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.696262 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Request method failure captured: Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 HTTP/1.1 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nOL1ipB55iAxSESscHBubDSKfsZGqKgqH-TP0urCyNRUiC8x7HGH5SvW4p-LPhL93VsKj-Pm_ODLrah1uw2fH0v8YoNcilCo-_bhQGe9bFjddKOMBsNE2oSzZGeqKY27VXP4MBElKDoO71JrrZdcpDFqN1IUqT_gpy3VCFeA4Nn1F0 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c4fb765454f2402ea51d908833a31333 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1141429898 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c4fb765454f2402ea51d908833a31333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c4fb765454f2402ea51d908833a31333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c4fb765454f2402ea51d908833a31333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c4fb765454f2402ea51d908833a31333"}]}] Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1141429898 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c4fb765454f2402ea51d908833a31333 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1141429898 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupRulesTestJSON-1141429898-project Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9f790b72d3bc44d188d701f3addcb3ce Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1141429898-project Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ce40ad11-3f7e-4c9f-896f-2f1a5362feb7'} Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:31:40.698190 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Returning 404 to user: Security group ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 does not exist Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-32e7db56-c2f3-47d7-8966-57928e6d7f67'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72e8b8de-d4fc-481d-87b0-91b9a49fb3ee tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ce40ad11-3f7e-4c9f-896f-2f1a5362feb7" status: 404 len: 194 microversion: 2.1 time: 0.058085 Jul 28 11:31:40.703742 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 920/1842] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:40 2022] DELETE /compute/v2.1/os-security-groups/ce40ad11-3f7e-4c9f-896f-2f1a5362feb7 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:40.714926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:40.714926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:40.724605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:40.725170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b32c40d2-bffd-4022-b184-aa93c04767fb req-7354b6a0-e7ce-4e3a-a261-48bf9e7caf97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119975 Jul 28 11:31:40.725559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:40.726846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:40.728099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:40.728728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 923/1843] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:40.739564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f645d85d-4311-453a-9c76-520d04208d85 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb2510160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:41.258169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:41.276641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-42f99f57-f479-4788-b3f4-b8884234c905 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.575350 Jul 28 11:31:41.280404 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 921/1844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:40 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:41.293461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:41.296498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:41.311057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:41.314001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:41.315101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:41.315908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:41.506183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:41.542521 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aefa9c5e-d047-4c4e-822f-4f1daf129db3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1270 microversion: 2.1 time: 0.259937 Jul 28 11:31:41.543155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 922/1845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:41 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1270 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:41.567735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dc3da3eb-e454-425b-9bf6-81cc67d93665 req-08ab76c6-d936-4979-b4d1-1d18665eeec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:41.614033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc3da3eb-e454-425b-9bf6-81cc67d93665 req-08ab76c6-d936-4979-b4d1-1d18665eeec9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:41.615259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc3da3eb-e454-425b-9bf6-81cc67d93665 req-08ab76c6-d936-4979-b4d1-1d18665eeec9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:41.638596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f645d85d-4311-453a-9c76-520d04208d85 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/f0c44356-086c-4cc0-aebc-1915b21ac8b7" status: 202 len: 0 microversion: 2.1 time: 0.905289 Jul 28 11:31:41.640095 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 924/1846] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:40 2022] DELETE /compute/v2.1/os-security-groups/f0c44356-086c-4cc0-aebc-1915b21ac8b7 => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:41.646342 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dc3da3eb-e454-425b-9bf6-81cc67d93665 req-08ab76c6-d936-4979-b4d1-1d18665eeec9 service nova] Creating event network-changed:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:31:41.654499 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dc3da3eb-e454-425b-9bf6-81cc67d93665 req-08ab76c6-d936-4979-b4d1-1d18665eeec9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109269 Jul 28 11:31:41.655775 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 923/1847] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:41.666621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3266c3d8-20a0-49c3-8fe6-7e392256b237 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb24cb550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:41.673086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:41.679835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:41.715720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:41.717130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:41.719502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:41.720661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.065572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:42.080325 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1eb66268-4ebd-46d4-9eb7-d7585dc484b3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.438621 Jul 28 11:31:42.099106 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 925/1848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:41 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:42.105832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:42.106712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:42.113082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.113767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.115334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.116251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.484735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:42.496070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:42.499185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:42.500619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-151c9a29-bb07-4105-a73a-0bd5a7947368 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.400159 Jul 28 11:31:42.515461 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3266c3d8-20a0-49c3-8fe6-7e392256b237 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/21f68a77-a75f-4c5e-944c-d9c742217387" status: 202 len: 0 microversion: 2.1 time: 0.848196 Jul 28 11:31:42.515461 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 924/1849] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:41 2022] DELETE /compute/v2.1/os-security-groups/21f68a77-a75f-4c5e-944c-d9c742217387 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:42.515461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:42.515461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:42.516726 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 926/1850] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:42 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:42.527667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d9763cb-5d96-43ab-810d-dd55275d419e tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb2488820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:42.533608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.535734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.537497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.539007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.796213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:42.806947 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-feecad3a-7dc2-46ed-8e11-2f33c0be834e tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.299666 Jul 28 11:31:42.808339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 925/1851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:42 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:42.817925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:42.819134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:42.828964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.829822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.831055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:42.832510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:42.915968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d9763cb-5d96-43ab-810d-dd55275d419e tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/40e50c83-d8a5-4585-869d-9fd96d382358" status: 202 len: 0 microversion: 2.1 time: 0.397872 Jul 28 11:31:42.920520 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 927/1852] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:42 2022] DELETE /compute/v2.1/os-security-groups/40e50c83-d8a5-4585-869d-9fd96d382358 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:42.928159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d8c041da-79ba-4a5a-8d1d-c3228bc8ce57 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb2479e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:43.353302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:43.363792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38fed9a4-0da1-4630-b6ea-1b4d424ed932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.551749 Jul 28 11:31:43.365950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 926/1853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:42 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:43.372678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:43.373734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:43.384851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.385690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:43.386715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.387395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:43.677687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:43.790891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:43.799964 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-255c8002-c72e-48dd-ba63-53a7dd443cf5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.432099 Jul 28 11:31:43.800711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 927/1854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:43 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:43.807276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:43.808123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:43.816844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.817154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:43.817928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.818360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:43.845251 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d8c041da-79ba-4a5a-8d1d-c3228bc8ce57 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/8b144f4c-1ce5-4781-aa4a-002e6ef8fb8b" status: 202 len: 0 microversion: 2.1 time: 0.923018 Jul 28 11:31:43.849384 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 928/1855] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:42 2022] DELETE /compute/v2.1/os-security-groups/8b144f4c-1ce5-4781-aa4a-002e6ef8fb8b => generated 0 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:43.855203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:43.856423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:43.864342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.865027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:43.866324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:43.866934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:44.047980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:44.314705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:44.329211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:44.334727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:44.342223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:44.363362 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a31176c-085c-4dca-bfcf-a224673e17ec tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.501767 Jul 28 11:31:44.363362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 929/1856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:43 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:44.363672 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2a94a1b-5a51-441f-9b25-9b15af22a07d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.538765 Jul 28 11:31:44.363768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8246f6a5-e64c-4564-b65d-a23b7f9bb166 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] Calling method '.version_select at 0x7f2eb2403550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:44.363874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 928/1857] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:43 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:44.396734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:44.397371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:44.405093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:44.406018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:44.407648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:44.409201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:44.696259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:44.709813 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b4021a1-4cf9-4e86-8a3d-3888f073c68d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.322948 Jul 28 11:31:44.711393 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 929/1858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:44 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:44.796821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-38a77fdc-65d0-446b-bffc-2365789bc0fe req-2876859a-e41d-4fbb-908d-e977cbdcca2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd250b16-7fcf-4d51-a1b7-856c77b3f04b", "tag": "fd4a7303-6e7e-4319-a613-5adde3fcb56e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:44.815491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-38a77fdc-65d0-446b-bffc-2365789bc0fe req-2876859a-e41d-4fbb-908d-e977cbdcca2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:44.816447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-38a77fdc-65d0-446b-bffc-2365789bc0fe req-2876859a-e41d-4fbb-908d-e977cbdcca2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:44.843270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-38a77fdc-65d0-446b-bffc-2365789bc0fe req-2876859a-e41d-4fbb-908d-e977cbdcca2e service nova] Creating event network-changed:fd4a7303-6e7e-4319-a613-5adde3fcb56e for instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b on n-h2-851368-1 Jul 28 11:31:44.849653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-38a77fdc-65d0-446b-bffc-2365789bc0fe req-2876859a-e41d-4fbb-908d-e977cbdcca2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058842 Jul 28 11:31:44.850417 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 930/1859] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:31:44.859649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:44.860292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:44.878348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:44.879404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:44.880734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:44.881422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:45.336719 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8246f6a5-e64c-4564-b65d-a23b7f9bb166 tempest-SecurityGroupRulesTestJSON-1141429898 tempest-SecurityGroupRulesTestJSON-1141429898-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/93fa5377-63d0-44e3-9786-d4146f4aa717" status: 202 len: 0 microversion: 2.1 time: 0.982296 Jul 28 11:31:45.337316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 930/1860] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:31:44 2022] DELETE /compute/v2.1/os-security-groups/93fa5377-63d0-44e3-9786-d4146f4aa717 => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:45.376191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:45.377468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:45.394879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:45.398278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:45.399428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:45.400069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:45.580412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:45.603918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4e77dcd-3cd3-48d4-90d9-bef691688b30 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.737948 Jul 28 11:31:45.619120 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 931/1861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:44 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:45.626380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:45.629542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:45.648960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:45.650361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:45.658624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:45.659402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:45.969845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:45.981943 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-562cdb23-57b9-4f32-9d80-bff9a0efbfee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.605643 Jul 28 11:31:45.982599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 931/1862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:45 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:46.005861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:46.008689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:46.024826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.025813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.026000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.032223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.032884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.041547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.045317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.046576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a225cf82-3e1c-42ec-859a-a668f0e572c9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.426062 Jul 28 11:31:46.047237 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 932/1863] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:45 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:46.053925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:46.054996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:46.064518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.065253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.066744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.067420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.082806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:46.211984 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f649c226-dc6a-4c17-86a6-c84ea7b225dc tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "DELETE /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 204 len: 0 microversion: 2.1 time: 0.215649 Jul 28 11:31:46.221100 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 932/1864] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:45 2022] DELETE /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:46.229675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:46.230623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:46.246822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.247579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.248602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.249214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.290635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:46.413793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.422022 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-521653f3-2673-4e64-8f39-a9bb3f0b52a5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.373532 Jul 28 11:31:46.426786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 933/1865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:46 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:46.490796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.506064 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5177bd0d-5f2a-4275-b702-3fad0658551d tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1665 microversion: 2.1 time: 0.280449 Jul 28 11:31:46.506969 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 933/1866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:46 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1665 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:46.625895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:46.626801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:46.633841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.634635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.635706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:46.636386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:46.788131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:46.797627 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6f80324-058a-42fa-b574-404be80a286b tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.175508 Jul 28 11:31:46.798638 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 934/1867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:46 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:47.018160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:47.018849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:47.025389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.025844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.026636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.027095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.075704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:47.076966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:47.085598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.086325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.088557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.089900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.242937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.252460 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-057251d6-35e9-4a21-8fdb-83ee3e7eaa11 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.246334 Jul 28 11:31:47.253055 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 934/1868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:47 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:47.274887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.285960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.287523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.292970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc29a56e-03b7-43d8-bf73-6af68ab131fa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.222924 Jul 28 11:31:47.298947 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 935/1869] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:47 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:31:47.432617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-985a5670-f6d3-4a5a-b29b-9b2a14d4555f req-414c5c64-de9f-4471-a2c6-686e26f1cb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5582e54-46f5-4b1f-916e-8f095a0678bf", "name": "network-vif-plugged", "status": "completed", "tag": "8807d135-32bc-4d25-b541-aa007b66eb87"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:47.445076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-985a5670-f6d3-4a5a-b29b-9b2a14d4555f req-414c5c64-de9f-4471-a2c6-686e26f1cb0e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.445848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-985a5670-f6d3-4a5a-b29b-9b2a14d4555f req-414c5c64-de9f-4471-a2c6-686e26f1cb0e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.448144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:47.449093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:47.457282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.457947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.459376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.459985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.467407 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-985a5670-f6d3-4a5a-b29b-9b2a14d4555f req-414c5c64-de9f-4471-a2c6-686e26f1cb0e service nova] Creating event network-vif-plugged:8807d135-32bc-4d25-b541-aa007b66eb87 for instance d5582e54-46f5-4b1f-916e-8f095a0678bf on n-h2-851368-1 Jul 28 11:31:47.472687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-985a5670-f6d3-4a5a-b29b-9b2a14d4555f req-414c5c64-de9f-4471-a2c6-686e26f1cb0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043647 Jul 28 11:31:47.473525 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 935/1870] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:47.538055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:47.538801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:47.546049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.546755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.560024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.561160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.680780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.688698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8f3f7ac-3b9c-4f10-b044-a947af89e9c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.244474 Jul 28 11:31:47.689951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 936/1871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:47 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:47.779699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.790403 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c455c01-4429-4cb8-9a93-b275b17df0ca tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1665 microversion: 2.1 time: 0.258011 Jul 28 11:31:47.791407 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 936/1872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:47 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1665 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:47.825050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:47.826128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:47.834143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.834610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.835444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:47.836071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:47.977626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:47.981181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:47.986867 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8215fc84-f748-45eb-965f-4a294cbed339 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.168071 Jul 28 11:31:47.988003 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 937/1873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:47 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:48.273862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:48.274756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:48.276968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:48.277630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:48.288535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.288984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.290074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.290519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.323399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:48.324070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:48.337106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.337709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.338347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.338778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.651525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:48.682961 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79022780-06ac-451e-9a68-4e8380767871 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.413987 Jul 28 11:31:48.694927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 937/1874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:48 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:48.721999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:48.723584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:48.724347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:48.739224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:48.740739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:48.741882 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c664e56c-3e01-42e1-bbf2-5e2c8ff6873a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.423918 Jul 28 11:31:48.743031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.746688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.747793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.749446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.764673 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 938/1875] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:48 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:48.816301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:48.816922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:48.826129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.826849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:48.828410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:48.829048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:49.596433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:49.598655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:49.611850 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ffca068b-d56b-40d2-9864-b36d4bc8a33e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.900242 Jul 28 11:31:49.611991 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 938/1876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:48 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:49.613569 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dba3a978-b0dd-492d-848a-8b4e3ab024b9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1665 microversion: 2.1 time: 0.801359 Jul 28 11:31:49.623376 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 939/1877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:48 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1665 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:49.623594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:49.623594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:49.631375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:49.631822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:49.632808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:49.633243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:49.715714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:49.716391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:49.724059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:49.724863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:49.725880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:49.726525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:50.158676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:50.168117 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-244f0b86-9aae-49bc-9eba-72c46473caf0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.555049 Jul 28 11:31:50.169865 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 939/1878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:49 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:50.175280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:50.176183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:50.182754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:50.183558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:50.184425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:50.184959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:50.230074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:50.239692 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4905ad6-db42-4245-b527-28b51af475de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1317 microversion: 2.1 time: 0.529780 Jul 28 11:31:50.253180 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 940/1879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:49 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:50.640700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:50.641318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:50.661923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:50.662378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:50.663195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:50.663635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.105980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.114875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.117049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.118362 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95238ad4-a087-4350-ba71-dec961185e3b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.947086 Jul 28 11:31:51.119451 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 940/1880] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:50 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:51.124810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:51.125575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:51.132340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.133560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.135025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.135651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.145828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.157679 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-861363c7-f681-4bf4-92d1-32f214d4261c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.529360 Jul 28 11:31:51.162765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 941/1881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:50 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:51.191972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:51.192839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:51.200724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.201445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.202388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.202986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.562227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.580808 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-242dcc21-b6ca-4f9c-a129-f01eb1052401 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.394113 Jul 28 11:31:51.581548 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 942/1882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:51 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:51.591307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:51.593792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:51.607748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.608949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.610435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:51.611397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:51.635140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:51.645053 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8010ebfe-410c-42af-abaf-ef514669e2e8 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1665 microversion: 2.1 time: 0.524312 Jul 28 11:31:51.645650 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 941/1883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:51 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1665 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:51.734116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1616915441", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2ee9bbf6-5533-4c74-b21c-9d3ad61e8713"}], "block_device_mapping_v2": [{"uuid": "c3d01e2e-8d9e-48b7-8c87-ebaf1fcc057d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:51.819578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] validate_networks() for [('2ee9bbf6-5533-4c74-b21c-9d3ad61e8713', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:31:52.011106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:52.040813 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9fc59c4-dab5-4ec7-971c-54464f12379a tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1467 microversion: 2.1 time: 0.457724 Jul 28 11:31:52.055665 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 943/1884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:51 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1467 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:52.063623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:52.065868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:52.079839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.080299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.081178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.081628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.490473 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21c66b88-58a4-4aea-9611-4db22b30fa12 tempest-ServersOnMultiNodesTest-1820438118 tempest-ServersOnMultiNodesTest-1820438118-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1618 microversion: 2.1 time: 0.431521 Jul 28 11:31:52.493750 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 944/1885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:52 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1618 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:52.523428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:52.524104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:52.534966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.535495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.536283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.536757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.829981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:52.840667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:52.842847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:52.844839 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8000fcf7-801f-4036-bb8e-e2030c5e5591 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.349130 Jul 28 11:31:52.845714 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 945/1886] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:52 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:52.851017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:52.851847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:52.859044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.859897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.861170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.861910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.975683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:31:52.976210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:31:52.976565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:31:52.976971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:31:52.977383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:31:52.989916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.992175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:52.993741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:52.994489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.030242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:31:53.042617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Getting quotas for user d61cd4ba16e748bbac55fe74a20c557e and project 64fcfa8211044955bd77c76a587dc952. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:31:53.048832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:53.057757 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0274062-16eb-4f5c-a975-0444df1a6163 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.210767 Jul 28 11:31:53.058341 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 946/1887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:52 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:53.075926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.076515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.082867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.083597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.084618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.085049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.113588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:53.124186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:31:53.126846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3d01e2e-8d9e-48b7-8c87-ebaf1fcc057d',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:31:53.227817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22cdc20d-bdcb-4aa9-bc66-4e0d7adda4f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 204 len: 0 microversion: 2.1 time: 0.154836 Jul 28 11:31:53.230148 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 947/1888] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:53 2022] DELETE /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:53.237582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6dd9afc8-e569-485a-b9e1-f122f69ec21f req-949cb748-9fd0-42ae-89f3-bacc8a53cc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ff8452-7708-412c-a4b5-9e967f4f394d", "name": "network-vif-deleted", "tag": "db1aaf79-0487-4df2-a3e8-ebea156a1269"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:53.250617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6dd9afc8-e569-485a-b9e1-f122f69ec21f req-949cb748-9fd0-42ae-89f3-bacc8a53cc34 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.251609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6dd9afc8-e569-485a-b9e1-f122f69ec21f req-949cb748-9fd0-42ae-89f3-bacc8a53cc34 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.265949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6dd9afc8-e569-485a-b9e1-f122f69ec21f req-949cb748-9fd0-42ae-89f3-bacc8a53cc34 service nova] Creating event network-vif-deleted:db1aaf79-0487-4df2-a3e8-ebea156a1269 for instance 24ff8452-7708-412c-a4b5-9e967f4f394d on n-h2-851368-1 Jul 28 11:31:53.271281 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6dd9afc8-e569-485a-b9e1-f122f69ec21f req-949cb748-9fd0-42ae-89f3-bacc8a53cc34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039428 Jul 28 11:31:53.271872 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 948/1889] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:53.278126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.278925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.286231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.286645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.287438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.287903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.316315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:31:53.359486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f50c1748-e2a3-486d-be0c-521d42725b4e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632455 Jul 28 11:31:53.367756 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 942/1890] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:31:53.374695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.375764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.389429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.390677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.392249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.393269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.430732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:53.450831 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-123c5038-d631-42e8-b4b9-241fdb85fda8 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 204 len: 0 microversion: 2.1 time: 0.176989 Jul 28 11:31:53.455632 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 949/1891] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:31:53 2022] DELETE /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:31:53.463111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.463836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.481790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.482248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.483039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.486497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.560693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.561432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.562090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lazy-loading 'fault' on Instance uuid 24ff8452-7708-412c-a4b5-9e967f4f394d {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:53.648825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:53.666216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2f794d4-5ec1-4284-a69f-512a07b96358 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1316 microversion: 2.1 time: 0.208029 Jul 28 11:31:53.666806 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 950/1892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:53 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:53.687916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.688547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.696936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.697631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.698844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.699482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.725548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:53.754261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:53.765728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-832a984e-8ab3-4633-b2ea-e8a86e45ccee tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.396049 Jul 28 11:31:53.766321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 943/1893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:53 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:53.775176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00b7b112-7262-44f9-a1d1-dff3b5a2ce8c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.775807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00b7b112-7262-44f9-a1d1-dff3b5a2ce8c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.886759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00b7b112-7262-44f9-a1d1-dff3b5a2ce8c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:53.891795 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00b7b112-7262-44f9-a1d1-dff3b5a2ce8c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1053 microversion: 2.1 time: 0.121394 Jul 28 11:31:53.895603 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 944/1894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:53 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1053 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:53.908678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:53.909477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:53.919746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.920107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.921123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:53.934258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:53.996717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.008883 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-597f5443-2532-4c1e-a491-f8a35351b86b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1555 microversion: 2.1 time: 0.324747 Jul 28 11:31:54.011333 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 951/1895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:53 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:54.021935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a6ac2e15-149b-4b62-847d-2e2c7f732679 req-d8278d21-05a3-463b-8f00-6db6ba48093f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd250b16-7fcf-4d51-a1b7-856c77b3f04b", "name": "network-vif-plugged", "status": "completed", "tag": "fd4a7303-6e7e-4319-a613-5adde3fcb56e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:54.042342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a6ac2e15-149b-4b62-847d-2e2c7f732679 req-d8278d21-05a3-463b-8f00-6db6ba48093f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.042979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a6ac2e15-149b-4b62-847d-2e2c7f732679 req-d8278d21-05a3-463b-8f00-6db6ba48093f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.054978 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a6ac2e15-149b-4b62-847d-2e2c7f732679 req-d8278d21-05a3-463b-8f00-6db6ba48093f service nova] Creating event network-vif-plugged:fd4a7303-6e7e-4319-a613-5adde3fcb56e for instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b on n-h2-851368-1 Jul 28 11:31:54.059675 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a6ac2e15-149b-4b62-847d-2e2c7f732679 req-d8278d21-05a3-463b-8f00-6db6ba48093f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046260 Jul 28 11:31:54.060273 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 952/1896] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:54.066124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:54.066822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:54.074448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.074925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.075752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.076188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.305541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.314743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86c400ef-b2fd-4b9c-8826-1e64a1ab5f8d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1473 microversion: 2.1 time: 0.412166 Jul 28 11:31:54.316613 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 945/1897] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:53 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:54.321903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:54.322785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:54.334434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.334897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.335955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.336405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.398840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.406938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.408464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.410335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fdb04cd-bdb2-4224-92fa-0f1139339082 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.348081 Jul 28 11:31:54.411163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 953/1898] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:54 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:54.551223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.579944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-534e922b-af25-4574-904b-62087c3c2f5a tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.261918 Jul 28 11:31:54.580994 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 946/1899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:54 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:54.689022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:54.689705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:54.697713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.698396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.699507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.699934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.739914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.740990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.742002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lazy-loading 'fault' on Instance uuid 24ff8452-7708-412c-a4b5-9e967f4f394d {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:54.793905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:54.794604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:54.809745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.810446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.810971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.811895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.812571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.829172 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5875f74c-9614-4ea6-a91c-2dff6fd231f9 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1316 microversion: 2.1 time: 0.144253 Jul 28 11:31:54.843792 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 954/1900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:54 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:54.920578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:54.921344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:54.928146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.928925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.929958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:54.930627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:54.984377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:54.997568 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ea13e03-2c33-4b5c-bea7-8363905af88c tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1533 microversion: 2.1 time: 0.209802 Jul 28 11:31:54.998292 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 947/1901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:54 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:55.017272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.024764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38309195-a7be-4cbf-b8b5-0632cc2afd77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1103 microversion: 2.1 time: 0.107927 Jul 28 11:31:55.027107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 955/1902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:54 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1103 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:55.032781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:55.033612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:55.040729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.041190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.042171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.042609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.194998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.203389 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d2a9fc7d-ec73-4f93-9634-9e981c4b4890 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1555 microversion: 2.1 time: 0.174374 Jul 28 11:31:55.204609 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 948/1903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:55 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:55.337506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:55.338236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:55.344624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.345069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.345837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.346270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.433806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:55.434498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:55.443576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.457044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.459385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.464257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.521910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.532935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ae11125-d319-474d-ba34-42b02454ad50 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1473 microversion: 2.1 time: 0.199027 Jul 28 11:31:55.535126 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 956/1904] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:55 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:55.601667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:55.602897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:55.609565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.610108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.610976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.611607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.617756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.631806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.634114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.636687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a9a2d82d-430b-4c7d-a374-76a2155007bd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.206769 Jul 28 11:31:55.651903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 949/1905] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:55 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:31:55.770071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.777988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9e57793-98d6-4099-8ad6-91d233b48568 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 0.180562 Jul 28 11:31:55.778574 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 957/1906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:55 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:55.860001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:55.860859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:55.867353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.868777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.868777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.869293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.904326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:55.904780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:55.905303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lazy-loading 'fault' on Instance uuid 24ff8452-7708-412c-a4b5-9e967f4f394d {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:31:55.951492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590a62b1aba54d538a4e86480a79f38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3654b0deb60473f9fe209d63bbc0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:55.958737 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-774cff47-cd92-47ad-b42a-8ccb4f1b84ba tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 200 len: 1316 microversion: 2.1 time: 0.102435 Jul 28 11:31:55.959352 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 950/1907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:55 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:56.020272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.020875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:56.027120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.027873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.028880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.029534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.051358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.052187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:56.062100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.062562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.063376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.063987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.162088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:56.215021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c668ab98-9a01-4ef3-b1c2-e280f30e756f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1095 microversion: 2.1 time: 0.168763 Jul 28 11:31:56.216229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 951/1908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1095 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:56.251368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-plugged", "status": "completed", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}, {"server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "name": "network-vif-plugged", "status": "completed", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:56.282920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.283674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.288545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:56.297510 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6a180a3-fc81-47d9-a942-fa4b444c0ef7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1533 microversion: 2.1 time: 0.281496 Jul 28 11:31:56.308525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 958/1909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1533 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:56.310534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:31:56.316931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] Creating event network-vif-plugged:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:31:56.321704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.322578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:56.330039 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] Creating event network-vif-plugged:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h1-851368-1 Jul 28 11:31:56.332735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.332735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.333841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.334404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.337587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2137b256-6bdf-486c-baf1-5bc020d3ad67 req-67d6d303-2c6b-485c-a303-6d96ffd5ca6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106465 Jul 28 11:31:56.338199 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 952/1910] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:56.555523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.556701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:56.567283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:56.570193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.570927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.571981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.572653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.577516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7315ff4-d0bb-42d3-bbb0-9b92d354ff80 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1555 microversion: 2.1 time: 0.261024 Jul 28 11:31:56.578442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 959/1911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:56.661429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.662256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:56.694720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.695217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.696017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:56.696459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:56.975915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:56.992025 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ccbb1a04-13b5-4119-aaaa-1176fad101ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1473 microversion: 2.1 time: 0.441692 Jul 28 11:31:56.992993 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 953/1912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:31:56.997805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:56.998485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:57.009996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.010452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:57.011280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.011724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:57.112155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:57.133790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:57.135459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:57.136673 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1bd816d5-6bc1-4567-a3d5-7039071bdc62 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.479774 Jul 28 11:31:57.137266 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 960/1913] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:31:57.141972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:57.142584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] [instance: 24ff8452-7708-412c-a4b5-9e967f4f394d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:57.164672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.165454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:57.166472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.167173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:57.200504 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] HTTP exception thrown: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Request method failure captured: Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d HTTP/1.1 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNaGXy0PbUwDUux1kMpVEeiloj-SCMx4hq8WFMT5-Xe1jl9E1Oi4nOCYKbebBIvOwFaVTkPyZPhoDQc9ckmJv071Ri8-Q1Fnvuib-z3ka3B4PNBFvuOMEuxPNQLxQj0O95VBQSAVHP4tpVWFn2zt9f27_DAYicZg1Oue26H6w2ljjQ Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: a3654b0deb60473f9fe209d63bbc0468 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestFqdnHostnames-1948161170 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a3654b0deb60473f9fe209d63bbc0468"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a3654b0deb60473f9fe209d63bbc0468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a3654b0deb60473f9fe209d63bbc0468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a3654b0deb60473f9fe209d63bbc0468"}]}] Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestFqdnHostnames-1948161170 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: a3654b0deb60473f9fe209d63bbc0468 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1948161170 Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestFqdnHostnames-1948161170-project Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 590a62b1aba54d538a4e86480a79f38a Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestFqdnHostnames-1948161170-project Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '24ff8452-7708-412c-a4b5-9e967f4f394d'} Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:31:57.215455 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Returning 404 to user: Instance 24ff8452-7708-412c-a4b5-9e967f4f394d could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:31:57.220749 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24068500-f031-404f-b15c-88f02931a44e tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d" status: 404 len: 111 microversion: 2.1 time: 0.078793 Jul 28 11:31:57.227462 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 961/1914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:57 2022] GET /compute/v2.1/servers/24ff8452-7708-412c-a4b5-9e967f4f394d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:31:57.236774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cbbbbbd8-1e1b-4ba6-92de-df5769cb2565 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] Calling method '.version_select at 0x7f2eb237fca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:57.289137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cbbbbbd8-1e1b-4ba6-92de-df5769cb2565 tempest-ServersTestFqdnHostnames-1948161170 tempest-ServersTestFqdnHostnames-1948161170-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091146497" status: 202 len: 0 microversion: 2.1 time: 0.056502 Jul 28 11:31:57.289945 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 962/1915] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091146497 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:31:57.298004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:57.298877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:57.316257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.319360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:57.320400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:57.323589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:58.183009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:58.193985 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8a6cc0bc-e732-420a-82b9-8aae578e76ef tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1159 microversion: 2.1 time: 0.899708 Jul 28 11:31:58.194963 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 963/1916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:57 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1159 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:58.213859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:58.214853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:58.222438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:58.223779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:58.224826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:58.225517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:58.679249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:58.687413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-005fdc22-fc21-402f-8ea4-e9700017149b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1312 microversion: 2.1 time: 1.693291 Jul 28 11:31:58.696014 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 954/1917] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:56 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1312 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:58.736886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:58.738047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:58.752397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:58.754703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:58.764675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:58.767587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.093309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:59.107646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4903e6ff-67ac-419c-9a98-c8b368871bd9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1346 microversion: 2.1 time: 0.409980 Jul 28 11:31:59.110545 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 955/1918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:58 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1346 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:59.122396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5d2d6c2f-fc96-47ec-8b51-ff71cb410392 req-d35abac2-c039-436b-bf18-c4ca044bcbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8401aefb-db11-41da-9b69-503f6d0ac0e8", "name": "network-vif-deleted", "tag": "16648b64-4f4f-483f-b22f-bd9432ed8766"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:31:59.147228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d2d6c2f-fc96-47ec-8b51-ff71cb410392 req-d35abac2-c039-436b-bf18-c4ca044bcbec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:59.147974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d2d6c2f-fc96-47ec-8b51-ff71cb410392 req-d35abac2-c039-436b-bf18-c4ca044bcbec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.164682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:59.174451 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5d2d6c2f-fc96-47ec-8b51-ff71cb410392 req-d35abac2-c039-436b-bf18-c4ca044bcbec service nova] Creating event network-vif-deleted:16648b64-4f4f-483f-b22f-bd9432ed8766 for instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 on n-h2-851368-1 Jul 28 11:31:59.178037 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-745688b6-9074-40b1-a9e6-da5189d7789f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1533 microversion: 2.1 time: 0.980264 Jul 28 11:31:59.191947 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 964/1919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:58 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1533 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:31:59.204601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:59.206653 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5d2d6c2f-fc96-47ec-8b51-ff71cb410392 req-d35abac2-c039-436b-bf18-c4ca044bcbec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094163 Jul 28 11:31:59.211716 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 956/1920] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:31:59.212667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:59.223773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:31:59.229799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:31:59.241632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:59.247406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.248197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:59.253832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:59.254082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.268195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.269099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:31:59.269541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:31:59.943379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:59.960972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:59.965550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:31:59.967116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2597aff-23e2-4834-8ec4-10f7430ad70b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1281 microversion: 2.25 time: 0.752159 Jul 28 11:31:59.969457 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 957/1921] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:31:59 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1281 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:31:59.983302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f6ab2a03-fd6a-4e3e-b1b0-0706aa92b18f req-d4f22752-e9cf-46a7-90a3-84bbf1f80682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "name": "network-vif-plugged", "status": "completed", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:00.004298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f6ab2a03-fd6a-4e3e-b1b0-0706aa92b18f req-d4f22752-e9cf-46a7-90a3-84bbf1f80682 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.006034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f6ab2a03-fd6a-4e3e-b1b0-0706aa92b18f req-d4f22752-e9cf-46a7-90a3-84bbf1f80682 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.034552 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f6ab2a03-fd6a-4e3e-b1b0-0706aa92b18f req-d4f22752-e9cf-46a7-90a3-84bbf1f80682 service nova] Creating event network-vif-plugged:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:32:00.047995 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f6ab2a03-fd6a-4e3e-b1b0-0706aa92b18f req-d4f22752-e9cf-46a7-90a3-84bbf1f80682 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071462 Jul 28 11:32:00.048821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 958/1922] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:00.076162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:00.078417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:00.093207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:00.098759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.100300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.103000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.104233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.119858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:00.133751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f170bf3-871d-4db2-9348-72a9ce89a3de tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 200 len: 1473 microversion: 2.1 time: 0.948420 Jul 28 11:32:00.140383 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 965/1923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:31:59 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 1473 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:00.151650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:00.154916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:00.167494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.170400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.178022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.178742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.332832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:00.354917 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a514298b-007f-4de0-9fc6-ff65d7c6fb18 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1169 microversion: 2.1 time: 0.293378 Jul 28 11:32:00.357901 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 959/1924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:00 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1169 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:00.375496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e19c6f88-185d-426c-8623-d85ba2c030a1 req-83087107-70d8-41b0-9894-a6507879f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5582e54-46f5-4b1f-916e-8f095a0678bf", "name": "network-vif-deleted", "tag": "8807d135-32bc-4d25-b541-aa007b66eb87"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:00.389540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e19c6f88-185d-426c-8623-d85ba2c030a1 req-83087107-70d8-41b0-9894-a6507879f5f2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.395854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e19c6f88-185d-426c-8623-d85ba2c030a1 req-83087107-70d8-41b0-9894-a6507879f5f2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.428570 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e19c6f88-185d-426c-8623-d85ba2c030a1 req-83087107-70d8-41b0-9894-a6507879f5f2 service nova] Creating event network-vif-deleted:8807d135-32bc-4d25-b541-aa007b66eb87 for instance d5582e54-46f5-4b1f-916e-8f095a0678bf on n-h2-851368-1 Jul 28 11:32:00.449876 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e19c6f88-185d-426c-8623-d85ba2c030a1 req-83087107-70d8-41b0-9894-a6507879f5f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088042 Jul 28 11:32:00.451321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 960/1925] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:00.461081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:00.462235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:00.473922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.474879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:00.476233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:00.477507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.011856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.028009 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1e67f96-b97b-4cb0-9892-9a58dde54a0a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1346 microversion: 2.1 time: 0.575257 Jul 28 11:32:01.029469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 961/1926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:00 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1346 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:01.053331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.053999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.069844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.070676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.075047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.075537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.235314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.251191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0743b2c8-b2a6-495c-9116-0a2637a0b4fc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1462 microversion: 2.1 time: 1.102910 Jul 28 11:32:01.252181 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 966/1927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:00 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1462 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:01.268752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.270699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.286910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.288750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.291854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.293338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.396789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.408718 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-486a8d00-5d1a-462a-ae8d-de7a7d90ad19 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1533 microversion: 2.1 time: 0.378144 Jul 28 11:32:01.411911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 962/1928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1533 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:01.418387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.420736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d5582e54-46f5-4b1f-916e-8f095a0678bf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.429777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.430222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.431381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.431980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.449250 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf HTTP/1.1 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd5582e54-46f5-4b1f-916e-8f095a0678bf'} Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:01.451306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. Jul 28 11:32:01.456322 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:01.464733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance d5582e54-46f5-4b1f-916e-8f095a0678bf could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:01.465859 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5a6af61-5f53-41ea-888b-58563ee22dd6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf" status: 404 len: 111 microversion: 2.1 time: 0.052987 Jul 28 11:32:01.467554 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 963/1929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/d5582e54-46f5-4b1f-916e-8f095a0678bf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:01.475236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.478076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.517306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.520152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.524040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.524684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.689229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.708372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.710150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.711377 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee20b899-8d43-4c28-b21e-429e1638af90 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1478 microversion: 2.25 time: 0.455009 Jul 28 11:32:01.711947 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 967/1930] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1478 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:01.716476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.717289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.738719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.739262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.740316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.740803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.922381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.923329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:01.948375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a0000ec-22c0-4c1a-8eb0-d7fa439c2d71 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1169 microversion: 2.1 time: 0.235344 Jul 28 11:32:01.949435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-698b1875-333d-4043-a719-f5f6ebe86f62 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1463 microversion: 2.1 time: 0.479961 Jul 28 11:32:01.950210 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 968/1931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:01.964705 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 964/1932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1463 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:01.964909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:01.964909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:01.987021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.988449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:01.989460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:01.991229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:02.053682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:02.112044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:02.222415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77522041-ae43-450e-bd10-d9f596f62ca4 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 204 len: 0 microversion: 2.1 time: 0.261750 Jul 28 11:32:02.224019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 969/1933] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:01 2022] DELETE /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:02.235343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:02.237094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:02.246910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:02.248080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:02.249254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:02.249867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:02.368081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:02.368697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:02.383286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:02.383743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:02.384534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:02.384969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:02.414644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:02.430315 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bea1476c-b7ee-4ecf-bbc3-2ade9e780a6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1346 microversion: 2.1 time: 0.204789 Jul 28 11:32:02.431125 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 970/1934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:02 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:02.439678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1545426670", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7dda79cd-76d3-400e-9d25-12ee78cf41ec"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:02.517787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:32:03.016647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:03.513906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ebee2d74-e07c-4280-94da-ebe7035490d6 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:03.533198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb18f08a-9c18-45c3-acf9-f6146aa3f5a8 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1971 microversion: 2.25 time: 1.574573 Jul 28 11:32:03.537902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 965/1935] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:01 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1971 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:03.543402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:03.544423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:03.552412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:03.553108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:03.554247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:03.554972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:03.891455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:04.003437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:04.012783 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c9a9ab1-1953-4ae7-bffb-fa274caa7d43 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1472 microversion: 2.1 time: 0.473583 Jul 28 11:32:04.016870 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 966/1936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:03 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1472 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:04.022026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:04.024051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:04.060144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.060990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.062690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.063854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.071586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:32:04.072096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:32:04.072467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:32:04.072876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:32:04.073287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:32:04.089122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.089578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.090381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.092132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.123117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:04.128908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Getting quotas for user 84e1308406bc4870967e9d826c14e68e and project 0ed58b93a0994b60ba42ab32ad236dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:04.147860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:32:04.150686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:32:04.206426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-330f6e65-ab21-46f4-a482-59ed9794c4dd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773589 Jul 28 11:32:04.207642 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 971/1937] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:32:04.213328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:04.214751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:04.223065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.223839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.225132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:04.225766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:04.978048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:04.999090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb055b62-e426-4929-aa5a-d6b18d4db8e2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.980207 Jul 28 11:32:05.014164 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 967/1938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:04 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:05.054932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:05.055612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:05.093155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.093777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.094725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.096734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.226960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.227453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.231883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'fault' on Instance uuid 8401aefb-db11-41da-9b69-503f6d0ac0e8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:05.539917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:05.554272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-541d5612-2dbb-47bf-9efe-ca45a53a88fe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 200 len: 1351 microversion: 2.1 time: 0.538960 Jul 28 11:32:05.559137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 968/1939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:05 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 1351 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:05.575321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:05.577607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:05.616713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.617595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.620640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:05.621920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.622383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.630833 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b06b2384-4bfb-4590-99cf-ff25f8f92a58 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1211 microversion: 2.1 time: 1.420959 Jul 28 11:32:05.633358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 972/1940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:04 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1211 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:05.643873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:05.654042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:05.672824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.675845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:05.679351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:05.682915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.186182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:06.200583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-535cdf3b-ad02-4613-af85-61c56295dffb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1218 microversion: 2.1 time: 0.565972 Jul 28 11:32:06.218607 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 973/1941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:05 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1218 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:06.249138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:06.251278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:06.276985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.277542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.278554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.283127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.647289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:06.657963 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c0178ed2-e5e6-45e8-a646-8cae41932f20 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 200 len: 1430 microversion: 2.1 time: 0.435874 Jul 28 11:32:06.663394 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 974/1942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:06 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 1430 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:06.673297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1b344bab-6eec-4d50-8f53-c6a9b889bf24 req-193cb045-6b3b-4334-8418-ca92bd5eb84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:06.697871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1b344bab-6eec-4d50-8f53-c6a9b889bf24 req-193cb045-6b3b-4334-8418-ca92bd5eb84f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.700241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1b344bab-6eec-4d50-8f53-c6a9b889bf24 req-193cb045-6b3b-4334-8418-ca92bd5eb84f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.728564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1b344bab-6eec-4d50-8f53-c6a9b889bf24 req-193cb045-6b3b-4334-8418-ca92bd5eb84f service nova] Creating event network-changed:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h2-851368-1 Jul 28 11:32:06.745265 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1b344bab-6eec-4d50-8f53-c6a9b889bf24 req-193cb045-6b3b-4334-8418-ca92bd5eb84f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079959 Jul 28 11:32:06.745994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 975/1943] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:06.759471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:06.762007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:06.777171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.780231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.783416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.784785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:06.808803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ebee2d74-e07c-4280-94da-ebe7035490d6 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:06.909298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d31abfa9-4537-4a8e-9ff0-75e15dad40be tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1971 microversion: 2.25 time: 1.346618 Jul 28 11:32:06.919144 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 969/1944] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:05 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1971 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:06.934783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e05b3451-c62d-401d-9206-2cc1e80ba790 req-97265044-e763-4302-ada9-0de8528ae6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3983adb-07cc-49b4-bc78-20facbe1f015", "name": "network-vif-deleted", "tag": "725657b1-8bbf-4cb7-b055-74a36543395d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:06.971049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e05b3451-c62d-401d-9206-2cc1e80ba790 req-97265044-e763-4302-ada9-0de8528ae6a4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:06.972061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e05b3451-c62d-401d-9206-2cc1e80ba790 req-97265044-e763-4302-ada9-0de8528ae6a4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:07.005676 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e05b3451-c62d-401d-9206-2cc1e80ba790 req-97265044-e763-4302-ada9-0de8528ae6a4 service nova] Creating event network-vif-deleted:725657b1-8bbf-4cb7-b055-74a36543395d for instance d3983adb-07cc-49b4-bc78-20facbe1f015 on n-h1-851368-1 Jul 28 11:32:07.031383 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e05b3451-c62d-401d-9206-2cc1e80ba790 req-97265044-e763-4302-ada9-0de8528ae6a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110426 Jul 28 11:32:07.031894 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 970/1945] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:07.054723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:07.064441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:07.102622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:07.112746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:07.117696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:07.120238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:07.180190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 HTTP/1.1 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '8401aefb-db11-41da-9b69-503f6d0ac0e8'} Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:07.191754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:07.196806 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:07.201269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:07.202493 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-555e7eb4-a15e-4cff-ab40-430a974e6c44 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 404 len: 111 microversion: 2.1 time: 0.169511 Jul 28 11:32:07.203958 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 971/1946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:07 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:07.211553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:07.214291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:07.230866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:07.231759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:07.232767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:07.233427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:07.277441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:08.098753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:08.114437 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57577ae1-a7b5-4dd8-a5c0-28cc5bc9e707 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 1.366715 Jul 28 11:32:08.125186 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 976/1947] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:06 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:08.135662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:08.144418 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:08.144418 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:32:08.153239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.159245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.160490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.161212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.235433 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64125ec3-87d3-457e-969e-b763767efe7b tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.104989 Jul 28 11:32:08.236639 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 977/1948] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Jul 28 11:32:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:32:08.242731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:08.244083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:08.253935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.254647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.255672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.256289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.297544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:08.306476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2545c6c4-c65e-42b2-91dc-906895d1d01d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1211 microversion: 2.1 time: 1.100671 Jul 28 11:32:08.315003 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 972/1949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:07 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1211 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:08.355184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:08.367753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:08.383510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.385796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.386722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.395457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.456425 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8/os-volume_attachments HTTP/1.1 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '8401aefb-db11-41da-9b69-503f6d0ac0e8'} Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:08.480327 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:32:08.492128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.497479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:08.501983 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3d2e93e2-a431-4490-9b1d-4f48d25a22dd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.163759 Jul 28 11:32:08.510084 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 973/1950] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:32:08 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8/os-volume_attachments => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:08.537890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:08.568795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:08.579923 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-481f9813-f7ca-406b-92aa-0bdcb54627d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1272 microversion: 2.1 time: 0.334131 Jul 28 11:32:08.580629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 978/1951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:08 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:08.587709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: d3983adb-07cc-49b4-bc78-20facbe1f015] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:08.606654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.609827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.615748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851368-1", "block_migration": "auto"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:08.616044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.617007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.638137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:08.661303 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 HTTP/1.1 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd3983adb-07cc-49b4-bc78-20facbe1f015'} Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:08.676392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:08.681850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance d3983adb-07cc-49b4-bc78-20facbe1f015 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:08.682554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5d7a428-d2e4-4a0b-b8ed-c07d15614439 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015" status: 404 len: 111 microversion: 2.1 time: 0.162512 Jul 28 11:32:08.683370 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 974/1952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:08 2022] GET /compute/v2.1/servers/d3983adb-07cc-49b4-bc78-20facbe1f015 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:08.684643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.685112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.685921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.695053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.703050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:08.715341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:08.740155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.740619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.741429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:08.741866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:08.773414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'flavor' on Instance uuid ebee2d74-e07c-4280-94da-ebe7035490d6 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:08.875378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Going to try to live migrate instance to n-h2-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:32:08.890931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:09.147530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a2f8cd17-8872-499c-8d03-01eadd1ff4fb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 204 len: 0 microversion: 2.1 time: 0.452330 Jul 28 11:32:09.156289 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 975/1953] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:08 2022] DELETE /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:09.165319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2137954150", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:09.347572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:32:11.044887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:32:11.045382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:32:11.045738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:32:11.046339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:32:11.046952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:32:11.064618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.074180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:11.077101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.077928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:11.127254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:11.144857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:11.187250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:32:11.189668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:32:11.338026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-daa3a371-a068-4fc4-b74f-9208ca42c88f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179349 Jul 28 11:32:11.338687 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 976/1954] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:32:11.354850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:11.355531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:11.385001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.385551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:11.387488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.388202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:11.794518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:11.805114 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9cc3dbb4-e22b-40f7-8b64-89113532ba11 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.457605 Jul 28 11:32:11.806365 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 977/1955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:11 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:11.820171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:11.821236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:11.837979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.847438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:11.848548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:11.849774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.170406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:12.186076 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-69edb472-c01b-47dc-a6cb-7cd53892615b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1473 microversion: 2.1 time: 0.378111 Jul 28 11:32:12.187295 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 978/1956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:11 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:12.199978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:12.200819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:12.220680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.221392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.223412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.226884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.537487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:12.573363 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ecd70238-9b0b-4111-9992-5c8eff554fec tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1211 microversion: 2.1 time: 0.383699 Jul 28 11:32:12.600944 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 979/1957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:12 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1211 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:12.612665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:12.628757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:12.644730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.645551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.648009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.648691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.863123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:12.878340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06bcd82d-a382-4f2d-aa07-255c6c96d36c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 0.273652 Jul 28 11:32:12.879868 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 980/1958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:12 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:12.898472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:12.899256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:12.914987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.917522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:12.920660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:12.921892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.090720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:13.102902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-35604487-2003-45a1-9c4a-60ce411e4d92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1267 microversion: 2.1 time: 0.217772 Jul 28 11:32:13.103786 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 981/1959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:12 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:13.120557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:13.131557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:13.153045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.158689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.159755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.162711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.542570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:13.555158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e94f269-24d9-4837-939e-5eafc96625c5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.450077 Jul 28 11:32:13.567603 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 982/1960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:13 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:13.579885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:13.584132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:13.601768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.603515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.606869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.607597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.701460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:13.954428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b16e8697-7138-4606-9670-835f56680518 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 204 len: 0 microversion: 2.1 time: 0.385153 Jul 28 11:32:13.955040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 983/1961] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:13 2022] DELETE /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:13.964157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:13.965044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:13.979312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.979819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:13.980749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:13.981194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:14.144247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:14.884249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:14.892679 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-938e8eac-be33-4be2-a947-2d97995f487c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 200 len: 1473 microversion: 2.1 time: 0.934669 Jul 28 11:32:14.910826 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 984/1962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:13 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 1473 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:14.920120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:14.920848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:14.936480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:14.937215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:14.938213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:14.939587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:16.240846 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f2f4dae-3b24-4c6c-adb3-ee295bdf4161 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6/action" status: 202 len: 0 microversion: 2.25 time: 7.653718 Jul 28 11:32:16.242134 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 979/1963] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:32:08 2022] POST /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6/action => generated 0 bytes in 7656 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:16.248190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:16.249170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:16.284497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:16.285305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:16.286483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:16.287147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:16.526318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:16.556173 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e17eedfe-82b2-4542-a223-120d37ec5ddf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1211 microversion: 2.1 time: 1.644062 Jul 28 11:32:16.569489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 985/1964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:14 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1211 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:16.599236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:16.614652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:16.633892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:16.634454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:16.635442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:16.636171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:17.579292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:17.595295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a3947881-1f3f-4215-9684-259b493cab03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 1.351752 Jul 28 11:32:17.617656 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 980/1965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:16 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:17.633771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:17.635361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:17.647949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:17.653613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:17.656820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:17.657734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:17.827647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:17.836558 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53d0552e-fd7d-445b-94cb-707ec27416ac tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 1.264815 Jul 28 11:32:17.837165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 986/1966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:16 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:17.870828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ffffd3c5-284c-49a9-b0a6-dca48b3ded46 req-73d52b7c-5dbe-4c7e-ab50-29e7bc48feba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda8c438-0f26-4ebf-be6c-11187f4c6e0d", "tag": "11ddc097-0a8c-4c9b-a797-5c6c131a548c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:17.915480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ffffd3c5-284c-49a9-b0a6-dca48b3ded46 req-73d52b7c-5dbe-4c7e-ab50-29e7bc48feba service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:17.916910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ffffd3c5-284c-49a9-b0a6-dca48b3ded46 req-73d52b7c-5dbe-4c7e-ab50-29e7bc48feba service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:17.945090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ffffd3c5-284c-49a9-b0a6-dca48b3ded46 req-73d52b7c-5dbe-4c7e-ab50-29e7bc48feba service nova] Creating event network-changed:11ddc097-0a8c-4c9b-a797-5c6c131a548c for instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d on n-h1-851368-1 Jul 28 11:32:17.955556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ffffd3c5-284c-49a9-b0a6-dca48b3ded46 req-73d52b7c-5dbe-4c7e-ab50-29e7bc48feba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105791 Jul 28 11:32:17.959895 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 987/1967] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:17.969022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:17.970281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:17.984824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:17.987384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:17.988940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:17.991296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.034249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca HTTP/1.1 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '21948ab3-5b81-48fc-bda3-4b2d6ac2fbca'} Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:18.037074 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. Jul 28 11:32:18.044397 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:18.047397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:18.048787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db2a9690-d736-415d-b33b-c126ab6e5b03 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca" status: 404 len: 111 microversion: 2.1 time: 0.087169 Jul 28 11:32:18.050637 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 988/1968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:17 2022] GET /compute/v2.1/servers/21948ab3-5b81-48fc-bda3-4b2d6ac2fbca => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:18.062484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:18.063473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:18.074074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.074530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.075344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.075772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.105274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:18.197849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:18.293367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:18.303465 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-358b6ad4-83d4-45a6-b59a-6c1791cc8918 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.684114 Jul 28 11:32:18.307944 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 981/1969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:17 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:18.320006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:18.320006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:18.336088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.336585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.337373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.337954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.607494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:18.627971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:18.645149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:18.646341 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8bec5319-c4d7-4e51-8161-1d91f947344e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.594385 Jul 28 11:32:18.650364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 989/1970] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:18 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:18.674813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:18.683617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:18.699703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.700543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.701644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:18.702339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:18.758303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:19.045981 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5c4a220-4a80-4670-8a56-5389a76605ee tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 204 len: 0 microversion: 2.1 time: 0.375071 Jul 28 11:32:19.048548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:19.058950 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 990/1971] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:18 2022] DELETE /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:19.065782 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5786d51-5cab-40c3-8185-7294d4f7b9bf tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.754870 Jul 28 11:32:19.068736 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 982/1972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:18 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:19.075608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:19.076319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:19.082044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:19.086830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:19.098549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:19.107407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:19.107797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:19.108647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:19.109088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:19.112687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:19.120090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:19.128111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:19.128891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:19.989362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:20.000452 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6085d381-d029-4812-9722-7fcf4ee71f6b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.929582 Jul 28 11:32:20.005105 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 983/1973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:19 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:20.014268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:20.026437 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a3ef26a6-81dc-4952-8f8d-877e10b87784 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 0.965890 Jul 28 11:32:20.028061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:20.029020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:20.044678 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 991/1974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:19 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:20.056985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:20.060001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:20.064848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:20.073446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.074625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:20.076849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.079259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.080094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:20.082522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.082779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:20.084514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:20.153988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:20.233421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:20.328171 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-457d0669-dfc3-44e7-b407-5774cfa64122 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 204 len: 0 microversion: 2.1 time: 0.321217 Jul 28 11:32:20.329884 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 984/1975] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:20 2022] DELETE /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:20.338541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:20.348136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:20.363984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.364756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:20.365728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:20.366351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:21.103802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:21.151182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:21.161988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76881f19-98af-4c1a-a16a-24509e120398 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 1.115341 Jul 28 11:32:21.165818 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 992/1976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:20 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:21.174260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:21.177413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:21.188841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:21.199637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:21.200716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:21.201799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:21.203564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:21.497473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:21.513153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:21.521051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:21.522820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c2f90feb-8171-407c-8bc6-663de0d643da tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 1.191320 Jul 28 11:32:21.545601 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 985/1977] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:20 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:21.551746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f5bdf843-136b-4ddc-ba85-bd2531c24475 req-25b4b8c5-4c52-42cc-8711-a3ae434310fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21948ab3-5b81-48fc-bda3-4b2d6ac2fbca", "name": "network-vif-deleted", "tag": "ab7adb52-69e9-48de-8fff-507aa26d7fab"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:21.563011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5bdf843-136b-4ddc-ba85-bd2531c24475 req-25b4b8c5-4c52-42cc-8711-a3ae434310fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:21.563804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5bdf843-136b-4ddc-ba85-bd2531c24475 req-25b4b8c5-4c52-42cc-8711-a3ae434310fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:21.582107 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f5bdf843-136b-4ddc-ba85-bd2531c24475 req-25b4b8c5-4c52-42cc-8711-a3ae434310fd service nova] Creating event network-vif-deleted:ab7adb52-69e9-48de-8fff-507aa26d7fab for instance 21948ab3-5b81-48fc-bda3-4b2d6ac2fbca on n-h1-851368-1 Jul 28 11:32:21.589051 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f5bdf843-136b-4ddc-ba85-bd2531c24475 req-25b4b8c5-4c52-42cc-8711-a3ae434310fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041100 Jul 28 11:32:21.589955 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 986/1978] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:21.595683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:21.596717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:21.608831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:21.612776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:21.613821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:21.616028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:22.337811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:22.345358 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a72f1982-4cfa-4d33-9ae3-749b6da4e757 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 1.177083 Jul 28 11:32:22.349096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 993/1979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:21 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:22.368461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:22.373925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:22.394062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:22.394848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:22.395846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:22.397492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:22.437668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:22.446624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aaaaf921-7f2a-48ec-a980-0e9d488a4867 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 200 len: 1474 microversion: 2.1 time: 0.855203 Jul 28 11:32:22.452894 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 987/1980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:21 2022] GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 1474 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:22.463794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:22.464424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:22.497034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:22.507532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:22.509225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:22.510125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:24.030007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:24.040731 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0d0b389-135d-47d0-9d4b-6e6e444db8d3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 1.683364 Jul 28 11:32:24.041322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 994/1981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:22 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:24.062111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-049e5778-0d27-40dd-90fb-0958fe9567fa req-1ed505b8-12b6-4508-b86e-2f0ac6813bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d34105-31ce-4d7a-9cac-b7dd06589c3e", "tag": "1f943c1f-2539-4e49-8410-b73dc3c83abc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:24.100625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-049e5778-0d27-40dd-90fb-0958fe9567fa req-1ed505b8-12b6-4508-b86e-2f0ac6813bf5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:24.101104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-049e5778-0d27-40dd-90fb-0958fe9567fa req-1ed505b8-12b6-4508-b86e-2f0ac6813bf5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:24.145132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-049e5778-0d27-40dd-90fb-0958fe9567fa req-1ed505b8-12b6-4508-b86e-2f0ac6813bf5 service nova] Creating event network-changed:1f943c1f-2539-4e49-8410-b73dc3c83abc for instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e on n-h2-851368-1 Jul 28 11:32:24.170708 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-049e5778-0d27-40dd-90fb-0958fe9567fa req-1ed505b8-12b6-4508-b86e-2f0ac6813bf5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120635 Jul 28 11:32:24.174899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 995/1982] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:24.192448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:24.205224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f716d9d-eb2b-4c0e-8bef-82bbb6152500 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 1.749839 Jul 28 11:32:24.206135 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 988/1983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:22 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:24.211124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:24.213223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:24.225889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:24.228109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:24.242887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:24.243788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:24.246465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:24.247905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:24.259699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:24.261074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:24.264606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:24.267536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.361923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:25.378366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c4cd7a0-d170-4286-9071-c72ded00ff51 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 1.201447 Jul 28 11:32:25.384823 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 996/1984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:24 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:25.401613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:25.403274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:25.419656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:25.420118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.424751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:25.425686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.506264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:25.522790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:25.528208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:25.530206 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dfcfbef5-a8d2-462b-80db-772b8e726394 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 1.321598 Jul 28 11:32:25.546270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 989/1985] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:24 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:25.565611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:25.566514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:25.596955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:25.600777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.602257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:25.605555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.735716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:25.737783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:25.738632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lazy-loading 'fault' on Instance uuid 0ee0637e-0188-44d7-90da-07a152c97d73 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:26.052817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:26.068746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecdccd08-a42c-4787-bd65-7a917d74e01d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 200 len: 1308 microversion: 2.1 time: 0.520567 Jul 28 11:32:26.085062 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 990/1986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:25 2022] GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:26.094645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1500a738-932f-4b56-ad73-a5fe3e00493f req-fb388c9e-d0eb-4b62-aa2e-1a6c1dd71acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee0637e-0188-44d7-90da-07a152c97d73", "name": "network-vif-unplugged", "status": "completed", "tag": "5c32a1b6-4881-4e74-a4c9-73f3059f269f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:26.138191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1500a738-932f-4b56-ad73-a5fe3e00493f req-fb388c9e-d0eb-4b62-aa2e-1a6c1dd71acd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.147045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1500a738-932f-4b56-ad73-a5fe3e00493f req-fb388c9e-d0eb-4b62-aa2e-1a6c1dd71acd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:26.209981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1500a738-932f-4b56-ad73-a5fe3e00493f req-fb388c9e-d0eb-4b62-aa2e-1a6c1dd71acd service nova] Creating event network-vif-unplugged:5c32a1b6-4881-4e74-a4c9-73f3059f269f for instance 0ee0637e-0188-44d7-90da-07a152c97d73 on n-h1-851368-1 Jul 28 11:32:26.257811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:26.267018 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9762b47f-ab7c-454f-bd70-2253278895ee tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.880822 Jul 28 11:32:26.270680 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1500a738-932f-4b56-ad73-a5fe3e00493f req-fb388c9e-d0eb-4b62-aa2e-1a6c1dd71acd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183338 Jul 28 11:32:26.272609 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 991/1987] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:26.305218 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 997/1988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:25 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:26.308516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-412f1cc8-f8c0-468d-82e0-97bb6d8caeb7 req-611ae0e1-2346-4612-a539-af0343f23c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee0637e-0188-44d7-90da-07a152c97d73", "name": "network-vif-deleted", "tag": "5c32a1b6-4881-4e74-a4c9-73f3059f269f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:26.333022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:26.341755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:26.361809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-412f1cc8-f8c0-468d-82e0-97bb6d8caeb7 req-611ae0e1-2346-4612-a539-af0343f23c82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.363586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-412f1cc8-f8c0-468d-82e0-97bb6d8caeb7 req-611ae0e1-2346-4612-a539-af0343f23c82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:26.367525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.368967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:26.369975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.370595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:26.396706 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-412f1cc8-f8c0-468d-82e0-97bb6d8caeb7 req-611ae0e1-2346-4612-a539-af0343f23c82 service nova] Creating event network-vif-deleted:5c32a1b6-4881-4e74-a4c9-73f3059f269f for instance 0ee0637e-0188-44d7-90da-07a152c97d73 on n-h1-851368-1 Jul 28 11:32:26.414417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-412f1cc8-f8c0-468d-82e0-97bb6d8caeb7 req-611ae0e1-2346-4612-a539-af0343f23c82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138196 Jul 28 11:32:26.417041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 992/1989] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:26.432539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:26.433921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:26.447254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.450137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:26.455777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:26.456474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:27.631382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:27.644641 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2639e85-3df7-44f5-a185-822377b1452f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 1.337383 Jul 28 11:32:27.646467 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 998/1990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:26 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:27.657313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-21ea5501-2eec-4301-b679-d4c742eb61ce req-c5e340d5-1f6c-4013-8c21-d7498bd54943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f03201-c90f-409e-8402-4db44eb5b4b1", "name": "network-vif-deleted", "tag": "359191e4-9eb6-4c86-a501-026cd96c15ed"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:27.688635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-21ea5501-2eec-4301-b679-d4c742eb61ce req-c5e340d5-1f6c-4013-8c21-d7498bd54943 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:27.690070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-21ea5501-2eec-4301-b679-d4c742eb61ce req-c5e340d5-1f6c-4013-8c21-d7498bd54943 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:27.775099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-21ea5501-2eec-4301-b679-d4c742eb61ce req-c5e340d5-1f6c-4013-8c21-d7498bd54943 service nova] Creating event network-vif-deleted:359191e4-9eb6-4c86-a501-026cd96c15ed for instance f9f03201-c90f-409e-8402-4db44eb5b4b1 on n-h2-851368-1 Jul 28 11:32:27.787538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-21ea5501-2eec-4301-b679-d4c742eb61ce req-c5e340d5-1f6c-4013-8c21-d7498bd54943 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138838 Jul 28 11:32:27.793256 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 999/1991] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:27.811917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:27.812730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:27.830559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:27.831014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:27.832604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:27.833050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:27.901572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:27.931317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3eeaeb9d-3b0b-48a6-9cc9-02e663ce6dfa tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 1.503376 Jul 28 11:32:27.934786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 993/1992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:26 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:27.944792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:27.987205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:28.012096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.014143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:28.015486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.016936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:28.558416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:28.572390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:28.588584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:28.594362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90c108a6-1dc4-444d-b66e-698b906eac15 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.652213 Jul 28 11:32:28.595391 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 994/1993] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:27 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:28.600674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:28.601302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 0ee0637e-0188-44d7-90da-07a152c97d73] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:28.652273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.652730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:28.653527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.666601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:28.724768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 HTTP/1.1 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0ee0637e-0188-44d7-90da-07a152c97d73'} Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:28.728177 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance 0ee0637e-0188-44d7-90da-07a152c97d73 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:28.733763 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d9a41b0a-63ef-42ce-8700-499da32bb018 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73" status: 404 len: 111 microversion: 2.1 time: 0.133116 Jul 28 11:32:28.742951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 995/1994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:28 2022] GET /compute/v2.1/servers/0ee0637e-0188-44d7-90da-07a152c97d73 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:28.757006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:28.757649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:28.785089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.798473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:28.800221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:28.807161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.196910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:29.207301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0268928e-5157-44e2-b7cc-63b3254389f9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 1.412665 Jul 28 11:32:29.208717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1000/1995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:27 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:29.215921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:29.216993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:29.235854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.243678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.245812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.246512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.382950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:29.392618 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f351e91-9520-496f-a070-1022c39c6505 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.648411 Jul 28 11:32:29.397924 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 996/1996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:28 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:29.435742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:29.439202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: f9f03201-c90f-409e-8402-4db44eb5b4b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:29.454400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.464254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.467554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.468224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.519415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 HTTP/1.1 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f9f03201-c90f-409e-8402-4db44eb5b4b1'} Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:29.520990 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance f9f03201-c90f-409e-8402-4db44eb5b4b1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:29.527013 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2da74e64-edb7-4bad-9c80-a37c5ae6b25f tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1" status: 404 len: 111 microversion: 2.1 time: 0.118622 Jul 28 11:32:29.541493 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 997/1997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:29 2022] GET /compute/v2.1/servers/f9f03201-c90f-409e-8402-4db44eb5b4b1 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:29.558239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-85ed2c2c-61d1-4339-92ae-a736d9bd5105 req-46d39376-e80c-4921-9dac-c8a873aef35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f03201-c90f-409e-8402-4db44eb5b4b1", "name": "network-vif-unplugged", "status": "completed", "tag": "359191e4-9eb6-4c86-a501-026cd96c15ed"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:29.579700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:29.585825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-85ed2c2c-61d1-4339-92ae-a736d9bd5105 req-46d39376-e80c-4921-9dac-c8a873aef35b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.586320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-85ed2c2c-61d1-4339-92ae-a736d9bd5105 req-46d39376-e80c-4921-9dac-c8a873aef35b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.598055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29e3b354-2ca3-405e-8f6d-f210b6d1a6b8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.379625 Jul 28 11:32:29.604552 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1001/1998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:29 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:29.634200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:29.635428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:29.654173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-85ed2c2c-61d1-4339-92ae-a736d9bd5105 req-46d39376-e80c-4921-9dac-c8a873aef35b service nova] Creating event network-vif-unplugged:359191e4-9eb6-4c86-a501-026cd96c15ed for instance f9f03201-c90f-409e-8402-4db44eb5b4b1 on n-h2-851368-1 Jul 28 11:32:29.668599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.671793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.673042 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-85ed2c2c-61d1-4339-92ae-a736d9bd5105 req-46d39376-e80c-4921-9dac-c8a873aef35b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130096 Jul 28 11:32:29.674490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 998/1999] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:29.679338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.682290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.693556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6208df5c-5062-4750-aa5b-19e58327bc6c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:29.778623 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6208df5c-5062-4750-aa5b-19e58327bc6c tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/f91feeaa-dd48-41cf-96ad-b7a28361e987" status: 204 len: 0 microversion: 2.1 time: 0.101677 Jul 28 11:32:29.781504 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 999/2000] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:32:29 2022] DELETE /compute/v2.1/os-server-groups/f91feeaa-dd48-41cf-96ad-b7a28361e987 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:29.793768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:29.799456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:29.823862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.825776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:29.827013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:29.828756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.095568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:30.106693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d847b312-e5d5-41f4-952f-c8e11feffd23 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 0.498682 Jul 28 11:32:30.112402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1002/2001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:29 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:30.123962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:30.125168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:30.154806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.156981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.161452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.162329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.233519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:30.276134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:30.288575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:30.293423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:30.297546 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34603a11-a428-40c4-94b5-eb0794c255d8 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.514653 Jul 28 11:32:30.298129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1000/2002] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:29 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:30.315007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:30.315691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:30.334903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.335986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.338255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.338739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.391217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:30.512848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e0fe5e3-32bc-4e53-b23b-912f8399381d tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 204 len: 0 microversion: 2.1 time: 0.397877 Jul 28 11:32:30.518371 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1003/2003] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:30 2022] DELETE /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:30.657607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b74ea4c-e123-469b-8c15-a1c321319f55 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Action: 'create', calling method: .version_select at 0x7f2eb2633700>, body: {"keypair": {"name": "tempest-keypair-1513497704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNoUo1ybLvrADT4dwDbJgRja5ODgixEy4yap1H2/Jpa2btoB21SwVJUiCnr7apaeUIyfQi4+SKfohqE8rWTKXXiqn3XApUolnymegOSgYZetTdldhfR8tMPT/d/6cpmHA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:30.708593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3b74ea4c-e123-469b-8c15-a1c321319f55 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for project 1b2b682f155947ddaccd0068445e86b5. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:30.720576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:30.736048 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2371c528-6638-4068-b79b-16a512da35d2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.433490 Jul 28 11:32:30.738905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3b74ea4c-e123-469b-8c15-a1c321319f55 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for user fedec2808ad842369ec2d36c2b5d61ab and project 1b2b682f155947ddaccd0068445e86b5. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:30.757748 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1001/2004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:30 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:30.778399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:30.782165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:30.794886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.795532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.796327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.803312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.806840 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b74ea4c-e123-469b-8c15-a1c321319f55 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281759 Jul 28 11:32:30.819810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1004/2005] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:32:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:30.828316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:30.829618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:30.847112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.847971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.849071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:30.849752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:30.915576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:31.076145 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1818cfc3-0b39-4e99-aaf8-077e863bbffb tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 204 len: 0 microversion: 2.1 time: 0.254035 Jul 28 11:32:31.077536 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1005/2006] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:30 2022] DELETE /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:31.085819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:31.086974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:31.105848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:31.106771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:31.107807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:31.109152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:31.265309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:31.276550 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa6e91ff-c548-4027-945f-d25ed810c664 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.517740 Jul 28 11:32:31.278414 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1002/2007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:30 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:31.291527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:31.292593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:31.308567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:31.309240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:31.312127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:31.313041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:31.954458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:31.967596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e36f6969-5bf2-48b0-b5c3-1d4fdcf5f868 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.884851 Jul 28 11:32:31.982315 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1006/2008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:31 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:32.011214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:32.012025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:32.037525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:32.038078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:32.040468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:32.047787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:32.048497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:32.055248 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc587f8f-0811-4d7d-973f-86e38c448732 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 200 len: 1474 microversion: 2.1 time: 0.772649 Jul 28 11:32:32.056089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1003/2009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:31 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 1474 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:32.071682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:32.084636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:32.103538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:32.112880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:32.120794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:32.121570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:33.450869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:33.466754 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab8afa5d-0e4b-4a5c-bc6e-8c579dd4bce7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 1.482312 Jul 28 11:32:33.468986 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1007/2010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:31 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:33.478102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:33.496779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:33.531374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:33.543368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e3942dc4-8d9a-4dcd-b368-c088f508ef86 req-cc970adc-5d55-45a8-b1d2-00288338bb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda8c438-0f26-4ebf-be6c-11187f4c6e0d", "name": "network-vif-plugged", "status": "completed", "tag": "11ddc097-0a8c-4c9b-a797-5c6c131a548c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:33.546129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:33.561168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-efb6aac0-f852-4f1c-9163-2d9775f258bc tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 1.496419 Jul 28 11:32:33.566038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1004/2011] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:32 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:33.588161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:33.589443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:33.598009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:33.599109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:33.600523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:33.601126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:33.604069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e3942dc4-8d9a-4dcd-b368-c088f508ef86 req-cc970adc-5d55-45a8-b1d2-00288338bb73 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:33.623689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e3942dc4-8d9a-4dcd-b368-c088f508ef86 req-cc970adc-5d55-45a8-b1d2-00288338bb73 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:34.117350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e3942dc4-8d9a-4dcd-b368-c088f508ef86 req-cc970adc-5d55-45a8-b1d2-00288338bb73 service nova] Creating event network-vif-plugged:11ddc097-0a8c-4c9b-a797-5c6c131a548c for instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d on n-h1-851368-1 Jul 28 11:32:34.134995 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e3942dc4-8d9a-4dcd-b368-c088f508ef86 req-cc970adc-5d55-45a8-b1d2-00288338bb73 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.634787 Jul 28 11:32:34.138970 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1008/2012] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:34.159795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:34.160442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:34.182870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:34.190508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:34.197180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:34.197640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:34.447535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:34.480274 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-153b66c4-9691-4d01-a703-2b4670552db1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.908285 Jul 28 11:32:34.498163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1005/2013] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:33 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:34.516194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:34.518617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:34.543684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:34.544474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:34.548205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:34.549066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:35.013109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:35.026236 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da78037b-a388-4ac0-9dee-7b8947d1c470 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.885887 Jul 28 11:32:35.026829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1009/2014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:34 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:35.038790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:35.039508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:35.074365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:35.075878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:35.081002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:35.081479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:35.216090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:35.225661 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c69f6604-d13d-4d20-89a1-063e41d74d9a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.726280 Jul 28 11:32:35.226694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1006/2015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:34 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:35.240394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:35.240394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:35.258665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:35.259142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:35.268211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:35.268601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:36.007940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:36.055878 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2757e33d-b948-4527-8a25-a744c9d9a604 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 200 len: 1474 microversion: 2.1 time: 1.020561 Jul 28 11:32:36.070396 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1010/2016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:35 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 1474 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:36.086265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:36.087273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:36.100716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:36.103671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:36.104523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:36.105219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:36.473925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:36.490989 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca00b968-6e49-41b1-88f3-8500a89276cc tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1314 microversion: 2.1 time: 1.256961 Jul 28 11:32:36.502764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1007/2017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:35 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1314 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:36.573316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:36.581569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:36.621173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:36.627899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:36.632142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:36.636143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:37.331601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:37.354937 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ab529bf-72df-44fa-b02f-2c5711c5c95e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.831652 Jul 28 11:32:37.357096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1008/2018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:36 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:37.395332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:37.396616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:37.421462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:37.422342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:37.423561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:37.424281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:37.742784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:37.778614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:37.787451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:37.799968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7de0e7d9-c6b8-4784-ba76-eaab1483ed76 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 1.725233 Jul 28 11:32:37.826266 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1011/2019] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:36 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:37.841573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:37.842790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:37.856199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:37.857800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:37.859314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:37.860980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:37.887724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:37.913847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82bfdd10-bcfd-44fa-8a74-426d5c824688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.531328 Jul 28 11:32:37.917848 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1009/2020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:37 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:37.940784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0466a6c8-cc86-4f43-a47f-2b1da0eaf6d3 req-6e13c73b-c12a-4370-9282-adc3d7626d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "name": "network-vif-plugged", "status": "completed", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:37.957133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0466a6c8-cc86-4f43-a47f-2b1da0eaf6d3 req-6e13c73b-c12a-4370-9282-adc3d7626d8e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:37.958860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0466a6c8-cc86-4f43-a47f-2b1da0eaf6d3 req-6e13c73b-c12a-4370-9282-adc3d7626d8e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.003764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0466a6c8-cc86-4f43-a47f-2b1da0eaf6d3 req-6e13c73b-c12a-4370-9282-adc3d7626d8e service nova] Creating event network-vif-plugged:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h2-851368-1 Jul 28 11:32:38.014846 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0466a6c8-cc86-4f43-a47f-2b1da0eaf6d3 req-6e13c73b-c12a-4370-9282-adc3d7626d8e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092158 Jul 28 11:32:38.016674 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1010/2021] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:38.035786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6d8df1a7-0476-445b-8a38-34481bd2b88e req-c7cf128c-5b3b-4ce0-b536-7a7e93c01727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740f5b7-e39a-4690-b748-715b4f068524", "name": "network-vif-deleted", "tag": "40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:38.051970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6d8df1a7-0476-445b-8a38-34481bd2b88e req-c7cf128c-5b3b-4ce0-b536-7a7e93c01727 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.053383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6d8df1a7-0476-445b-8a38-34481bd2b88e req-c7cf128c-5b3b-4ce0-b536-7a7e93c01727 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.070539 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6d8df1a7-0476-445b-8a38-34481bd2b88e req-c7cf128c-5b3b-4ce0-b536-7a7e93c01727 service nova] Creating event network-vif-deleted:40cc80f5-daf9-48d7-ad2c-adc08e6cf1a9 for instance 9740f5b7-e39a-4690-b748-715b4f068524 on n-h1-851368-1 Jul 28 11:32:38.077370 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6d8df1a7-0476-445b-8a38-34481bd2b88e req-c7cf128c-5b3b-4ce0-b536-7a7e93c01727 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055709 Jul 28 11:32:38.078841 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1011/2022] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:38.091436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:38.092425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:38.101703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.102444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.111732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.112496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.170875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.171882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.172770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lazy-loading 'fault' on Instance uuid 96fa3a16-e75f-4867-99ec-2f1666e66fbb {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:38.392873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:38.427173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b468c262-9364-41d8-bf3a-02c6d7d44978 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 200 len: 1308 microversion: 2.1 time: 0.344788 Jul 28 11:32:38.430718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1012/2023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:38 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:38.440509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:38.441466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:38.458747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.466467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.467699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:38.468360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:38.984153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:38.994507 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b1b8c2c-caef-49fa-b68d-f25976d589fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 1.166132 Jul 28 11:32:39.013921 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1012/2024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:37 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:39.019187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.023915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:39.040258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.041019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.042020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.042639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.226587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.236335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56a2117c-8d30-4aed-8802-9fce977e54a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1464 microversion: 2.1 time: 0.804168 Jul 28 11:32:39.263447 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1013/2025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:38 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1464 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:39.273700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.279369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:39.292942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.295659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.297929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.308130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.581906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.594636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6967ff3-1a27-437f-8b10-b64f07527c18 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1528 microversion: 2.1 time: 0.579206 Jul 28 11:32:39.599471 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1013/2026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1528 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:39.613889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.614821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:39.630427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.630897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.634384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.634857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.669495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.682482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.689524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.693877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd577fdf-fdd4-42ac-be62-db05a2fb04fb tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.425959 Jul 28 11:32:39.696416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1014/2027] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:39.849372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:39.851837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.856852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'deleted': False, 'project_id': 'e8d8bac159e44917a4b9e07fa990f95e'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:39.858266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8757e6e-26f7-44d2-bb42-8118f3452a76 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1199 microversion: 2.1 time: 0.256338 Jul 28 11:32:39.858829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1014/2028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1199 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:39.863099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.863577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.864661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.865100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.865467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1563934059", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b90ade02-14f6-4474-8164-6e438db571f2"}], "security_groups": [{"name": "tempest-securitygroup--492811026"}], "key_name": "tempest-keypair-1513497704", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:39.899006 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e698600-89d6-4486-b626-49920e580b85 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.198645 Jul 28 11:32:39.899600 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1015/2029] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:32:39.904130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.904945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 96fa3a16-e75f-4867-99ec-2f1666e66fbb] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:39.910757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.911434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.913570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.913570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.931853 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb HTTP/1.1 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '96fa3a16-e75f-4867-99ec-2f1666e66fbb'} Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:39.933500 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45cb089b-ffdd-452a-b724-6134d35b2201 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb" status: 404 len: 111 microversion: 2.1 time: 0.034192 Jul 28 11:32:39.940751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1016/2030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/96fa3a16-e75f-4867-99ec-2f1666e66fbb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:39.943769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:39.950401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'deleted': False} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:39.955564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.956010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.956816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:39.957247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:39.985219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] validate_networks() for [('b90ade02-14f6-4474-8164-6e438db571f2', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:32:40.096686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:32:40.187239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.187687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.565788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for project 1b2b682f155947ddaccd0068445e86b5. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:40.575342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for user fedec2808ad842369ec2d36c2b5d61ab and project 1b2b682f155947ddaccd0068445e86b5. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:40.597750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:32:40.598600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:32:40.599105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:32:40.599828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:32:40.600433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:32:40.614727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.615528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.616593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.617235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.637256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for project 1b2b682f155947ddaccd0068445e86b5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:40.643507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Getting quotas for user fedec2808ad842369ec2d36c2b5d61ab and project 1b2b682f155947ddaccd0068445e86b5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:40.657321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:32:40.660234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:32:40.721655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9ec3b51-09a5-4726-8fca-909647410b47 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861350 Jul 28 11:32:40.722336 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1015/2031] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:32:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:32:40.734397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:40.734637 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a652ed45-8aad-4579-bf76-b06b85f885ad tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22646 microversion: 2.1 time: 0.794021 Jul 28 11:32:40.744827 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1017/2032] 10.222.0.93 () {58 vars in 1171 bytes} [Thu Jul 28 11:32:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22646 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:32:40.745314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: 9740f5b7-e39a-4690-b748-715b4f068524] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:40.745413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:40.745413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:40.745578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.749744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.750331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.751151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.751597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.758545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.761068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.761544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.795466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 HTTP/1.1 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '9740f5b7-e39a-4690-b748-715b4f068524'} Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:40.809754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:40.815582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance 9740f5b7-e39a-4690-b748-715b4f068524 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:40.817425 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b96dcaf0-9319-4ace-8b89-d2104779f7ca tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524" status: 404 len: 111 microversion: 2.1 time: 0.094008 Jul 28 11:32:40.823444 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1016/2033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:40 2022] GET /compute/v2.1/servers/9740f5b7-e39a-4690-b748-715b4f068524 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:40.833590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cde62ce7-d239-45c6-9bb4-b6fd5102b36f req-41a17498-4a3e-4e43-8134-9d7c9e6af43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d34105-31ce-4d7a-9cac-b7dd06589c3e", "name": "network-vif-plugged", "status": "completed", "tag": "1f943c1f-2539-4e49-8410-b73dc3c83abc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:40.855956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cde62ce7-d239-45c6-9bb4-b6fd5102b36f req-41a17498-4a3e-4e43-8134-9d7c9e6af43e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.856408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cde62ce7-d239-45c6-9bb4-b6fd5102b36f req-41a17498-4a3e-4e43-8134-9d7c9e6af43e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.880353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cde62ce7-d239-45c6-9bb4-b6fd5102b36f req-41a17498-4a3e-4e43-8134-9d7c9e6af43e service nova] Creating event network-vif-plugged:1f943c1f-2539-4e49-8410-b73dc3c83abc for instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e on n-h2-851368-1 Jul 28 11:32:40.890027 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cde62ce7-d239-45c6-9bb4-b6fd5102b36f req-41a17498-4a3e-4e43-8134-9d7c9e6af43e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064028 Jul 28 11:32:40.890929 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1017/2034] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:40.904444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9d4c21ba-8506-43ad-9738-4bb379388222 req-9ddb2cee-45f2-4f6f-b8bf-ec28ea3dd773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96fa3a16-e75f-4867-99ec-2f1666e66fbb", "name": "network-vif-deleted", "tag": "ea211130-4770-46fd-a1c2-05084c85eda1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:40.933310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d4c21ba-8506-43ad-9738-4bb379388222 req-9ddb2cee-45f2-4f6f-b8bf-ec28ea3dd773 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.936787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d4c21ba-8506-43ad-9738-4bb379388222 req-9ddb2cee-45f2-4f6f-b8bf-ec28ea3dd773 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.956960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9d4c21ba-8506-43ad-9738-4bb379388222 req-9ddb2cee-45f2-4f6f-b8bf-ec28ea3dd773 service nova] Creating event network-vif-deleted:ea211130-4770-46fd-a1c2-05084c85eda1 for instance 96fa3a16-e75f-4867-99ec-2f1666e66fbb on n-h1-851368-1 Jul 28 11:32:40.964115 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9d4c21ba-8506-43ad-9738-4bb379388222 req-9ddb2cee-45f2-4f6f-b8bf-ec28ea3dd773 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070866 Jul 28 11:32:40.965273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1018/2035] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:40.974579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:40.975506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:40.977757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:40.983811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.984579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:40.985585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:40.986690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.012601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.025643 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58b31f10-dcf0-475d-ac8f-ec81eed69d6f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.287465 Jul 28 11:32:41.027563 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1018/2036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:40 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:41.059528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.067528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:41.086814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.089926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.092490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.092952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.284128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.295098 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3c91d05-a83c-4c2d-bf2a-8387aa203272 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1510 microversion: 2.1 time: 0.328163 Jul 28 11:32:41.295972 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1019/2037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:40 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:41.301432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c23bf594-96d8-45bc-a501-7df8ad7a29d9 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.301984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c23bf594-96d8-45bc-a501-7df8ad7a29d9 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:41.392760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c23bf594-96d8-45bc-a501-7df8ad7a29d9 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.396105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.402546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c23bf594-96d8-45bc-a501-7df8ad7a29d9 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1270 microversion: 2.1 time: 0.105494 Jul 28 11:32:41.407202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1020/2038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:41.415919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.421341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.422074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.424323 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a1f61b9-6889-4207-9762-aceae1afbaad tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.395269 Jul 28 11:32:41.427561 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1019/2039] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:41.430808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'deleted': False, 'project_id': 'e8d8bac159e44917a4b9e07fa990f95e'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:41.436117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8b237d4-f0b8-4a01-bd0c-c35705eb80cf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.460618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.463097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.467373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.481606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:41.484671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.497242 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8b237d4-f0b8-4a01-bd0c-c35705eb80cf tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/a32fab36-7d9d-4fbc-b34e-ba2da46d10d5" status: 204 len: 0 microversion: 2.1 time: 0.068125 Jul 28 11:32:41.502019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1020/2040] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:32:41 2022] DELETE /compute/v2.1/os-server-groups/a32fab36-7d9d-4fbc-b34e-ba2da46d10d5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:41.510314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.511351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:41.530769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.531250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.532237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.532678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.538299 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8ba2e00-6d0a-4714-aaf5-3e27198ca25b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?tenant_id=0ed58b93a0994b60ba42ab32ad236dd8" status: 200 len: 15 microversion: 2.1 time: 0.124195 Jul 28 11:32:41.539280 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1021/2041] 10.222.0.93 () {58 vars in 1231 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/detail?tenant_id=0ed58b93a0994b60ba42ab32ad236dd8 => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:32:41.544447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.544950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:41.553291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.553664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.554443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.554966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.597866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:32:41.704197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39621bd9-6c3b-49ac-a25b-e5def070f5e6 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "DELETE /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 204 len: 0 microversion: 2.1 time: 0.163329 Jul 28 11:32:41.705797 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1022/2042] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:32:41 2022] DELETE /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:32:41.712762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.723708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'tenant_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'deleted': False} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:41.732207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.733270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.736405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.736405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.753873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:41.766430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:41.776982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:32:41.785400 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-677c6ed1-2d6b-4412-841b-d1159ceade6c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1383 microversion: 2.1 time: 0.281673 Jul 28 11:32:41.789542 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1021/2043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1383 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:41.796155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:41.797200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:41.805349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.811519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.812460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.812919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:41.884339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:41.884799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.010747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.019347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-687ac8df-c18b-41b2-a13b-350dcdf34c44 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1472 microversion: 2.1 time: 0.228513 Jul 28 11:32:42.020167 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1022/2044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.039997 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4fbe573f-ff14-4df7-85ff-4fb31240b274 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ed58b93a0994b60ba42ab32ad236dd8" status: 200 len: 4825 microversion: 2.1 time: 0.332635 Jul 28 11:32:42.051298 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1023/2045] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 11:32:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ed58b93a0994b60ba42ab32ad236dd8 => generated 4825 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.051298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.051298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.057167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.057567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.059599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.059599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.216869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.226974 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07dd57d2-e803-40c3-8489-e9407f46cd53 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.180946 Jul 28 11:32:42.231571 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1024/2046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:32:42.239473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.252527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'tenant_id': 'e8d8bac159e44917a4b9e07fa990f95e', 'deleted': False} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:42.257082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.257784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.258547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.259009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.259857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.260301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.265136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.265601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.266519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.266967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.302924 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1e8c6609-c579-4932-8764-13c2d79b7f02 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e8d8bac159e44917a4b9e07fa990f95e" status: 200 len: 15 microversion: 2.1 time: 0.069124 Jul 28 11:32:42.303724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1025/2047] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e8d8bac159e44917a4b9e07fa990f95e => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:32:42.325553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.327121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.337408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.338011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.339390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.339948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.458078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52688cce-9244-4670-8e4c-28d36968be61 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1534 microversion: 2.1 time: 0.436494 Jul 28 11:32:42.468569 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1023/2048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1534 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.468569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e4543fc-2818-4b79-a67e-0d1bc0045ce5 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.468870 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e4543fc-2818-4b79-a67e-0d1bc0045ce5 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008436 Jul 28 11:32:42.469345 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1024/2049] 10.222.0.93 () {58 vars in 1189 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:32:42.473949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.474618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.488826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.489273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.490047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.490675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.496134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:42.527697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.550570 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd73f1a3-6f4e-4ecf-a4db-396d61eeeafe tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1510 microversion: 2.1 time: 0.229939 Jul 28 11:32:42.551279 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1026/2050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.556420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.557143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.566221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.566805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.567730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.568208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.568396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.582208 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d569156b-629a-4db7-aad0-a9827c119072 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1266 microversion: 2.1 time: 0.111512 Jul 28 11:32:42.582818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1025/2051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.587753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.588360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.594329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.594856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.596283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.597044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.765368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.775467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.777603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.778502 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-412f7ad9-6c36-43a8-bb96-edf6b099ade9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.226102 Jul 28 11:32:42.779342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1027/2052] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:42.794687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:42.797312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.804908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.805479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.806325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.806824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.809256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f874d1aa-895a-4976-9014-c0eb716024d9 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1534 microversion: 2.1 time: 0.225117 Jul 28 11:32:42.810268 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1026/2053] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1534 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:42.830856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.833259 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:42.833259 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:32:42.834887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.835702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.836739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.837129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.864345 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5978f21-1de3-4dbb-a3cf-a09be380c438 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038412 Jul 28 11:32:42.865257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1027/2054] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:32:42.880337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851368-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:42.883290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:42.889964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.890424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.891244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.891676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.909731 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6439929-9823-4f9b-a3c6-17826023fa9e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 0 microversion: 2.1 time: 0.119435 Jul 28 11:32:42.911202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1028/2055] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:42 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:32:42.918924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:42.924080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lazy-loading 'flavor' on Instance uuid cf062eef-e0e9-46f9-bdbb-2d3cf599902c {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:42.924269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:42.924986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:42.930600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.931048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.931873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:42.932310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:42.936537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Going to try to live migrate instance to n-h1-851368-1 {{(pid=119235) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 11:32:43.044026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:32:43.112494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d6b091c-034b-4a67-bfa9-ad2830eac1f2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.195957 Jul 28 11:32:43.112672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1029/2056] 10.222.0.93 () {58 vars in 1150 bytes} [Thu Jul 28 11:32:42 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:32:43.117040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:43.117663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:43.124028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.124485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.125334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.125785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.290064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:43.299654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca73dd04-78ab-41e5-abff-79d282706e0b tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1472 microversion: 2.1 time: 0.186107 Jul 28 11:32:43.300236 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1030/2057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:43 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:43.306166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:43.308802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:43.318078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.318772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.320055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.320784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.445774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3e72f8f0-39c9-4b80-9190-5badb9a71642 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 0 microversion: 2.1 time: 0.144416 Jul 28 11:32:43.447108 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1031/2058] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:43 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:32:43.452148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:43.452784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:43.461889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.462349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.463206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.463692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.629554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:43.637555 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a3d52c3-842e-4986-926d-45f8c1c06d77 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1315 microversion: 2.1 time: 0.189272 Jul 28 11:32:43.638133 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1032/2059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:43 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:43.642678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-aa8e7d31-473c-4083-b09e-6e6e84cd68ca req-1377734e-6147-4723-a086-2c49f4a805c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "name": "network-vif-unplugged", "status": "completed", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:43.652798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa8e7d31-473c-4083-b09e-6e6e84cd68ca req-1377734e-6147-4723-a086-2c49f4a805c7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.653246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa8e7d31-473c-4083-b09e-6e6e84cd68ca req-1377734e-6147-4723-a086-2c49f4a805c7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.664869 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-aa8e7d31-473c-4083-b09e-6e6e84cd68ca req-1377734e-6147-4723-a086-2c49f4a805c7 service nova] Creating event network-vif-unplugged:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:32:43.671629 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-aa8e7d31-473c-4083-b09e-6e6e84cd68ca req-1377734e-6147-4723-a086-2c49f4a805c7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032231 Jul 28 11:32:43.672227 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1033/2060] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:43.678288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:43.678980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:43.686159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.686964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.687854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.688465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.818683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-607ddefc-ab4f-4366-97a8-1dad02c82a8a tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1614 microversion: 2.1 time: 0.145025 Jul 28 11:32:43.831115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1034/2061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:43 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:43.831115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:43.831115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:43.831908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.832367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:43.835327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:43.835327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.099402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:44.108067 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ee63960-5ec4-46f9-b857-73bf3af0abd3 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1510 microversion: 2.1 time: 0.287520 Jul 28 11:32:44.121896 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1035/2062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:43 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:44.121896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:44.121896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:44.122895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.123474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.124332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.124870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.215941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:44.225760 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a10a25a-bfde-4264-ab84-72bf39168afa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1322 microversion: 2.1 time: 0.115757 Jul 28 11:32:44.239097 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1036/2063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:44 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1322 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:44.239097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:44.239097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:44.252373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.253099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.266135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.266807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.273144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:44.921335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:44.935509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:44.942846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:44.946819 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2f81690d-c897-401e-9575-ec4341108540 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.718448 Jul 28 11:32:44.963264 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1037/2064] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:44 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:44.981407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:44.982496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:44.991820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.992694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:44.993516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:44.994046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:45.502765 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ab62144-5096-4596-8cb7-7881f87aa9bf tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1614 microversion: 2.1 time: 0.529919 Jul 28 11:32:45.516032 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1038/2065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:44 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1614 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:45.521697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:45.522509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:45.537307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:45.538053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:45.539643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:45.540247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.256282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fe34e31-85b9-48b4-94d6-c630274524ec tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c/action" status: 202 len: 0 microversion: 2.1 time: 3.382612 Jul 28 11:32:46.276769 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1028/2066] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:42 2022] POST /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c/action => generated 0 bytes in 3385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:32:46.276769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-627e4687-f396-4c31-907d-6f28d47015f6 req-b031f916-26e8-4775-8535-bd94875c7e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "name": "network-vif-unplugged", "status": "completed", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:46.321491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-627e4687-f396-4c31-907d-6f28d47015f6 req-b031f916-26e8-4775-8535-bd94875c7e8f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.331279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-627e4687-f396-4c31-907d-6f28d47015f6 req-b031f916-26e8-4775-8535-bd94875c7e8f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.361375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-627e4687-f396-4c31-907d-6f28d47015f6 req-b031f916-26e8-4775-8535-bd94875c7e8f service nova] Creating event network-vif-unplugged:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h1-851368-1 Jul 28 11:32:46.377824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-627e4687-f396-4c31-907d-6f28d47015f6 req-b031f916-26e8-4775-8535-bd94875c7e8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118387 Jul 28 11:32:46.379233 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1029/2067] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:46.387481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:46.401061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:46.414372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.415287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.422470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.423603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.666449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64884e3fb37a4b5eb5967b843b7b5e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864dc3b3e25847ac9c2bb27cb726cbdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:46.682055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfd42bce-a335-4e4a-9d30-1f0cd288adce tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 200 len: 1472 microversion: 2.1 time: 1.164344 Jul 28 11:32:46.691484 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1039/2068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:45 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 1472 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:46.696595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:46.701234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:46.737636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.738161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.738944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.739405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.741377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:46.760001 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7e50adb-75db-4e89-af0d-79cbb25759ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1294 microversion: 2.1 time: 0.377906 Jul 28 11:32:46.778013 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1030/2069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:46 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1294 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:46.793153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:46.796616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:46.820874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.824257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:46.825293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:46.827496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.261398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:47.272732 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a6277ea-9fb3-47cd-8fab-7f3f4e35dd3d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1328 microversion: 2.1 time: 0.491063 Jul 28 11:32:47.293721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1031/2070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:46 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1328 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:47.301702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:47.324740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'host': 'n-h1-851368-1', 'deleted': False} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:47.336482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.343902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.344983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.345661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.556427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:32:47.638531 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-87b39853-b332-4c09-8eb7-5cb4eae2ef8b tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=n-h1-851368-1&all_tenants=1" status: 200 len: 1982 microversion: 2.1 time: 0.343389 Jul 28 11:32:47.648067 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1032/2071] 10.222.0.93 () {58 vars in 1190 bytes} [Thu Jul 28 11:32:47 2022] GET /compute/v2.1/servers?host=n-h1-851368-1&all_tenants=1 => generated 1982 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:47.666347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ed2897c9-7e20-47c2-bc5e-f6ff5b64a51b req-198b54cd-6329-4edd-9279-a290efcfa574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d34105-31ce-4d7a-9cac-b7dd06589c3e", "name": "network-vif-deleted", "tag": "1f943c1f-2539-4e49-8410-b73dc3c83abc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:47.676798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ed2897c9-7e20-47c2-bc5e-f6ff5b64a51b req-198b54cd-6329-4edd-9279-a290efcfa574 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.677518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ed2897c9-7e20-47c2-bc5e-f6ff5b64a51b req-198b54cd-6329-4edd-9279-a290efcfa574 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.689620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ed2897c9-7e20-47c2-bc5e-f6ff5b64a51b req-198b54cd-6329-4edd-9279-a290efcfa574 service nova] Creating event network-vif-deleted:1f943c1f-2539-4e49-8410-b73dc3c83abc for instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e on n-h2-851368-1 Jul 28 11:32:47.695286 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ed2897c9-7e20-47c2-bc5e-f6ff5b64a51b req-198b54cd-6329-4edd-9279-a290efcfa574 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045332 Jul 28 11:32:47.696579 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1033/2072] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:47.702599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:47.703590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:47.711567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.712271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.713265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.713878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.812992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:47.836506 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c013821-01a9-4a54-9b15-e896478e7f12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1453 microversion: 2.1 time: 1.139475 Jul 28 11:32:47.837710 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1040/2073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:46 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1453 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:47.853819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:47.856109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:47.877766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.881605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:47.886272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:47.888051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.394599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:48.412184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:48.417143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:48.421350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffe9b462-6d53-4850-90f4-09d58b490064 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.722437 Jul 28 11:32:48.423272 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1034/2074] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:47 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:48.437283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:48.455542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:32:48.471101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.472578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.477956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.479288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.496892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:48.509234 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7feaef8b-b2c5-4838-923f-ced69915cfc3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.666794 Jul 28 11:32:48.510933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1041/2075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:47 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:48.516052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:48.516958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] [instance: df3a374f-7b2d-457c-866e-e6c033a0b067] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:48.521778 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25cee3ff-7300-4784-b219-08df2c939f55 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.094798 Jul 28 11:32:48.525308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.528087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.529298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.531729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.533294 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1035/2076] 10.222.0.93 () {58 vars in 1196 bytes} [Thu Jul 28 11:32:48 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:32:48.538972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:48.539872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:48.548251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.549584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.550764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.551425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.554896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] HTTP exception thrown: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Request method failure captured: Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 HTTP/1.1 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nL4A30VJm3TzxSJpHLkH5lZ1udEuWlyHvrThMEcJDzj-YZKhTalTApPvpDWEU-b6IKVkC7x44DeR9r3SDK3yuTn-hJd7yeHm0Wa4qgYxBtLBAMIZ0NIG6MaNUkCz2tlqRC---U9AkvUuXTVewwCIh0c9NHHDpQ7qWwNpROdQDpdzbA Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_864dc3b3e25847ac9c2bb27cb726cbdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/864dc3b3e25847ac9c2bb27cb726cbdc"}]}] Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 864dc3b3e25847ac9c2bb27cb726cbdc Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1683393198 Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 64884e3fb37a4b5eb5967b843b7b5e6b Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersOnMultiNodesTest-1683393198-project Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'df3a374f-7b2d-457c-866e-e6c033a0b067'} Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:48.556678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] Returning 404 to user: Instance df3a374f-7b2d-457c-866e-e6c033a0b067 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-416b421f-6b08-4734-a6e4-650d4bdff1c0 tempest-ServersOnMultiNodesTest-1683393198 tempest-ServersOnMultiNodesTest-1683393198-project] 10.222.0.93 "GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067" status: 404 len: 111 microversion: 2.1 time: 0.045812 Jul 28 11:32:48.562239 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1042/2077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:48 2022] GET /compute/v2.1/servers/df3a374f-7b2d-457c-866e-e6c033a0b067 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:48.566337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:48.567473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:48.577270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.578104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.581746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.583373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.734496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:48.743373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b6f9e48-519d-4207-8fe5-6928d5ba99a9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1294 microversion: 2.1 time: 0.208529 Jul 28 11:32:48.743951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1036/2078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:48 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:48.760327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:48.761224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:48.767926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.768602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.769566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:48.770166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:48.988277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:49.002253 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fc215ad-b694-4061-9148-0c85c08fabef tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1453 microversion: 2.1 time: 0.438820 Jul 28 11:32:49.003641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1043/2079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:48 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1453 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:49.012032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}, {"server_uuid": "df3a374f-7b2d-457c-866e-e6c033a0b067", "name": "network-vif-deleted", "tag": "c2c3bcd5-83a8-4931-b369-848b92c34e36"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:49.038869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.046308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.068505 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] Creating event network-changed:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h1-851368-1 Jul 28 11:32:49.069031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] Creating event network-vif-deleted:c2c3bcd5-83a8-4931-b369-848b92c34e36 for instance df3a374f-7b2d-457c-866e-e6c033a0b067 on n-h2-851368-1 Jul 28 11:32:49.092814 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-eff099be-cff9-489b-a71e-4f35c0ff12f8 req-36864dc2-feb5-45a2-9ad4-5bca2d9cea5b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087611 Jul 28 11:32:49.101146 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1044/2080] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:49.106473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:49.111256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.139414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.139873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.140668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.141103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.273772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:49.297485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-361f0849-30d2-4ce3-9c51-00c29372b6a3 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.546520 Jul 28 11:32:49.303129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1037/2081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:48 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:49.317498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:49.318508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.344621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.345247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.346155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.347827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.361392 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4bd7bbad-2ed8-42eb-ad1f-a52541b150fa tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 0 microversion: 2.1 time: 0.262577 Jul 28 11:32:49.363267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1045/2082] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:49 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:32:49.376410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:49.382952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.397309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.401085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.402682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.403336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.414530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'flavor' on Instance uuid 037232de-716c-4380-9033-c2c3d8c09598 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:32:49.437981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'shelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state shelved_offloaded Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 14 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: {"shelve": {}} Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: exception: Cannot 'shelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state shelved_offloaded Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'shelve': {}}} Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 28 11:32:49.446241 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state shelved_offloaded Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state shelved_offloaded Jul 28 11:32:49.452043 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:49.454121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'shelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state shelved_offloaded {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:49.458295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13a40bc3-8fb3-401e-9210-9d000ce83026 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 155 microversion: 2.1 time: 0.156140 Jul 28 11:32:49.461420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1038/2083] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:49 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 155 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:32:49.474878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:49.476147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.495190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.496010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.497742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.499499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.615854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:32:49.618192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:32:49.618841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:32:49.620354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:32:49.621093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:32:49.733889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:49.772390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.785739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:49.788713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:49.790226 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93defe4c-418f-43f2-b083-f968ec955690 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.327483 Jul 28 11:32:49.792378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.793127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.807331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.807331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.807903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1039/2084] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:49 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:49.819560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:49.825882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.851495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.851816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.852829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.853350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.867432 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b0f0b78-cbba-4047-bab0-2f15185b4a0f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 1067 microversion: 2.1 time: 0.496758 Jul 28 11:32:49.874081 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1046/2085] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:49 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 1067 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 11:32:49.888095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:49.890416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:49.913966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.915029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.920164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:49.923591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:49.963729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119235) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 11:32:50.163929 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e8ee950-9706-45bc-a263-92df42b94702 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.353719 Jul 28 11:32:50.165803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1040/2086] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:32:49 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:32:50.171098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:50.171776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:50.174378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:50.196003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.198672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:50.201793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.202201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:50.260643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:50.571243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:50.579844 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b638f91a-d5d5-419e-a1f3-1cf479dbec06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 200 len: 1294 microversion: 2.1 time: 0.412860 Jul 28 11:32:50.591848 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1041/2087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:50 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 1294 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:50.609599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:50.610478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:50.626185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:50.636125 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c300276a-d5ba-4bc2-ac7f-cb9711d973c4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.759975 Jul 28 11:32:50.636628 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1047/2088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:49 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:50.637778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.638440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:50.639519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.640131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:50.666464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:50.684055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:50.699310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.699797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:50.700599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:50.701040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:51.429086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:51.444817 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2c8248e6-b7ed-493e-a439-948e0e3a6f65 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1461 microversion: 2.1 time: 0.779575 Jul 28 11:32:51.446733 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1048/2089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:50 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1461 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:51.463680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:51.464539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:51.495875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:51.499920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:51.504114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:51.504787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:51.561129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:51.586384 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f27270e-f8c2-4622-93d1-15e86a9420fd tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.976330 Jul 28 11:32:51.589267 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1042/2090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:50 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:51.609631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:51.610673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:51.633958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:51.640363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:51.641490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:51.642899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:51.872934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:52.272048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:52.291454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:52.293323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:52.294986 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-65e9f28c-5a2b-4825-b0fd-26ea580b5035 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.703580 Jul 28 11:32:52.306935 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1043/2091] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:51 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:52.317840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:52.318678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:52.325826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:52.327440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.328152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.331219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.331941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.348187 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e HTTP/1.1 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '84d34105-31ce-4d7a-9cac-b7dd06589c3e'} Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:32:52.350234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:32:52.354891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:32:52.371571 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfc7bb7b-f6a7-43cb-bceb-7a2b5a7aeead tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.905889 Jul 28 11:32:52.371571 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1049/2092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:51 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:52.375817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:32:52.378257 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f3c1b639-629c-4002-89de-5de34eff3a4d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 404 len: 111 microversion: 2.1 time: 0.069964 Jul 28 11:32:52.382498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1044/2093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:52 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:32:52.390813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:52.395203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:52.414334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.418413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.422515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.423395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.441334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-eee448b2-13bd-4509-96c4-4ef1f3654bb8 req-afeea501-258f-44e6-b527-aa54b9e601ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13beab8e-6c0f-4e20-8156-8dbc2dd6ada8", "tag": "e5fe0882-e97a-4540-bd2b-8708fef840df"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:52.464719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-eee448b2-13bd-4509-96c4-4ef1f3654bb8 req-afeea501-258f-44e6-b527-aa54b9e601ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.465780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-eee448b2-13bd-4509-96c4-4ef1f3654bb8 req-afeea501-258f-44e6-b527-aa54b9e601ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.495157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-eee448b2-13bd-4509-96c4-4ef1f3654bb8 req-afeea501-258f-44e6-b527-aa54b9e601ea service nova] Creating event network-changed:e5fe0882-e97a-4540-bd2b-8708fef840df for instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 on n-h2-851368-1 Jul 28 11:32:52.508398 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-eee448b2-13bd-4509-96c4-4ef1f3654bb8 req-afeea501-258f-44e6-b527-aa54b9e601ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071150 Jul 28 11:32:52.512978 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1045/2094] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:32:52.529718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:52.537641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:52.567112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.567112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.567112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:52.567112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:52.963293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:52.995115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:53.017447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dedc4d96-03c3-4b76-975b-434053e20bdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.654493 Jul 28 11:32:53.019434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1050/2095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:52 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:53.034058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-734274646", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:53.168801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:32:53.304717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:53.318877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55d28549-7f23-4720-965b-c2176a9a0c9a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1463 microversion: 2.1 time: 0.804000 Jul 28 11:32:53.334669 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1046/2096] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:52 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1463 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:53.359365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:53.359995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:53.379488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:53.381450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:53.383630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:53.385586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:54.170014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:54.186338 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-33fa2eaf-30b1-4c1e-ba28-89ecbdb1dab7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.843534 Jul 28 11:32:54.202891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1047/2097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:53 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:54.211651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:54.212409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:54.221849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:54.223569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:54.224501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:54.226482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.022144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:55.058800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:55.069414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:55.071653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1af01a68-0267-4ed8-933f-3ae7c8ab3f8f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.866767 Jul 28 11:32:55.072552 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1048/2098] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:54 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:55.080435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:55.082442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:55.100873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.102633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.104406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.105436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.443604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:32:55.445627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:32:55.446325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:32:55.446929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:32:55.447974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:32:55.468373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.469146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.470670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.471603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.515147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:32:55.523885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:32:55.551159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:32:55.562523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:55.574058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:32:55.576966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e18e739-f838-4080-9b6b-61f3928a154d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.503045 Jul 28 11:32:55.588129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1049/2099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:55 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:55.611424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-af792587-749f-4c15-bec6-767b1fd7ca13 req-ceddafb4-4e94-4e33-8e3b-28da0e871723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "name": "network-vif-unplugged", "status": "completed", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:32:55.640635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-af792587-749f-4c15-bec6-767b1fd7ca13 req-ceddafb4-4e94-4e33-8e3b-28da0e871723 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.647496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-af792587-749f-4c15-bec6-767b1fd7ca13 req-ceddafb4-4e94-4e33-8e3b-28da0e871723 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.680154 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-af792587-749f-4c15-bec6-767b1fd7ca13 req-ceddafb4-4e94-4e33-8e3b-28da0e871723 service nova] Creating event network-vif-unplugged:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h1-851368-1 Jul 28 11:32:55.692475 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-af792587-749f-4c15-bec6-767b1fd7ca13 req-ceddafb4-4e94-4e33-8e3b-28da0e871723 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102766 Jul 28 11:32:55.694370 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1050/2100] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:55.705835 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-edf8353b-ab1c-474f-8265-a6b319bcaf92 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.684950 Jul 28 11:32:55.706749 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1051/2101] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:32:55.715792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:55.723883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:55.737940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.738626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.739665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:55.750688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:55.790638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:56.043725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.064761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.070274 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:56.070274 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:32:56.071774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.072358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.073233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.073736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.081369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4bc92090-d9dd-4830-8531-4efc8f38da4d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.372360 Jul 28 11:32:56.095134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1052/2102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:55 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:56.099626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.100748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:56.129030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:32:56.140029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.140565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.144269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.144509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.166230 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ba9d300-0b4b-4fe6-8a08-29334f68c84d tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.470328 Jul 28 11:32:56.167492 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1051/2103] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:32:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:56.174878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.176380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:56.193872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.194591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.198389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.199276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.525430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.541537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fecc6c7c-a95b-4416-a322-78efc40cb045 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.450722 Jul 28 11:32:56.542639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1053/2104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:56.553133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.565670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70d1b4b6-4795-49c3-90df-143397270c8d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.569021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70d1b4b6-4795-49c3-90df-143397270c8d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:56.572415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d9aa71a0-c570-49ae-a80b-7789cc65bf98 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.403385 Jul 28 11:32:56.575334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1052/2105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:56.588536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.591670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:56.612963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.613594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.618117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.618705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.693716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-70d1b4b6-4795-49c3-90df-143397270c8d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.702326 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70d1b4b6-4795-49c3-90df-143397270c8d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1214 microversion: 2.1 time: 0.158385 Jul 28 11:32:56.706283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1054/2106] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:56.723337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.731354 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:56.731354 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:32:56.736115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.736854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.737862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.749638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.799880 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-baddc4b5-ae78-4c3a-817f-cbf7c6885454 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851368-1" status: 200 len: 578 microversion: 2.1 time: 0.083368 Jul 28 11:32:56.807216 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1055/2107] 10.222.0.93 () {58 vars in 1172 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/os-services?host=n-d-851368-1 => generated 578 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:56.812796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.818475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:56.826460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.835626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.836800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.837415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.920810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.931157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.936225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:56.939309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3328c278-7a2b-43d7-a313-2d700aa6eeba tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.362678 Jul 28 11:32:56.961600 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1053/2108] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:56.970784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:56.981768 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:56.981768 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:32:56.983364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.984067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:56.986698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:56.989590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.066849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e747de29-24c3-493f-ac30-a40357a79976 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102724 Jul 28 11:32:57.071981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1054/2109] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:57.094272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:57.103879 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:32:57.103879 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:32:57.105802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.107635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.110991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.112634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.135872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:57.145287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad909430-5fc6-4a97-891c-03a18ed98466 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.336710 Jul 28 11:32:57.145871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1056/2110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:56 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:57.167360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:57.167990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:57.175860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.176241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.176992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.177429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.192634 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6418cf95-c0de-434e-9eb1-233eaaa86f02 tempest-ServicesAdminTestJSON-1870130520 tempest-ServicesAdminTestJSON-1870130520-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111251 Jul 28 11:32:57.201537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1055/2111] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:32:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:32:57.367585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:57.376142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f42b0f9b-66d5-4c88-b55b-b7ada8291b34 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.213453 Jul 28 11:32:57.383737 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1057/2112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:57 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:57.567104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:57.568073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:57.595434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.595904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.596707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.597154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.600224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:57.601132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:57.613816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.614776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:57.617238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:57.618180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.018025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.026628 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-916b4ff7-3231-457c-9d2c-629a804da27e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.431565 Jul 28 11:32:58.041954 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1058/2113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:57 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:32:58.041954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:58.045463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:58.061476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.066483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.073589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.074845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.107957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.114600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60a02494-3c18-4d9f-af40-50e33b264d1f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.554612 Jul 28 11:32:58.119896 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1056/2114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:57 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:58.149435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:58.164522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:58.171343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.175166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.176301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.176862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.181638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.196128 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9709c05-6143-4418-94f5-faa802bf1ead tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1218 microversion: 2.1 time: 0.165188 Jul 28 11:32:58.198132 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1059/2115] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:58 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:58.203606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:58.204456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:58.215024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.217146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.221755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.222422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.784975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.819482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.828337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.839350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe43b2a0-b2ad-4c7b-8037-553e11f1e68f tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.701959 Jul 28 11:32:58.857237 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1057/2116] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:58 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:32:58.868235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:58.869175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:58.890670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:58.895819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.901865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.902960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:58.903664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:58.915298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2c40f101-2f6d-4779-927e-5a9ba936a733 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.715336 Jul 28 11:32:58.922301 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1060/2117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:58 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:59.049885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:59.050809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:59.065531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.069847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.073028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.086161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.383999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:59.397586 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95765c48-ecf9-47da-a132-f227a2b6a250 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.538465 Jul 28 11:32:59.400447 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1058/2118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:58 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:59.411199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:59.412306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:59.426181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.431022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.432914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.433944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.489674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:59.515539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f256e5e5-41fa-4184-a2e3-698df379eea4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.469839 Jul 28 11:32:59.521203 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1061/2119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:59 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:32:59.537642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:59.538957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:59.565102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.568340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.569450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.575320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.708635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:59.717835 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-acbb499a-9860-44ea-ae3b-f1825ae5c09b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1210 microversion: 2.1 time: 0.192929 Jul 28 11:32:59.724964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1062/2120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:59 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1210 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:59.809986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:32:59.831712 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a298525c-b88b-4ae0-b496-e588d6889ec9 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.424547 Jul 28 11:32:59.835575 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1059/2121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:59 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:32:59.865486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:59.866163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:59.878402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.878883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.879741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.880182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.940127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:32:59.940752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:32:59.951020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.966984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:32:59.969331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:32:59.972047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:00.464596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:00.476947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:00.484413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:00.491295 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d891540-6ea5-4032-9f4b-1b262f356ef3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.630376 Jul 28 11:33:00.497423 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1063/2122] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:32:59 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:00.509380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:00.510234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:00.543032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:00.545074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:00.547348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:00.552200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:00.609088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:00.631444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62118aea-775e-43d1-bcc1-39eedf973a86 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.695175 Jul 28 11:33:00.633501 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1060/2123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:32:59 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:00.662498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:00.665706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:00.706963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:00.707734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:00.713534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:00.714232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.110234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.115670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:01.130048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.130909 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d447b2c4-3977-49f1-bc45-4717d8cccae9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.493544 Jul 28 11:33:01.135456 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1061/2124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:00 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:01.147185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:01.148489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:01.156057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.157234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.159034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.159636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-035bb351-03ad-412e-9b0a-921177599d77 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.655152 Jul 28 11:33:01.159907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.160842 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1064/2125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:00 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:01.169728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:01.170656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:01.185778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.186510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.190838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.191519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.321436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.338924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77787d2f-ae14-440b-9767-4284e37ce736 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.195848 Jul 28 11:33:01.340246 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1062/2126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:01 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:01.348444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f5a1b60c-29a3-4f42-babe-29ec808b6f67 req-db8b4dad-7f2b-4e19-b4a5-a6ba77a6863a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13beab8e-6c0f-4e20-8156-8dbc2dd6ada8", "name": "network-vif-plugged", "status": "completed", "tag": "e5fe0882-e97a-4540-bd2b-8708fef840df"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:01.370723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:01.377966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5a1b60c-29a3-4f42-babe-29ec808b6f67 req-db8b4dad-7f2b-4e19-b4a5-a6ba77a6863a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.378419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5a1b60c-29a3-4f42-babe-29ec808b6f67 req-db8b4dad-7f2b-4e19-b4a5-a6ba77a6863a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.400490 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f5a1b60c-29a3-4f42-babe-29ec808b6f67 req-db8b4dad-7f2b-4e19-b4a5-a6ba77a6863a service nova] Creating event network-vif-plugged:e5fe0882-e97a-4540-bd2b-8708fef840df for instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 on n-h2-851368-1 Jul 28 11:33:01.406274 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f5a1b60c-29a3-4f42-babe-29ec808b6f67 req-db8b4dad-7f2b-4e19-b4a5-a6ba77a6863a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062965 Jul 28 11:33:01.408107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1063/2127] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:01.435677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.447574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cce40c76-135b-41a6-8a5e-9fee5c1b5675 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.285192 Jul 28 11:33:01.450547 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1065/2128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:01 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:01.519291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:01.519995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:01.527801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.528317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.529332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.529945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.656347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:01.658752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:01.668410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.668876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.669676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:01.670126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:01.747065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.756467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.759751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.761263 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ff51e19-b8e8-42ac-85be-4a3a64cac240 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.246809 Jul 28 11:33:01.762941 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1064/2129] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:01 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:01.852017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:01.860061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b938097-9baa-4877-857c-9f8fa2b2c14c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.207869 Jul 28 11:33:01.861441 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1066/2130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:01 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:02.157016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.158082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.164856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.165318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.166187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.166634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.181246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.182249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.197509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.199205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.200219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.203713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.441080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:02.449059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:02.452271 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-923cfb78-6d6a-4684-889c-cc030521c8c3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.298253 Jul 28 11:33:02.457956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60628062-9bd5-465a-9338-12757452dfdc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.281105 Jul 28 11:33:02.459062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1067/2131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:02.459739 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1065/2132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:02.465236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.466131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.475163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.476138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.478694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.479179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.480179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.480792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.486492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.487281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.494073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.494888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.616977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:02.625921 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f005dbc-0149-444f-90ed-f8b1a7955d47 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.164989 Jul 28 11:33:02.639165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1068/2133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:02.787776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.788669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.800601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.801336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.802124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.802558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.806181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:02.825489 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-271d981b-6bcf-490f-b085-baa39777fda5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.357898 Jul 28 11:33:02.826358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1066/2134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:02.884220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:02.886130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:02.901038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.901623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:02.903760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:02.905839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:03.080589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:03.103719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:03.113161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:03.129485 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9aa9a78-b5a3-4c02-83eb-98d92ae85919 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.331951 Jul 28 11:33:03.130918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1069/2135] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:33:03.238360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:03.256021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80f2043f-a04a-4894-ace4-af930391e831 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1395 microversion: 2.1 time: 0.375728 Jul 28 11:33:03.269170 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1067/2136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:02 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1395 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:03.482415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:03.483128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:03.498124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:03.499058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:03.500635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:03.501779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:03.502947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:03.511041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:03.546262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:03.546873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:03.548337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:03.549574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.441395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:04.446428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:04.474966 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c896f4dd-d94d-4fff-b4dd-ddf4bdedb740 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.998717 Jul 28 11:33:04.477446 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1070/2137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:03 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:04.489643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:04.494842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:04.497097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:04.507878 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e39ea5e7-acf6-4ddb-a378-1b2c1caa35a1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 1.024520 Jul 28 11:33:04.508661 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1068/2138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:03 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:04.515312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.517315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.521931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.523830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.549024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:04.549748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:04.558577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.559213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.560133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.560743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.847696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:04.868012 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65e7ef4f-1a19-4903-b9a7-3d658ee82797 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.386936 Jul 28 11:33:04.869070 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1071/2139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:04 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:04.874486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:04.875422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:04.882555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.883458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:04.884272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:04.884890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.081994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:05.096430 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ec703e6-a46a-4c6d-81a8-8200b2041e12 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.569168 Jul 28 11:33:05.097638 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1069/2140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:04 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:05.111357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:05.112480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:05.122491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.123460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.124610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.125579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.536606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:05.546245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:05.549068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:05.551296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc8bcbb9-b4f8-4f0e-9c77-864745a6fa63 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.680542 Jul 28 11:33:05.552380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1072/2141] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:04 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:05.560560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-57250e1a-2bf1-4704-8821-063d113a77ce req-cb25b3f3-7c06-443b-adef-237d8fc408f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:05.588564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-57250e1a-2bf1-4704-8821-063d113a77ce req-cb25b3f3-7c06-443b-adef-237d8fc408f8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.589013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-57250e1a-2bf1-4704-8821-063d113a77ce req-cb25b3f3-7c06-443b-adef-237d8fc408f8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.589441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:05.612671 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7321746c-1486-4293-9b80-a6e5643fb3d2 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1575 microversion: 2.1 time: 0.511096 Jul 28 11:33:05.612864 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-57250e1a-2bf1-4704-8821-063d113a77ce req-cb25b3f3-7c06-443b-adef-237d8fc408f8 service nova] Creating event network-vif-unplugged:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:33:05.614510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1070/2142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:05 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1575 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:05.625560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:05.626376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:05.631190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-57250e1a-2bf1-4704-8821-063d113a77ce req-cb25b3f3-7c06-443b-adef-237d8fc408f8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077211 Jul 28 11:33:05.633562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.634302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.635402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.636070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.638545 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1073/2143] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:05.644218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:05.644998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:05.659397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.659839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:05.661483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:05.661483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.167355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.185046 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2784447c-392c-4676-871b-df6deeea4c70 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.543041 Jul 28 11:33:06.185046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1074/2144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:05 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:06.195209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:06.195795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:06.197050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.202413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.202945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.204039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.204757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.216862 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d3565a3f-dc32-4806-9725-bb7ba20c87e2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.594392 Jul 28 11:33:06.220792 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1071/2145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:05 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:06.227910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:06.229054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:06.237642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.238547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.239764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.240399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.376091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.386244 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad9a44ce-1a3e-4ca2-8945-429e0d0e7e69 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.164011 Jul 28 11:33:06.387815 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1072/2146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:06 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:06.395622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:06.396500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:06.406128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.406740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.410764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.411670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.422153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70640007-778f-4712-913c-acf983afc75c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236269 Jul 28 11:33:06.423677 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1075/2147] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:33:06 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:06.578598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:06.579600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:06.592536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.593426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.594573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:06.596211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:06.699521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:06.757329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:06.776000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.787783 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41e1f032-8792-4f63-824d-0dc4c347b420 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.398418 Jul 28 11:33:06.796664 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1073/2148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:06 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:06.964033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.983024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.996778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:06.998759 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea84fb82-2df2-457b-aa14-302349459f53 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.424459 Jul 28 11:33:07.001812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1076/2149] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:06 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:07.224788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:07.226514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:07.236659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:07.239844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.240724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.243245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.244075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.244816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:07.245569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:07.254087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.254846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.255839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.256470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.575749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:07.596657 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a36d04a4-4484-42f3-8a9e-f274b00f5c01 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.356388 Jul 28 11:33:07.597623 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1077/2150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:07 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:07.602777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:07.603434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:07.614694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.615873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.617715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.619010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.632582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:07.648097 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a92012ee-3ef7-4e7a-8b4f-c65da735d58f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.435681 Jul 28 11:33:07.649025 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1074/2151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:07 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:07.740529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:07.749351 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4570179f-3da6-4efe-88b0-eca130db4e9f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.150555 Jul 28 11:33:07.750539 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1078/2152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:07 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:07.813142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:07.815859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:07.824316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.827374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:07.829426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:07.831592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.028953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:08.030954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:08.044211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.044978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.045993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.046660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.499230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:08.519575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-97e3d69b-2b1d-4292-8481-fecfbd257d34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.709905 Jul 28 11:33:08.523620 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1075/2153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:07 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:08.636175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:08.637707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:08.648139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.648980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.650005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.650745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.680993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:08.692745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:08.694242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:08.706130 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b05fb74c-d1a7-4933-9d19-0ea8f49211b5 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.675291 Jul 28 11:33:08.719250 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1079/2154] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:08 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:08.731442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:08.734221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:08.748396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.749497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:08.750474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:08.751688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.261873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:09.270871 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e1aa4ff-2f79-465e-8d9c-bc5360105688 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.646511 Jul 28 11:33:09.276154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1076/2155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:08 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:09.281066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:09.287569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:09.307309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.307774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.308570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.309208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.347126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:09.374650 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-362b5852-ac1f-436d-9e3a-82ec435036a4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1471 microversion: 2.1 time: 0.652823 Jul 28 11:33:09.375891 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1080/2156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:08 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1471 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:09.381478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:09.383173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:09.397745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.405153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.406257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.406881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.440953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:09.448493 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cbd2889b-2a68-4791-8e2b-942c12e57dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.171039 Jul 28 11:33:09.449083 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1077/2157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:09 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:09.470685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1cb8d27d-59a8-4580-bddc-8108dfa9a8a7 req-9ce3e71e-3043-4e44-9349-98834393dbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13beab8e-6c0f-4e20-8156-8dbc2dd6ada8", "tag": "e5fe0882-e97a-4540-bd2b-8708fef840df"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:09.480515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1cb8d27d-59a8-4580-bddc-8108dfa9a8a7 req-9ce3e71e-3043-4e44-9349-98834393dbf9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.481181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1cb8d27d-59a8-4580-bddc-8108dfa9a8a7 req-9ce3e71e-3043-4e44-9349-98834393dbf9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.495008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1cb8d27d-59a8-4580-bddc-8108dfa9a8a7 req-9ce3e71e-3043-4e44-9349-98834393dbf9 service nova] Creating event network-changed:e5fe0882-e97a-4540-bd2b-8708fef840df for instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 on n-h2-851368-1 Jul 28 11:33:09.502036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1cb8d27d-59a8-4580-bddc-8108dfa9a8a7 req-9ce3e71e-3043-4e44-9349-98834393dbf9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034763 Jul 28 11:33:09.503316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1078/2158] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:09.549388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:09.550734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:09.564387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.565185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:09.566243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:09.568706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:10.362757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:10.370777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b7c7186-b86a-493b-a3a9-0678ec6d0f87 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1575 microversion: 2.1 time: 0.992963 Jul 28 11:33:10.383852 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1081/2159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:09 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1575 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:10.385772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:10.387619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:10.396298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:10.402817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:10.404258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:10.405184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:10.443496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:10.447275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:10.457457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b56e686-894e-4dcf-9ae3-cf89bfbf0f02 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.913462 Jul 28 11:33:10.463395 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1079/2160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:09 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:10.474843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:10.475827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:10.490665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:10.492935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:10.496127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:10.496946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:11.521095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:11.531416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:11.534219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:11.537759 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-daac6397-a3f6-4b22-9783-1c7ad2563c38 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 1.156261 Jul 28 11:33:11.539965 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1082/2161] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:10 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:11.548762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:11.555587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:11.562303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:11.563112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:11.564682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:11.565534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:11.660024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:11.677615 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd9c0434-4018-494d-88e9-098e63b54f79 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 1.212783 Jul 28 11:33:11.685077 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1080/2162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:10 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:11.700217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:11.700856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:11.720619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:11.721413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:11.722571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:11.723197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.021141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:12.028885 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef242664-664a-4517-9dc8-0fd9044778da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.342398 Jul 28 11:33:12.044230 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1081/2163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:11 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:12.050587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43c15522-3f22-437f-b93e-f874bd7ff47b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Action: 'create', calling method: .version_select at 0x7f2eb21e0160>, body: {"keypair": {"name": "tempest-keypair-424257062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk0flz8E1V6qwRenQP5tOXVOH4dVsYp374H5QNPIxlShm6aPP+WlzhJFn9g8MuTYwTOM7ylG8KLSr/9fAqjVGdIHh2vGbhLPUUMr9M8Uwwd1eFA7zDFXE/w4A/dmctT6Q=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:12.068798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-43c15522-3f22-437f-b93e-f874bd7ff47b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Getting quotas for project ced4fe632ca9495d9e703b2488d55094. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:33:12.073931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-43c15522-3f22-437f-b93e-f874bd7ff47b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Getting quotas for user 9076d0f6075a4e6aad7a2dfd2797b1a8 and project ced4fe632ca9495d9e703b2488d55094. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:33:12.102732 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43c15522-3f22-437f-b93e-f874bd7ff47b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.056836 Jul 28 11:33:12.103368 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1082/2164] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:33:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:33:12.108415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:12.109352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:12.118322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.119022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.120449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.121127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.390293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:12.407189 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1c92d15-8356-41f7-9a88-7f643adf4636 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.857664 Jul 28 11:33:12.407945 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1083/2165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:11 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:12.572951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:12.574668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:12.598687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.601381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:12.602824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.606192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.609304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.615326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4060f53e-1a3a-4cdf-9fef-19784e66d3bf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.510427 Jul 28 11:33:12.629227 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1083/2166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:12 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:12.707617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:12.709641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:12.720773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.730178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:12.731306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:12.732050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.294245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:13.318103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-538fc952-5a41-454c-a5da-7f9f61f681d5 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.615374 Jul 28 11:33:13.319860 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1084/2167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:12 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:13.328917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:13.343257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:13.370098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.370948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.372084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.372818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.410259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:13.425190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:13.426815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:13.429615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ec65778-3997-4eb0-a713-74b1672d90f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1488 microversion: 2.25 time: 0.862003 Jul 28 11:33:13.430223 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1084/2168] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:12 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1488 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:33:13.457497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:13.458570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:13.479171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.479731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.480624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.481084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.578356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:13.592247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d24c38c-c75a-4367-9596-c624f768b564 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.268464 Jul 28 11:33:13.595668 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1085/2169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:13 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:13.639564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:13.640460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:13.657743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.658299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:13.659179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:13.659635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:14.162743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:14.171416 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-387cbf84-6acf-4e69-b154-139d7491df33 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.723567 Jul 28 11:33:14.172122 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1085/2170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:13 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:14.260879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:14.283877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfe7492c-2c84-4594-bdac-dbf8326aedda tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.648267 Jul 28 11:33:14.287936 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1086/2171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:13 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:14.343691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:14.346116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:14.359815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:14.361235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:14.362403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:14.370204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:14.463784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:14.464407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:14.473565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:14.474030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:14.474980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:14.475571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:14.977268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:14.988232 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-abbecb49-927c-48cc-be51-b907460e5fa1 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.650287 Jul 28 11:33:14.989250 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1086/2172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:14 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:14.995366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1571502119", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4814dd12-ae87-4729-a994-b87b72f428cb"}, {"port": "4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1", "tag": "port-1"}, {"port": "68b0ab21-d61f-4ee1-a0c7-f3315d681809", "tag": "port-2"}, {"uuid": "9d5c6e88-f638-4583-b258-453c580f26ce", "tag": "net-1"}, {"uuid": "9d5c6e88-f638-4583-b258-453c580f26ce"}, {"uuid": "091904c2-e347-4577-8af4-db257a5f1353", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "091904c2-e347-4577-8af4-db257a5f1353", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "600b4bd5-85ca-4feb-8d63-baa4c5158f60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1b806e20-f8ec-4c39-bdeb-80921e21b980", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7d387d6a-6f6c-405f-be8d-f02872e7893a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--555348786"}], "key_name": "tempest-keypair-424257062", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:14.998263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:15.013566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:15.015115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:15.022659 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5341304-903b-4a16-9663-785b17068c56 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1478 microversion: 2.25 time: 0.558416 Jul 28 11:33:15.024075 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1087/2173] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:14 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1478 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:33:15.028322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:15.028952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:15.043455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.044196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.045181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.046019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.190001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:15.199304 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e90d3535-e3ad-45a4-9bdd-9eac667740db tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1266 microversion: 2.1 time: 0.174477 Jul 28 11:33:15.200021 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1088/2174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:15 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:15.205550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd757b12-d99c-42fc-801f-d2d85099e621 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '.version_select at 0x7f2eb22aae50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:15.210050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd757b12-d99c-42fc-801f-d2d85099e621 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.210584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd757b12-d99c-42fc-801f-d2d85099e621 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.224039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd757b12-d99c-42fc-801f-d2d85099e621 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3873 microversion: 2.25 time: 0.022935 Jul 28 11:33:15.224756 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1089/2175] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Jul 28 11:33:15 2022] GET /compute/v2.1/os-migrations => generated 3873 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:15.229274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:15.229957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:15.234832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] validate_networks() for [('4814dd12-ae87-4729-a994-b87b72f428cb', None, None, None, None, None), (None, None, '4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1', None, None, None), (None, None, '68b0ab21-d61f-4ee1-a0c7-f3315d681809', None, None, None), ('9d5c6e88-f638-4583-b258-453c580f26ce', None, None, None, None, None), ('9d5c6e88-f638-4583-b258-453c580f26ce', None, None, None, None, None), ('091904c2-e347-4577-8af4-db257a5f1353', '10.2.2.100', None, None, None, None), ('091904c2-e347-4577-8af4-db257a5f1353', '10.2.2.200', None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:33:15.236529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.237188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.238359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.238975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.660335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:15.670459 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd3a21ea-da50-443e-b9b2-300d4ab57fd3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.444599 Jul 28 11:33:15.688151 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1090/2176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:15 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:15.693854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:15.694787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:15.702825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.703589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:15.704683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:15.705384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:16.107992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] Lazy-loading 'services' on Instance uuid ebee2d74-e07c-4280-94da-ebe7035490d6 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:16.145691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5de61718-66eb-409a-a1a6-7d5dbe58ba30 tempest-LiveAutoBlockMigrationV225Test-852262219 tempest-LiveAutoBlockMigrationV225Test-852262219-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1971 microversion: 2.25 time: 0.455440 Jul 28 11:33:16.146307 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1091/2177] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:15 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1971 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:16.153460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:16.154088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:16.171879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:16.173982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:16.180150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:16.180820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:16.496699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:16.506152 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7d3cea2a-3400-403e-aa53-8c5834786ac1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.358776 Jul 28 11:33:16.507987 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1092/2178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:16 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:16.513293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c18c3b41-899d-473e-88b1-c6d31c52c02b req-bb9b5be1-e36d-4c04-89d5-cfd571d75a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "name": "network-vif-plugged", "status": "completed", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:16.525993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c18c3b41-899d-473e-88b1-c6d31c52c02b req-bb9b5be1-e36d-4c04-89d5-cfd571d75a74 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:16.526718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c18c3b41-899d-473e-88b1-c6d31c52c02b req-bb9b5be1-e36d-4c04-89d5-cfd571d75a74 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:16.557842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c18c3b41-899d-473e-88b1-c6d31c52c02b req-bb9b5be1-e36d-4c04-89d5-cfd571d75a74 service nova] Creating event network-vif-plugged:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:33:16.571275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c18c3b41-899d-473e-88b1-c6d31c52c02b req-bb9b5be1-e36d-4c04-89d5-cfd571d75a74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061811 Jul 28 11:33:16.575512 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1093/2179] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:16.589008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:16.589760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:16.602113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:16.603135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:16.609695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:16.612423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.233138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:17.248080 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab81d670-aae6-4a88-9e18-b153bc5e5042 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.665200 Jul 28 11:33:17.249068 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1094/2180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:16 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:17.258484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:17.260489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:17.275980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.276450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.277979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.278636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.336868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:17.514039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55c8fa28-34ab-4332-aaad-057cfa933b4e tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 204 len: 0 microversion: 2.25 time: 0.263458 Jul 28 11:33:17.519011 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1095/2181] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:33:17 2022] DELETE /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:33:17.527052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:17.527792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:17.543133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.543604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.544407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.544844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.904091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:17.911675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:17.914223 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-574158a8-70b0-47c1-9b95-1d7539ce8183 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.393596 Jul 28 11:33:17.919860 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1096/2182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:17 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:17.935328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:17.938671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:17.966031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.966724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:17.973725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:17.974492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:18.921112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:18.935501 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf0da3d7-160c-4dec-9a4e-0e5b35eb4f5f tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 1.008766 Jul 28 11:33:18.936371 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1097/2183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:17 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:18.958569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:18.960142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:18.972895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:18.973658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:18.974680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:18.976413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:19.874781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:19.891850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:19.896734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:19.900986 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57c3fd0e-1ecc-40e5-8241-072c2bdc8b26 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1484 microversion: 2.25 time: 0.947028 Jul 28 11:33:19.911335 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1098/2184] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:18 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1484 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:19.926060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:19.928039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:19.957546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:19.958254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:19.959319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:19.961007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:20.481947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:20.499316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-07b4f95d-921b-4b35-bf91-17163f664682 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1519 microversion: 2.1 time: 0.586467 Jul 28 11:33:20.500511 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1099/2185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:19 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1519 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:20.505868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:20.511497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:20.527553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:20.528306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:20.529283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:20.529904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.039839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:21.051949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3e18c9c-a08b-4027-abbb-e5fe82025b0c tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.548121 Jul 28 11:33:21.052795 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1100/2186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:20 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:21.063553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6bac3365-9616-4fb2-aa27-84a8ad71021f req-d9580154-3f5e-4180-ae8c-c04a6e0e61b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "name": "network-vif-unplugged", "status": "completed", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:21.083537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6bac3365-9616-4fb2-aa27-84a8ad71021f req-d9580154-3f5e-4180-ae8c-c04a6e0e61b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.084272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6bac3365-9616-4fb2-aa27-84a8ad71021f req-d9580154-3f5e-4180-ae8c-c04a6e0e61b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.102348 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6bac3365-9616-4fb2-aa27-84a8ad71021f req-d9580154-3f5e-4180-ae8c-c04a6e0e61b7 service nova] Creating event network-vif-unplugged:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h2-851368-1 Jul 28 11:33:21.108636 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6bac3365-9616-4fb2-aa27-84a8ad71021f req-d9580154-3f5e-4180-ae8c-c04a6e0e61b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049621 Jul 28 11:33:21.110640 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1101/2187] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:21.118987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fcc79b41-637e-4012-ba6c-1fe8d9610cff req-95c5beb8-b27c-450b-b743-b76d264c05d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-plugged", "status": "completed", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:21.133046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fcc79b41-637e-4012-ba6c-1fe8d9610cff req-95c5beb8-b27c-450b-b743-b76d264c05d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.133780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fcc79b41-637e-4012-ba6c-1fe8d9610cff req-95c5beb8-b27c-450b-b743-b76d264c05d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.162071 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fcc79b41-637e-4012-ba6c-1fe8d9610cff req-95c5beb8-b27c-450b-b743-b76d264c05d0 service nova] Creating event network-vif-plugged:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:33:21.169037 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fcc79b41-637e-4012-ba6c-1fe8d9610cff req-95c5beb8-b27c-450b-b743-b76d264c05d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055909 Jul 28 11:33:21.170183 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1102/2188] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:21.185168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:21.187896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:21.197025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.198452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.199610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.200297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.754601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:21.763583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be528f96-8c6f-446e-bd6f-4d8c0b35f8e7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.591890 Jul 28 11:33:21.764719 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1103/2189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:21 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:21.770679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:21.771505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:21.778558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.779017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:21.780130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:21.780576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.044948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:33:22.046474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:33:22.048596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:33:22.049381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:33:22.050221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:33:22.066451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.067323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.068541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.069499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.072113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:22.080970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4bcbd307-e8a7-43e0-b724-5669335b0df9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.314963 Jul 28 11:33:22.082361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1104/2190] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:21 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:22.084423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:22.095187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Getting quotas for project ced4fe632ca9495d9e703b2488d55094. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:33:22.102009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e7fcd225-afe5-4334-be98-ed6554d4d62a req-94882f7f-3914-425b-ba41-2f4400a86612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebee2d74-e07c-4280-94da-ebe7035490d6", "name": "network-vif-deleted", "tag": "df70f3b2-13f3-48b4-93df-09cc28c506a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:22.102562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Getting quotas for user 9076d0f6075a4e6aad7a2dfd2797b1a8 and project ced4fe632ca9495d9e703b2488d55094. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:33:22.119664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e7fcd225-afe5-4334-be98-ed6554d4d62a req-94882f7f-3914-425b-ba41-2f4400a86612 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.120124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e7fcd225-afe5-4334-be98-ed6554d4d62a req-94882f7f-3914-425b-ba41-2f4400a86612 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.139234 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e7fcd225-afe5-4334-be98-ed6554d4d62a req-94882f7f-3914-425b-ba41-2f4400a86612 service nova] Creating event network-vif-deleted:df70f3b2-13f3-48b4-93df-09cc28c506a5 for instance ebee2d74-e07c-4280-94da-ebe7035490d6 on n-h2-851368-1 Jul 28 11:33:22.148567 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e7fcd225-afe5-4334-be98-ed6554d4d62a req-94882f7f-3914-425b-ba41-2f4400a86612 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064508 Jul 28 11:33:22.149400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1105/2191] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:22.154808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:22.160600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:22.166228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:22.168093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.168599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.169460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.169930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.279354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:22.292308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:22.294085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:22.295550 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d01525d5-054a-44b5-b170-0be83d8928e1 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1266 microversion: 2.25 time: 0.144817 Jul 28 11:33:22.311219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1106/2192] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:22 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:22.316869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:22.317669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:22.324163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.324927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.325897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.326501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.365183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:33:22.369180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='600b4bd5-85ca-4feb-8d63-baa4c5158f60',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1b806e20-f8ec-4c39-bdeb-80921e21b980',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d387d6a-6f6c-405f-be8d-f02872e7893a',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:33:22.579730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:22.590822 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1731df5-df01-42a5-beaa-08029a4b3fe4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.277940 Jul 28 11:33:22.599567 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1107/2193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:22 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:22.613783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:22.614291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:22.629924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.631316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.632837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.633286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.833974 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5c88f66-0d06-4ce0-8429-83eca24b2d0d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.842984 Jul 28 11:33:22.835305 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1087/2194] 10.222.0.93 () {62 vars in 1189 bytes} [Thu Jul 28 11:33:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 7846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:33:22.845863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:22.846776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:22.856180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.856902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:22.859635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:22.860398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.119242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.130958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d20143c1-f565-480f-9315-134bc1b06805 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.529060 Jul 28 11:33:23.147172 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1108/2195] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:22 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:23.147172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:23.147172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:23.163438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.163944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.165113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.165765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.300045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.310404 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-749cfa2c-5143-449a-ab5f-7672ec4f95b5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.473698 Jul 28 11:33:23.326402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1088/2196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:22 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:23.336380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:23.336380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:23.472148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.483497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.485545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.487493 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da7a139b-23eb-452d-85b7-8ca022625f6f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1285 microversion: 2.42 time: 0.159336 Jul 28 11:33:23.489148 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1089/2197] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:23 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:23.506765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:23.508176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:23.531927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.532699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.533697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.534155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.549514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.559556 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e222cde9-ffff-4acb-a7d5-993d2df33a84 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.420466 Jul 28 11:33:23.560441 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1109/2198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:23 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:23.571962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:23.572990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}, {"name": "network-changed", "server_uuid": "cbe9ae38-2d4a-46ad-9c98-379998279c3e", "tag": "4ba58e10-1327-49f7-83f9-a05abe98290b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:23.595706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.596415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.611102 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] Creating event network-changed:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h2-851368-1 Jul 28 11:33:23.611911 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] Creating event network-changed:4ba58e10-1327-49f7-83f9-a05abe98290b for instance cbe9ae38-2d4a-46ad-9c98-379998279c3e on n-h1-851368-1 Jul 28 11:33:23.623945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ca602920-290f-4e3d-be3b-8eb29aabbd46 req-23eae118-7b78-49ae-9dbf-bd1ffe7c3236 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061012 Jul 28 11:33:23.625176 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1110/2199] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:23.632984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:23.634019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:23.641116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.642403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.643461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.644088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.816941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.828338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.830513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:23.831890 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10d43b49-f631-406d-8f4e-f62b9e3df023 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1266 microversion: 2.25 time: 0.204839 Jul 28 11:33:23.832707 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1111/2200] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:23 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:23.838063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:23.838877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:23.846093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.846938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:23.847998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:23.848616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.120619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:24.129710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcae708b-c547-44d3-8837-1e5a02e2eb95 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.639379 Jul 28 11:33:24.136853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1090/2201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:23 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:24.162193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:24.162921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:24.178335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.179205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.181711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.184392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.356118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:24.365476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-021e36ed-1420-4cff-8ab2-8fc16f2a3c21 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.531415 Jul 28 11:33:24.380039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1112/2202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:23 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:24.387988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe05e76e-ceca-4526-95fd-f5cfde72abed tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:24.394507 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fe05e76e-ceca-4526-95fd-f5cfde72abed tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe05e76e-ceca-4526-95fd-f5cfde72abed tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/e4c91bf7-4be1-456e-bf7a-c34ea7405242/action HTTP/1.1 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: {"os-stop": {}} Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e4c91bf7-4be1-456e-bf7a-c34ea7405242', 'body': {'os-stop': {}}} Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:24.399810 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe05e76e-ceca-4526-95fd-f5cfde72abed tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance e4c91bf7-4be1-456e-bf7a-c34ea7405242 has no mapping to a cell. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe05e76e-ceca-4526-95fd-f5cfde72abed tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/e4c91bf7-4be1-456e-bf7a-c34ea7405242/action" status: 404 len: 117 microversion: 2.1 time: 0.018470 Jul 28 11:33:24.406420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1113/2203] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:24 2022] POST /compute/v2.1/servers/e4c91bf7-4be1-456e-bf7a-c34ea7405242/action => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:33:24.415502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:24.415956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:24.425401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.425401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.426244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.426694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.847091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:24.860055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2088a6b5-1e37-4cd0-b34e-5530b9b26288 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.701372 Jul 28 11:33:24.862112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1091/2204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:24 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:24.869222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:24.870515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:24.874518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:24.880858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.882330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:24.883690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:24.885639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.001521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.009058 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6071ed85-869c-4771-9535-82a78b291acb tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.597552 Jul 28 11:33:25.009713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1114/2205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:24 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:25.022235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.023532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.030808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.031545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.033301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.033918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.097383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.120664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.123143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.124560 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6243e55c-1003-458c-b575-04dfbb4d7661 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1583 microversion: 2.42 time: 0.260981 Jul 28 11:33:25.126741 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1092/2206] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:24 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1583 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:25.154324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.155790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.176359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.177274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.180916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.182169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.341954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.353594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.362365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.369398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.371217 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8ce7a3b-d6d3-42c7-8a17-7047079f1dbd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.358140 Jul 28 11:33:25.372449 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1115/2207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:25.374224 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06b11417-dbc6-4ef2-9eae-4e7c7b204ff0 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1266 microversion: 2.25 time: 0.245681 Jul 28 11:33:25.378011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.378541 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1093/2208] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:25.379204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.386566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.387356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.388449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.389105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.409193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.410005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.420025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.420995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.422623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.426406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.617237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.629823 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd42a60c-ad50-4744-9550-793216b16a32 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.256010 Jul 28 11:33:25.633405 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1116/2209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:25.657847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:25.658847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 677564a7-67cd-476d-a26f-5dfa28ef3c03] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.666276 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/677564a7-67cd-476d-a26f-5dfa28ef3c03/action HTTP/1.1 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: {"suspend": {}} Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '677564a7-67cd-476d-a26f-5dfa28ef3c03', 'body': {'suspend': {}}} Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:25.668711 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:25.675367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:25.675367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:25.675367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. Jul 28 11:33:25.675367 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:25.676789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 677564a7-67cd-476d-a26f-5dfa28ef3c03 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:25.677916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1e1f665-2610-4a1b-b0a4-9cea9fcdb766 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/677564a7-67cd-476d-a26f-5dfa28ef3c03/action" status: 404 len: 111 microversion: 2.1 time: 0.025484 Jul 28 11:33:25.679110 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1117/2210] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:25 2022] POST /compute/v2.1/servers/677564a7-67cd-476d-a26f-5dfa28ef3c03/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:33:25.687740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.688810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.697763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.698593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.699773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.700536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.706356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:25.744166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.764900 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c91dd9d-60b5-4577-b3ee-372135152b7c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1477 microversion: 2.1 time: 0.383508 Jul 28 11:33:25.768389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1094/2211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:25.888361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.889136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.904085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.905965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.907888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.908985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.942157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:25.952683 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e36335b-f892-4870-9501-c244587be3cd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.269635 Jul 28 11:33:25.954929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1118/2212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:25.980704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:25.981624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:25.988862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.989674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:25.990689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:25.991409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.237961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.249968 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e04738d-54a0-42b7-ad4d-203e893de92e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.272069 Jul 28 11:33:26.250689 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1119/2213] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:26.274768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:26.278502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.292437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.293211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.294204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.296769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.319188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.330893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf85ed1c-71e5-455a-808c-223bf79b2afd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.447180 Jul 28 11:33:26.333807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1095/2214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:25 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:26.342238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:26.342789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.361768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.362745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.366052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.366522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.423979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'flavor' on Instance uuid 037232de-716c-4380-9033-c2c3d8c09598 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:26.481875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.499271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.501674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.504336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77803aaa-e062-4728-908e-5250825c33fa tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1593 microversion: 2.42 time: 0.239481 Jul 28 11:33:26.507463 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1120/2215] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:26 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1593 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:26.526908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:26.527817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.558136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.559280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.562562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.567703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.599616 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24726aed-8856-4330-80f6-ff61a588579a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.264440 Jul 28 11:33:26.603638 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1096/2216] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:26 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:33:26.633516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:26.634258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.649016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.649749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.650319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.650771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.810651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.823689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.825133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.826801 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2053728-86d4-41ed-a6fd-e29b698d50f3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 200 len: 1266 microversion: 2.25 time: 0.220208 Jul 28 11:33:26.826948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1097/2217] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:26 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:26.843206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:26.843840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.853224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:26.854553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.855016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.855845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.856302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.878905 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-816e27d2-a344-442f-abbf-efa7dad58fd3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.366909 Jul 28 11:33:26.881715 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1121/2218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:26 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:26.908731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:26.910728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:26.917712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.920554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:26.921574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:26.922186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.259433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:27.274680 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16ddc393-060e-40dd-83bb-cf8591a30c42 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1514 microversion: 2.1 time: 0.442578 Jul 28 11:33:27.278826 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1098/2219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:26 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1514 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:27.337541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:27.348874 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8c0cc49-ca45-4935-8817-fdabcf467dcf tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1463 microversion: 2.1 time: 0.461457 Jul 28 11:33:27.360661 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1122/2220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:26 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:27.370940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:27.371283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:27.371713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:27.373546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:27.381465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.382382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.383824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.384605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.393789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.394293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.408926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.409619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.873278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:27.889292 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ca426d3-32d3-4272-b6f9-88045658b2d1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1463 microversion: 2.1 time: 0.522272 Jul 28 11:33:27.907716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1123/2221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:27 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1463 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:27.918794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:27.928403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:27.945090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.948648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:27.956308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:27.958084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.071722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.082632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6e72770c-fab2-45f0-ae3d-efa4c1adaafc tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.720276 Jul 28 11:33:28.097853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1099/2222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:27 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:28.103272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:28.104143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ebee2d74-e07c-4280-94da-ebe7035490d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.114853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.117798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.129373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.130439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.159994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] HTTP exception thrown: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Request method failure captured: Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 HTTP/1.1 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJRgGQ72MPx4stskHUG30e5z7PecgBylSDMNk8KaS2o0NabPtIX-ahmT7reZP7vav04FZwEuHuo97tN5g9miEMnNRe6CZ26WBv2l8t9VeTCbXRn-Y7cYyv6pDQhIrv7wxc0-DtBDA-SpgXCfTQeHb9Fs4TsdsB6IXfnV_98m-6oTfI Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2367458a06b245769d5851becc658136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2367458a06b245769d5851becc658136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}] Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ccea87d21921492f8544e0e81ea485d5 Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'ebee2d74-e07c-4280-94da-ebe7035490d6'} Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. Jul 28 11:33:28.161976 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. Jul 28 11:33:28.167598 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.169212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Returning 404 to user: Instance ebee2d74-e07c-4280-94da-ebe7035490d6 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:28.170256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b0645d4-5990-4470-8bd8-9d0b46dd07cd tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6" status: 404 len: 111 microversion: 2.25 time: 0.071084 Jul 28 11:33:28.174966 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1100/2223] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:28 2022] GET /compute/v2.1/servers/ebee2d74-e07c-4280-94da-ebe7035490d6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:33:28.182084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:28.189100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.209002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.210063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.211103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.211747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.379748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.397041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.401891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.405758 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-391f9fe4-8455-452b-a417-2a408e37a494 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1660 microversion: 2.42 time: 0.496088 Jul 28 11:33:28.411348 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1124/2224] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:27 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1660 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:28.429632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:28.437148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.453008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.453466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.457197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.461900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.533649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.542004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b94e6d17-73ca-4cb2-ab19-7dc6edce8841 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.365683 Jul 28 11:33:28.561622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1101/2225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:28 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:28.577258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:28.577915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.585406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.585868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.586663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.590765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.607869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:33:28.608304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:33:28.608787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:33:28.609207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:33:28.609629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:33:28.808968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.822668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.822668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.823757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.825018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.865259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:28.880264 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3452744e-ed97-4970-b6c5-6740130c9fb2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1497 microversion: 2.1 time: 0.317314 Jul 28 11:33:28.884071 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1102/2226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:28 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:28.896713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ceb25e20-8054-4307-9a26-683a016f3dc9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 1067 microversion: 2.1 time: 0.481421 Jul 28 11:33:28.913473 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1125/2227] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:28 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 1067 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 11:33:28.913709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b0ff0c16-272d-4451-8b57-710d7d463229 req-768f83a6-63a5-40e1-8187-4a8980a17c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "name": "network-vif-unplugged", "status": "completed", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:28.920703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:28.921211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.928965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b0ff0c16-272d-4451-8b57-710d7d463229 req-768f83a6-63a5-40e1-8187-4a8980a17c82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.929462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b0ff0c16-272d-4451-8b57-710d7d463229 req-768f83a6-63a5-40e1-8187-4a8980a17c82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.930596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.931399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.932713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.933259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.960268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b0ff0c16-272d-4451-8b57-710d7d463229 req-768f83a6-63a5-40e1-8187-4a8980a17c82 service nova] Creating event network-vif-unplugged:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h2-851368-1 Jul 28 11:33:28.965170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'flavor' on Instance uuid 037232de-716c-4380-9033-c2c3d8c09598 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:28.974176 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b0ff0c16-272d-4451-8b57-710d7d463229 req-768f83a6-63a5-40e1-8187-4a8980a17c82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088099 Jul 28 11:33:28.974798 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1103/2228] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:28.980632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:28.981298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:28.984465 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'suspend' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state suspended Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: {"suspend": {}} Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: exception: Cannot 'suspend' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state suspended Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'suspend': {}}} Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 28 11:33:28.986445 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state suspended Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state suspended Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'suspend' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state suspended {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:28.992065 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-840aa98f-9508-4109-90cf-4ec2d3ca74d0 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 148 microversion: 2.1 time: 0.083604 Jul 28 11:33:28.995119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1126/2229] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:28 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 148 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:33:28.996639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.997097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:28.997897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:28.998342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.000111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:29.001307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:29.008708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.009186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.009955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.010391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.143153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8c71a58-6415-482d-8fff-abe4b3fa92be tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 202 len: 0 microversion: 2.1 time: 0.146298 Jul 28 11:33:29.144432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1127/2230] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:28 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:33:29.151886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:29.152987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:29.194559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.196238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.197276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.197860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.264516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.273065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70dbd45a-f80f-4c4e-a183-43e4c20bde99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.297014 Jul 28 11:33:29.285147 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1104/2231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:28 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:29.317912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:29.318545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:29.330686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.331075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.344108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.344753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.539832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.550702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e526d65-a4d1-4c49-886d-34aabcfbfcd3 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.404935 Jul 28 11:33:29.551347 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1128/2232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:29 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:29.563654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:29.563654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:29.579900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.589381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dae600a3-087a-4eb0-973c-5101cd7f032e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1503 microversion: 2.1 time: 0.291735 Jul 28 11:33:29.589972 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1105/2233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:29 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:29.603888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:29.603888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:29.605356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.605817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.606612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.607054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.614240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.614700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.615564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:29.615991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:29.653154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:29.853079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.862479 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-644aca28-5aea-4ff0-8c1a-c3b8ecf6785e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.271417 Jul 28 11:33:29.873025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1106/2234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:29 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:29.905975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.918734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.920623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:29.922194 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f61683b4-c25a-401c-b4ac-bbea5c286a33 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1660 microversion: 2.42 time: 0.369913 Jul 28 11:33:29.924159 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1129/2235] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:29 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1660 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:30.315057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:30.315789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:30.341055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.345641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:30.348819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.350149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:30.577436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:30.578417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:30.592801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.593609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:30.595989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.596621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:30.699958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:30.711239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9fd123e9-7e67-47dd-81a2-624dc2abe9b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.401158 Jul 28 11:33:30.717858 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1107/2236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:30 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:30.723438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:30.728251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:30.744128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.747045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:30.748622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:30.751324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.196103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:31.210309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-883ec575-8829-4ad3-9927-8e6371a3cf25 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.637577 Jul 28 11:33:31.211250 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1130/2237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:30 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:31.215820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:31.216434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:31.227907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:31.228369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.240113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:31.240576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.314051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:31.339257 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54c5c403-dcdc-4805-8215-7cdbb8f8cede tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1503 microversion: 2.1 time: 0.619781 Jul 28 11:33:31.343853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1108/2238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:30 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1503 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:31.357437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:31.359693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:31.386674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:31.388282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.390082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:31.393885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.517306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:31.522134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:31.529727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ed40ba0-f30d-44af-a1c8-e3891191ea56 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.317316 Jul 28 11:33:31.531004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1131/2239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:31 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:31.536105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8987b949-8231-454d-9c14-b47ee2e3f68d req-e332f30f-26b0-4c53-bcf9-1e88310eb65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe9ae38-2d4a-46ad-9c98-379998279c3e", "name": "network-vif-plugged", "status": "completed", "tag": "4ba58e10-1327-49f7-83f9-a05abe98290b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:31.573768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8987b949-8231-454d-9c14-b47ee2e3f68d req-e332f30f-26b0-4c53-bcf9-1e88310eb65f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:31.574311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8987b949-8231-454d-9c14-b47ee2e3f68d req-e332f30f-26b0-4c53-bcf9-1e88310eb65f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:31.612531 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8987b949-8231-454d-9c14-b47ee2e3f68d req-e332f30f-26b0-4c53-bcf9-1e88310eb65f service nova] Creating event network-vif-plugged:4ba58e10-1327-49f7-83f9-a05abe98290b for instance cbe9ae38-2d4a-46ad-9c98-379998279c3e on n-h1-851368-1 Jul 28 11:33:31.625229 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8987b949-8231-454d-9c14-b47ee2e3f68d req-e332f30f-26b0-4c53-bcf9-1e88310eb65f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091952 Jul 28 11:33:31.627162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1132/2240] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:32.083447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:32.092303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4204cdb2-84e2-4df4-86be-3bbc7029b28b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Action: 'create', calling method: .version_select at 0x7f2eb22aae50>, body: {"keypair": {"name": "tempest-keypair-1359614044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoVsR+SkgEwMNvIvd7jD4CvzcHMwV/A0VV8L/RKB9uzW8ZwobhZiEu6Osigvv3KB66faOhSpu/ccv9+6o+YaBZZcT2f+nKhvmtkMyWGMmazVZucewohLWev3PFuHhB/OQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:32.125698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:32.135168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:32.137638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4204cdb2-84e2-4df4-86be-3bbc7029b28b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:33:32.143717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4204cdb2-84e2-4df4-86be-3bbc7029b28b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for user d79daea187ea48f6a2dbf47751ea0d84 and project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:33:32.145023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:32.146200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-472215fa-87f8-46b2-b8dd-4c8a1116f963 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1706 microversion: 2.42 time: 0.800708 Jul 28 11:33:32.146734 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1109/2241] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:31 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1706 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:32.157805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:32.163051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:32.177819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.178559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.179383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.179828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.195364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4204cdb2-84e2-4df4-86be-3bbc7029b28b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.565086 Jul 28 11:33:32.199916 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1133/2242] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:33:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:32.233377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:32.234539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:32.250387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.251413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.255237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.257015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.762338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:32.771452 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5316549f-ee6a-4e8b-a65c-79b96941d275 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.543531 Jul 28 11:33:32.772047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1134/2243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:32 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:32.781920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:32.792811 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d64a317b-b270-4611-a7db-d6a9223f04b2 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.639252 Jul 28 11:33:32.793774 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1110/2244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:32 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:32.796605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:32.797273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:32.807150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:32.807777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:32.833314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.833785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.834851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.835326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.841587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.842051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:32.842860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:32.843339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.202643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.214632 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a63879fd-b517-43e4-9db6-ba6ccf530d5f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.428261 Jul 28 11:33:33.215635 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1135/2245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:32 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:33.221034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:33.221648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:33.233783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.242045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.246708 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c742e4d-9110-46fe-98a2-9d0725cfc3f7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1314 microversion: 2.1 time: 0.443260 Jul 28 11:33:33.247911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1111/2246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:32 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:33.248891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.251466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.252198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.255926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:33.259749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:33.269079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.269848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.279967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.280812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.481264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:33.517916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.535605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.537135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.538349 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ecc50fa-c400-4b63-96b6-cf7e3aa68740 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1752 microversion: 2.42 time: 0.321680 Jul 28 11:33:33.538928 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1136/2247] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:33 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1752 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:33.678914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:33.687000 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0c6733a-8815-42df-a987-d5bb1d3e549e tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.436787 Jul 28 11:33:33.691337 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1112/2248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:33 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:33.718149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:33.718709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: b9e6c4bd-5a16-45a9-a32b-928f99be3f9f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:33.730537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/b9e6c4bd-5a16-45a9-a32b-928f99be3f9f/action HTTP/1.1 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: {"unpause": {}} Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'b9e6c4bd-5a16-45a9-a32b-928f99be3f9f', 'body': {'unpause': {}}} Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:33.736864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:33.742888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:33.742888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:33.742888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. Jul 28 11:33:33.742888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:33.744052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance b9e6c4bd-5a16-45a9-a32b-928f99be3f9f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:33.748582 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e1970d2-c4d5-4159-a2fb-6ac9e15dd40f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/b9e6c4bd-5a16-45a9-a32b-928f99be3f9f/action" status: 404 len: 111 microversion: 2.1 time: 0.035027 Jul 28 11:33:33.755129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1137/2249] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:33 2022] POST /compute/v2.1/servers/b9e6c4bd-5a16-45a9-a32b-928f99be3f9f/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:33.758870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:33.814103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:33.814103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.814103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.814103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.814103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.815194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:33.815194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:33.841514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.841965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:33.842787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:33.844692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.288439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:34.302642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-82f7acd1-aed1-4f00-8239-62d49eb49d55 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.546469 Jul 28 11:33:34.306407 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1113/2250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:33 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:34.316398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:34.319215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:34.333839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.336020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.340895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.343835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.404732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:34.430749 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e99a21c8-a54c-4739-aa44-07190857c848 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.627620 Jul 28 11:33:34.435153 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1138/2251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:33 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:34.450698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:34.455196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:34.470127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.474547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.476232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.481795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.667673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:34.678723 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56108d79-ea1b-4d8a-8315-527e7a9022a6 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.369476 Jul 28 11:33:34.680718 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1114/2252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:34 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:34.692501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:34.693450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:34.704614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.707644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.710145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.713179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.782699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:34.793774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3f37f43-be2a-445b-8ba9-693d38b9b189 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1501 microversion: 2.1 time: 0.356057 Jul 28 11:33:34.807777 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1139/2253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:34 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1501 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:34.821936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:34.822790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:34.836948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.837988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.838948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:34.839554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:34.996851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.015789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91cd5154-e0b7-4f10-af72-6f4c1c463394 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.333719 Jul 28 11:33:35.019824 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1115/2254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:34 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:35.029120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:35.029913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.048937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.049399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.050232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.050678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.218508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5029ec5f-e92c-410d-8cb0-090ac710faa3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.194457 Jul 28 11:33:35.221059 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1116/2255] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:35 2022] POST /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:33:35.239817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:35.243262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.258023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.264370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.271617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.272938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.303532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.316054 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'unpause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 15 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: {"unpause": {}} Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'unpause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'unpause': {}}} Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state active. Cannot unpause while the instance is in this state. Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:35.317754 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:35.320778 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:35.320778 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:35.320778 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:35.320778 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:35.320778 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:35.323434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'unpause' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:35.324616 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b86bdcc-6b46-4288-bce9-2c71f655eef1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 145 microversion: 2.1 time: 0.099212 Jul 28 11:33:35.326749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.329383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.330843 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1117/2256] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:35 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 145 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:33:35.337288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb49d4d4-2345-44fa-a588-e5872d8ba9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1798 microversion: 2.42 time: 0.527968 Jul 28 11:33:35.338870 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1140/2257] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:34 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1798 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:35.349318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:35.349767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:35.350910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.351302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.358230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.358915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.364347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.364715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.365495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.371771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.377228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.377963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.674397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.683742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62c0278e-c1d1-4dc1-96cf-f641dcbc0db5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.343516 Jul 28 11:33:35.688557 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1141/2258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:35 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:35.688851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:35.699003 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd9a2035-7453-446c-8913-5e4de9c12dad tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1506 microversion: 2.1 time: 0.366959 Jul 28 11:33:35.701292 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1118/2259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:35 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:35.701892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:35.702636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.713821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:35.718790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:35.727040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.727658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.728656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.729253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.729912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.731614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:35.732586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:35.737308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.043352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:36.054665 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1bdb6cd1-dde6-428d-a9f5-46ff24212a12 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1393 microversion: 2.1 time: 0.364500 Jul 28 11:33:36.055853 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1142/2260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:35 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1393 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:36.067180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:36.068668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:36.088729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.089413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.090362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.090950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.095297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:36.111938 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9317e0ab-bc56-42ad-82e5-d87548f91ed4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.402166 Jul 28 11:33:36.128260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1119/2261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:35 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:36.314508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:36.322748 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9efb3ce3-ae8f-4ae3-b194-6e2574d1c192 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.265679 Jul 28 11:33:36.327898 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1143/2262] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:36 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:36.346984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:36.347644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: e5961c86-cc72-4820-ac2c-ed5508376912] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:36.362059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:36.362687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:36.368470 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. Jul 28 11:33:36.378250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/e5961c86-cc72-4820-ac2c-ed5508376912/action HTTP/1.1 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 18 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: {"unshelve": null} Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e5961c86-cc72-4820-ac2c-ed5508376912', 'body': {'unshelve': None}} Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:36.379005 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. Jul 28 11:33:36.382668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:36.386236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.386915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance e5961c86-cc72-4820-ac2c-ed5508376912 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:36.388593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db941416-0a8d-4476-8ebf-b367e3046fa5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/e5961c86-cc72-4820-ac2c-ed5508376912/action" status: 404 len: 111 microversion: 2.1 time: 0.046396 Jul 28 11:33:36.392625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.393089 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1120/2263] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:36 2022] POST /compute/v2.1/servers/e5961c86-cc72-4820-ac2c-ed5508376912/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:36.393846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.408891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:36.411817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:36.432911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.433597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:36.434559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:36.439048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.346134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.369300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.376218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.380027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-273990fb-cdd8-4f19-8dc7-ccb094466122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1798 microversion: 2.42 time: 1.022020 Jul 28 11:33:37.386699 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1144/2264] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:36 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1798 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:33:37.394457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:37.402646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.412085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:37.416886 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7836efb1-4eeb-459c-b0b9-d77439612a91 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 1.019906 Jul 28 11:33:37.417499 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1121/2265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:36 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:37.423401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.427388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:37.428621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:37.429083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.430053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.432341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.445310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.448967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.450067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.450650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.786142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.803092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bddd07d6-8b5b-4111-84b4-96c49f1f2d6e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1383 microversion: 2.1 time: 0.383084 Jul 28 11:33:37.818045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:37.822512 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1122/2266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:37 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1383 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:37.827404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:37.833190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:37.844075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.845072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.846311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.847784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.848570 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-548769a4-b56b-4ff0-9636-d8791b32b9bd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1486 microversion: 2.1 time: 0.459919 Jul 28 11:33:37.851158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1145/2267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:37 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1486 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:37.856840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:37.857690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:37.866466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.867149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.868137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:37.868958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:37.884191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:38.113669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:38.123659 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d535f117-2775-41f8-bb78-2e949bcfd61c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.299924 Jul 28 11:33:38.143362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1123/2268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:37 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:38.145818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:38.148109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-340aedcb-193b-4035-a5d7-e559c8a60486 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '.version_select at 0x7f2eb2fc7ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.151930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340aedcb-193b-4035-a5d7-e559c8a60486 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.152386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340aedcb-193b-4035-a5d7-e559c8a60486 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.161168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5fb3ea53-e967-48c6-90b5-d3d4bb1b4fd4 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.308730 Jul 28 11:33:38.176035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1146/2269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:37 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:38.188234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.189743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.208017 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-340aedcb-193b-4035-a5d7-e559c8a60486 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.063459 Jul 28 11:33:38.221836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.222295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.223167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.223559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.228127 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1124/2270] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:33:38 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:38.233202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:38.233815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.252177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.252884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.253829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.254421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.275657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:38.321546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Cannot 'unshelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action HTTP/1.1 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 18 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: {"unshelve": null} Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'unshelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'unshelve': None}} Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 037232de-716c-4380-9033-c2c3d8c09598 in vm_state active. Cannot unshelve while the instance is in this state. Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:33:38.331844 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active Jul 28 11:33:38.335221 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:38.340348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 409 to user: Cannot 'unshelve' instance 037232de-716c-4380-9033-c2c3d8c09598 while it is in vm_state active {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:38.341557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d200783-b1eb-4b23-ae30-dcc940c3706f tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action" status: 409 len: 146 microversion: 2.1 time: 0.112288 Jul 28 11:33:38.342333 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1125/2271] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:33:38 2022] POST /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598/action => generated 146 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:33:38.357899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.359140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.378183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.379136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.380321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.380971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.439058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:38.460845 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ccd88c7-c4b4-4666-b746-e6122646d770 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 204 len: 0 microversion: 2.1 time: 0.282259 Jul 28 11:33:38.473088 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1147/2272] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:33:38 2022] DELETE /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:33:38.503430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.507561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.522457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.527545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.529954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.531152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.774200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3847a178-aba8-4fb4-bcc6-4523fa8731d5 tempest-LiveMigrationTest-88728641 tempest-LiveMigrationTest-88728641-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1534 microversion: 2.1 time: 0.426347 Jul 28 11:33:38.775745 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1126/2273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:38 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1534 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:38.780656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.785967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.819001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.819498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.820322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.820766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.898273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:38.910637 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-119b3c4b-e44b-478e-b3fa-5ea885f5cc45 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.421124 Jul 28 11:33:38.911260 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1148/2274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:38 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:38.938574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:38.939437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:38.955311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.955685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.956758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:38.957209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:38.991549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:39.231253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.257614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.261021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.264211 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-702c67f6-40e1-4519-9655-59770534a175 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1844 microversion: 2.42 time: 0.487301 Jul 28 11:33:39.268610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1127/2275] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:38 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1844 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:39.276274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:39.276804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:39.288429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.288883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.291236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.291657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.343259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:39.345437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.353713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3dbf8f42-a092-4f5c-a900-f11bb93a99cd tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1492 microversion: 2.1 time: 0.436877 Jul 28 11:33:39.354298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1149/2276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:38 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1492 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:39.359984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:39.360607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:39.379030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.382201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.386343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.401923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.483646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31d46373-2ac5-4917-bc94-e2dec5715110 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 204 len: 0 microversion: 2.1 time: 0.213682 Jul 28 11:33:39.486804 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1128/2277] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:33:39 2022] DELETE /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:33:39.503658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-490266685", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "58cf4434-ca5a-4c20-9a34-866c10873d90"}], "security_groups": [{"name": "tempest-securitygroup--7125182"}], "key_name": "tempest-keypair-1359614044", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:39.664001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.674052 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0faf3e60-471a-495d-909c-e140e49414cf tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.317516 Jul 28 11:33:39.674891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] validate_networks() for [('58cf4434-ca5a-4c20-9a34-866c10873d90', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:33:39.676673 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1150/2278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:39 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:39.690122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:39.691648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:39.698124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.698754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.699599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.700039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.908523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:39.921246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb7c5c90-6308-45b2-99d7-6352e0615a03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.243414 Jul 28 11:33:39.926019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1151/2279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:39 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:39.937447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2c134e2e-6865-4e70-af53-26666a666b19 req-d1ae3734-9c86-452a-854d-9e610a71c589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "c1fba3ac-4c0c-450f-ae53-952d5aa51f4e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:39.957402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2c134e2e-6865-4e70-af53-26666a666b19 req-d1ae3734-9c86-452a-854d-9e610a71c589 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.961575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2c134e2e-6865-4e70-af53-26666a666b19 req-d1ae3734-9c86-452a-854d-9e610a71c589 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.972571 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2c134e2e-6865-4e70-af53-26666a666b19 req-d1ae3734-9c86-452a-854d-9e610a71c589 service nova] Creating event network-changed:c1fba3ac-4c0c-450f-ae53-952d5aa51f4e for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:39.977486 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2c134e2e-6865-4e70-af53-26666a666b19 req-d1ae3734-9c86-452a-854d-9e610a71c589 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048071 Jul 28 11:33:39.980982 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1152/2280] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:39.987362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:39.988079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:39.997072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.997531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:39.998718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:39.998841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.242629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.254358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2215ceec-1de1-4ea3-8e95-457b34673fad tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1389 microversion: 2.1 time: 0.271791 Jul 28 11:33:40.280555 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1153/2281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:39 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1389 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:40.306036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-919267068_updated"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:40.312680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 934262f6-61e5-43da-99f1-9aa818980b4a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.326918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/servers/934262f6-61e5-43da-99f1-9aa818980b4a HTTP/1.1 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 80 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-919267068_updated"}} Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '934262f6-61e5-43da-99f1-9aa818980b4a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-919267068_updated'}}} Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 28 11:33:40.330509 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 934262f6-61e5-43da-99f1-9aa818980b4a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:40.334118 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc7ea17a-1ca3-4880-81b3-6c41f8139dd5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "PUT /compute/v2.1/servers/934262f6-61e5-43da-99f1-9aa818980b4a" status: 404 len: 111 microversion: 2.1 time: 0.051063 Jul 28 11:33:40.339273 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1154/2282] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:33:40 2022] PUT /compute/v2.1/servers/934262f6-61e5-43da-99f1-9aa818980b4a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:40.348429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:40.349338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.361586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.362237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.363205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.363819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.411770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:33:40.412219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:33:40.412776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:33:40.413252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:33:40.413729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:33:40.424338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.425144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.426179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.426824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.446899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:33:40.452704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for user d79daea187ea48f6a2dbf47751ea0d84 and project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:33:40.467122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:33:40.470165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:33:40.551171 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e2fd335-f800-48ae-b9b3-ea0a848dbc53 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.062286 Jul 28 11:33:40.553400 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1129/2283] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:33:39 2022] POST /compute/v2.1/servers => generated 403 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:33:40.559118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:40.559985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.564995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.584098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.587861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.588336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.589308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.589494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.589744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.590885 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88cbf39d-bf6f-4be7-bd08-e79d8b6950a2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1844 microversion: 2.42 time: 0.249835 Jul 28 11:33:40.591652 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1155/2284] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:40 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1844 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:40.610470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:40.611208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.627494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.628031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.628913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.629715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.941371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.945925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:40.955943 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4127db3e-7d41-4f16-9fab-c389e6f49076 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.401083 Jul 28 11:33:40.956543 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1130/2285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:40 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:40.967308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-128e49a5-4a8a-4967-a00b-0ecaa6962237 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1492 microversion: 2.1 time: 0.366524 Jul 28 11:33:40.967308 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1156/2286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:40 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1492 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:40.968372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fcb640af-5d50-4521-80ac-b8616ad8372d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:40.974836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fcb640af-5d50-4521-80ac-b8616ad8372d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.981099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:40.981987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:40.989996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.990751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:40.991798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:40.992477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.241949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:41.244603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fcb640af-5d50-4521-80ac-b8616ad8372d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:41.254842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e94b4f3c-a694-4d06-bc33-f676f0472bc4 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.277293 Jul 28 11:33:41.256097 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1131/2287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:40 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:41.256479 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fcb640af-5d50-4521-80ac-b8616ad8372d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1241 microversion: 2.1 time: 0.293003 Jul 28 11:33:41.257478 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1157/2288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:40 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:41.275094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:41.276236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:41.277797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:41.279294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:41.285436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:41.288519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.289165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.291656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.292281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.293227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.293754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.294787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.295461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.534509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:41.548108 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe189088-190d-44b4-a761-5c60031011a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.290826 Jul 28 11:33:41.568328 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1132/2289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:41 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:41.576457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:41.576976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:41.593476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.594488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.596814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.597474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.666012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:41.702049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:41.715527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb17eb78-b715-483d-9652-04fede637009 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1389 microversion: 2.1 time: 0.442409 Jul 28 11:33:41.722030 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1158/2290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:41 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1389 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:41.728042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cabafb27-1dc8-4114-8f73-b8ef5cd239dd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cabafb27-1dc8-4114-8f73-b8ef5cd239dd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 HTTP/1.1 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 280 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.731937 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cabafb27-1dc8-4114-8f73-b8ef5cd239dd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:41.734916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cabafb27-1dc8-4114-8f73-b8ef5cd239dd tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 400 len: 619 microversion: 2.1 time: 0.010255 Jul 28 11:33:41.748031 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1159/2291] 10.222.0.93 () {60 vars in 1257 bytes} [Thu Jul 28 11:33:41 2022] PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:33:41.753998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:41.754751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:41.780440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.780896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.781717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.782155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.851876 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc451aa6-c537-436c-a66a-55114c1827f2 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 204 len: 0 microversion: 2.25 time: 0.261415 Jul 28 11:33:41.853527 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1133/2292] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:33:41 2022] DELETE /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:33:41.873862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:41.876067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:41.884649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.885110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:41.886152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:41.886769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.095590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.107321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.108898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.110654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f2b4a2d-9c45-431c-b773-b54e81759e4a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1844 microversion: 2.42 time: 0.361548 Jul 28 11:33:42.115683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1160/2293] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:41 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1844 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:42.120655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:42.121271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:42.128032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.128472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.129492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.130131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.180365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.190178 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94daa456-6a3e-43e7-bd1c-1bf2cff19fc7 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.331109 Jul 28 11:33:42.195594 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1134/2294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:41 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:42.200444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:42.205060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:42.219362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.220217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.221222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.223509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.589721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.608493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.616928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.620744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.622059 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a2855833-417e-4fbd-bff2-f86bb9f0755c tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1732 microversion: 2.25 time: 0.503683 Jul 28 11:33:42.635459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-112ac52c-b10d-4d79-9553-7b43b9e4dadc tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1492 microversion: 2.1 time: 0.436661 Jul 28 11:33:42.636634 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1161/2295] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:42 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1732 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:42.637311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1135/2296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:42 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1492 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:42.651409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:42.652458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:42.658777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:42.659555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:42.659669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.660392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.661420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.662381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.666317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.666885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.667890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.668433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.796366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:42.813566 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-625c265e-7bbd-4673-8b11-c0743669152c tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1299 microversion: 2.1 time: 0.171871 Jul 28 11:33:42.814535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1136/2297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:42 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:42.821908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:42.822840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:42.831855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.832604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.833836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:42.835412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:42.992874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.013402 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d34b612f-b3ab-429d-afdc-e57af27691a5 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.374841 Jul 28 11:33:43.015721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1162/2298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:42 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:43.021366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:43.022236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:43.030140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.031940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.035739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.036712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.156936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.170181 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-82832143-5c55-4e3c-a22a-0c9e21860803 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.353902 Jul 28 11:33:43.171043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1137/2299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:42 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:43.175684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0af1cd2-517b-4960-8b57-40dae43a0c34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0af1cd2-517b-4960-8b57-40dae43a0c34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 HTTP/1.1 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 24 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": ""}} Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598', 'body': {'server': {'name': ''}}} Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '' Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:33:43.179609 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:43.182988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0af1cd2-517b-4960-8b57-40dae43a0c34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:43.189378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0af1cd2-517b-4960-8b57-40dae43a0c34 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 400 len: 108 microversion: 2.1 time: 0.012603 Jul 28 11:33:43.190283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1138/2300] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:33:43 2022] PUT /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:33:43.200171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:43.201247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:43.212332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.212630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.214361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.214361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.239392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:43.366383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.377112 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93ae2b0e-deb2-4e3b-8ed7-7da42000d3ac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1389 microversion: 2.1 time: 0.359924 Jul 28 11:33:43.384593 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1163/2301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:43 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1389 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:43.396143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:43.397048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:43.403481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.412907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.415846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.416459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.664060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.678844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.685571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.692005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d85c43a4-08db-4657-b8f0-8f970ba386c5 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1865 microversion: 2.42 time: 0.496117 Jul 28 11:33:43.713226 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1139/2302] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:43 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1865 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:43.718435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bd5f1e1f-3460-4c56-a1e9-6dda2e5d559a req-b00bbc30-617f-4f61-a6e4-77e4bb45feca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe9ae38-2d4a-46ad-9c98-379998279c3e", "name": "network-vif-deleted", "tag": "4ba58e10-1327-49f7-83f9-a05abe98290b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:43.741798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd5f1e1f-3460-4c56-a1e9-6dda2e5d559a req-b00bbc30-617f-4f61-a6e4-77e4bb45feca service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.742407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd5f1e1f-3460-4c56-a1e9-6dda2e5d559a req-b00bbc30-617f-4f61-a6e4-77e4bb45feca service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.760933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bd5f1e1f-3460-4c56-a1e9-6dda2e5d559a req-b00bbc30-617f-4f61-a6e4-77e4bb45feca service nova] Creating event network-vif-deleted:4ba58e10-1327-49f7-83f9-a05abe98290b for instance cbe9ae38-2d4a-46ad-9c98-379998279c3e on n-h1-851368-1 Jul 28 11:33:43.780239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bd5f1e1f-3460-4c56-a1e9-6dda2e5d559a req-b00bbc30-617f-4f61-a6e4-77e4bb45feca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065446 Jul 28 11:33:43.781861 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1140/2303] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:43.790301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:43.791600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:43.801555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.802492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.803537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.804096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.814197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:43.830453 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-728965c5-26ac-44a9-9eae-e7a58923ce26 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1506 microversion: 2.1 time: 0.444550 Jul 28 11:33:43.847015 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1164/2304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:43 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:43.859119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:43.859793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:43.880402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.881847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:43.883564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:43.888148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.013589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.014329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.015169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'fault' on Instance uuid cbe9ae38-2d4a-46ad-9c98-379998279c3e {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:44.205520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:44.220271 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d8a0fb2-d743-4574-bb34-1ca07c954ef1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 200 len: 1304 microversion: 2.1 time: 0.371857 Jul 28 11:33:44.225970 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1165/2305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:43 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 1304 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:44.244150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:44.244778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:44.269219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.269674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.270465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.270906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.729019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:44.746718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:44.748819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:44.750780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-850d42fa-c346-4dcb-ad45-7a60798c560a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 200 len: 1732 microversion: 2.25 time: 0.967016 Jul 28 11:33:44.751859 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1141/2306] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:43 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 1732 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:44.765043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:44.766444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:44.778768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.779568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.780551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.781249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.856699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:44.877425 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6fa7df4-b48e-4981-b7cc-2f4960994d98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 0.636771 Jul 28 11:33:44.898414 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1166/2307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:44 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:44.904829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:44.905693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:44.919615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.920422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:44.922437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:44.926393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.161668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:45.188413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ccb9b569-1258-4bf4-ba1f-a5c8e96cadd0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1184 microversion: 2.1 time: 0.287842 Jul 28 11:33:45.200062 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1167/2308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:44 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1184 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:45.211523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:45.216486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:45.217273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Searching by: {'deleted': False, 'project_id': '1b2b682f155947ddaccd0068445e86b5'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:33:45.235023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.239776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.240885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.241478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.304577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:33:45.383810 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-200c9837-21f0-4a54-9e16-6e06abb940aa tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.181902 Jul 28 11:33:45.384970 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1168/2309] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:33:45 2022] GET /compute/v2.1/servers => generated 334 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:45.390496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:45.394093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:45.414537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.415948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.416928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.417522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.466404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:45.778824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:45.787895 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67b3d3f2-f204-4f1b-91af-19f8303fd39b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 1.034810 Jul 28 11:33:45.788489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1142/2310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:44 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:45.809964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:45.810395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:45.831754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.832217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.833012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:45.833460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:45.943425 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e HTTP/1.1 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cbe9ae38-2d4a-46ad-9c98-379998279c3e'} Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:45.960294 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:33:45.963501 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:45.979709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:45.983399 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0123e474-4ed8-4c41-85b0-a4fff9d39402 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 404 len: 111 microversion: 2.1 time: 0.181650 Jul 28 11:33:45.991500 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1143/2311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:45 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:45.999022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:46.015224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:46.017146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Searching by: {'deleted': False, 'project_id': '1b2b682f155947ddaccd0068445e86b5'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:33:46.036019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.036815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.044646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.045577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.165527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:33:46.242806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:46.259606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.263836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.675177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:46.690021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:46.697950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:46.699426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e16e098-7514-4173-981d-c32ade472f1a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 1.313133 Jul 28 11:33:46.720415 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1169/2312] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:45 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:46.727137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:46.728916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: e136674d-52b8-4587-b731-21134272b802] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:46.736802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.737408 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85fe2636-824f-447f-b3e3-5fb85360f1df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.744134 Jul 28 11:33:46.738829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1144/2313] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:33:45 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:46.744161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1"}, {"server_uuid": "cf062eef-e0e9-46f9-bdbb-2d3cf599902c", "name": "network-vif-deleted", "tag": "529091a0-6986-4dab-8e65-9527c6f717b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:46.764545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.767338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.779774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.791583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.799610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.805081 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] HTTP exception thrown: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Request method failure captured: Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 HTTP/1.1 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJRgGQ72MPx4stskHUG30e5z7PecgBylSDMNk8KaS2o0NabPtIX-ahmT7reZP7vav04FZwEuHuo97tN5g9miEMnNRe6CZ26WBv2l8t9VeTCbXRn-Y7cYyv6pDQhIrv7wxc0-DtBDA-SpgXCfTQeHb9Fs4TsdsB6IXfnV_98m-6oTfI Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2367458a06b245769d5851becc658136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2367458a06b245769d5851becc658136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}] Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ccea87d21921492f8544e0e81ea485d5 Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e136674d-52b8-4587-b731-21134272b802'} Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. Jul 28 11:33:46.807985 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. Jul 28 11:33:46.810984 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:46.818835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Returning 404 to user: Instance e136674d-52b8-4587-b731-21134272b802 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:46.820313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4eccab2-5cbe-4b48-a8c6-363471cbf14b tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802" status: 404 len: 111 microversion: 2.25 time: 0.097764 Jul 28 11:33:46.824572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1170/2314] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:46 2022] GET /compute/v2.1/servers/e136674d-52b8-4587-b731-21134272b802 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:33:46.830402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:46.836945 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] Creating event network-changed:4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:46.837658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] Creating event network-vif-deleted:529091a0-6986-4dab-8e65-9527c6f717b4 for instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c on n-h1-851368-1 Jul 28 11:33:46.839633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:46.849741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.853223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.854372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.856790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-81adb83a-9261-4a75-878d-a6cf7ce60a5d req-f38b7af1-2048-4596-b291-31129458d2fa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.116479 Jul 28 11:33:46.857421 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1145/2315] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:46.857786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.880440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:46.881183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:46.905377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.905841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:46.906696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:46.907168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:47.117243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:47.140963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-889ec800-2cfc-4357-a225-160783996ba0 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1184 microversion: 2.1 time: 0.278682 Jul 28 11:33:47.145851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1146/2316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:46 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1184 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:47.164229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1725621421", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:47.306753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:33:48.046331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:48.059022 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-347ad4c9-ce40-46b0-9aff-529c1268a2d2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 1.232952 Jul 28 11:33:48.063032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1171/2317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:46 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:48.070283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67b34781-82ac-4f4f-90af-b9a8dab7f90d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:48.094935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67b34781-82ac-4f4f-90af-b9a8dab7f90d tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030576 Jul 28 11:33:48.098474 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1172/2318] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:33:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:48.104262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:48.105475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:48.144240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:48.147985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:48.149185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:48.149867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:48.540917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:48.552125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d868ada-409f-4211-a37e-c817d3d534ed tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.450761 Jul 28 11:33:48.555400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1173/2319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:48 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:48.585124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5792ded2-e079-40e7-a404-576b7bac5e3d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '.version_select at 0x7f2eb2465f70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:48.649036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5792ded2-e079-40e7-a404-576b7bac5e3d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979904633" status: 204 len: 0 microversion: 2.25 time: 0.076843 Jul 28 11:33:48.651840 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1174/2320] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Jul 28 11:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979904633 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:33:48.662729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:48.663398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:48.688708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:48.689595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:48.690602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:48.691279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.322685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:49.355921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:49.368636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:49.372690 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f62aee2-d0ff-4453-a004-5fffd6eb3b3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.717828 Jul 28 11:33:49.378042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1175/2321] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:48 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:49.398114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d312481a-06fe-43ef-9800-549ea6be0123 req-688dc9f2-cfc1-4449-a6de-7c83fe3b32e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b207e98c-1958-45e4-9fee-41ca4e03ab14", "tag": "c640a81d-2531-4490-b242-181f2b39aa92"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:49.425137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d312481a-06fe-43ef-9800-549ea6be0123 req-688dc9f2-cfc1-4449-a6de-7c83fe3b32e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.425596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d312481a-06fe-43ef-9800-549ea6be0123 req-688dc9f2-cfc1-4449-a6de-7c83fe3b32e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.440110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:33:49.440659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:33:49.441048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:33:49.441467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:33:49.441896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:33:49.497322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.497774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.498608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.499127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.502830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d312481a-06fe-43ef-9800-549ea6be0123 req-688dc9f2-cfc1-4449-a6de-7c83fe3b32e7 service nova] Creating event network-changed:c640a81d-2531-4490-b242-181f2b39aa92 for instance b207e98c-1958-45e4-9fee-41ca4e03ab14 on n-h2-851368-1 Jul 28 11:33:49.508539 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d312481a-06fe-43ef-9800-549ea6be0123 req-688dc9f2-cfc1-4449-a6de-7c83fe3b32e7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125793 Jul 28 11:33:49.518029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1176/2322] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:49.542483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:49.543347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:49.555320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.555781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.556576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.557020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.568173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:33:49.580274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:33:49.613998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:33:49.616454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:33:49.696627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:49.711248 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b4c8b6b-b3fc-4a33-889e-6ed27a4bc4e9 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1184 microversion: 2.1 time: 0.190389 Jul 28 11:33:49.712444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1177/2323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:49 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1184 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:49.718378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:49.719686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:49.720070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5e383a5-db0a-4877-8bce-4e2ba6978873 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.570341 Jul 28 11:33:49.721082 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1147/2324] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:33:49.726532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.727199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.728129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.728716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.729346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e136674d-52b8-4587-b731-21134272b802", "name": "network-vif-deleted", "tag": "e0cce9c2-5ea3-4242-82cb-e3afcd8826e3"}, {"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "68b0ab21-d61f-4ee1-a0c7-f3315d681809"}, {"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "66490c9f-860d-4659-a0f8-fb12c956cbda"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:49.760892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.761550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.767199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:49.793512 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Creating event network-vif-deleted:e0cce9c2-5ea3-4242-82cb-e3afcd8826e3 for instance e136674d-52b8-4587-b731-21134272b802 on n-h1-851368-1 Jul 28 11:33:49.794266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Creating event network-changed:68b0ab21-d61f-4ee1-a0c7-f3315d681809 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:49.794924 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] Creating event network-changed:66490c9f-860d-4659-a0f8-fb12c956cbda for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:49.803175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cd73a55d-55fa-4aa9-8bc1-84e41cc7a271 req-e29daeca-4957-40db-a219-12603724b109 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.080627 Jul 28 11:33:49.803983 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1148/2325] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:49.812983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:49.814547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:49.822591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.823315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.826706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.827351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.936157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-599a26e4-fdc7-45c8-88e2-e6e6a61371c0 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 204 len: 0 microversion: 2.1 time: 0.221817 Jul 28 11:33:49.940552 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1178/2326] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:33:49 2022] DELETE /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:33:49.949100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:49.950338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:49.960209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.960885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:49.961954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:49.962514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.220677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.230435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-64dcc82d-9c0c-4a33-acd5-e8ec4aa72ff9 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 0.424189 Jul 28 11:33:50.240775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.247373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1149/2327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:49 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:50.251552 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fbb6c2a9-21eb-441f-a936-1f6a7dcaa76c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.310362 Jul 28 11:33:50.254033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a30a86b9-9fcc-4fd2-af25-4730c8963509 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:50.255031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a30a86b9-9fcc-4fd2-af25-4730c8963509 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:50.267287 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1179/2328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:49 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:50.273016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:50.273653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:50.284381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.287133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.290141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.290856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.354246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a30a86b9-9fcc-4fd2-af25-4730c8963509 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.363371 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a30a86b9-9fcc-4fd2-af25-4730c8963509 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1215 microversion: 2.1 time: 0.114483 Jul 28 11:33:50.365308 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1150/2329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:50 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:50.403469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:50.404546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:50.428737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.429447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.430639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.443567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.558549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.566963 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-272ab504-0cfe-44d7-a8bd-cfa14af481df tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1698 microversion: 2.1 time: 0.298454 Jul 28 11:33:50.567592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1180/2330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:50 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1698 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:50.767506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:50.768275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:50.772440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.780262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.781398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.782499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.783110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.785379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.787286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.789040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f4b65d4-5d87-47e2-a8df-6fff3edb5e63 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.390205 Jul 28 11:33:50.790141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1151/2331] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:50 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:50.795630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:50.797189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:50.807405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.808136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.809511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:50.810216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:50.828082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:50.896391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:50.905354 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfbf1367-f249-4ddd-8416-a54136abda9d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1184 microversion: 2.1 time: 0.113899 Jul 28 11:33:50.905869 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1152/2332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:50 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1184 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:51.005103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-433c3548-36ab-4a48-8fac-76a9e68bc82d tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 204 len: 0 microversion: 2.25 time: 0.240845 Jul 28 11:33:51.011901 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1181/2333] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:33:50 2022] DELETE /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:33:51.017597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:51.018212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:51.028004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.028490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.033340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.033857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.245723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.256203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:51.257117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:51.259944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:51.260960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.263693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.270252 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2531e6aa-0540-4d4b-bf08-66c6cdca61f9 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1549 microversion: 2.25 time: 0.255182 Jul 28 11:33:51.271083 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1153/2334] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:51.284080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:51.284080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:51.294173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.295015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.295868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.297193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.297660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.298251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.300606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.303301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.834889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.850452 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f55a9c7-a2c7-4fd1-91c1-6e9201afe6b4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 0.599373 Jul 28 11:33:51.851048 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1182/2335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:51.852856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.856686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:51.860276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:51.870972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.878342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.879200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a44bfeb-ef1d-4e4c-86bb-45d52dce4fe7 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.596770 Jul 28 11:33:51.879725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.879830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1154/2336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:51.880497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.888699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:51.889708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:51.900113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.901735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.902910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:51.903732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:51.975098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:51.988945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28e39f0b-6e96-4751-a792-6f57218b1e81 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1273 microversion: 2.1 time: 0.131950 Jul 28 11:33:51.989716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1183/2337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:52.002349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:52.003244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:52.016828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.016828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.017681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.021303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.587107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:52.598201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b949cf67-07af-46b6-8bac-5ce5b0fdd13c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1698 microversion: 2.1 time: 0.716037 Jul 28 11:33:52.598735 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1155/2338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1698 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:52.609828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "af75dad6-3f30-441e-ad60-3c2fb5b737d9"}, {"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "dbcb2a40-88e7-4d42-9494-b9bb721bdde3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:52.629527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.632212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.658779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] Creating event network-changed:af75dad6-3f30-441e-ad60-3c2fb5b737d9 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:52.659721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] Creating event network-changed:dbcb2a40-88e7-4d42-9494-b9bb721bdde3 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:52.665499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:52.668420 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c2b95a0e-b6c4-4af1-94c9-473239728eb1 req-d9f381d5-cdfb-497e-aeb7-b06213166f0a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068167 Jul 28 11:33:52.669601 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1156/2339] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:52.676336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:52.677323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:52.680353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:52.681862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:52.683830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47284a65-bd6b-44d3-9e7c-05c734c55748 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.692884 Jul 28 11:33:52.691095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1184/2340] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:51 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:52.696086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:52.699424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:52.717009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.717606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.717734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.718058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.719497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.720054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:52.720172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:52.739698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:53.579748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:53.596921 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-11683bb6-5fff-49a0-bc05-8035b911fb83 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 200 len: 1184 microversion: 2.1 time: 0.925214 Jul 28 11:33:53.600561 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1157/2341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:52 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 1184 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:53.617644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:53.626253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:53.636490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:53.637617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:53.639113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:53.643350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:53.652423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:53.678712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:53.692385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:53.697316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:53.703183 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de81d3d8-6250-4110-9170-318dcbf6936a tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1549 microversion: 2.25 time: 1.008802 Jul 28 11:33:53.725465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1185/2342] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:52 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1549 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:53.741300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:53.742714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:53.766344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:53.766824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:53.769022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:53.769489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.293096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:54.307349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73cb7595-532d-4360-a583-b383a48bd5fc tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 0.704720 Jul 28 11:33:54.308022 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1158/2343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:53 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:54.313323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:54.313944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:54.338077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.338534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.339360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.339805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.644248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:54.659513 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81e50473-41e5-45cb-ae17-cb7ad517e4b1 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.927154 Jul 28 11:33:54.661038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1186/2344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:53 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:54.666851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-aaba4ba2-4faa-4525-ac49-e9fcfba2dbef req-293adae4-1872-49b5-8aba-8136fb0378c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b207e98c-1958-45e4-9fee-41ca4e03ab14", "name": "network-vif-plugged", "status": "completed", "tag": "c640a81d-2531-4490-b242-181f2b39aa92"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:54.696289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-aaba4ba2-4faa-4525-ac49-e9fcfba2dbef req-293adae4-1872-49b5-8aba-8136fb0378c6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.696959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-aaba4ba2-4faa-4525-ac49-e9fcfba2dbef req-293adae4-1872-49b5-8aba-8136fb0378c6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.717227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-aaba4ba2-4faa-4525-ac49-e9fcfba2dbef req-293adae4-1872-49b5-8aba-8136fb0378c6 service nova] Creating event network-vif-plugged:c640a81d-2531-4490-b242-181f2b39aa92 for instance b207e98c-1958-45e4-9fee-41ca4e03ab14 on n-h2-851368-1 Jul 28 11:33:54.734772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-aaba4ba2-4faa-4525-ac49-e9fcfba2dbef req-293adae4-1872-49b5-8aba-8136fb0378c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071612 Jul 28 11:33:54.735644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1187/2345] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:54.755248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:54.756234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:54.759518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=96,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:54.763577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.763906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:54.764733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.770754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.771393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.773649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e38f36e1-4701-4ba6-baf6-3bccab4b1e65 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.464570 Jul 28 11:33:54.776181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1159/2346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:54 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:54.787008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:54.792323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:54.804925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.806994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.808609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:54.809057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:54.846485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:55.026589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.056569 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45860da4-b1db-4daf-9ae9-f5e7ae36e156 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1631 microversion: 2.1 time: 0.313039 Jul 28 11:33:55.061729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1188/2347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:54 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1631 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:55.069653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:55.074927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: cf062eef-e0e9-46f9-bdbb-2d3cf599902c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:55.090597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.091084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.091912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.092357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.136574 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] HTTP exception thrown: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Request method failure captured: Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c HTTP/1.1 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJAyws-pJR1QX2KC3qKvMH0lHwpjq502Dnfy-250NbY4h2qRlKCGU6LBn4ImJt-bjsKFwXPIdCEtf2OO3es0rH-e_x2mDggkl8PEbwxh10AatNNyut3VbVE3-snOAHxFwUwywHz588tJK7XRy3hmP063Qnfjm4wWeSXPT5s8W5WgnA Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64fcfa8211044955bd77c76a587dc952"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}] Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-LiveMigrationTest-138238008 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-LiveMigrationTest-138238008-project Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d61cd4ba16e748bbac55fe74a20c557e Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-LiveMigrationTest-138238008-project Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cf062eef-e0e9-46f9-bdbb-2d3cf599902c'} Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:55.138571 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. Jul 28 11:33:55.142563 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:55.143462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Returning 404 to user: Instance cf062eef-e0e9-46f9-bdbb-2d3cf599902c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:55.144620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c5b9abc-6f9d-4764-8fe4-74c0ee38fc7e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c" status: 404 len: 111 microversion: 2.1 time: 0.081736 Jul 28 11:33:55.145523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1189/2348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:55 2022] GET /compute/v2.1/servers/cf062eef-e0e9-46f9-bdbb-2d3cf599902c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:55.151389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:55.152173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:55.165727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.165727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.166426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.166874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.290068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:55.491481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.508966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.510883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.512897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f359923-28f3-4b72-97c4-0bdaa9acfe45 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1507 microversion: 2.25 time: 0.365724 Jul 28 11:33:55.538686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1190/2349] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:55 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:55.553921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7de63f60-a7a1-4a6b-87d0-223a1ab2ced0 req-2cc18033-f149-4094-915f-c714de603986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "76e66cec-d53f-4daf-a198-0b75991865a7"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:55.589454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7de63f60-a7a1-4a6b-87d0-223a1ab2ced0 req-2cc18033-f149-4094-915f-c714de603986 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.590656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7de63f60-a7a1-4a6b-87d0-223a1ab2ced0 req-2cc18033-f149-4094-915f-c714de603986 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.619585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7de63f60-a7a1-4a6b-87d0-223a1ab2ced0 req-2cc18033-f149-4094-915f-c714de603986 service nova] Creating event network-changed:76e66cec-d53f-4daf-a198-0b75991865a7 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:33:55.637616 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7de63f60-a7a1-4a6b-87d0-223a1ab2ced0 req-2cc18033-f149-4094-915f-c714de603986 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095962 Jul 28 11:33:55.639882 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1191/2350] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:55.652158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:55.653517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:55.670000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.671138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.672691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.673271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.692989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.710257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.712858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:55.715863 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-96e2f6ae-df1e-4064-a16a-86139f8fa3ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.938443 Jul 28 11:33:55.720212 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1160/2351] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:54 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:55.728463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:55.730962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:55.751670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.752301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:55.753819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:55.754417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.121385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:56.130120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6ff2890-f91d-43dc-be4d-f9cd51774c4b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1364 microversion: 2.1 time: 0.488670 Jul 28 11:33:56.131553 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1192/2352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:55 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:56.137461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:56.138348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:56.145493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.146478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.147485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.148100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.309197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:56.329153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1f91aa2-1cdf-4fd3-bf3c-e6a814c8d509 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.606001 Jul 28 11:33:56.330203 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1161/2353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:55 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:56.341209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ae00306a-db28-4860-90bf-e2ef84ff93ad req-13718be1-e1de-4309-849d-26b4c2c5fff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4d6bf8-b399-47af-b305-c27cae04cbbf", "name": "network-vif-deleted", "tag": "3214b498-d505-46fc-a5dd-9c918c2def71"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:56.378566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ae00306a-db28-4860-90bf-e2ef84ff93ad req-13718be1-e1de-4309-849d-26b4c2c5fff8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.379054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ae00306a-db28-4860-90bf-e2ef84ff93ad req-13718be1-e1de-4309-849d-26b4c2c5fff8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.405055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ae00306a-db28-4860-90bf-e2ef84ff93ad req-13718be1-e1de-4309-849d-26b4c2c5fff8 service nova] Creating event network-vif-deleted:3214b498-d505-46fc-a5dd-9c918c2def71 for instance eb4d6bf8-b399-47af-b305-c27cae04cbbf on n-h2-851368-1 Jul 28 11:33:56.413801 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ae00306a-db28-4860-90bf-e2ef84ff93ad req-13718be1-e1de-4309-849d-26b4c2c5fff8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082286 Jul 28 11:33:56.419435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1162/2354] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:56.435606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:56.437148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:56.444881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.445576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.446591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.447225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.600276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:56.612743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cadd26ae-f5fa-4b7b-81d6-721afc129f0c tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1631 microversion: 2.1 time: 0.190768 Jul 28 11:33:56.613376 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1163/2355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:56 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1631 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:56.637710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:56.639462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:56.658452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.663162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.664373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.665036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.681044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:56.697628 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebf8a6d3-fa44-4285-a41a-64f684af1a37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.564775 Jul 28 11:33:56.711098 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1193/2356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:56 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:56.757804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:56.761238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:56.769329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.774983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.777198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.782328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lazy-loading 'fault' on Instance uuid eb4d6bf8-b399-47af-b305-c27cae04cbbf {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:56.794116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.800785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:56.802983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:56.988159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:56.997886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.011702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.021434 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c38354f5-7c4f-4f3a-a66e-3eea5e714275 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 200 len: 1351 microversion: 2.25 time: 0.387843 Jul 28 11:33:57.029167 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1164/2357] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:56 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 1351 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:57.157934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:57.159472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:57.183803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.184753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.188842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.189572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.447687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.471313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.485824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.494139 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-329f9a9a-6133-4016-824d-0db986efc8c9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.750099 Jul 28 11:33:57.510619 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1194/2358] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:56 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:33:57.510619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:57.510619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:57.535499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.539244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.542086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.542711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.705380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.744884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6818c3c8-93c1-4bc3-91a7-7423daeacb1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1554 microversion: 2.1 time: 0.593994 Jul 28 11:33:57.748907 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1165/2359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:57 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1554 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:33:57.755766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:57.767174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:57.794854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.795301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.796798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.801472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.878352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:57.897552 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-987dbb5d-d0a4-4ba5-b5d9-c32e6c0df9e8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.400424 Jul 28 11:33:57.918836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1195/2360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:57 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:57.920490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.920951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.923595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lazy-loading 'fault' on Instance uuid 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:33:57.926397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d1cd5bab-8cf5-416c-ae9c-cf1d355646f2 req-60c48a38-b954-4351-baf8-ec5bdf4bce1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f", "tag": "63b1715e-ad82-449a-892e-6e1917cc0395"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:57.955836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d1cd5bab-8cf5-416c-ae9c-cf1d355646f2 req-60c48a38-b954-4351-baf8-ec5bdf4bce1b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:57.957677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d1cd5bab-8cf5-416c-ae9c-cf1d355646f2 req-60c48a38-b954-4351-baf8-ec5bdf4bce1b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:57.994455 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d1cd5bab-8cf5-416c-ae9c-cf1d355646f2 req-60c48a38-b954-4351-baf8-ec5bdf4bce1b service nova] Creating event network-changed:63b1715e-ad82-449a-892e-6e1917cc0395 for instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f on n-h1-851368-1 Jul 28 11:33:58.002881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d1cd5bab-8cf5-416c-ae9c-cf1d355646f2 req-60c48a38-b954-4351-baf8-ec5bdf4bce1b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082419 Jul 28 11:33:58.007368 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1196/2361] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:58.029013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.032572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.034384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedec2808ad842369ec2d36c2b5d61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2b682f155947ddaccd0068445e86b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:58.041372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.042173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.047453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.048174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.053799 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4952c7a6-38dd-41d0-8db6-e6c88844e5c1 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 200 len: 1360 microversion: 2.1 time: 0.301460 Jul 28 11:33:58.069349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1166/2362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:57 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 1360 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:58.081835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.082935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.097130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.097970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.102596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.103612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.334933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d18ea87-092d-40ae-8f09-2683572ddc1b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263825 Jul 28 11:33:58.335679 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1167/2363] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:33:58 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:58.340871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.341764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: eb4d6bf8-b399-47af-b305-c27cae04cbbf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.358085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.359441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.368523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.370012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.407347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:58.407697 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] HTTP exception thrown: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Request method failure captured: Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf HTTP/1.1 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJRgGQ72MPx4stskHUG30e5z7PecgBylSDMNk8KaS2o0NabPtIX-ahmT7reZP7vav04FZwEuHuo97tN5g9miEMnNRe6CZ26WBv2l8t9VeTCbXRn-Y7cYyv6pDQhIrv7wxc0-DtBDA-SpgXCfTQeHb9Fs4TsdsB6IXfnV_98m-6oTfI Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2367458a06b245769d5851becc658136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2367458a06b245769d5851becc658136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}] Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 2367458a06b245769d5851becc658136 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ccea87d21921492f8544e0e81ea485d5 Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'eb4d6bf8-b399-47af-b305-c27cae04cbbf'} Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. Jul 28 11:33:58.410442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. Jul 28 11:33:58.414993 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.417175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-42bc6ec9-de00-45e7-96ea-cbfe0b972a79 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.403360 Jul 28 11:33:58.417569 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1197/2364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:58 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:58.418824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Returning 404 to user: Instance eb4d6bf8-b399-47af-b305-c27cae04cbbf could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:58.420392 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-022a15f3-cd0e-4775-8ab9-8ed1fa37b583 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf" status: 404 len: 111 microversion: 2.25 time: 0.083313 Jul 28 11:33:58.421757 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1168/2365] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:58 2022] GET /compute/v2.1/servers/eb4d6bf8-b399-47af-b305-c27cae04cbbf => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:33:58.430133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.430837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.440434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.441942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.442857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.443443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.485355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-738a2f52-4ac5-43ba-8a45-dc13480be768 req-7e798db7-6a21-4ad4-9858-1dc0ec0c5f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13beab8e-6c0f-4e20-8156-8dbc2dd6ada8", "name": "network-vif-deleted", "tag": "e5fe0882-e97a-4540-bd2b-8708fef840df"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:33:58.487450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:58.505066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:58.514490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-738a2f52-4ac5-43ba-8a45-dc13480be768 req-7e798db7-6a21-4ad4-9858-1dc0ec0c5f84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.515333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-738a2f52-4ac5-43ba-8a45-dc13480be768 req-7e798db7-6a21-4ad4-9858-1dc0ec0c5f84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.535634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-738a2f52-4ac5-43ba-8a45-dc13480be768 req-7e798db7-6a21-4ad4-9858-1dc0ec0c5f84 service nova] Creating event network-vif-deleted:e5fe0882-e97a-4540-bd2b-8708fef840df for instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 on n-h2-851368-1 Jul 28 11:33:58.540965 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-738a2f52-4ac5-43ba-8a45-dc13480be768 req-7e798db7-6a21-4ad4-9858-1dc0ec0c5f84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061599 Jul 28 11:33:58.542348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1169/2366] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:33:58.572037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.581715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.596850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.597311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.598140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.598628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.626673 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d80e7ab-35c8-436a-a2a7-ba66536b31aa tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 204 len: 0 microversion: 2.25 time: 0.197021 Jul 28 11:33:58.628039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1198/2367] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:33:58 2022] DELETE /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:33:58.648491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.649701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.660289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.661007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.662079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.662669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.701227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee HTTP/1.1 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '33daecce-0fef-495a-a0bd-cdb1ab7683ee'} Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:58.708499 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:58.711988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51a211f5-ec3e-498a-8344-30604b9f3742 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 404 len: 111 microversion: 2.1 time: 0.080700 Jul 28 11:33:58.713614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1199/2368] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:33:58 2022] DELETE /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:58.724344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:58.724976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:58.744638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.745094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:58.745898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:58.746340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.233550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.260671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.263966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.269790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.271335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.271653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.272520 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49a5d8f2-df1c-496a-b995-4078f3876de4 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1563 microversion: 2.25 time: 0.558669 Jul 28 11:33:59.275456 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83987a76-4cbf-4954-ae91-7d43b05b2670 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.731173 Jul 28 11:33:59.277247 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1200/2369] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:58 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1563 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:59.282016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1170/2370] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:33:58 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:33:59.297105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.299844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.302843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.303515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 33daecce-0fef-495a-a0bd-cdb1ab7683ee] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.314672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.319919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.321177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.321627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.322092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.322200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.322887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.323353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.357209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee HTTP/1.1 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '33daecce-0fef-495a-a0bd-cdb1ab7683ee'} Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:59.358735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 33daecce-0fef-495a-a0bd-cdb1ab7683ee could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:59.362583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ee720f8-005c-46e4-8258-318560866864 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee" status: 404 len: 111 microversion: 2.1 time: 0.081928 Jul 28 11:33:59.363342 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1201/2371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:59 2022] GET /compute/v2.1/servers/33daecce-0fef-495a-a0bd-cdb1ab7683ee => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:59.368308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.371991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] [instance: 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.385730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.388029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.389008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.392805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.421892 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] HTTP exception thrown: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Request method failure captured: Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 HTTP/1.1 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nPOnavASqficBBGK9Ws28vObIcQpPWibOIXQDCluNtLxI-9qPuPxcafl2v8DcQ4sfmg29tmfd9TuF6aurvgjr-NPOd9ud3jESHuXXUHcrdk4NuPRwr9Syv1FmJK2BHDeJHDyWw5s71MvkXqKLIkDK4tr2zjwumG7gzY-yuV3-3Whuk Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1b2b682f155947ddaccd0068445e86b5 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-291684805 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b2b682f155947ddaccd0068445e86b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1b2b682f155947ddaccd0068445e86b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1b2b682f155947ddaccd0068445e86b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1b2b682f155947ddaccd0068445e86b5"}]}] Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-291684805 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1b2b682f155947ddaccd0068445e86b5 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-291684805 Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-291684805-project Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: fedec2808ad842369ec2d36c2b5d61ab Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-291684805-project Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '13beab8e-6c0f-4e20-8156-8dbc2dd6ada8'} Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.423819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. Jul 28 11:33:59.427498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:33:59.429114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Returning 404 to user: Instance 13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:33:59.430442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d50e282-7200-421a-a5a2-efbbaa403a50 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8" status: 404 len: 111 microversion: 2.1 time: 0.065741 Jul 28 11:33:59.436006 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1202/2372] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:59 2022] GET /compute/v2.1/servers/13beab8e-6c0f-4e20-8156-8dbc2dd6ada8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:33:59.451596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.452924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.469736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.470479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.471479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.472127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.513265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:33:59.541883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:59.582419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:33:59.620082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d240145-9233-457c-a5fb-e8a4c3741396 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "DELETE /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 204 len: 0 microversion: 2.1 time: 0.181579 Jul 28 11:33:59.621588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1203/2373] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:33:59 2022] DELETE /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:33:59.629228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.631449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.643546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.644346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.646344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.647044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.859945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.869128 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30395007-bb91-4dc6-b106-e30c99d36272 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.583313 Jul 28 11:33:59.884434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1171/2374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:59 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:59.888288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:33:59.897736 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e065a1f1-eedf-49f7-962b-7059620744d6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.274018 Jul 28 11:33:59.903250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5bab24e-e0c6-4dea-bf2b-ee149db894c4 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] Calling method '.version_select at 0x7f2eb3389c10>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.915103 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1204/2375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:59 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:33:59.927792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:33:59.928711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:33:59.935960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5bab24e-e0c6-4dea-bf2b-ee149db894c4 tempest-ServersTestJSON-291684805 tempest-ServersTestJSON-291684805-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513497704" status: 202 len: 0 microversion: 2.1 time: 0.049926 Jul 28 11:33:59.939312 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1172/2376] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513497704 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:33:59.946646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.947870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:33:59.951323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:33:59.952086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:00.298879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3feeedde-59a6-4350-ab1a-eec4979ef88b req-11baafd1-5755-4576-a33e-8002bc5af9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b207e98c-1958-45e4-9fee-41ca4e03ab14", "tag": "c640a81d-2531-4490-b242-181f2b39aa92"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:00.346159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3feeedde-59a6-4350-ab1a-eec4979ef88b req-11baafd1-5755-4576-a33e-8002bc5af9a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:00.347745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3feeedde-59a6-4350-ab1a-eec4979ef88b req-11baafd1-5755-4576-a33e-8002bc5af9a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:00.366884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:00.390884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3feeedde-59a6-4350-ab1a-eec4979ef88b req-11baafd1-5755-4576-a33e-8002bc5af9a3 service nova] Creating event network-changed:c640a81d-2531-4490-b242-181f2b39aa92 for instance b207e98c-1958-45e4-9fee-41ca4e03ab14 on n-h2-851368-1 Jul 28 11:34:00.418353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3feeedde-59a6-4350-ab1a-eec4979ef88b req-11baafd1-5755-4576-a33e-8002bc5af9a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124446 Jul 28 11:34:00.432389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1173/2377] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:00.448743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:00.450744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:00.464077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:00.464657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:00.465550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:00.465996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.023042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.044945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee459f8e-27b7-47ed-8427-af7ed7d3e4c2 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 1.121280 Jul 28 11:34:01.047655 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1205/2378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:33:59 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:01.067316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:01.067961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:01.088710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.089168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.089964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.094414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.146636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.158050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.169691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.178381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40c8c84d-6541-40c4-b25a-b1bd7e0a5dd3 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1563 microversion: 2.25 time: 0.743817 Jul 28 11:34:01.181528 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1174/2379] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:00 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1563 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:01.194218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:01.198232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:01.218971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.219452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.220462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.221985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.778905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.797127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.801229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.805500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5815af7-3b5c-469e-94df-5fa88917a3e0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.755555 Jul 28 11:34:01.818519 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1206/2380] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:01 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:01.832652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:01.833337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:01.858058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.865840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.867745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.868219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:01.908777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:01.936259 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f31186c-3f2e-4ddb-b4ae-fa72e5963439 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.752805 Jul 28 11:34:01.941371 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1175/2381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:01 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:01.964045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e009a35f-7fe2-4d29-9020-9374e606dc0e req-bb1efaad-3c3c-46fc-8b9f-72e0523596e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23", "name": "network-vif-deleted", "tag": "e9bb6a58-0c30-4514-a054-8f60c104687f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:01.993202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e009a35f-7fe2-4d29-9020-9374e606dc0e req-bb1efaad-3c3c-46fc-8b9f-72e0523596e9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:01.997062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e009a35f-7fe2-4d29-9020-9374e606dc0e req-bb1efaad-3c3c-46fc-8b9f-72e0523596e9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.033096 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e009a35f-7fe2-4d29-9020-9374e606dc0e req-bb1efaad-3c3c-46fc-8b9f-72e0523596e9 service nova] Creating event network-vif-deleted:e9bb6a58-0c30-4514-a054-8f60c104687f for instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 on n-h2-851368-1 Jul 28 11:34:02.044391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e009a35f-7fe2-4d29-9020-9374e606dc0e req-bb1efaad-3c3c-46fc-8b9f-72e0523596e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099043 Jul 28 11:34:02.047443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1176/2382] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:02.083856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:02.094104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:02.118474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.118933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.119851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.120195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.590558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:02.619207 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c2e3d84-1176-4eb4-8667-a193d9e10896 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.797546 Jul 28 11:34:02.634683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1207/2383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:01 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:02.635159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:02.644870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:02.665477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.668603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.671640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.676237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.752220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:02.760043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-82ba79ce-c557-4894-acbf-6f2ed5208295 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.691035 Jul 28 11:34:02.768902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1177/2384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:02 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:02.834824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:02.835464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:02.836255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.843134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.844000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lazy-loading 'fault' on Instance uuid ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:02.850124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.852415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.853414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:02.860341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:02.956834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:02.975883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:02.980655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccea87d21921492f8544e0e81ea485d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2367458a06b245769d5851becc658136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:02.986184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2cea7f12-69c0-4b5e-a36c-8064ddfd5899 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 200 len: 1351 microversion: 2.25 time: 0.360204 Jul 28 11:34:02.987308 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1208/2385] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:02 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 1351 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:02.998732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:03.000917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:03.016123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.016847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:03.017818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.021208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:03.489332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:03.492305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:03.505915 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c3f4e7b-2e00-401f-9a13-04537f0fec68 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1472 microversion: 2.1 time: 0.516572 Jul 28 11:34:03.506746 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1209/2386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:02 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1472 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:03.525069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:03.529800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:03.534174 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d592b82-bdc4-4e18-8d7f-aaa3fb2f892c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.703503 Jul 28 11:34:03.538435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1178/2387] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:02 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:03.642742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:03.644021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:03.657583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.660596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:03.661776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.662387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:03.789273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:03.790262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:03.799154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.803572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:03.804589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:03.805257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.101535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:04.115821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e4a941d-0f6c-4c65-996e-1de6807966b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.477550 Jul 28 11:34:04.116423 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1210/2388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:03 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:04.126653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:04.127310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] [instance: ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:04.135689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:04.142370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.142824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.150984 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1bcdf3c-6e9f-487e-b805-25b411552479 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.365491 Jul 28 11:34:04.152581 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1179/2389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:03 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:04.152734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.153600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.174268 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] HTTP exception thrown: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Request method failure captured: Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 HTTP/1.1 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJRgGQ72MPx4stskHUG30e5z7PecgBylSDMNk8KaS2o0NabPtIX-ahmT7reZP7vav04FZwEuHuo97tN5g9miEMnNRe6CZ26WBv2l8t9VeTCbXRn-Y7cYyv6pDQhIrv7wxc0-DtBDA-SpgXCfTQeHb9Fs4TsdsB6IXfnV_98m-6oTfI Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 2367458a06b245769d5851becc658136 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2367458a06b245769d5851becc658136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2367458a06b245769d5851becc658136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2367458a06b245769d5851becc658136"}]}] Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 2367458a06b245769d5851becc658136 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ccea87d21921492f8544e0e81ea485d5 Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1450429902-project Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23'} Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. Jul 28 11:34:04.178349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] Returning 404 to user: Instance ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:04.181589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-03ad0fc6-46ba-418e-b122-d84435887462 tempest-LiveAutoBlockMigrationV225Test-1450429902 tempest-LiveAutoBlockMigrationV225Test-1450429902-project] 10.222.0.93 "GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23" status: 404 len: 111 microversion: 2.25 time: 0.063180 Jul 28 11:34:04.186668 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1211/2390] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:04 2022] GET /compute/v2.1/servers/ed3721e3-9c79-4b4c-b4f1-d4bd7be99d23 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:34:04.529338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:04.531280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:04.543298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.544317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.547270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.548996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.560223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:04.560852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:04.574494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.574987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.575810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:04.576254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:04.983368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:04.994602 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cbcdfae7-a81e-4bd4-8983-fb1b3d78c3f8 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.470525 Jul 28 11:34:04.996959 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1180/2391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:04 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:05.107545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:05.122205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:05.131320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:05.132737 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b3d7a51-a8e2-479e-ae0f-24507fb84e44 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.576425 Jul 28 11:34:05.136465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1212/2392] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:04 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:05.151852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:05.152710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:05.165393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.170611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.172680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.174218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:05.175414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:05.177566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.192084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.193248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.196852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.200436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:05.201341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.629388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:05.642103 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fbac07e-9538-4f0a-b1ec-db3c32cf5e0c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.506741 Jul 28 11:34:05.643955 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1181/2393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:05 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:05.658033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b44d7ce7-cdc7-4998-91d0-3b9b9e9b9f4f req-1dadde88-f74a-45bc-a53c-206bc0f1171c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f", "name": "network-vif-plugged", "status": "completed", "tag": "63b1715e-ad82-449a-892e-6e1917cc0395"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:05.691755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:05.699653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b44d7ce7-cdc7-4998-91d0-3b9b9e9b9f4f req-1dadde88-f74a-45bc-a53c-206bc0f1171c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.700261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b44d7ce7-cdc7-4998-91d0-3b9b9e9b9f4f req-1dadde88-f74a-45bc-a53c-206bc0f1171c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.703404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe3768e7-53d1-4489-9832-394722c62a2a tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.534172 Jul 28 11:34:05.705718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1213/2394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:05 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:05.712481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:05.714886 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b44d7ce7-cdc7-4998-91d0-3b9b9e9b9f4f req-1dadde88-f74a-45bc-a53c-206bc0f1171c service nova] Creating event network-vif-plugged:63b1715e-ad82-449a-892e-6e1917cc0395 for instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f on n-h1-851368-1 Jul 28 11:34:05.719123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:05.732606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.732773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b44d7ce7-cdc7-4998-91d0-3b9b9e9b9f4f req-1dadde88-f74a-45bc-a53c-206bc0f1171c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086055 Jul 28 11:34:05.733320 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1182/2395] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:05.736274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.737224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:05.738855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:05.795918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:06.002236 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-011b9710-c430-4083-b14a-462c8df92c04 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 204 len: 0 microversion: 2.1 time: 0.293568 Jul 28 11:34:06.004979 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1214/2396] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:05 2022] DELETE /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:06.017279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:06.018214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:06.039367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:06.040100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:06.043759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.044231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.045032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.045481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.061914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.062383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.063275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.063675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.788154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:06.793770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:06.805553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6106155c-35c8-49c1-a44f-30e1c83d9ec8 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1664 microversion: 2.1 time: 0.795463 Jul 28 11:34:06.806653 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1183/2397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:06 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1664 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:06.806787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a6647e6-00b6-480f-8ce9-7a6cad921041 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.782520 Jul 28 11:34:06.807348 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1215/2398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:06 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:06.813344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:06.814590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:06.827414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.828088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.829202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.829799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.838699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:06.839663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:06.847105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.847907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:06.848830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:06.849874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:07.624790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:07.643714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:07.644957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:07.647343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:07.649290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-848b0d39-fe55-4b52-a7cf-91fb67bd851d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.841243 Jul 28 11:34:07.650445 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1184/2399] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:06 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:07.667746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7bcab6c-7d22-486e-9927-c21ae097ef88 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.825573 Jul 28 11:34:07.667746 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1216/2400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:06 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:07.676041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:07.676678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:07.686025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:07.686652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:07.687665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:07.688331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:07.751574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-85ea5c95-38d6-4a9e-acfe-af632a12d678 req-58e71a0e-acb4-44ae-9869-6c284183a402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:07.767761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-85ea5c95-38d6-4a9e-acfe-af632a12d678 req-58e71a0e-acb4-44ae-9869-6c284183a402 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:07.770649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-85ea5c95-38d6-4a9e-acfe-af632a12d678 req-58e71a0e-acb4-44ae-9869-6c284183a402 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:07.795970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-85ea5c95-38d6-4a9e-acfe-af632a12d678 req-58e71a0e-acb4-44ae-9869-6c284183a402 service nova] Creating event network-vif-unplugged:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:34:07.807903 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-85ea5c95-38d6-4a9e-acfe-af632a12d678 req-58e71a0e-acb4-44ae-9869-6c284183a402 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060687 Jul 28 11:34:07.808443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1185/2401] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:07.829400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:07.830431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:07.837779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:07.838232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:07.839226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:07.839668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:08.275039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:08.291528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-367bd297-8105-4d43-a324-46fb6931c0d8 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1512 microversion: 2.1 time: 0.632050 Jul 28 11:34:08.296661 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1217/2402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:07 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1512 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:08.311455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:08.319476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:08.331701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:08.332411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:08.333630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:08.334335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:08.801500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:08.841976 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fcfbc5d-fa2d-4187-996f-1e2d9e997cbd tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1664 microversion: 2.1 time: 1.015908 Jul 28 11:34:08.848681 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1186/2403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:07 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1664 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:08.863990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:08.866311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:08.891941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:08.892779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:08.894578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:08.895827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.110160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.119514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9a4e59a-4315-4202-8a25-20b588621952 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.820492 Jul 28 11:34:09.121506 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1218/2404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:08 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:09.129570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:09.130497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:09.137977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.139060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.141574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.142223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.151390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:09.357971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.378730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.386774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.388350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a2cf1846-2155-4285-a0c6-e1aa47d5b179 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1886 microversion: 2.42 time: 0.536720 Jul 28 11:34:09.394869 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1187/2405] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:08 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1886 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:09.409167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fa2218a1-9ae1-4ae1-a863-50398d59c38c req-fe1f18a8-2d4b-4730-bf05-28b767434a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037232de-716c-4380-9033-c2c3d8c09598", "name": "network-vif-deleted", "tag": "415c3a6f-facb-4466-9bc7-b88a599a0e77"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:09.434015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa2218a1-9ae1-4ae1-a863-50398d59c38c req-fe1f18a8-2d4b-4730-bf05-28b767434a69 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.434888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa2218a1-9ae1-4ae1-a863-50398d59c38c req-fe1f18a8-2d4b-4730-bf05-28b767434a69 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.461054 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fa2218a1-9ae1-4ae1-a863-50398d59c38c req-fe1f18a8-2d4b-4730-bf05-28b767434a69 service nova] Creating event network-vif-deleted:415c3a6f-facb-4466-9bc7-b88a599a0e77 for instance 037232de-716c-4380-9033-c2c3d8c09598 on n-h1-851368-1 Jul 28 11:34:09.474527 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fa2218a1-9ae1-4ae1-a863-50398d59c38c req-fe1f18a8-2d4b-4730-bf05-28b767434a69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077950 Jul 28 11:34:09.476855 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1188/2406] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:09.488147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:09.504311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:09.526641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.528538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.531733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.532355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.572674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.573229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.574019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lazy-loading 'fault' on Instance uuid 037232de-716c-4380-9033-c2c3d8c09598 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:09.663890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.664866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccf1445753846ac929d677614481e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e3111f193244edbdb62d786409040a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:09.677581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b000bb5e-9599-4ff5-aae0-1e341b8907d1 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 200 len: 1306 microversion: 2.1 time: 0.199277 Jul 28 11:34:09.678173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1189/2407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:09 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:09.678457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37494405-1aad-4e4b-b6ab-331c9eecaf06 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1315 microversion: 2.1 time: 0.555592 Jul 28 11:34:09.694559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1219/2408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:09 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:09.870547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:09.871208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:09.880671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.881399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.882937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:09.883903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:09.993464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:10.008322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01bb6f6a-d083-441e-a65e-8dc9e37c50d2 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1597 microversion: 2.1 time: 0.141573 Jul 28 11:34:10.009196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1190/2409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:09 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1597 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:10.142875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:10.143823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:10.155697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.158166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.161957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.163194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.411903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:10.414037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:10.414714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:10.427266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.427798 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35c61573-b978-4ad3-bf79-bc98e9a6da99 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.289619 Jul 28 11:34:10.427927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.441956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1220/2410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:10 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:10.442203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.442203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.593227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a777ea54-e8f2-47d2-b0d7-e5e5eddd0a6f req-955bed9c-4ce9-40e6-bbc8-e0a62968c262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4c426-667d-481c-a22b-13db36383d0c", "name": "network-vif-deleted", "tag": "c4fa438a-beae-4c57-80b4-69c40171a069"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:10.620565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a777ea54-e8f2-47d2-b0d7-e5e5eddd0a6f req-955bed9c-4ce9-40e6-bbc8-e0a62968c262 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.621426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a777ea54-e8f2-47d2-b0d7-e5e5eddd0a6f req-955bed9c-4ce9-40e6-bbc8-e0a62968c262 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.660768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a777ea54-e8f2-47d2-b0d7-e5e5eddd0a6f req-955bed9c-4ce9-40e6-bbc8-e0a62968c262 service nova] Creating event network-vif-deleted:c4fa438a-beae-4c57-80b4-69c40171a069 for instance 54d4c426-667d-481c-a22b-13db36383d0c on n-h2-851368-1 Jul 28 11:34:10.667676 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a777ea54-e8f2-47d2-b0d7-e5e5eddd0a6f req-955bed9c-4ce9-40e6-bbc8-e0a62968c262 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085291 Jul 28 11:34:10.671128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1221/2411] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:10.704854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:10.705355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] [instance: 037232de-716c-4380-9033-c2c3d8c09598] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:10.715773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.720399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.725597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.726671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.778709 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] HTTP exception thrown: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Request method failure captured: Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 HTTP/1.1 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nMRjvWOEx7g3_U-rX7yyMf3fwP-r1mEtQT4Iu58wuqKs_tcdSsTWzc-7nDwoiThSXuzsAV8E9rqrMkrGYGbEaEHXFnyOgr0TNEbZ4rjpS1Oy0URsuWQ6_CRSud_PlhO9JIParaXZGTSX6unD5-KLp1E5NB5zVDWXcVKv7pItmxx6cY Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c3e3111f193244edbdb62d786409040a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c3e3111f193244edbdb62d786409040a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c3e3111f193244edbdb62d786409040a"}]}] Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c3e3111f193244edbdb62d786409040a Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-64614439 Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dccf1445753846ac929d677614481e5f Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-64614439-project Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '037232de-716c-4380-9033-c2c3d8c09598'} Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:10.785745 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. Jul 28 11:34:10.789687 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:10.796605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] Returning 404 to user: Instance 037232de-716c-4380-9033-c2c3d8c09598 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:10.800295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5cd168f-20c4-4b32-8842-488def53f154 tempest-ServersNegativeTestJSON-64614439 tempest-ServersNegativeTestJSON-64614439-project] 10.222.0.93 "GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598" status: 404 len: 111 microversion: 2.1 time: 0.104158 Jul 28 11:34:10.803238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1222/2412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:10 2022] GET /compute/v2.1/servers/037232de-716c-4380-9033-c2c3d8c09598 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:10.816251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:10.817230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:10.837650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.838430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:10.839482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:10.840139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.103548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.120495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.122019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.128296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a28a73d8-6606-42dc-8a73-2fc5437c3ab3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.718187 Jul 28 11:34:11.128885 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1191/2413] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:10 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:11.146267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:11.147330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:11.170165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.171504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.173319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.177173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.265926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.268345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.269047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lazy-loading 'fault' on Instance uuid 54d4c426-667d-481c-a22b-13db36383d0c {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:11.361463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.378412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d4b67ea-f5f5-42a6-a2bc-16b83ff2e004 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1502 microversion: 2.1 time: 0.572643 Jul 28 11:34:11.395400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1223/2414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:10 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1502 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:11.398580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.410879 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62e09f22-d231-4739-9ba7-360861778a5e tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 200 len: 1322 microversion: 2.1 time: 0.276603 Jul 28 11:34:11.411150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:11.413312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:11.429809 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1192/2415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:11 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:11.439838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.441728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.442809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.445859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.460834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:11.461739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:11.469668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.470844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.472289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.472941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.513238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'flavor' on Instance uuid cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:11.815305 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3240d41c-8128-4878-9beb-82d761ec0f91 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f/action" status: 202 len: 0 microversion: 2.1 time: 0.418523 Jul 28 11:34:11.819426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1224/2416] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:34:11 2022] POST /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:34:11.840890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b9bea3d6-e40a-438e-b5f4-8a4fd1b1fff0 req-16ca09ca-9ab4-4004-a322-68d62cd03e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-plugged", "status": "completed", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:11.881586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b9bea3d6-e40a-438e-b5f4-8a4fd1b1fff0 req-16ca09ca-9ab4-4004-a322-68d62cd03e88 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.882059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b9bea3d6-e40a-438e-b5f4-8a4fd1b1fff0 req-16ca09ca-9ab4-4004-a322-68d62cd03e88 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.891901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:11.905187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d93037f4-459a-4e8e-8e99-caab47531c7e tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.452173 Jul 28 11:34:11.908108 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1193/2417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:11 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:11.918269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:11.921990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:11.922201 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b9bea3d6-e40a-438e-b5f4-8a4fd1b1fff0 req-16ca09ca-9ab4-4004-a322-68d62cd03e88 service nova] Creating event network-vif-plugged:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:34:11.929895 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b9bea3d6-e40a-438e-b5f4-8a4fd1b1fff0 req-16ca09ca-9ab4-4004-a322-68d62cd03e88 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108982 Jul 28 11:34:11.933388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.937146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:11.938964 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1225/2418] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:11.942323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:11.942777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.154329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:12.155094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:12.178252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.178645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.179458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.180062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.786495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:12.794717 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9bed3013-2e7f-4885-b5ff-a79abf4a8f37 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.883836 Jul 28 11:34:12.795364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1194/2419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:11 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:12.820319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:12.824744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 54d4c426-667d-481c-a22b-13db36383d0c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:12.831811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.832441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.833400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.833978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.850750 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] HTTP exception thrown: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Request method failure captured: Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c HTTP/1.1 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJAyws-pJR1QX2KC3qKvMH0lHwpjq502Dnfy-250NbY4h2qRlKCGU6LBn4ImJt-bjsKFwXPIdCEtf2OO3es0rH-e_x2mDggkl8PEbwxh10AatNNyut3VbVE3-snOAHxFwUwywHz588tJK7XRy3hmP063Qnfjm4wWeSXPT5s8W5WgnA Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64fcfa8211044955bd77c76a587dc952"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}] Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveMigrationTest-138238008 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d61cd4ba16e748bbac55fe74a20c557e Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '54d4c426-667d-481c-a22b-13db36383d0c'} Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:12.852714 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. Jul 28 11:34:12.856603 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:12.857661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Returning 404 to user: Instance 54d4c426-667d-481c-a22b-13db36383d0c could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:12.859358 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-726c4877-363d-4370-a987-7eddbeecb0a4 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c" status: 404 len: 111 microversion: 2.1 time: 0.051130 Jul 28 11:34:12.860991 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1195/2420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:12 2022] GET /compute/v2.1/servers/54d4c426-667d-481c-a22b-13db36383d0c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:12.878868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cfa89ef-63be-458d-86d2-3a00a2c486ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '.version_select at 0x7f2eb28383a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:12.907103 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cfa89ef-63be-458d-86d2-3a00a2c486ce tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67063366" status: 202 len: 0 microversion: 2.1 time: 0.033173 Jul 28 11:34:12.909853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1196/2421] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Jul 28 11:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67063366 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:34:12.930127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:12.930762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:12.943859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.944230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:12.946508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:12.947159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:13.049488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:13.066678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:13.069089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:13.072591 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c796d7b9-7dcb-441d-ad50-9363a8dee6c4 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.922441 Jul 28 11:34:13.076381 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1226/2422] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:12 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:13.430438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:13.453858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7dd09ce2-0c57-4082-8950-e85c3b194eb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.527668 Jul 28 11:34:13.475185 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1197/2423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:12 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:13.825024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:13.825863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:13.833084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:13.833538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:13.834317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:13.840775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:14.105015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:14.105729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:14.115351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:14.116019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:14.117955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:14.126369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:14.242865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:14.251682 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3976dc1c-37b7-4397-b7d8-05c09de96d1f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.430391 Jul 28 11:34:14.255105 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1227/2424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:13 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:14.480256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:14.480871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:14.483954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:14.488285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:14.488744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:14.489528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:14.490142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:14.795203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:14.806473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:14.808706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:14.810005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0463f4f8-ba61-4572-8b3e-27bd87023923 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.709257 Jul 28 11:34:14.810663 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1198/2425] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:14 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:15.189884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:15.199857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ca0ad8f-e9cb-4817-a88a-15574c04d3e3 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1478 microversion: 2.1 time: 0.723383 Jul 28 11:34:15.206665 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1228/2426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:14 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1478 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:15.279751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:15.286512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:15.292003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:15.293094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:15.305805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.306167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:15.306966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.307445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:15.314202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.314780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:15.315650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.316094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:15.372397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:15.463183 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64e064f5-0982-448a-9332-7d55b7986123 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 204 len: 0 microversion: 2.1 time: 0.176567 Jul 28 11:34:15.466859 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1229/2427] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:15 2022] DELETE /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:15.474070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:15.474908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:15.481179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.481713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:15.482569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:15.483685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:16.182309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.201725 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-223fe319-40f1-4186-8347-2e05fce71d18 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.926528 Jul 28 11:34:16.220677 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1199/2428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:15 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:16.252766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:16.253805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:16.266227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:16.267317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:16.269475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:16.272017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:16.343143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.360749 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e21ad822-e53d-44d1-a864-3c88974a565d tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 200 len: 1485 microversion: 2.1 time: 0.891841 Jul 28 11:34:16.364135 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1230/2429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:15 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 1485 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:16.380862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:16.381789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:16.393527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:16.394049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:16.394829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:16.395311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:16.931360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.932757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:16.954431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.975326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21f7fa46-342a-49f8-8212-d0f5ff520ac9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1463 microversion: 2.1 time: 0.605628 Jul 28 11:34:16.977653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1231/2430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:16 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1463 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:16.979191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.981490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:16.982907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fca8911-9e86-4c4d-bc53-3d3a9ecc1497 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.744915 Jul 28 11:34:16.996785 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1200/2431] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:16 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:17.011022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:17.015694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:17.040586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.045882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.046841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.047394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.214191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:17.233821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6ccc6580-2ae9-4fc1-8ac1-ba59a7edd7c2 tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 0 microversion: 2.1 time: 0.227093 Jul 28 11:34:17.234645 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1232/2432] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:34:17 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:34:17.247265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:17.247917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:17.248780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:17.259304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:17.259777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.267771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.269168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.269891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.275570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.276102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.276921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.277366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.353704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:17.354327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:17.354847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lazy-loading 'fault' on Instance uuid 7dda79cd-76d3-400e-9d25-12ee78cf41ec {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:17.962375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:17.978405 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-343b12a0-43cb-4834-9547-d34c309fedc3 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.740031 Jul 28 11:34:17.988957 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1201/2433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:17 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:17.994867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ecd4da75-617a-478a-94d1-b579566ec13d req-b1116197-2f31-4f47-af42-e74a93d53703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1d97a9-421f-485d-8322-4b75e50fde18", "name": "network-vif-deleted", "tag": "1338718d-9a06-438a-b329-4cc5b9f673c7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:18.008818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ecd4da75-617a-478a-94d1-b579566ec13d req-b1116197-2f31-4f47-af42-e74a93d53703 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.009789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ecd4da75-617a-478a-94d1-b579566ec13d req-b1116197-2f31-4f47-af42-e74a93d53703 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.024547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ecd4da75-617a-478a-94d1-b579566ec13d req-b1116197-2f31-4f47-af42-e74a93d53703 service nova] Creating event network-vif-deleted:1338718d-9a06-438a-b329-4cc5b9f673c7 for instance 9c1d97a9-421f-485d-8322-4b75e50fde18 on n-h1-851368-1 Jul 28 11:34:18.030778 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ecd4da75-617a-478a-94d1-b579566ec13d req-b1116197-2f31-4f47-af42-e74a93d53703 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039237 Jul 28 11:34:18.032054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1202/2434] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:18.054886 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-687b1110-ad80-45a6-8a82-44fd41bf746e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1597 microversion: 2.1 time: 0.816157 Jul 28 11:34:18.056772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.072347 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1233/2435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:17 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1597 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:18.072825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 9c1d97a9-421f-485d-8322-4b75e50fde18] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.087790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.093035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.093816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.094911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.097198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.097647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.107448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.107945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.108752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.112304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.127868 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] HTTP exception thrown: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Request method failure captured: Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 HTTP/1.1 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nJAyws-pJR1QX2KC3qKvMH0lHwpjq502Dnfy-250NbY4h2qRlKCGU6LBn4ImJt-bjsKFwXPIdCEtf2OO3es0rH-e_x2mDggkl8PEbwxh10AatNNyut3VbVE3-snOAHxFwUwywHz588tJK7XRy3hmP063Qnfjm4wWeSXPT5s8W5WgnA Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64fcfa8211044955bd77c76a587dc952"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}] Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-LiveMigrationTest-138238008 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d61cd4ba16e748bbac55fe74a20c557e Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '9c1d97a9-421f-485d-8322-4b75e50fde18'} Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:18.134218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. Jul 28 11:34:18.140675 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:18.148912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Returning 404 to user: Instance 9c1d97a9-421f-485d-8322-4b75e50fde18 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:18.150494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-749485c5-92c7-43ab-b266-980d14178d0f tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18" status: 404 len: 111 microversion: 2.1 time: 0.116698 Jul 28 11:34:18.151807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1203/2436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:18 2022] GET /compute/v2.1/servers/9c1d97a9-421f-485d-8322-4b75e50fde18 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:18.161374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:18.169138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.182673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.189811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.190928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.191639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.299039 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8963d4aa-b603-47d9-bc25-b0143b4cc90d tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action" status: 202 len: 0 microversion: 2.1 time: 0.145610 Jul 28 11:34:18.320443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1204/2437] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:34:18 2022] POST /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:34:18.331378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.336818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.355054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.356172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.359120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.359596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.398196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:18.495161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b8eca03-4f9d-485d-b27e-cccab3c7a252 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "DELETE /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 204 len: 0 microversion: 2.1 time: 0.172797 Jul 28 11:34:18.495519 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1205/2438] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:18 2022] DELETE /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:18.501315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.502205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.508997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.509416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.510796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.510796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.524825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:18.537950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:18.540495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:18.541871 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-225f2dde-206c-401e-b5ec-398a6614e5de tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.467631 Jul 28 11:34:18.543382 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1234/2439] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:18 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:18.559021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.559669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.567025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.567705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.568648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.569082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.867601 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eee29f3a-a4ae-4ef8-bf91-aa0f32f9fa3e tempest-ServersAdminTestJSON-1706672687 tempest-ServersAdminTestJSON-1706672687-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1614 microversion: 2.1 time: 0.370583 Jul 28 11:34:18.875092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1206/2440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:18 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1614 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:18.896879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:18.897385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:18.905903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.906361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.907306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:18.907625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:18.923587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:18.935725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd8762f1-363f-4e33-85ee-bd5842ab12db tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1500 microversion: 2.1 time: 0.391084 Jul 28 11:34:18.936891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1235/2441] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:18 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:18.966964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:19.011087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:19.011658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:19.029094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.029845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.030899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.031587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.119789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b57af62d-7ac0-4153-a6dd-7e23e9c21166 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 204 len: 0 microversion: 2.1 time: 0.226463 Jul 28 11:34:19.120731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1207/2442] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:18 2022] DELETE /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:19.129598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:19.130305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:19.146975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.147768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.148726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.149306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.689285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:19.696858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:19.710407 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-16c659fb-5fa3-4689-95e6-959e7760625f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.703655 Jul 28 11:34:19.716096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1236/2443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:19 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:19.722893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab021b09-cb66-4f0c-b487-03ece107a752 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1470 microversion: 2.1 time: 0.596261 Jul 28 11:34:19.725843 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1208/2444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:19 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1470 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:19.728046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:19.730159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:19.737358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.738240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.739342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.740351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.961897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:19.962666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:19.965039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:19.982925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.984187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:19.991279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:19.991795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:20.220727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:20.242935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:20.248086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:20.252663 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a930f86d-fdda-4dbe-8031-aacd5882e422 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.533726 Jul 28 11:34:20.262441 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1237/2445] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:19 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:20.404808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:20.413758 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8bcb34e8-7b96-45c6-944a-46244235deed tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1500 microversion: 2.1 time: 0.455684 Jul 28 11:34:20.414686 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1209/2446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:19 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1500 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:20.738807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:20.739576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:20.745859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:20.746697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:20.752202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:20.754949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:20.755593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:20.756055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:20.756688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:20.756839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:20.757288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:20.764904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:21.292060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:21.302876 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55a036f6-14e7-47c9-9eee-85a82c9c9c31 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1470 microversion: 2.1 time: 0.560961 Jul 28 11:34:21.305763 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1210/2447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:20 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1470 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:21.312921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:21.319222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:21.327551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:21.336500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10899d24-afbc-473c-9e3d-1274d37db59e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.602057 Jul 28 11:34:21.337633 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1238/2448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:20 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:21.345508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:21.345962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:21.346750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:21.347223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:21.435016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:21.435668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:21.451874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:21.452349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:21.453166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:21.453613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:21.891850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:21.901425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:21.902933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:21.911312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7fd29ad8-2134-4363-b42d-4d92df86bc16 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.604181 Jul 28 11:34:21.911909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1211/2449] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:21 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:22.006130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cd4ba16e748bbac55fe74a20c557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64fcfa8211044955bd77c76a587dc952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:22.019566 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24e209f8-1635-4f4f-85dd-027a26021eac tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 200 len: 1500 microversion: 2.1 time: 0.587358 Jul 28 11:34:22.044706 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1239/2450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:21 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 1500 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:22.057878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-83b90c01-d5e9-4792-98a2-ec108ac34def req-8ac92ed0-d697-402e-8c39-c0121caec62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eda5f-3857-46a7-9490-37f5f31aa2df", "name": "network-vif-deleted", "tag": "9b9e80fd-1c0d-4471-9390-8e913ba7bb4d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:22.084359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-83b90c01-d5e9-4792-98a2-ec108ac34def req-8ac92ed0-d697-402e-8c39-c0121caec62d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:22.085360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-83b90c01-d5e9-4792-98a2-ec108ac34def req-8ac92ed0-d697-402e-8c39-c0121caec62d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:22.124276 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-83b90c01-d5e9-4792-98a2-ec108ac34def req-8ac92ed0-d697-402e-8c39-c0121caec62d service nova] Creating event network-vif-deleted:9b9e80fd-1c0d-4471-9390-8e913ba7bb4d for instance 700eda5f-3857-46a7-9490-37f5f31aa2df on n-h1-851368-1 Jul 28 11:34:22.145027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-83b90c01-d5e9-4792-98a2-ec108ac34def req-8ac92ed0-d697-402e-8c39-c0121caec62d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097889 Jul 28 11:34:22.145881 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1240/2451] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:22.277895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3cc642ba-e178-47b4-b3c5-4a9bf1a03ed1 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Action: 'create', calling method: .version_select at 0x7f2eb2c0f790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-126146852", "metadata": {"Type": "work"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:22.327115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:22.327896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:22.354880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:22.355613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:22.356600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:22.357195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:22.544252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:22.560751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0ce4b114-18b1-4970-924d-2b78c0a04afb tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 200 len: 1428 microversion: 2.1 time: 0.238576 Jul 28 11:34:22.561903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1241/2452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:22 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 1428 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:22.582366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:22.582991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:22.608810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:22.611947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:22.612983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:22.613583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.046132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3cc642ba-e178-47b4-b3c5-4a9bf1a03ed1 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.083084 Jul 28 11:34:23.049078 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1212/2453] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Jul 28 11:34:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1087 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 11:34:23.055035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:23.056770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:23.096137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.097720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.100501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.102071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.681741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:23.692562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5932128-b6c8-43ca-9ccb-476b69258658 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 1.129574 Jul 28 11:34:23.693960 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1242/2454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:22 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:23.699196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:23.700150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] [instance: 700eda5f-3857-46a7-9490-37f5f31aa2df] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:23.708042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.708733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.709984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.710754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.729945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] HTTP exception thrown: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Request method failure captured: Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df HTTP/1.1 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nJAyws-pJR1QX2KC3qKvMH0lHwpjq502Dnfy-250NbY4h2qRlKCGU6LBn4ImJt-bjsKFwXPIdCEtf2OO3es0rH-e_x2mDggkl8PEbwxh10AatNNyut3VbVE3-snOAHxFwUwywHz588tJK7XRy3hmP063Qnfjm4wWeSXPT5s8W5WgnA Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64fcfa8211044955bd77c76a587dc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64fcfa8211044955bd77c76a587dc952"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64fcfa8211044955bd77c76a587dc952"}]}] Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-LiveMigrationTest-138238008 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 64fcfa8211044955bd77c76a587dc952 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-LiveMigrationTest-138238008 Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d61cd4ba16e748bbac55fe74a20c557e Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-LiveMigrationTest-138238008-project Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '700eda5f-3857-46a7-9490-37f5f31aa2df'} Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.732262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. Jul 28 11:34:23.736462 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.738180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] Returning 404 to user: Instance 700eda5f-3857-46a7-9490-37f5f31aa2df could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:23.739269 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df5d3fbd-150e-49d4-8080-66848276fa02 tempest-LiveMigrationTest-138238008 tempest-LiveMigrationTest-138238008-project] 10.222.0.93 "GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df" status: 404 len: 111 microversion: 2.1 time: 0.044093 Jul 28 11:34:23.740338 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1243/2455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:23 2022] GET /compute/v2.1/servers/700eda5f-3857-46a7-9490-37f5f31aa2df => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:23.746529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0198f2f-d6ad-42db-a0c5-144fe0977c3d tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb2485040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:23.806295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:23.819838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:23.821346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:23.822517 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a9c94cdf-1319-4bd5-85f6-7cf03d81eaf2 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.772429 Jul 28 11:34:23.822660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0198f2f-d6ad-42db-a0c5-144fe0977c3d tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 352 microversion: 2.1 time: 0.080933 Jul 28 11:34:23.823062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1213/2456] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:23 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:23.823301 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1244/2457] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:23 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:23.846455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:23.849163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bda8c438-0f26-4ebf-be6c-11187f4c6e0d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:23.863994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.864597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.865469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.866762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.892366 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] HTTP exception thrown: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Request method failure captured: Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d HTTP/1.1 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nOVT7Qk10vzH3h5jJYdpG23_rAaq-5azPoWj1zmqs4smnwT7aC06Q9QCAtWcGJAu1g5svoUdHIxQEcBcqtUE1Q_9dkMy-uwtVS0Cv4IN5VHe9PMACh9TLtAyY1ZhfWla0F3IkeVjHAog0nxM7d-Ya008v5_7hEFAShyEuhFjSq9LPg Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}] Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 84e1308406bc4870967e9d826c14e68e Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bda8c438-0f26-4ebf-be6c-11187f4c6e0d'} Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:23.895050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:23.899415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Returning 404 to user: Instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:23.901641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0dfbc79-4e02-49e7-8ea1-32914c9e3ac5 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d" status: 404 len: 111 microversion: 2.1 time: 0.070414 Jul 28 11:34:23.903289 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1245/2458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:23 2022] GET /compute/v2.1/servers/bda8c438-0f26-4ebf-be6c-11187f4c6e0d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:23.912053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:23.912651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:23.920360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.921027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.922396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:23.922974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:23.972670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:23.976041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:24.083651 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e3a7c48-2318-4e4b-9eba-0e32644f0932 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 204 len: 0 microversion: 2.1 time: 0.175082 Jul 28 11:34:24.085865 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1214/2459] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:23 2022] DELETE /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:24.094766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:24.096048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:24.109571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.110338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.110812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.111305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.209236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-35aa0f7e-e396-4c3c-a41b-d4ce4fbf8379 req-9975fc95-eff9-45ee-a97b-e6b1d142bd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda8c438-0f26-4ebf-be6c-11187f4c6e0d", "name": "network-vif-deleted", "tag": "11ddc097-0a8c-4c9b-a797-5c6c131a548c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:24.222569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-35aa0f7e-e396-4c3c-a41b-d4ce4fbf8379 req-9975fc95-eff9-45ee-a97b-e6b1d142bd2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.223274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-35aa0f7e-e396-4c3c-a41b-d4ce4fbf8379 req-9975fc95-eff9-45ee-a97b-e6b1d142bd2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.242302 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-35aa0f7e-e396-4c3c-a41b-d4ce4fbf8379 req-9975fc95-eff9-45ee-a97b-e6b1d142bd2f service nova] Creating event network-vif-deleted:11ddc097-0a8c-4c9b-a797-5c6c131a548c for instance bda8c438-0f26-4ebf-be6c-11187f4c6e0d on n-h1-851368-1 Jul 28 11:34:24.268611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-35aa0f7e-e396-4c3c-a41b-d4ce4fbf8379 req-9975fc95-eff9-45ee-a97b-e6b1d142bd2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058403 Jul 28 11:34:24.275691 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1215/2460] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:34:24.496612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:24.505427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb20a14e-ffa3-450d-9b26-cc4840bbbdb9 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1468 microversion: 2.1 time: 0.415191 Jul 28 11:34:24.506283 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1246/2461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:24 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:24.718219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:24.719521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:24.728251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.728965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.729972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.730632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.838199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe14076e-23b2-416c-8812-4ae705b5fe2b tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb24cb8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:24.925997 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe14076e-23b2-416c-8812-4ae705b5fe2b tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 353 microversion: 2.1 time: 0.091855 Jul 28 11:34:24.927003 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1247/2462] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:24 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:24.937617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:24.938379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:24.944847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.945824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:24.947489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:24.948128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:25.005414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:25.018445 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a24907f-59de-485b-a350-eb2a54305f8e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.307659 Jul 28 11:34:25.044485 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1216/2463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:24 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:25.061892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-214e2849-d552-4492-b0d9-4beedb9d7784 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb289fe50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:25.166200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-214e2849-d552-4492-b0d9-4beedb9d7784 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 353 microversion: 2.1 time: 0.119320 Jul 28 11:34:25.177304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1217/2464] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:25 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:25.185512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c8d46d8-d7f5-49e8-b187-12e31542e949 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb2838af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:25.322215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c8d46d8-d7f5-49e8-b187-12e31542e949 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 202 len: 0 microversion: 2.1 time: 0.143110 Jul 28 11:34:25.324246 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1218/2465] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:34:25 2022] DELETE /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:34:25.335791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-283adef4-f8c6-4e40-9c48-77a2254a3cd2 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb2836f70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:25.409305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:25.426431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:25.429196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:25.431330 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95d2f7a0-0887-4559-9cc5-608f4d724e7b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.503122 Jul 28 11:34:25.432041 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-283adef4-f8c6-4e40-9c48-77a2254a3cd2 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 352 microversion: 2.1 time: 0.103701 Jul 28 11:34:25.432478 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1248/2466] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:24 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:25.439267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1219/2467] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:25 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:34:25.528572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:25.529326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:25.545188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:25.547627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:25.554408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:25.555618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:26.044793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:26.045784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:26.058979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:26.059506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:26.059788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:26.060299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:26.060790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:26.067554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a3ceb8e-9bde-453f-9a7a-a7c32d8f719d tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1468 microversion: 2.1 time: 0.544379 Jul 28 11:34:26.074696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1220/2468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:25 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:26.445888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08d71031-47a3-45f5-a2c4-673257def8d2 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb294f1f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:26.466048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:26.476977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db90dbc2-5f4b-4270-b41e-f4b004fc5990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.437482 Jul 28 11:34:26.481122 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1249/2469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:26 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:26.493434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:26.496832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:26.516115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:26.517582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:26.518729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:26.519452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:26.602003 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08d71031-47a3-45f5-a2c4-673257def8d2 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 352 microversion: 2.1 time: 0.159855 Jul 28 11:34:26.608601 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1221/2470] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:26 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:27.063610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:27.081320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:27.085823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:27.087570 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82c8745f-6c92-4f5c-b35b-702891f50bde tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.604304 Jul 28 11:34:27.090295 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1250/2471] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:26 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:27.113615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:27.114165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:27.136179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:27.136444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:27.140859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:27.141355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:27.205470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-134c6db7-6318-4c25-8afa-ca414b58fb83 req-c019bf3d-e4b1-4836-a1ef-f51ff5d2b986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd250b16-7fcf-4d51-a1b7-856c77b3f04b", "name": "network-vif-deleted", "tag": "fd4a7303-6e7e-4319-a613-5adde3fcb56e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:27.227589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-134c6db7-6318-4c25-8afa-ca414b58fb83 req-c019bf3d-e4b1-4836-a1ef-f51ff5d2b986 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:27.228793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-134c6db7-6318-4c25-8afa-ca414b58fb83 req-c019bf3d-e4b1-4836-a1ef-f51ff5d2b986 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:27.269800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-134c6db7-6318-4c25-8afa-ca414b58fb83 req-c019bf3d-e4b1-4836-a1ef-f51ff5d2b986 service nova] Creating event network-vif-deleted:fd4a7303-6e7e-4319-a613-5adde3fcb56e for instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b on n-h2-851368-1 Jul 28 11:34:27.278456 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-134c6db7-6318-4c25-8afa-ca414b58fb83 req-c019bf3d-e4b1-4836-a1ef-f51ff5d2b986 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078635 Jul 28 11:34:27.283633 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1251/2472] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:34:27.301027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:27.309492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01c97479-978f-48c0-b326-b656c3410948 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 200 len: 1426 microversion: 2.1 time: 0.204813 Jul 28 11:34:27.312065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1222/2473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:27 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 1426 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:27.506007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:27.507021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:27.574189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:27.576217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:27.578217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:27.582608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:27.617512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c810ffaf-9dda-4f2f-b836-b0f035096b3a tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb2836b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:27.826004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c810ffaf-9dda-4f2f-b836-b0f035096b3a tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 352 microversion: 2.1 time: 0.212293 Jul 28 11:34:27.826648 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1223/2474] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:27 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:28.118966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:28.119748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:28.132492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.134500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.136886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.138756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.206116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:28.219372 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-192adff0-3cf7-4881-a7b9-de8b072b07e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.718650 Jul 28 11:34:28.224186 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1252/2475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:27 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:28.333011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:28.334737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: bd250b16-7fcf-4d51-a1b7-856c77b3f04b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:28.349791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.350594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.351594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.352338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.413240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] HTTP exception thrown: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Request method failure captured: Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b HTTP/1.1 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nOVT7Qk10vzH3h5jJYdpG23_rAaq-5azPoWj1zmqs4smnwT7aC06Q9QCAtWcGJAu1g5svoUdHIxQEcBcqtUE1Q_9dkMy-uwtVS0Cv4IN5VHe9PMACh9TLtAyY1ZhfWla0F3IkeVjHAog0nxM7d-Ya008v5_7hEFAShyEuhFjSq9LPg Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}] Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 84e1308406bc4870967e9d826c14e68e Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bd250b16-7fcf-4d51-a1b7-856c77b3f04b'} Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:28.421266 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. Jul 28 11:34:28.424910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:28.426825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Returning 404 to user: Instance bd250b16-7fcf-4d51-a1b7-856c77b3f04b could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:28.427983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ed68871-e38f-48a5-8807-b5ce8c453f3c tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b" status: 404 len: 111 microversion: 2.1 time: 0.099453 Jul 28 11:34:28.431860 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1253/2476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:28 2022] GET /compute/v2.1/servers/bd250b16-7fcf-4d51-a1b7-856c77b3f04b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:28.448416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:28.449260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:28.470904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.471761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.472796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.473431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.506992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:28.552448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:34:28.744990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-311b9e09-422a-4710-a766-d4d23a547bde tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 204 len: 0 microversion: 2.1 time: 0.300792 Jul 28 11:34:28.745616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1254/2477] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:34:28 2022] DELETE /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:34:28.768976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:28.778344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:28.803061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.804575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:28.807680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:28.807970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:29.565537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:29.580283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-861a83e5-38b8-4a0d-a92a-0b92c200b839 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1469 microversion: 2.1 time: 0.819881 Jul 28 11:34:29.581219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1255/2478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:28 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1469 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:29.596950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7e6e9b5-2515-4a25-91e5-2a7efbbfae6c tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb25ab160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:29.731727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7e6e9b5-2515-4a25-91e5-2a7efbbfae6c tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 200 len: 352 microversion: 2.1 time: 0.149256 Jul 28 11:34:29.733733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1256/2479] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:29 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:29.738699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:29.739344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:29.757422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:29.764006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:29.766476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:29.767893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:29.882386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:29.896916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:29.904233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:29.906695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f8f9f225-b9c0-4f17-9696-ea5032a4756a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 1.792527 Jul 28 11:34:29.909578 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1224/2480] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:28 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:29.923626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1521451357", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "29e9b746-5e35-4dd2-92d3-57da6ae9bf17"}, {"uuid": "ff8d0fc9-cdb8-47da-af0c-d84fd6aef42e"}, {"uuid": "29e9b746-5e35-4dd2-92d3-57da6ae9bf17"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:29.987291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] validate_networks() for [('29e9b746-5e35-4dd2-92d3-57da6ae9bf17', None, None, None, None, None), ('ff8d0fc9-cdb8-47da-af0c-d84fd6aef42e', None, None, None, None, None), ('29e9b746-5e35-4dd2-92d3-57da6ae9bf17', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:34:30.168506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:30.188021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2aeeefa8-9e1b-4cce-9534-d193cac67b40 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.453163 Jul 28 11:34:30.188651 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1257/2481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:29 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:30.511745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c1e36cd4-5c6b-4bd7-8f51-bf6830f8cdff tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] Calling method '.version_select at 0x7f2eb2485940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:30.512636 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:30.512636 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:34:30.550051 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c1e36cd4-5c6b-4bd7-8f51-bf6830f8cdff tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.360000 Jul 28 11:34:30.550652 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1258/2482] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:34:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:30.563335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1dc3e5c4-1633-4ecd-9b14-a491947757e3 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb2485a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:30.567423 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:30.567423 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:34:30.895765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=10,nova_api:INSERT=5 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:31.029731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1dc3e5c4-1633-4ecd-9b14-a491947757e3 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.467184 Jul 28 11:34:31.030606 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1259/2483] 10.222.0.93 () {60 vars in 1206 bytes} [Thu Jul 28 11:34:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:34:31.044382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:31.045034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:31.068698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:31.069664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:31.070817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:31.081461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:31.691451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:31.707204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5a72eb5c-18da-4c09-8c30-a0a824faa158 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1469 microversion: 2.1 time: 0.665609 Jul 28 11:34:31.708886 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1260/2484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:31 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1469 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:31.716255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-555e3354-0f19-4e0f-8541-b602624b7622 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Calling method '.version_select at 0x7f2eb2547ca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:31.756378 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-555e3354-0f19-4e0f-8541-b602624b7622 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] HTTP exception thrown: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-555e3354-0f19-4e0f-8541-b602624b7622 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Request method failure captured: Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b HTTP/1.1 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nQ96zo9S-94YLAcPLcFrc1bDumaPCDX5kpZDFdM1YvYB14LKBNqpQp31GW6yjs0m7yoFJrXTvpRVgLsGrWwjlT22kx7LRLsiSmmUBpo1LsZWJybevCpZCCnqufHqjl1sDB0BbFVXKYZLUeM_TPbovKRhD4KksC6REBmyX2UjqO_bKA Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: f63636dc30f0484c8bd37d279fe9d9d2 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesGetTestJSON-1609368813 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f63636dc30f0484c8bd37d279fe9d9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f63636dc30f0484c8bd37d279fe9d9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f63636dc30f0484c8bd37d279fe9d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f63636dc30f0484c8bd37d279fe9d9d2"}]}] Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesGetTestJSON-1609368813 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: f63636dc30f0484c8bd37d279fe9d9d2 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesGetTestJSON-1609368813 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesGetTestJSON-1609368813-project Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9e74dcede6fc452998200f6b99a3f429 Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesGetTestJSON-1609368813-project Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: exception: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd469b0aa-1384-4ad5-912d-5ff0d3eed46b'} Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. (HTTP 404) (Request-ID: req-5e741957-9520-448b-b241-c74f50693989) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:34:31.810232 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-555e3354-0f19-4e0f-8541-b602624b7622 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] Returning 404 to user: Volume d469b0aa-1384-4ad5-912d-5ff0d3eed46b could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-555e3354-0f19-4e0f-8541-b602624b7622 tempest-VolumesGetTestJSON-1609368813 tempest-VolumesGetTestJSON-1609368813-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b" status: 404 len: 109 microversion: 2.1 time: 0.102663 Jul 28 11:34:31.815151 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1261/2485] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:34:31 2022] GET /compute/v2.1/os-volumes/d469b0aa-1384-4ad5-912d-5ff0d3eed46b => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:34:31.834974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:31.835938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:31.860280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:31.863014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:31.863876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:31.864329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.200284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:34:32.203933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:34:32.205348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:34:32.207395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:34:32.207958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:34:32.223201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.224046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.225219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.226095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.250374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Getting quotas for project 94da65f2f5404355bb866482aba46657. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:34:32.256238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Getting quotas for user d589864c43174112961a7c1a3c17ee8b and project 94da65f2f5404355bb866482aba46657. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:34:32.277812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:34:32.281421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:34:32.292917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:32.309592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:32.311986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:32.314169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9db77bee-2705-4ea4-8f98-dd87c3a256eb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.499007 Jul 28 11:34:32.314779 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1262/2486] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:31 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:32.326454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-242f7cf0-dbfa-4095-a5d3-756e1a9b71b4 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] Calling method '.version_select at 0x7f2eb2465940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:32.336435 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:32.336435 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:34:32.374257 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-242f7cf0-dbfa-4095-a5d3-756e1a9b71b4 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.057713 Jul 28 11:34:32.378145 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1263/2487] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 11:34:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:32.391378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:32.391539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9474d3a4-4a10-4ba3-ad94-dde45e6b2cbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478257 Jul 28 11:34:32.392451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:32.399213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1225/2488] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:34:32.403832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.408670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.409713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da1aaba9-ddb8-4b72-9466-4728b27d9c07 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb289fdc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:32.410299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.410755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.419663 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:32.419663 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:32.606842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da1aaba9-ddb8-4b72-9466-4728b27d9c07 tempest-QuotaClassesAdminTestJSON-1714631485 tempest-QuotaClassesAdminTestJSON-1714631485-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.205963 Jul 28 11:34:32.617619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1226/2489] 10.222.0.93 () {60 vars in 1206 bytes} [Thu Jul 28 11:34:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:32.624669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0fa4b9b-7df7-4881-8043-c91569816b71 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:32.625535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0fa4b9b-7df7-4881-8043-c91569816b71 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:32.749585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0fa4b9b-7df7-4881-8043-c91569816b71 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:32.765085 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0fa4b9b-7df7-4881-8043-c91569816b71 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1213 microversion: 2.1 time: 0.145909 Jul 28 11:34:32.765889 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1227/2490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:32 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:32.787456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f051408e-ac01-4411-be18-78a26d071c58 req-8d28d9f1-9ae5-447e-945b-74f84f58f9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dda79cd-76d3-400e-9d25-12ee78cf41ec", "name": "network-vif-deleted", "tag": "ee7cf233-568c-4cf0-9137-eb7c41eb4f1b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:32.816334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f051408e-ac01-4411-be18-78a26d071c58 req-8d28d9f1-9ae5-447e-945b-74f84f58f9d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.817179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f051408e-ac01-4411-be18-78a26d071c58 req-8d28d9f1-9ae5-447e-945b-74f84f58f9d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.852312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f051408e-ac01-4411-be18-78a26d071c58 req-8d28d9f1-9ae5-447e-945b-74f84f58f9d0 service nova] Creating event network-vif-deleted:ee7cf233-568c-4cf0-9137-eb7c41eb4f1b for instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec on n-h1-851368-1 Jul 28 11:34:32.860563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f051408e-ac01-4411-be18-78a26d071c58 req-8d28d9f1-9ae5-447e-945b-74f84f58f9d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091896 Jul 28 11:34:32.867373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1228/2491] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:32.874313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:32.880116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:32.915528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.916625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:32.918602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:32.920984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:33.062800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:33.074906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df2d14ec-fe62-4d52-a965-386f85d48229 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1427 microversion: 2.1 time: 0.206055 Jul 28 11:34:33.075900 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1229/2492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:32 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:33.135368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:33.152691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54b26250-bd3f-4607-ab7e-69e6b0acc282 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.766267 Jul 28 11:34:33.157388 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1264/2493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:32 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:33.344287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:33.350105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:33.367937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:33.370189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:33.371946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:33.377767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:33.789702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:33.790420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:33.800721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:33.801292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:33.802383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:33.803661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:33.943824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:33.991418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b6d70cb-e9bd-48ab-97de-ace073fb0de0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1265 microversion: 2.1 time: 0.197714 Jul 28 11:34:33.992484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1265/2494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:33 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:34.074962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:34.097025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:34.098783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:34.100237 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5dab629-ccbf-4df7-bc78-1d07b7913cba tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.761719 Jul 28 11:34:34.100703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:34.101433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:34.115975 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1230/2495] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:33 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:34.129789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:34.130838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:34.132052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:34.137507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:34.187329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:34.188505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:34.202791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:34.204124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:34.205575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:34.206270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:34.226717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:34.228894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:34.229614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lazy-loading 'fault' on Instance uuid 7dda79cd-76d3-400e-9d25-12ee78cf41ec {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:34.371506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e1308406bc4870967e9d826c14e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed58b93a0994b60ba42ab32ad236dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:34.385499 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-106b3516-e747-4123-a019-a2d1e55f2c03 tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 200 len: 1303 microversion: 2.1 time: 0.290704 Jul 28 11:34:34.387311 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1266/2496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:34 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:34.667510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:34.677918 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c66404fe-bf37-4156-b699-cff3a4af136b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.497197 Jul 28 11:34:34.699698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1231/2497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:34 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:35.014649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:35.015543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:35.028562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.029727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.032623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.033881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.128308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:35.129330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:35.142136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.142846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.144024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.147335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.198925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:35.211884 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-605d05ce-6d0d-4c65-8159-84a253cf4dd9 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1271 microversion: 2.1 time: 0.200517 Jul 28 11:34:35.215163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1267/2498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:35 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:35.410502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:35.411303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] [instance: 7dda79cd-76d3-400e-9d25-12ee78cf41ec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:35.425578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.426038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.432058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.432521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.476424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] HTTP exception thrown: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Request method failure captured: Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec HTTP/1.1 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nOVT7Qk10vzH3h5jJYdpG23_rAaq-5azPoWj1zmqs4smnwT7aC06Q9QCAtWcGJAu1g5svoUdHIxQEcBcqtUE1Q_9dkMy-uwtVS0Cv4IN5VHe9PMACh9TLtAyY1ZhfWla0F3IkeVjHAog0nxM7d-Ya008v5_7hEFAShyEuhFjSq9LPg Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0ed58b93a0994b60ba42ab32ad236dd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0ed58b93a0994b60ba42ab32ad236dd8"}]}] Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0ed58b93a0994b60ba42ab32ad236dd8 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminTestJSON-393600120 Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 84e1308406bc4870967e9d826c14e68e Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminTestJSON-393600120-project Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7dda79cd-76d3-400e-9d25-12ee78cf41ec'} Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:35.482875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:35.486708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] Returning 404 to user: Instance 7dda79cd-76d3-400e-9d25-12ee78cf41ec could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:35.488181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d8e2a21-2110-4e1a-a17f-69a52d827a2b tempest-ServersAdminTestJSON-393600120 tempest-ServersAdminTestJSON-393600120-project] 10.222.0.93 "GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec" status: 404 len: 111 microversion: 2.1 time: 0.080450 Jul 28 11:34:35.491144 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1268/2499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:35 2022] GET /compute/v2.1/servers/7dda79cd-76d3-400e-9d25-12ee78cf41ec => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:34:35.712721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:35.713746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:35.721269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.721876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:35.722939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:35.723698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:36.028542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:36.061177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:36.070751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:36.076713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55a0c585-c12e-470c-99c6-ba252a9d0c17 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.947969 Jul 28 11:34:36.077639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1232/2500] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:35 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:36.227628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:36.242428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:36.243288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:36.247674 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-137269a4-fd4e-4e6f-ac19-7f242c04733f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.543565 Jul 28 11:34:36.265818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1269/2501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:35 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:36.272588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:36.277784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:36.279826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:36.280499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:36.491988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:36.506202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-466bd3e8-1cca-4381-8d13-ee755feb54c6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1271 microversion: 2.1 time: 0.268552 Jul 28 11:34:36.507054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1233/2502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:36 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1271 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:37.118600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:37.120370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:37.152087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:37.152881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:37.156735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:37.159211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:37.273803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:37.275161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:37.282483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:37.292736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:37.294490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:37.295287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:38.216311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:38.230394 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d8b3858-4d3a-4361-83b1-8e5f9a72f7da tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.960232 Jul 28 11:34:38.241588 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1234/2503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:37 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:38.249907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:38.262432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:38.263979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:38.265183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:38.267207 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d15c42d-ed0b-4fa8-a759-3d836cc3931a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 1.156531 Jul 28 11:34:38.268262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1270/2504] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:37 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:38.271130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:38.286589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aee9020-323c-47c6-9424-59ab99cda212"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:38.290953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:38.301581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:38.302335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:38.304989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:38.307264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:38.308141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:38.311565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:38.312413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:38.312872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:38.825021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1862e994-cb0e-4056-8f0e-47b2e09efd13 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "POST /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555280 Jul 28 11:34:38.825715 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1271/2505] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:34:38 2022] POST /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:39.232132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:39.255044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:39.256385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:39.263437 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc1c3426-c7ad-45a4-b35e-0f4b9fc4e115 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1334 microversion: 2.1 time: 1.011948 Jul 28 11:34:39.269506 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1235/2506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:38 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1334 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:39.277619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:39.278598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:39.283315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:39.283992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:39.301133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:39.303838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:39.336939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:39.337584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:39.338423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:39.338872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:40.303030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:40.310989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:40.331532 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5456dea-86ee-4c6e-b01a-c69ffced4114 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 1.083471 Jul 28 11:34:40.347217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:40.348731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:40.349913 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4dc7bcf5-85a4-44bb-a6e3-a40254e20a9f tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 1.060011 Jul 28 11:34:40.359757 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1272/2507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:39 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:40.359862 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1236/2508] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:39 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:40.370866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:40.385792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:40.409620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:40.414842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:40.422573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:40.428876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:40.614590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:41.329253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:41.347826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60781206-b5f0-402d-9835-e20a9eea8c41 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.993776 Jul 28 11:34:41.355483 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1273/2509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:40 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:41.359926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:41.361100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:41.382379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:41.383551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:41.388821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:41.390535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:41.391382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:41.391833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:41.406112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:41.408720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:41.411355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:41.413835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:41.886526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:41.901874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:41.905973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:41.908606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2de5c3e0-507d-4603-b1b3-277b2cea3827 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.531966 Jul 28 11:34:41.912379 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1274/2510] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:41 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:41.943982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:41.955061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afb5aea1-09ea-49e6-a941-0ee5e0f88df8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.600547 Jul 28 11:34:41.957937 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1237/2511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:41 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:42.389589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:42.390295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:42.394209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:42.414171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:42.416547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:42.417386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:42.426537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:42.690803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:42.763743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:43.017921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:43.032050 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c72310e4-408a-42a2-a40b-863dfd39e706 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.649674 Jul 28 11:34:43.032637 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1275/2512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:42 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:43.043777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:43.044618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:43.052350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:43.053094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:43.054472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:43.055136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:43.243975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb28364c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:43.667993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:43.686535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:43.689458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:43.700945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4255b83c-5846-46ba-a142-8bba0bce0032 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.664311 Jul 28 11:34:43.715100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1276/2513] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:43 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:43.716490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:43.718700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:43.736725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:43.737196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:43.739471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:43.741727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.002613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.003201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.006951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.007487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.093751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:44.100197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:44.111122 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51641be9-99d6-41bd-80c6-82f64f619557 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1508 microversion: 2.1 time: 0.403536 Jul 28 11:34:44.112156 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1277/2514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:43 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:44.123562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-00442fe7-47b7-4c41-ac47-f6802eaaf824 req-4d34e31e-8ec2-459d-86dc-e635becc656e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "tag": "9a6b8bc3-b40d-4d62-9f40-655b91127ac9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:44.133633 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40671b17-7d9f-462e-8472-a8a8a0b5785a tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556" status: 200 len: 240 microversion: 2.36 time: 1.447668 Jul 28 11:34:44.135312 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1238/2515] 10.222.0.93 () {62 vars in 1303 bytes} [Thu Jul 28 11:34:42 2022] PUT /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556 => generated 240 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:34:44.141592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:44.142653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:44.147365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00442fe7-47b7-4c41-ac47-f6802eaaf824 req-4d34e31e-8ec2-459d-86dc-e635becc656e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.147819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00442fe7-47b7-4c41-ac47-f6802eaaf824 req-4d34e31e-8ec2-459d-86dc-e635becc656e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.150645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.151297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.152476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.153170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.176413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-00442fe7-47b7-4c41-ac47-f6802eaaf824 req-4d34e31e-8ec2-459d-86dc-e635becc656e service nova] Creating event network-changed:9a6b8bc3-b40d-4d62-9f40-655b91127ac9 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:34:44.184316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:44.187658 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-00442fe7-47b7-4c41-ac47-f6802eaaf824 req-4d34e31e-8ec2-459d-86dc-e635becc656e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071969 Jul 28 11:34:44.188545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1278/2516] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:44.204464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Calling method '.version_select at 0x7f2eb24aa0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:44.734587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:44.754775 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a83ef95-2896-411d-935d-7ca7b619a9b5 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.617814 Jul 28 11:34:44.771860 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1239/2517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:44 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:44.781210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:44.782741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:44.793245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.794500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.796188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.796861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.886123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.886650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.887452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:44.887899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:44.967191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb0c66c8-cd96-4688-850e-5ff95291ce11 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556/detail" status: 200 len: 672 microversion: 2.36 time: 0.773552 Jul 28 11:34:44.968108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1279/2518] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Jul 28 11:34:44 2022] GET /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556/detail => generated 672 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:34:45.140067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:45.140888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:45.154194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:45.154693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:45.155722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:45.156343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:45.520974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:45.543113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:45.545894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:45.549478 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e9a5c4b-acaa-4be0-aa33-b17ca631e669 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.775670 Jul 28 11:34:45.550599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1240/2519] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:44 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:45.565258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:45.574077 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11db9fb2-4d77-4938-889b-c372404c65eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1529 microversion: 2.1 time: 0.440519 Jul 28 11:34:45.577442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1280/2520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:45 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1529 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:45.786915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:45.787884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:45.815965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:45.817606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:45.827336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:45.828771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:45.941457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb346f5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:46.234657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:46.258858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4cba1fb-f4fb-4d81-8564-adb2de12b035 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.476765 Jul 28 11:34:46.263285 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1241/2521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:45 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:46.273322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5d89c85c-b853-4f1c-9f51-f142a9649642 req-34320280-0306-43d5-91fe-00aa02ca212d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "tag": "a529d433-5061-4466-a96d-6e6c4d5593b6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:46.305597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d89c85c-b853-4f1c-9f51-f142a9649642 req-34320280-0306-43d5-91fe-00aa02ca212d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.306292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d89c85c-b853-4f1c-9f51-f142a9649642 req-34320280-0306-43d5-91fe-00aa02ca212d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.330045 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5d89c85c-b853-4f1c-9f51-f142a9649642 req-34320280-0306-43d5-91fe-00aa02ca212d service nova] Creating event network-changed:a529d433-5061-4466-a96d-6e6c4d5593b6 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:34:46.346466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5d89c85c-b853-4f1c-9f51-f142a9649642 req-34320280-0306-43d5-91fe-00aa02ca212d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081166 Jul 28 11:34:46.347808 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1242/2522] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:46.550366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.552596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.554107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.555813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.633885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.635870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.638348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.640797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.650579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2022263157", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:46.746118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:34:46.758163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c80aec3c-b7e3-44ad-b457-343ee6c64e20 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556?user_id=1120469f3a9d4e28b0ff205cb9c0f1a7" status: 200 len: 240 microversion: 2.36 time: 0.820919 Jul 28 11:34:46.759555 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1281/2523] 10.222.0.93 () {62 vars in 1384 bytes} [Thu Jul 28 11:34:45 2022] PUT /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556?user_id=1120469f3a9d4e28b0ff205cb9c0f1a7 => generated 240 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 11:34:46.764436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:46.765311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:46.771646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.772415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:46.773416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:46.774048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.318273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:47.334332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:47.337636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:47.339399 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a1a1186-191b-4a69-9e91-aa79775b367e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.578646 Jul 28 11:34:47.339956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1282/2524] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:46 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:47.352353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:47.357682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:47.379339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.379917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.380963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.381532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.761888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:34:47.762951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:34:47.765180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:34:47.765620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:34:47.766050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:34:47.776428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.777057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.778013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.778836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.800877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Getting quotas for project 10e4941f9f064085aef668b56f0d3b6d. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:34:47.808656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Getting quotas for user efaead1779d443a29706991be48f1282 and project 10e4941f9f064085aef668b56f0d3b6d. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:34:47.832619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:34:47.837815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:34:47.875098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:47.889539 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c1bb05c-0bd4-4dbd-8e33-283050d2affb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1529 microversion: 2.1 time: 0.541135 Jul 28 11:34:47.903800 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1283/2525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:47 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1529 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:47.906223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bccbce66-d14f-4f0a-867a-c1fb2769110e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556924 Jul 28 11:34:47.907377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1243/2526] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:34:47.913217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:47.914390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:47.924448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.925230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.926222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:47.927028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:47.947605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f20ef2a8-363e-428b-9030-3c6ea696c302 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] Calling method '.version_select at 0x7f2eb24aa0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:48.313844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:48.326885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a74e3341-3675-4086-aea5-55496f0a44ef tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.418191 Jul 28 11:34:48.327521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1244/2527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:47 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:48.336656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-25a17b33-a0a2-4c53-91ff-7101b3eed5e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:48.337271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-25a17b33-a0a2-4c53-91ff-7101b3eed5e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:48.398748 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f20ef2a8-363e-428b-9030-3c6ea696c302 tempest-QuotasAdminTestV236-510080831 tempest-QuotasAdminTestV236-510080831-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556?user_id=1120469f3a9d4e28b0ff205cb9c0f1a7" status: 200 len: 282 microversion: 2.36 time: 0.476248 Jul 28 11:34:48.400032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1284/2528] 10.222.0.93 () {60 vars in 1364 bytes} [Thu Jul 28 11:34:47 2022] GET /compute/v2.1/os-quota-sets/610afca4c5b24cb6b567dfcf04e5c556?user_id=1120469f3a9d4e28b0ff205cb9c0f1a7 => generated 282 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:34:48.406343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:48.407200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:48.414788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:48.415473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:48.417036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:48.417628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:48.464020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-25a17b33-a0a2-4c53-91ff-7101b3eed5e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:48.473327 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-25a17b33-a0a2-4c53-91ff-7101b3eed5e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1222 microversion: 2.1 time: 0.143576 Jul 28 11:34:48.474046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1245/2529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:48 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:48.760383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:48.782479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:48.784463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:48.786145 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f152b02f-6ac6-4c6e-a52f-14660f6bec8c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.384753 Jul 28 11:34:48.786935 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1285/2530] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:48 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:48.910629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:48.917155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8c25d1ab-b261-48d8-9cdc-15b2d4b537b0 req-396c2b5c-edf2-4494-9860-f187c2e43daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "tag": "45941616-0248-4667-a9dc-c3f8bc929237"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:48.922218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:48.947469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:48.954565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8c25d1ab-b261-48d8-9cdc-15b2d4b537b0 req-396c2b5c-edf2-4494-9860-f187c2e43daf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:48.955015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8c25d1ab-b261-48d8-9cdc-15b2d4b537b0 req-396c2b5c-edf2-4494-9860-f187c2e43daf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:48.957750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:48.958721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:48.963560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:48.989153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8c25d1ab-b261-48d8-9cdc-15b2d4b537b0 req-396c2b5c-edf2-4494-9860-f187c2e43daf service nova] Creating event network-changed:45941616-0248-4667-a9dc-c3f8bc929237 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:34:48.997817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8c25d1ab-b261-48d8-9cdc-15b2d4b537b0 req-396c2b5c-edf2-4494-9860-f187c2e43daf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085144 Jul 28 11:34:49.003666 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1286/2531] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:49.258129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:49.269815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5a246c9-32b7-4182-8e4d-b5663e49b350 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1529 microversion: 2.1 time: 0.363342 Jul 28 11:34:49.270964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1246/2532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:48 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1529 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:49.357539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:49.359497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:49.365756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:49.367840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.368629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.369691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.370483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.494530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:49.495821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:49.510037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.510887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.515602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.516573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.730888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:49.741197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-313e60cc-60b0-48a6-8c59-0a44c17426ed tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1282 microversion: 2.1 time: 0.250984 Jul 28 11:34:49.741812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1247/2533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:49 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:49.814553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:49.815315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:49.830057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.832072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.833360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:49.835107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:49.918626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:49.929463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e4f4066a-696f-4427-a227-35b12c3e5588 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.576412 Jul 28 11:34:49.939496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1287/2534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:49 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:50.295118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:50.296627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:50.305235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.305923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.307474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.308099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.387889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:50.405745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:50.409493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:50.411833 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-59b26145-d39c-4878-b92f-e7c18c6ea472 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.605022 Jul 28 11:34:50.427682 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1248/2535] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:49 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:50.748622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:50.762871 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7ea7b6c-daf3-41b9-8096-5ea289c9e1c2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1529 microversion: 2.1 time: 0.474933 Jul 28 11:34:50.766601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:50.767742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:50.778334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1288/2536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:50 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1529 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:50.780586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.782694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.785906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.786799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.958930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:50.960535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:50.967614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.968703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.969711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:50.970317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:50.991769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:51.003257 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55a6c30d-eb95-46e6-9643-11517529c9f7 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1280 microversion: 2.1 time: 0.242430 Jul 28 11:34:51.004704 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1249/2537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:50 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:51.440601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:51.442471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:51.456206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:51.457017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:51.458286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:51.460776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:51.810086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:51.819489 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b45cafe4-eb9e-48e6-926d-cacd6ef1f8a8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.865825 Jul 28 11:34:51.823329 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1289/2538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:50 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:51.836352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:51.837337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:51.848565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:51.852214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:51.854403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:51.855555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:52.152329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:52.163057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-505cad73-9ad4-4e34-aaca-2fbc3ac094be tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.337766 Jul 28 11:34:52.166817 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1290/2539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:51 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:52.190796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:52.196603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:52.218265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:52.220086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:52.222463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:52.224209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:52.860110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:52.869149 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b617ae35-899a-4010-b3b8-ff7d97835be5 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.699746 Jul 28 11:34:52.869686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1291/2540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:52 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:52.881810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-10548fe9-0271-4508-8ba0-d8073099e6ea req-a25b2687-8392-4e5b-8485-27115849579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "c1fba3ac-4c0c-450f-ae53-952d5aa51f4e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:52.911515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:52.924895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:52.925828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10548fe9-0271-4508-8ba0-d8073099e6ea req-a25b2687-8392-4e5b-8485-27115849579c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:52.928493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10548fe9-0271-4508-8ba0-d8073099e6ea req-a25b2687-8392-4e5b-8485-27115849579c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:52.942722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:52.949488 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-10548fe9-0271-4508-8ba0-d8073099e6ea req-a25b2687-8392-4e5b-8485-27115849579c service nova] Creating event network-vif-plugged:c1fba3ac-4c0c-450f-ae53-952d5aa51f4e for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:52.949652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56103593-f555-4b4e-bf8a-38c640239d03 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 1.517075 Jul 28 11:34:52.950238 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1250/2541] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:51 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:34:52.974491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:52.975375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:52.982597 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-10548fe9-0271-4508-8ba0-d8073099e6ea req-a25b2687-8392-4e5b-8485-27115849579c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104963 Jul 28 11:34:52.985228 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1292/2542] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:52.987588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:52.990737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:52.992719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:52.993340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:53.190444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:53.191211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:53.204808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:53.205299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:53.207093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:53.207631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:53.503447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:53.524355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff8f02e2-e9ce-4a09-9bb4-60e375842f9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.565301 Jul 28 11:34:53.525015 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1251/2543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:52 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:53.893553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:53.894607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:53.918692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:53.921243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:53.924825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:53.928568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:55.015510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:55.019096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:55.030773 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-748a1b3b-1472-4337-8c17-f5cceceff8d7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 1.848563 Jul 28 11:34:55.049858 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1293/2544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:53 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:34:55.063542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:55.064178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:55.081056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:55.081529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:55.082337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:55.082784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:55.158461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:55.168716 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa413647-6f9a-4041-9552-11bf4f3cec90 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 1.282516 Jul 28 11:34:55.171999 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1252/2545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:53 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:55.178554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:55.187230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:55.201870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:55.204091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:55.206427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:55.208398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:55.763113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:55.774400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:55.779718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:55.783467 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32d18668-5835-4d5c-bbae-567f2438a625 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.732497 Jul 28 11:34:55.788214 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1294/2546] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:55 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:56.044408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:56.055616 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8da49ac1-3d37-4086-a67d-126cd983aae1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.880105 Jul 28 11:34:56.081077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1253/2547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:55 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:56.086414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "66490c9f-860d-4659-a0f8-fb12c956cbda"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "76e66cec-d53f-4daf-a198-0b75991865a7"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "68b0ab21-d61f-4ee1-a0c7-f3315d681809"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "af75dad6-3f30-441e-ad60-3c2fb5b737d9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:56.125654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:56.126101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:56.195971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Creating event network-vif-plugged:66490c9f-860d-4659-a0f8-fb12c956cbda for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:56.196648 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Creating event network-vif-plugged:76e66cec-d53f-4daf-a198-0b75991865a7 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:56.203819 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Creating event network-vif-plugged:68b0ab21-d61f-4ee1-a0c7-f3315d681809 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:56.206355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] Creating event network-vif-plugged:af75dad6-3f30-441e-ad60-3c2fb5b737d9 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:56.224336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a15b19dd-f7ea-44a2-87e5-ccff7d33d5d1 req-51e76b0c-7f8d-48c3-a90c-3e296a623105 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.138654 Jul 28 11:34:56.227665 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1254/2548] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:56.246919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b6fc52e6-ad54-4394-9048-9b4ee5ca78f1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:56.250389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:56.259729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:56.261115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:56.262411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:56.263918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:56.641266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1633725098", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:56.663264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:56.789749 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] HTTP exception thrown: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Request method failure captured: Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments/4aee9020-323c-47c6-9424-59ab99cda212 HTTP/1.1 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 74 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nQLiZGzllUGooGQmTDY9FivXCsEstXYC9FSQg9CYpPFTo7Qkw3LasOyWzTIdoH-gjDjjAQ9KUsNbqvrmi3I0TcP-V8VLXV-p0umKDPgA9bSNAK0U0WqqUmS_4f0SPiTVmZjJyH4WEGmOA0XQh7IhbE0C7Zws2BBaiteMttd15Zdxoc Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: b47f986e20d14843ae2d027705fa0a06 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b47f986e20d14843ae2d027705fa0a06"}]}] Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: b47f986e20d14843ae2d027705fa0a06 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesAdminNegativeTest-2001279814-project-admin Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: fe56a7153ce1413ead29528c6fb5025e Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesAdminNegativeTest-2001279814-project-admin Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: {"volumeAttachment": {"volumeId": "b6fc52e6-ad54-4394-9048-9b4ee5ca78f1"}} Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: exception: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': 'b207e98c-1958-45e4-9fee-41ca4e03ab14', 'id': '4aee9020-323c-47c6-9424-59ab99cda212', 'body': {'volumeAttachment': {'volumeId': 'b6fc52e6-ad54-4394-9048-9b4ee5ca78f1'}}} Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. (HTTP 404) (Request-ID: req-89183ebb-436d-4132-ab84-bae5bcf072eb) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:34:56.793322 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. Jul 28 11:34:56.798700 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:56.805098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Returning 400 to user: Volume b6fc52e6-ad54-4394-9048-9b4ee5ca78f1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:56.813732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:34:56.814600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c569b587-72e8-4bed-b5e9-a0cc7eae0ce6 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments/4aee9020-323c-47c6-9424-59ab99cda212" status: 400 len: 107 microversion: 2.1 time: 1.022390 Jul 28 11:34:56.815537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1295/2549] 10.222.0.93 () {60 vars in 1433 bytes} [Thu Jul 28 11:34:55 2022] PUT /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments/4aee9020-323c-47c6-9424-59ab99cda212 => generated 107 bytes in 1027 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:34:57.057319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb24aa700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:57.071357 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:57.071357 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:34:57.072672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.073144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.106691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.107343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.140367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] HTTP exception thrown: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Request method failure captured: Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: request: PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 HTTP/1.1 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 56 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRfZuMF2kppJVweAVWBeU-C-RIlldRk8IVRFAlDjjryhnmOeeIcg-SbXXf1g-rCjGl6Kubi7V0s3kezttmJ8eBp8FRvBvaquvUgZdPd58GkhlS8SyQjrzKat9eOz-AIjPBayJLIxwIraG19hcjsBOQRgpZKEjvutJ_6k-e-kE3fHpQ Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}] Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dda8471918ae4425a0f1feceb9182e2a Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: exception: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0786330b-fe82-44c5-a3e1-08323ab48c31', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:34:57.146032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Returning 404 to user: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:57.150034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf08527b-9257-494d-8225-105bec1d2faf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31" status: 404 len: 110 microversion: 2.53 time: 0.331069 Jul 28 11:34:57.152614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1296/2550] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Jul 28 11:34:56 2022] PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 => generated 110 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:34:57.168240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:57.169042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:57.199287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.199775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.201135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.201629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.498464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:34:57.500107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:34:57.500859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:34:57.501617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:34:57.502455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:34:57.527828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.530665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.532214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.535915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.585436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Getting quotas for project ce0606b0679e45a8a7e1aa65cc909019. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:34:57.592924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:57.603024 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-212abef8-9d3d-45c8-9ed0-fb577d3b60e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.450495 Jul 28 11:34:57.606047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Getting quotas for user 3449da8563ec432f90df80c20740741f and project ce0606b0679e45a8a7e1aa65cc909019. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:34:57.607218 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1297/2551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:57 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:57.614915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:57.619551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:57.632093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.634998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.637519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:34:57.638284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.638969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.646245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:34:57.725905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a205c379-2769-454b-b7e9-9ef236854035 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496454 Jul 28 11:34:57.728668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1255/2552] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:34:57.734994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-597e8030-544a-449a-af5a-b74b96a20b38 req-6625954a-6188-4c07-9399-cd078fa1f7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39918982-e3fb-4720-a3d9-bd3958b8e6a9", "tag": "153e4ab4-6c27-4848-9770-eb3734ecbf9b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:57.748473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-597e8030-544a-449a-af5a-b74b96a20b38 req-6625954a-6188-4c07-9399-cd078fa1f7b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.749283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-597e8030-544a-449a-af5a-b74b96a20b38 req-6625954a-6188-4c07-9399-cd078fa1f7b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.779781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-597e8030-544a-449a-af5a-b74b96a20b38 req-6625954a-6188-4c07-9399-cd078fa1f7b7 service nova] Creating event network-changed:153e4ab4-6c27-4848-9770-eb3734ecbf9b for instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 on n-h2-851368-1 Jul 28 11:34:57.786961 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-597e8030-544a-449a-af5a-b74b96a20b38 req-6625954a-6188-4c07-9399-cd078fa1f7b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056626 Jul 28 11:34:57.788369 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1256/2553] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:57.795732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:57.796713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:57.804248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.805139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:57.807498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:57.808174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.173234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.185132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.186666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.207713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d642129-94a7-48ea-9fa4-6a8901789016 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.417501 Jul 28 11:34:58.210808 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1257/2554] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:57 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:58.227254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:58.229154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:58.252639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.253360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.257021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.267521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.268611 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35520efb-3d8b-45d0-b771-20bceb2eff86 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.660064 Jul 28 11:34:58.269240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.274697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1298/2555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:57 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:58.283719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:58.284568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:58.297376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.301451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.302656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.303391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.386481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=18 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:58.463646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lazy-loading 'services' on Instance uuid b207e98c-1958-45e4-9fee-41ca4e03ab14 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:34:58.655276 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4c98a11d-756e-4a39-bc8f-a193c469d47d tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments/4aee9020-323c-47c6-9424-59ab99cda212" status: 202 len: 0 microversion: 2.1 time: 0.443116 Jul 28 11:34:58.656625 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1258/2556] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:34:58 2022] DELETE /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments/4aee9020-323c-47c6-9424-59ab99cda212 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:34:58.667809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Action: 'update', calling method: .version_select at 0x7f2ebbeff9d0>, body: {"status": "disabled"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:58.671090 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:58.671090 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:58.672707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.673212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.679430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.681883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.682341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.699877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-845a0d86-ef37-4ac8-8eee-b1b49ff01e49 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.423040 Jul 28 11:34:58.701811 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1299/2557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:58 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:58.714598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c81a1a7-b86a-46a8-a515-fc03466c0f80 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:58.721132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c81a1a7-b86a-46a8-a515-fc03466c0f80 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:58.787520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] HTTP exception thrown: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Request method failure captured: Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 HTTP/1.1 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 22 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRfZuMF2kppJVweAVWBeU-C-RIlldRk8IVRFAlDjjryhnmOeeIcg-SbXXf1g-rCjGl6Kubi7V0s3kezttmJ8eBp8FRvBvaquvUgZdPd58GkhlS8SyQjrzKat9eOz-AIjPBayJLIxwIraG19hcjsBOQRgpZKEjvutJ_6k-e-kE3fHpQ Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}] Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dda8471918ae4425a0f1feceb9182e2a Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: {"status": "disabled"} Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: exception: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0786330b-fe82-44c5-a3e1-08323ab48c31', 'body': {'status': 'disabled'}} Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:34:58.795816 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Returning 404 to user: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:58.801960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5d63bb5-2990-41cd-b840-21ae579deeb3 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31" status: 404 len: 110 microversion: 2.53 time: 0.143934 Jul 28 11:34:58.803186 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1259/2558] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Jul 28 11:34:58 2022] PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 => generated 110 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:34:58.815576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-plugged", "status": "completed", "tag": "dbcb2a40-88e7-4d42-9494-b9bb721bdde3"}, {"server_uuid": "cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f", "name": "network-vif-plugged", "status": "completed", "tag": "63b1715e-ad82-449a-892e-6e1917cc0395"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:58.842971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c81a1a7-b86a-46a8-a515-fc03466c0f80 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:58.849744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.849990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c81a1a7-b86a-46a8-a515-fc03466c0f80 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1223 microversion: 2.1 time: 0.146769 Jul 28 11:34:58.851495 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1300/2559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:58 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:58.852410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.882048 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Creating event network-vif-plugged:4e4ddecc-a0ea-48b8-a029-bdcc3976f8c1 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:58.883435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Creating event network-vif-plugged:dbcb2a40-88e7-4d42-9494-b9bb721bdde3 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:34:58.885057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] Creating event network-vif-plugged:63b1715e-ad82-449a-892e-6e1917cc0395 for instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f on n-h1-851368-1 Jul 28 11:34:58.895752 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d1ac7279-e99b-415b-82de-65621370815e req-59c861f1-c4bc-4b1e-9c33-9bd19ce26511 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090271 Jul 28 11:34:58.897038 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1260/2560] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:58.904141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:58.904429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:58.904800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:58.907496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:58.916760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.917459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.918670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.919390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.945117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:34:58.945632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.946235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.947041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:58.948043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:58.988804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9905caff-54a8-416e-9235-9e0697fb755a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090120 Jul 28 11:34:58.992508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1261/2561] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:34:58 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:34:59.003307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Action: 'update', calling method: .version_select at 0x7f2eb29968b0>, body: {"status": "enabled"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:34:59.007623 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:59.007623 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:59.015443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.015953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.040596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.041059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.047801 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] HTTP exception thrown: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Request method failure captured: Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 HTTP/1.1 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 21 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRfZuMF2kppJVweAVWBeU-C-RIlldRk8IVRFAlDjjryhnmOeeIcg-SbXXf1g-rCjGl6Kubi7V0s3kezttmJ8eBp8FRvBvaquvUgZdPd58GkhlS8SyQjrzKat9eOz-AIjPBayJLIxwIraG19hcjsBOQRgpZKEjvutJ_6k-e-kE3fHpQ Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c67cf45304e946d2aeb8d1b64f5dfd28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c67cf45304e946d2aeb8d1b64f5dfd28"}]}] Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c67cf45304e946d2aeb8d1b64f5dfd28 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177 Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dda8471918ae4425a0f1feceb9182e2a Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: {"status": "enabled"} Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: exception: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0786330b-fe82-44c5-a3e1-08323ab48c31', 'body': {'status': 'enabled'}} Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6158, in service_get_by_id Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6018, in _find_service_in_cell Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6160, in service_get_by_id Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:34:59.049774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Returning 404 to user: Service 0786330b-fe82-44c5-a3e1-08323ab48c31 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd92f97a-6db7-414d-bae4-bbe6a06f8fec tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31" status: 404 len: 110 microversion: 2.53 time: 0.057666 Jul 28 11:34:59.053633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1262/2562] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Jul 28 11:34:58 2022] PUT /compute/v2.1/os-services/0786330b-fe82-44c5-a3e1-08323ab48c31 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:34:59.074611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:59.077948 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:59.077948 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:59.080216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.080773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.092313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.094171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.184994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3044584-1b10-416a-95b0-e1893c63a98d tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.116458 Jul 28 11:34:59.186429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1263/2563] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:59.201506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:59.205557 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:59.205557 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:59.208349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.210808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.211907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.213534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.295152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c1f381f8-ed1b-4dc7-9408-18ea7062ec2e tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.098324 Jul 28 11:34:59.300339 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1264/2564] 10.222.0.93 () {60 vars in 1211 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:59.315237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:59.317221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:59.329609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.330739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.334378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.335428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.397123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:59.410193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34f03b7a-9f17-47a3-a08b-6fcf494bb7ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.543550 Jul 28 11:34:59.411818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1301/2565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:58 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:59.423390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:59.427102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:34:59.445438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.445892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.446676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.454014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.879846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:59.894669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:59.900273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:59.904619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b200e3a-febd-42e9-b775-19ffe5ab0b99 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1874 microversion: 2.42 time: 0.603160 Jul 28 11:34:59.909155 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1265/2566] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:59.923052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:34:59.925975 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:34:59.925975 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:34:59.927516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.928176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.931878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:34:59.932556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:34:59.968526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:34:59.977319 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f596d28f-4aff-4254-8de7-4bf558ededaf tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.066830 Jul 28 11:34:59.982400 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04235785-46a7-4c25-a357-10b7a54cc067 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.564548 Jul 28 11:34:59.983861 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1266/2567] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:34:59.984507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1302/2568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:34:59.990563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:00.006254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:00.007761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:00.012175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:00.025816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.031016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.040908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.041988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.042873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.043351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.046033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.046498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.612494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:00.627803 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2079fa7c-2bbe-453d-8dd3-e04c1334148f tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1275 microversion: 2.1 time: 0.635334 Jul 28 11:35:00.637600 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1267/2569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1275 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:00.642856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:00.647517 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:35:00.647517 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:35:00.649496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.652577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.664034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.667014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.745545 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b3d0902-abea-443f-a1c9-cf1499687356 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851368-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.104013 Jul 28 11:35:00.747281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1268/2570] 10.222.0.93 () {60 vars in 1235 bytes} [Thu Jul 28 11:35:00 2022] GET /compute/v2.1/os-services?host=n-d-851368-1&binary=xxx => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:00.770584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:00.774062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:00.786918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:00.791879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.798206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.801058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.801221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.883220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51afa807-87ce-4804-a128-37fb4b18a2c1 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132977 Jul 28 11:35:00.884058 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1269/2571] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:00 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:00.899127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:00.899762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:00.921418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.923551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:00.926239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:00.927950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:01.619227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:01.634399 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d4c63eb-9fb3-43aa-8cfe-333d9d29669c tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 1.647659 Jul 28 11:35:01.638847 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1303/2572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:34:59 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:01.651376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:01.655241 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:35:01.655241 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:35:01.660984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:01.662207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:01.664577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:01.665810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:01.714356 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7aea462b-8420-422c-8dff-f6100f5bcc6a tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071120 Jul 28 11:35:01.715549 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1304/2573] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Jul 28 11:35:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:01.722603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:01.723552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:01.731773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:01.732577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:01.733527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:01.734128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.140003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:02.156951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3d7e96bd-843e-4b2d-93e8-4e6ad640a45e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 1.270876 Jul 28 11:35:02.183150 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1270/2574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:00 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:02.197932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:02.199571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:02.237688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.238552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.242013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.247688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.578016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:02.587997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:02.595464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:02.598033 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4f95cce-6144-4234-8e10-eca541b2f9ad tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2831 microversion: 2.42 time: 0.880412 Jul 28 11:35:02.600393 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1305/2575] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:01 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2831 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:02.609725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-plugged", "status": "completed", "tag": "9a6b8bc3-b40d-4d62-9f40-655b91127ac9"}, {"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-plugged", "status": "completed", "tag": "a529d433-5061-4466-a96d-6e6c4d5593b6"}, {"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-plugged", "status": "completed", "tag": "45941616-0248-4667-a9dc-c3f8bc929237"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:02.637376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.640294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.659200 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Creating event network-vif-plugged:9a6b8bc3-b40d-4d62-9f40-655b91127ac9 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:02.659922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Creating event network-vif-plugged:a529d433-5061-4466-a96d-6e6c4d5593b6 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:02.660553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] Creating event network-vif-plugged:45941616-0248-4667-a9dc-c3f8bc929237 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:02.666936 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0648ac23-e3e8-481f-8820-5588b7d78114 req-e36f7b51-8f65-464f-bf02-57510f51a92f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065242 Jul 28 11:35:02.668503 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1306/2576] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:02.677071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:02.678116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:02.687697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.688689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.690068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.690796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.729545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:02.747646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3da8034c-7c56-49c7-923b-85852b4f1c88 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.555190 Jul 28 11:35:02.748434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1271/2577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:02 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:02.771064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:02.788972 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:35:02.788972 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:35:02.793512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.794168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.795099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.795631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.835927 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac205ef8-6d7a-4edd-9c52-b4e7fd07fc59 tempest-ServicesAdminNegativeV253TestJSON-266111177 tempest-ServicesAdminNegativeV253TestJSON-266111177-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.070356 Jul 28 11:35:02.837528 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1272/2578] 10.222.0.93 () {60 vars in 1239 bytes} [Thu Jul 28 11:35:02 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:02.844085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:02.847302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:02.854647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.855223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.856650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.857200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.937031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b3c080b0-2bdd-4fde-acd6-dec7c35cfa6a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098151 Jul 28 11:35:02.938104 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1273/2579] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:02 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:02.949155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:02.950596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:02.961535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.962827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:02.964016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:02.964695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:03.297074 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e85f308a-6e6c-4c19-b05b-7c224a978122 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.357216 Jul 28 11:35:03.298185 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1274/2580] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 11:35:02 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a/os-interface => generated 1831 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:03.303792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:03.308397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:03.332547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:03.333230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:03.339519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:03.341307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:03.467420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:03.480310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7b236a4e-e7fc-4401-84d7-421a2b6f9af0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.809659 Jul 28 11:35:03.480913 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1307/2581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:02 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:03.757334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:03.777915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6bf46b58-8f5f-43aa-8e14-89ceefa81e6b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1355 microversion: 2.1 time: 0.478207 Jul 28 11:35:03.795517 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1275/2582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:03 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1355 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:03.802864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:03.803861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:03.814444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:03.815502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:03.817359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:03.817993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:03.942353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f8b28bb-1ef5-4446-a965-77eecd40b3f2 tempest-ServicesAdminNegativeV253TestJSON-2017989911 tempest-ServicesAdminNegativeV253TestJSON-2017989911-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:03.947784 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:35:03.947784 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:35:03.953289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f8b28bb-1ef5-4446-a965-77eecd40b3f2 tempest-ServicesAdminNegativeV253TestJSON-2017989911 tempest-ServicesAdminNegativeV253TestJSON-2017989911-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8149c67b90e84d41824eb6d6350314ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9272f403a54a09a9daa15d438e0a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f8b28bb-1ef5-4446-a965-77eecd40b3f2 tempest-ServicesAdminNegativeV253TestJSON-2017989911 tempest-ServicesAdminNegativeV253TestJSON-2017989911-project] Request method failure captured: Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRdKSbhw4T5_8dpMX5CbE5J85OO05oY_zm7MsnubsvLryWvcpYhuZRHXwGhis5FnsjDaKVAqIPCLbYUw-ZkgT65Zi2f2IdoQtJy9NDXDrF2brEzh59bbNyF4OA95HvphdXcFZep67cuW12Q0MNpKd_rlTaD0hdFipLHMX9HP-raBiw Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1e9272f403a54a09a9daa15d438e0a84 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2017989911 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "tempest-ServicesTestJSON-Type-575236869", "name": "tempest-ServicesTestJSON-Service-1742148484", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1e9272f403a54a09a9daa15d438e0a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1e9272f403a54a09a9daa15d438e0a84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "tempest-ServicesTestJSON-Type-1535392530", "name": "tempest-ServicesTestJSON-Service-1445947695", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1e9272f403a54a09a9daa15d438e0a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1e9272f403a54a09a9daa15d438e0a84"}]}] Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2017989911 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1e9272f403a54a09a9daa15d438e0a84 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2017989911 Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2017989911-project Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 8149c67b90e84d41824eb6d6350314ad Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2017989911-project Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:35:03.956864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:03.961568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f8b28bb-1ef5-4446-a965-77eecd40b3f2 tempest-ServicesAdminNegativeV253TestJSON-2017989911 tempest-ServicesAdminNegativeV253TestJSON-2017989911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:03.963296 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f8b28bb-1ef5-4446-a965-77eecd40b3f2 tempest-ServicesAdminNegativeV253TestJSON-2017989911 tempest-ServicesAdminNegativeV253TestJSON-2017989911-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.455809 Jul 28 11:35:03.977566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1308/2583] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Jul 28 11:35:03 2022] GET /compute/v2.1/os-services => generated 112 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:35:03.996074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:04.004058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:04.029082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.029662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.030641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.031260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.064361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:04.074639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5de780d9-8e42-4163-abc2-ee327ee6f37e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.277851 Jul 28 11:35:04.075318 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1276/2584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:03 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:04.088413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:04.093318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:04.120632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.121357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.122653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.123709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.229971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48e94310-9de1-4ad4-b92e-8f24b2f53769 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153580 Jul 28 11:35:04.233331 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1277/2585] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:04 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:04.420564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:04.437294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e95a1f33-953c-4f55-ad25-44dc40d33495 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.458244 Jul 28 11:35:04.438155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1309/2586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:03 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:04.503749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:04.505511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:04.527596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.528764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.529826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.530548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.689327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-79ebb767-27fc-4202-8c70-206c4f2a6664 req-9c75c426-1295-432a-82d0-dfee9cc059c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39918982-e3fb-4720-a3d9-bd3958b8e6a9", "name": "network-vif-plugged", "status": "completed", "tag": "153e4ab4-6c27-4848-9770-eb3734ecbf9b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:04.704085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-79ebb767-27fc-4202-8c70-206c4f2a6664 req-9c75c426-1295-432a-82d0-dfee9cc059c1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.706051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-79ebb767-27fc-4202-8c70-206c4f2a6664 req-9c75c426-1295-432a-82d0-dfee9cc059c1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.760328 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-79ebb767-27fc-4202-8c70-206c4f2a6664 req-9c75c426-1295-432a-82d0-dfee9cc059c1 service nova] Creating event network-vif-plugged:153e4ab4-6c27-4848-9770-eb3734ecbf9b for instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 on n-h2-851368-1 Jul 28 11:35:04.770454 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-79ebb767-27fc-4202-8c70-206c4f2a6664 req-9c75c426-1295-432a-82d0-dfee9cc059c1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086481 Jul 28 11:35:04.775649 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1310/2587] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:35:04.811906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:04.813647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:04.859799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.860633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.864203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:04.869557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:04.955307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:04.970772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df235a58-33de-42e7-9a78-4542e8f2a4d0 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.468656 Jul 28 11:35:04.989792 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1278/2588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:04 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:05.096894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:05.097867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:05.105177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.110883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.113638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.114989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.492948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:05.503640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7137bef0-f4e9-4e45-8aa2-ded51257467e tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1805 microversion: 2.1 time: 0.698793 Jul 28 11:35:05.504488 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1311/2589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:04 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1805 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:05.522948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:05.526646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:05.541788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.542609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.543798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.544451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.623543 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3379bfa9-dc70-42f4-839b-eaf2735ea5b2 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111220 Jul 28 11:35:05.629576 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1312/2590] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:05 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:05.636218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:05.637120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:05.646318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.647153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.648198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.650403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.678851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:05.695525 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f3ee018-bb09-4c23-91bb-bd76550f7039 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.598781 Jul 28 11:35:05.696206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1279/2591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:05 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:05.705890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:05.707182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:05.724896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.725742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.727089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.732732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.779774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eea694a3-9c62-45d2-8523-421a36d022ec tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7/ips" status: 200 len: 218 microversion: 2.1 time: 0.082329 Jul 28 11:35:05.780717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1280/2592] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:35:05 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7/ips => generated 218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:05.796669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:05.797177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:05.814803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.815290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.816347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:05.816524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:05.877163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:05.930060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:06.033609 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-906aa995-d680-469b-82f5-206fa5bb1c84 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 204 len: 0 microversion: 2.1 time: 0.240970 Jul 28 11:35:06.035056 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1281/2593] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:05 2022] DELETE /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:35:06.041934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:06.042894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:06.049939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.050725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.051902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.052547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.203283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:06.220487 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49855b71-f2fd-4502-bfd0-69847b8becaf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.584371 Jul 28 11:35:06.220487 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1313/2594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:05 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:06.232547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:06.233237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:06.248733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.252050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.255221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.255850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.674956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:06.683809 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c65da326-ac22-4fb5-a05e-2adda2beb0a2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1811 microversion: 2.1 time: 0.461614 Jul 28 11:35:06.706896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:06.710938 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1314/2595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:06 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1811 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:06.716857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c21a0c16-ebce-4340-935f-f9248ad1e48d tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.680222 Jul 28 11:35:06.717435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1282/2596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:06 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:06.721467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4416038c-f19f-40c1-bc0b-a85fad2764ae req-12d48094-c2db-495a-9f67-265b1659d991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568e25c-1079-4a4f-bc2b-ab27fbb18cf5", "tag": "4478158c-01c6-4dac-ab5c-d594d5b8a94d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:06.727741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:06.737359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:06.747367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.749781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4416038c-f19f-40c1-bc0b-a85fad2764ae req-12d48094-c2db-495a-9f67-265b1659d991 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.750672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4416038c-f19f-40c1-bc0b-a85fad2764ae req-12d48094-c2db-495a-9f67-265b1659d991 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.753213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.754114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.755540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.791796 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4416038c-f19f-40c1-bc0b-a85fad2764ae req-12d48094-c2db-495a-9f67-265b1659d991 service nova] Creating event network-changed:4478158c-01c6-4dac-ab5c-d594d5b8a94d for instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 on n-h1-851368-1 Jul 28 11:35:06.810144 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4416038c-f19f-40c1-bc0b-a85fad2764ae req-12d48094-c2db-495a-9f67-265b1659d991 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097630 Jul 28 11:35:06.813465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1315/2597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:06.834926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:06.847425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:06.862871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8462a843-70cd-484f-96f1-61a9bda034ad tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140047 Jul 28 11:35:06.867882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.871421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.872936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:06.875786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:06.877901 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1283/2598] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:06 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:06.927707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:07.240626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:07.241465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:07.253103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.258401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:07.260092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.261990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:07.266029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:07.274955 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38626bc4-064f-4127-bbd4-583078a98ea1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.457280 Jul 28 11:35:07.282510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1316/2599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:06 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:07.619682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:07.630630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-040e9277-b2e7-4e0b-a47e-4468eeb7838e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1322 microversion: 2.1 time: 0.393431 Jul 28 11:35:07.633087 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1284/2600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:07 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:07.709360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:07.711442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:07.738220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.739290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:07.740384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:07.741129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:07.743316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=22 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:07.746042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.749203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:07.762254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.772050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:07.773763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:07.777825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.565692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:08.574169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be95fd9c-165b-4770-a0f7-513a2a0e8913 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1811 microversion: 2.1 time: 0.872860 Jul 28 11:35:08.578550 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1317/2601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:07 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1811 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:08.583655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:08.594190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:08.601524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:08.608581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.608957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.614720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.615337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.617333 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b24e13e3-938c-49b0-b9dc-430bd64aade7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.882817 Jul 28 11:35:08.621304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1285/2602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:07 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:08.630095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:08.631032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:08.650558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.651421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.652487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.653811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.695583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc18361d-ce53-4b1e-9869-f703cbeb7344 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115607 Jul 28 11:35:08.696791 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1318/2603] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:35:08 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:35:08.711516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:08.712901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:08.722337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.723031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.724029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:08.724691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:08.847293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:09.177395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:09.197032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b3801eed-38c7-4a2b-a48f-49f918db8986 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.574066 Jul 28 11:35:09.211394 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1286/2604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:08 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:09.218964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-097e6382-1b88-429c-a395-b01671e9b2c9 req-1e7ea5f3-4d9a-4214-84c7-493cc27253e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "tag": "c1fba3ac-4c0c-450f-ae53-952d5aa51f4e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:09.233354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-097e6382-1b88-429c-a395-b01671e9b2c9 req-1e7ea5f3-4d9a-4214-84c7-493cc27253e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:09.234121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-097e6382-1b88-429c-a395-b01671e9b2c9 req-1e7ea5f3-4d9a-4214-84c7-493cc27253e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:09.248584 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-097e6382-1b88-429c-a395-b01671e9b2c9 req-1e7ea5f3-4d9a-4214-84c7-493cc27253e1 service nova] Creating event network-changed:c1fba3ac-4c0c-450f-ae53-952d5aa51f4e for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:35:09.256530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-097e6382-1b88-429c-a395-b01671e9b2c9 req-1e7ea5f3-4d9a-4214-84c7-493cc27253e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043433 Jul 28 11:35:09.257917 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1287/2605] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:09.266405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1164438883", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "58cf4434-ca5a-4c20-9a34-866c10873d90"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:09.323064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:09.339824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd0cdd2d-c88d-47a7-a289-ee604092ef6e tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1472 microversion: 2.1 time: 0.641303 Jul 28 11:35:09.340957 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1319/2606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:08 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1472 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:09.354825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] validate_networks() for [('58cf4434-ca5a-4c20-9a34-866c10873d90', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:35:09.933405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:09.934648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] [instance: 6f60854c-3004-4cc7-aa70-c6987da6fc9c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:09.950343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] HTTP exception thrown: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Request method failure captured: Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/6f60854c-3004-4cc7-aa70-c6987da6fc9c/action HTTP/1.1 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRWduZqh3hiDXYQ3nn1dioq2JG9VsmHDj8JKgEB-BRxjNeccD-jThI3P0dgYDulhaUhI_iFM4noOXWUxKpdw3I2LLjJ_2b8P3dV5hBQpOJU4pLzbcMQphZJSCvjFClv9X3pRVBSjHedm_KOgThBt_BCAjBXXg5YG1w3GnAJhhwwjuQ Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}] Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 99a2e0c773024dde81ee7f094ac0b23f Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: {"migrate": {}} Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6f60854c-3004-4cc7-aa70-c6987da6fc9c', 'body': {'migrate': {}}} Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:09.958761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. Jul 28 11:35:09.962899 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:09.966147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Returning 404 to user: Instance 6f60854c-3004-4cc7-aa70-c6987da6fc9c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:09.967412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1409a90c-20e3-46e0-b0c3-042b92a09c10 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/6f60854c-3004-4cc7-aa70-c6987da6fc9c/action" status: 404 len: 111 microversion: 2.1 time: 0.602332 Jul 28 11:35:09.982899 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1320/2607] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:09 2022] POST /compute/v2.1/servers/6f60854c-3004-4cc7-aa70-c6987da6fc9c/action => generated 111 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:35:09.994469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:09.995297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:10.008801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.009272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.010072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.010523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.406034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:10.406581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:10.406821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:10.407266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:10.407685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:10.420774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.423481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.427122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.428080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.455421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:35:10.456250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:10.462900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Getting quotas for user d79daea187ea48f6a2dbf47751ea0d84 and project 2bc1bcff90a247cb9fd3da771b563070. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:35:10.474243 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f7f5547-f576-43c4-883f-ae8b24df4f77 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1790 microversion: 2.1 time: 0.483358 Jul 28 11:35:10.475190 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1321/2608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:09 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1790 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:10.480488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:35:10.484655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:35:10.496194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:10.496882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:10.521955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.527309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.532370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.535303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.557462 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fef23d51-4d04-4ae4-9e2f-fa439edefd87 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298108 Jul 28 11:35:10.570456 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1288/2609] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:35:10.581550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a6b0b501-a1a5-4a57-9507-798f309d1a14 req-9260191d-eba0-4d14-ac05-87f29177b64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-deleted", "tag": "a529d433-5061-4466-a96d-6e6c4d5593b6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:10.599330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a6b0b501-a1a5-4a57-9507-798f309d1a14 req-9260191d-eba0-4d14-ac05-87f29177b64c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.600051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a6b0b501-a1a5-4a57-9507-798f309d1a14 req-9260191d-eba0-4d14-ac05-87f29177b64c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.614782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a6b0b501-a1a5-4a57-9507-798f309d1a14 req-9260191d-eba0-4d14-ac05-87f29177b64c service nova] Creating event network-vif-deleted:a529d433-5061-4466-a96d-6e6c4d5593b6 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:10.624721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a6b0b501-a1a5-4a57-9507-798f309d1a14 req-9260191d-eba0-4d14-ac05-87f29177b64c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052603 Jul 28 11:35:10.627927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1289/2610] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:10.645609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:10.646745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:10.662814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.665809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:10.666950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:10.668194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:11.329721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:11.350262 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8682212-c988-4a83-8ed3-19606a83a9bf tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.870644 Jul 28 11:35:11.353329 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1322/2611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:10 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:11.366206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1198705155", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:11.463426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:11.475942 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7143a6e-d012-4553-a924-1aa2c365de75 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.843122 Jul 28 11:35:11.476916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1290/2612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:10 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:11.483899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:11.484774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:11.500756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:11.501981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:35:11.522399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:11.525348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:11.525996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:11.687151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:12.534212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:12.544577 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1ab1019-0571-418c-b2ce-ef668a38823b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1222 microversion: 2.1 time: 1.065863 Jul 28 11:35:12.557118 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1291/2613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:11 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1222 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:12.562929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:12.581498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:12.592217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:12.595010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:12.600234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:12.600888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.231371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:13.232262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:13.232968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:13.233604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:13.234209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:13.255363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.259394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.261949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.263628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.318386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Getting quotas for project 10e4941f9f064085aef668b56f0d3b6d. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:35:13.326512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Getting quotas for user efaead1779d443a29706991be48f1282 and project 10e4941f9f064085aef668b56f0d3b6d. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:35:13.353547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:35:13.358266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:13.362384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:35:13.378446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43f858d6-63c3-44ff-873d-f2948ab569d2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 200 len: 1610 microversion: 2.1 time: 0.819719 Jul 28 11:35:13.389747 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1292/2614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:12 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 1610 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:13.398501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:13.400551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:13.435059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.436164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.437817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.438640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.458538 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-173ac73f-935c-424a-b4bf-d13f9f3c593b tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.101911 Jul 28 11:35:13.469188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1323/2615] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:35:13.486209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:13.489161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:13.510690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.512222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:13.514887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:13.516863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.096891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:14.107884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:14.114256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86b4eacc-7e1e-4840-bd9b-9642ecd6e0a4 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.721621 Jul 28 11:35:14.116986 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1293/2616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:13 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:14.131254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-46cf3d66-ee02-4f3c-a60d-8636b4410639 req-c1bc3058-d6b0-4de3-ae93-eddc80fd48ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-deleted", "tag": "45941616-0248-4667-a9dc-c3f8bc929237"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:14.143278 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45617ade-1a3f-450e-a7d4-4aac016a3e6e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.661882 Jul 28 11:35:14.144276 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1324/2617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:13 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:14.162604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-46cf3d66-ee02-4f3c-a60d-8636b4410639 req-c1bc3058-d6b0-4de3-ae93-eddc80fd48ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:14.163774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-46cf3d66-ee02-4f3c-a60d-8636b4410639 req-c1bc3058-d6b0-4de3-ae93-eddc80fd48ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.167893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c142fbcc-8bf6-421e-a6b7-d3c756bd1161 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:14.171350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c142fbcc-8bf6-421e-a6b7-d3c756bd1161 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:14.192474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-46cf3d66-ee02-4f3c-a60d-8636b4410639 req-c1bc3058-d6b0-4de3-ae93-eddc80fd48ed service nova] Creating event network-vif-deleted:45941616-0248-4667-a9dc-c3f8bc929237 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:14.204438 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-46cf3d66-ee02-4f3c-a60d-8636b4410639 req-c1bc3058-d6b0-4de3-ae93-eddc80fd48ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085217 Jul 28 11:35:14.207540 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1294/2618] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:14.221667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:14.222924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:14.241067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:14.242435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.247229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:14.247837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.327784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c142fbcc-8bf6-421e-a6b7-d3c756bd1161 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:14.337580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c142fbcc-8bf6-421e-a6b7-d3c756bd1161 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1222 microversion: 2.1 time: 0.190979 Jul 28 11:35:14.347770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1325/2619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:14 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:14.419913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:14.421781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:14.452085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:14.452828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.460148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:14.460820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:14.484145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:14.493083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f79b0b36-527c-4292-8cf6-a3ccd25438fa tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1276 microversion: 2.1 time: 0.282598 Jul 28 11:35:14.508754 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1295/2620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:14 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:14.534156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 HTTP/1.1 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3ce37e08-94de-44d9-b38e-721822902aa7'} Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:14.538440 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e727cad-0083-4cc4-ac6b-216c8cbff038 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 404 len: 111 microversion: 2.1 time: 0.131709 Jul 28 11:35:14.582181 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1326/2621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:14 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:15.141260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:15.142619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:15.157457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:15.158131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:15.160015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:15.162397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:15.170574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:15.171357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:15.188659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:15.193730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:15.196134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:15.201404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.072598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:16.092687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ac8ee43-68b2-44d5-b267-8f53a651c498 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.926269 Jul 28 11:35:16.099307 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1327/2622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:15 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:16.112553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:16.113139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:16.133837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.137735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.138582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.139037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.242696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:16.251697 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-613e7c9d-58e8-4f9c-88e6-55e3ad905042 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 1.116095 Jul 28 11:35:16.252934 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1296/2623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:15 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:16.258022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3ee08cb3-74ee-4954-a76a-5beea50d4b08 req-4b27efc6-a506-4629-9549-c8e008e0634a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568e25c-1079-4a4f-bc2b-ab27fbb18cf5", "name": "network-vif-plugged", "status": "completed", "tag": "4478158c-01c6-4dac-ab5c-d594d5b8a94d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:16.271900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3ee08cb3-74ee-4954-a76a-5beea50d4b08 req-4b27efc6-a506-4629-9549-c8e008e0634a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.272610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3ee08cb3-74ee-4954-a76a-5beea50d4b08 req-4b27efc6-a506-4629-9549-c8e008e0634a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.294494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3ee08cb3-74ee-4954-a76a-5beea50d4b08 req-4b27efc6-a506-4629-9549-c8e008e0634a service nova] Creating event network-vif-plugged:4478158c-01c6-4dac-ab5c-d594d5b8a94d for instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 on n-h1-851368-1 Jul 28 11:35:16.300012 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3ee08cb3-74ee-4954-a76a-5beea50d4b08 req-4b27efc6-a506-4629-9549-c8e008e0634a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045498 Jul 28 11:35:16.306432 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1297/2624] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:16.314181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:16.315390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:16.323688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:16.334240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1317c86-10c1-4a85-9704-46207efe0891 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1280 microversion: 2.1 time: 0.233321 Jul 28 11:35:16.337776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.338263 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1328/2625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:16 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:16.347787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.355492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.356235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.560091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:16.577360 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22dea978-f44a-436d-8609-f76b8f8a4668 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1276 microversion: 2.1 time: 0.267655 Jul 28 11:35:16.596513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1298/2626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:16 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:16.666090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8a5ff453-296f-4436-a29a-3b747829f5e5 req-a0e1475d-e344-458b-a6dd-8867857576c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce37e08-94de-44d9-b38e-721822902aa7", "name": "network-vif-deleted", "tag": "9a6b8bc3-b40d-4d62-9f40-655b91127ac9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:16.677871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:16.680175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8a5ff453-296f-4436-a29a-3b747829f5e5 req-a0e1475d-e344-458b-a6dd-8867857576c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:16.680691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8a5ff453-296f-4436-a29a-3b747829f5e5 req-a0e1475d-e344-458b-a6dd-8867857576c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:16.695494 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8a5ff453-296f-4436-a29a-3b747829f5e5 req-a0e1475d-e344-458b-a6dd-8867857576c8 service nova] Creating event network-vif-deleted:9a6b8bc3-b40d-4d62-9f40-655b91127ac9 for instance 3ce37e08-94de-44d9-b38e-721822902aa7 on n-h2-851368-1 Jul 28 11:35:16.702058 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8a5ff453-296f-4436-a29a-3b747829f5e5 req-a0e1475d-e344-458b-a6dd-8867857576c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.361941 Jul 28 11:35:16.702981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1329/2627] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:17.116013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:17.117005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:17.126359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.126803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.127634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.128071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.276752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:17.278404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:17.292132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.294951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.296153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.299910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.712422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:17.747816 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-176bcdbb-d613-415c-a744-c22a764c73d9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1524 microversion: 2.1 time: 0.636027 Jul 28 11:35:17.758970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:17.760323 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1299/2628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:17 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1524 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:17.766166 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4112ac9a-8a12-4767-ac03-1b3548358cf6 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.494569 Jul 28 11:35:17.767557 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1330/2629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:17 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:17.771033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:17.771753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:17.774596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:17.775427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:17.781045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.786223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.786691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.787258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.788082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.788693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:17.792107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:17.792919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:18.229118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:18.236787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d962afc6-5507-4be6-a1c3-14c03b3aecbf tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.467771 Jul 28 11:35:18.242306 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1331/2630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:17 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:18.253269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:18.264143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:18.268054 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3757f51a-46b0-4096-a07d-ca2c774a1461 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.504266 Jul 28 11:35:18.281292 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1300/2631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:17 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:18.770378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:18.771694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:18.781591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:18.784963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:18.789896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:18.790546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:18.792599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:18.793343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:18.814600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:18.815177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:18.821160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:18.821488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:19.690742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:19.700350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf894611-90f3-41db-b36e-444c55fdf788 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1323 microversion: 2.1 time: 0.914114 Jul 28 11:35:19.724498 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1301/2632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:18 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:19.732716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:19.733746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:19.742334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:19.743047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:19.744020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:19.745055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:19.780397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:19.805935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd40e1a4-162c-464d-9f5e-c471768fcec1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1506 microversion: 2.1 time: 1.039969 Jul 28 11:35:19.806713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1332/2633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:18 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1506 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:19.817620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:19.821649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:19.833364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:19.833833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:19.834896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:19.835615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:20.309837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:20.330491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:20.336958 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e7c29933-8fd8-45b7-beb0-01fb79dbe21e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.607576 Jul 28 11:35:20.337600 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1302/2634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:19 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:20.354329 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0950f9b-57bd-47a9-bdf2-a1fb9165e046 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.542411 Jul 28 11:35:20.356939 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1333/2635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:19 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:20.646270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=22 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:20.647395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:20.727127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:20.728038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:20.753160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:20.755121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:20.757831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:20.758481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:20.998331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-61e06aa3-2245-4a59-afb0-024db73f7e51 req-16512264-e7f3-44a1-909b-dd5cd6eebbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afa97e4-3607-47c7-b34e-02acfa522d4e", "tag": "8a71ab21-8bc0-44d9-9d8f-70406bbf94b3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:21.042369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-61e06aa3-2245-4a59-afb0-024db73f7e51 req-16512264-e7f3-44a1-909b-dd5cd6eebbaa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.047561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-61e06aa3-2245-4a59-afb0-024db73f7e51 req-16512264-e7f3-44a1-909b-dd5cd6eebbaa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:21.087962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-61e06aa3-2245-4a59-afb0-024db73f7e51 req-16512264-e7f3-44a1-909b-dd5cd6eebbaa service nova] Creating event network-changed:8a71ab21-8bc0-44d9-9d8f-70406bbf94b3 for instance 4afa97e4-3607-47c7-b34e-02acfa522d4e on n-h1-851368-1 Jul 28 11:35:21.101153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-61e06aa3-2245-4a59-afb0-024db73f7e51 req-16512264-e7f3-44a1-909b-dd5cd6eebbaa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.458597 Jul 28 11:35:21.120086 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1303/2636] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:21.152029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:21.156595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:21.175358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.175832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:21.176637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.181143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:21.388846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:21.408744 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c8bc72e-2fbf-4aa8-8381-d5392a03667a tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1472 microversion: 2.1 time: 0.684043 Jul 28 11:35:21.430922 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1334/2637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:20 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1472 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:21.449473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a04a5881-8275-40ed-afdb-17b743b35041 req-fc5cd6b4-b368-4c93-9358-c7cdeef1c177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcc207c-d481-4ede-a698-a0e6435532f9", "tag": "7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:21.479251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a04a5881-8275-40ed-afdb-17b743b35041 req-fc5cd6b4-b368-4c93-9358-c7cdeef1c177 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.479749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a04a5881-8275-40ed-afdb-17b743b35041 req-fc5cd6b4-b368-4c93-9358-c7cdeef1c177 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:21.502535 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a04a5881-8275-40ed-afdb-17b743b35041 req-fc5cd6b4-b368-4c93-9358-c7cdeef1c177 service nova] Creating event network-changed:7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08 for instance 4fcc207c-d481-4ede-a698-a0e6435532f9 on n-h2-851368-1 Jul 28 11:35:21.513703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a04a5881-8275-40ed-afdb-17b743b35041 req-fc5cd6b4-b368-4c93-9358-c7cdeef1c177 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077261 Jul 28 11:35:21.515264 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1335/2638] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:21.524583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:21.525797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:21.538491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.539219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:21.541374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:21.541964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.042897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:22.058439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af992574-2017-4878-9c7a-72d8962ddbe7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1506 microversion: 2.1 time: 0.934677 Jul 28 11:35:22.059972 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1304/2639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:21 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1506 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:22.076718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:22.077626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:22.104093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.113199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.144667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.147479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.299372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:22.316306 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-245b32f6-aa55-453b-bd13-f66532216ff8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.799421 Jul 28 11:35:22.316996 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1336/2640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:21 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:22.337348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:22.338204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:22.355170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.355870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.356803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.357433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.375531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:22.387703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Request method failure captured: Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5/diagnostics HTTP/1.1 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRcFaQsdUNzfBw6XxkOXbh8L1G54GiKBwxE1MUpx9GZnim0qZ17WDXObiOSM2J8Gbk5Zzdv_TaWmfRTEP1a_sb8TOx1lDtaGERf0-r1zYWLggYJy7mtozYE7bb-VxoUM3-iLY-c_msdgeVv-PPGzo-tsZbxgJtrB-Dk0Gkbt29S6no Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ce0606b0679e45a8a7e1aa65cc909019 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce0606b0679e45a8a7e1aa65cc909019"}]}] Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ce0606b0679e45a8a7e1aa65cc909019 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiagnosticsNegativeTest-1672559813-project Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3449da8563ec432f90df80c20740741f Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1672559813-project Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '0568e25c-1079-4a4f-bc2b-ab27fbb18cf5'} Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:22.393370 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 11:35:22.397717 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:35:22.399844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:22.400826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e13da3f-5c95-4259-90bd-c3031731ba00 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.082522 Jul 28 11:35:22.401411 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1337/2641] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:35:22 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5/diagnostics => generated 117 bytes in 84 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:22.416869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:22.419348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:22.432156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.432618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.433408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.433890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.507060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:22.701918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6f8f188-c68e-468f-bce5-f21b0fe2b2d8 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 204 len: 0 microversion: 2.1 time: 0.292632 Jul 28 11:35:22.712608 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1338/2642] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:22 2022] DELETE /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:35:22.734550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:22.736358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:22.748223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.748683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.749485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.749943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.829161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:22.844321 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-18a40a31-8124-4338-90fb-77590417d5d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.782826 Jul 28 11:35:22.858111 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1305/2643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:22 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:22.863523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fd0a9087-af04-415c-804e-6566e3ee6ddf req-0738b129-1ad5-4d79-8ae6-df1c91e1f7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f", "name": "network-vif-unplugged", "status": "completed", "tag": "63b1715e-ad82-449a-892e-6e1917cc0395"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:22.875283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd0a9087-af04-415c-804e-6566e3ee6ddf req-0738b129-1ad5-4d79-8ae6-df1c91e1f7b2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:22.875949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd0a9087-af04-415c-804e-6566e3ee6ddf req-0738b129-1ad5-4d79-8ae6-df1c91e1f7b2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:22.892020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_external_events [req-fd0a9087-af04-415c-804e-6566e3ee6ddf req-0738b129-1ad5-4d79-8ae6-df1c91e1f7b2 service nova] Unable to find a host for instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f. Dropping event network-vif-unplugged {{(pid=119236) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 11:35:22.893690 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fd0a9087-af04-415c-804e-6566e3ee6ddf req-0738b129-1ad5-4d79-8ae6-df1c91e1f7b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033949 Jul 28 11:35:22.894906 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1306/2644] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 11:35:23.086304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:23.086934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:23.098559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.099029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.101993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.104081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.297793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:23.514420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:23.524364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72dfb84c-cd20-46c1-8391-9f69d2d631b1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1478 microversion: 2.1 time: 0.810200 Jul 28 11:35:23.525230 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1339/2645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:22 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1478 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:23.530602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:23.531557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:23.550094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.550864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.551792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.552263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.707792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:23.717726 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d36cd00c-ec8e-47d6-8a81-e3e218a184e6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 200 len: 1449 microversion: 2.1 time: 0.636310 Jul 28 11:35:23.737043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1307/2646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:23 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 1449 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:23.743297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:23.744496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:23.751747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:23.754111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.754825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.756413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:23.757240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:23.790314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:23.797666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Working on deleting snapshot 3f194b49-6d36-4326-8494-907e32c09361 from shelved instance... Jul 28 11:35:23.926468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:23.937677 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de56729e-cb5c-4f12-9ea6-cb742c48c559 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.411066 Jul 28 11:35:23.972853 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1340/2647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:23 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:23.979215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:23.979842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:24.014505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:24.016844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:24.017830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:24.018288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:24.335283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:24.568561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:24.576927 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e993dbaa-16ae-4f92-a416-b4928c95cd71 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.602313 Jul 28 11:35:24.577547 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1341/2648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:23 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:24.600383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:24.601074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:24.619876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:24.620330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:24.621638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:24.623172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:25.009032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Doing local delete in cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119236) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:35:25.011308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:25.012720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:25.013546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 28 11:35:25.020578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] deallocate_for_instance() {{(pid=119236) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:35:25.444580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:25.455237 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6d13362-ba2a-471c-94ee-c46a02923597 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1478 microversion: 2.1 time: 0.858114 Jul 28 11:35:25.457550 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1342/2649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:24 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1478 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:25.470619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:25.471733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:25.483951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:25.489365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:25.491566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:25.493706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:26.347991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:26.356782 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e3c4e1d-46ba-4165-bf45-72d8839a9c2b tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.896957 Jul 28 11:35:26.357402 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1343/2650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:25 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:26.383860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:26.384804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:26.391654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:26.392364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:26.393331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:26.393920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:27.033145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:27.041494 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fecf7019-8544-4fe0-889a-a4848fb4806c tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.663419 Jul 28 11:35:27.042452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1344/2651] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:26 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:27.048552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:27.050289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:27.060210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:27.061275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:27.064744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:27.066414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:27.290040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3449da8563ec432f90df80c20740741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0606b0679e45a8a7e1aa65cc909019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:27.316279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d15f0811-ecfa-4255-8078-63673d6742a7 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 200 len: 1436 microversion: 2.1 time: 0.272431 Jul 28 11:35:27.327877 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1345/2652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:27 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 1436 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:27.343170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-bec49d8e-a4f0-4eb2-b87f-780b4832b21e req-4aec5783-fb26-4152-8740-b191c76a5689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568e25c-1079-4a4f-bc2b-ab27fbb18cf5", "name": "network-vif-deleted", "tag": "4478158c-01c6-4dac-ab5c-d594d5b8a94d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:27.369323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bec49d8e-a4f0-4eb2-b87f-780b4832b21e req-4aec5783-fb26-4152-8740-b191c76a5689 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:27.369976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bec49d8e-a4f0-4eb2-b87f-780b4832b21e req-4aec5783-fb26-4152-8740-b191c76a5689 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:27.417029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Updating instance_info_cache with network_info: [] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:35:27.417671 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-bec49d8e-a4f0-4eb2-b87f-780b4832b21e req-4aec5783-fb26-4152-8740-b191c76a5689 service nova] Creating event network-vif-deleted:4478158c-01c6-4dac-ab5c-d594d5b8a94d for instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 on n-h1-851368-1 Jul 28 11:35:27.437072 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-bec49d8e-a4f0-4eb2-b87f-780b4832b21e req-4aec5783-fb26-4152-8740-b191c76a5689 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107370 Jul 28 11:35:27.437973 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1346/2653] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:27.444262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1725091934", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "461c1401-ad83-4de1-9252-6c907d2894d5"}, {"uuid": "5f581892-5fbe-425b-a7ab-68138837f12a"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:27.578066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] validate_networks() for [('461c1401-ad83-4de1-9252-6c907d2894d5', None, None, None, None, None), ('5f581892-5fbe-425b-a7ab-68138837f12a', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:35:28.346271 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d99fcf7-5685-43e8-9a76-d28c80c84de1 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 204 len: 0 microversion: 2.1 time: 4.607601 Jul 28 11:35:28.347454 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1308/2654] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:23 2022] DELETE /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 0 bytes in 4609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:35:28.368767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:28.369847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:28.392097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:28.396629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:28.398503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:28.404455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.211385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:29.222588 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc5e9413-f3ea-4dce-afd1-7dfbc2a4f4ab tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.873442 Jul 28 11:35:29.230501 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1309/2655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:28 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:29.235325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f887ad1e-69ed-48e1-88ef-37d3a105fced req-4004849e-7307-452a-be4a-562952e8e607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f", "name": "network-vif-deleted", "tag": "63b1715e-ad82-449a-892e-6e1917cc0395"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:29.257543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f887ad1e-69ed-48e1-88ef-37d3a105fced req-4004849e-7307-452a-be4a-562952e8e607 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.257991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f887ad1e-69ed-48e1-88ef-37d3a105fced req-4004849e-7307-452a-be4a-562952e8e607 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.306463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_external_events [req-f887ad1e-69ed-48e1-88ef-37d3a105fced req-4004849e-7307-452a-be4a-562952e8e607 service nova] Unable to find a host for instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f. Dropping event network-vif-deleted {{(pid=119236) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 11:35:29.307697 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f887ad1e-69ed-48e1-88ef-37d3a105fced req-4004849e-7307-452a-be4a-562952e8e607 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.076163 Jul 28 11:35:29.308305 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1310/2656] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 11:35:29.328563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:29.330347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:29.345298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.345817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.346664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.349304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.909447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:29.925707 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-17112e50-f53c-485d-939d-d0eaf3fd9662 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.613436 Jul 28 11:35:29.927821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1311/2657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:29 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:29.934699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:29.935933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] [instance: 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:29.945257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.946060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.954231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:29.955533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:29.956330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:29.957008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:29.957743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:29.962077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.962870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.976002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.976704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.977593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:29.978229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:29.997016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] HTTP exception thrown: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Request method failure captured: Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 HTTP/1.1 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRcFaQsdUNzfBw6XxkOXbh8L1G54GiKBwxE1MUpx9GZnim0qZ17WDXObiOSM2J8Gbk5Zzdv_TaWmfRTEP1a_sb8TOx1lDtaGERf0-r1zYWLggYJy7mtozYE7bb-VxoUM3-iLY-c_msdgeVv-PPGzo-tsZbxgJtrB-Dk0Gkbt29S6no Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ce0606b0679e45a8a7e1aa65cc909019 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ce0606b0679e45a8a7e1aa65cc909019"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce0606b0679e45a8a7e1aa65cc909019"}]}] Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ce0606b0679e45a8a7e1aa65cc909019 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1672559813 Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerDiagnosticsNegativeTest-1672559813-project Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3449da8563ec432f90df80c20740741f Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1672559813-project Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0568e25c-1079-4a4f-bc2b-ab27fbb18cf5'} Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.006865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. Jul 28 11:35:30.014410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.017265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Getting quotas for project 94da65f2f5404355bb866482aba46657. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:35:30.024135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Getting quotas for user d589864c43174112961a7c1a3c17ee8b and project 94da65f2f5404355bb866482aba46657. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:35:30.029360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] Returning 404 to user: Instance 0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:30.031466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6230485-aaa0-4a62-a751-07fcd8578ae1 tempest-ServerDiagnosticsNegativeTest-1672559813 tempest-ServerDiagnosticsNegativeTest-1672559813-project] 10.222.0.93 "GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5" status: 404 len: 111 microversion: 2.1 time: 0.102272 Jul 28 11:35:30.032451 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1312/2658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:29 2022] GET /compute/v2.1/servers/0568e25c-1079-4a4f-bc2b-ab27fbb18cf5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:30.047342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:35:30.049276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:30.052820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:35:30.053314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:30.068788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:30.069496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:30.070655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:30.071418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:30.088756 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f HTTP/1.1 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f'} Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:30.091502 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:35:30.095388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:30.098456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:30.099700 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1bd71e30-4f39-4b54-b4f1-844093a3872a tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 404 len: 111 microversion: 2.1 time: 0.062502 Jul 28 11:35:30.119478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1313/2659] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:30 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:30.191374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff6b231a-4a39-4798-9220-f944d857a07d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.751888 Jul 28 11:35:30.193703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1347/2660] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:35:30.205859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-75e24692-ef92-4de0-8424-3f4b107f8245 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:30.206537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-75e24692-ef92-4de0-8424-3f4b107f8245 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:30.259518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:30.260543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:30.281811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:30.282389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:30.287409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:30.289141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:30.557177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75e24692-ef92-4de0-8424-3f4b107f8245 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:30.574639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-75e24692-ef92-4de0-8424-3f4b107f8245 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1213 microversion: 2.1 time: 0.371111 Jul 28 11:35:30.577161 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1314/2661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:30 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1213 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:30.611108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1304085384", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:30.726594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:35:31.017116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:31.031942 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be669684-47c5-44a9-b866-8dec38d37260 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.779829 Jul 28 11:35:31.046850 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1348/2662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:30 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:31.062419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:31.063606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:31.080812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.081725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.082713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.083353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.405206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:31.413840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6f07a1e-0518-4e18-b200-33bf44832b64 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.362793 Jul 28 11:35:31.427933 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1349/2663] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:31 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:31.602881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:31.603844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:31.611619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.612407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.613414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.614091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.693695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:31.694195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:31.694685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:31.695204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:31.695647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:31.713071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.713524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.714559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:31.715709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:31.742422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:31.762375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:35:31.762704 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8d0f10d-597a-4731-9dcb-d8ae97690b9b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1265 microversion: 2.1 time: 0.162205 Jul 28 11:35:31.772482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1350/2664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:31 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:31.785935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:35:31.809423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:35:31.812826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:35:31.926501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d07a800-dac5-4c92-bbab-b1cb620ce39e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346123 Jul 28 11:35:31.930245 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1315/2665] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:35:31.945270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf750ed5-226c-4b3c-aa80-1fdede23baf2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:31.946286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bf750ed5-226c-4b3c-aa80-1fdede23baf2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:32.057510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:32.059253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:32.069957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:32.072424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:32.075257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:32.077034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:32.093078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:32.222214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bf750ed5-226c-4b3c-aa80-1fdede23baf2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:32.230684 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf750ed5-226c-4b3c-aa80-1fdede23baf2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1215 microversion: 2.1 time: 0.293924 Jul 28 11:35:32.232074 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1351/2666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:31 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:32.450427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:32.451059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:32.465874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:32.466613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:32.467617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:32.468217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:32.531697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:32.539728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0291f101-8413-4cd8-8291-e403fb953e9a tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.486390 Jul 28 11:35:32.558865 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1316/2667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:32 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:33.069935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cc5bd51f-5a7e-4a9e-ab1b-71d05df1ec1f req-d99450f0-adb4-45d6-8300-b843195ab7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcc207c-d481-4ede-a698-a0e6435532f9", "name": "network-vif-plugged", "status": "completed", "tag": "7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:33.093550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cc5bd51f-5a7e-4a9e-ab1b-71d05df1ec1f req-d99450f0-adb4-45d6-8300-b843195ab7fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.094001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cc5bd51f-5a7e-4a9e-ab1b-71d05df1ec1f req-d99450f0-adb4-45d6-8300-b843195ab7fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.135218 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cc5bd51f-5a7e-4a9e-ab1b-71d05df1ec1f req-d99450f0-adb4-45d6-8300-b843195ab7fa service nova] Creating event network-vif-plugged:7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08 for instance 4fcc207c-d481-4ede-a698-a0e6435532f9 on n-h2-851368-1 Jul 28 11:35:33.143738 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cc5bd51f-5a7e-4a9e-ab1b-71d05df1ec1f req-d99450f0-adb4-45d6-8300-b843195ab7fa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583221 Jul 28 11:35:33.155499 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1317/2668] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:33.161677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:33.162688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:33.202279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.203190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.204452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.205615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.524993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:33.538706 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5866af7-8aba-4560-984f-1191d04667a1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1271 microversion: 2.1 time: 0.381685 Jul 28 11:35:33.546498 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1318/2669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:33 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1271 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:33.576176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:33.593242 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ab6cab0-5235-4e44-a480-d0cea0c8ebcf tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 1.147100 Jul 28 11:35:33.594425 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1352/2670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:32 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:33.614908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:33.617447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:33.633796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.634302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.636549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.640133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.789533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:33.791511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:33.801295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.802105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.803252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:33.803920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:33.848281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:33.858078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45c3d783-92f7-4d03-bd5b-3c610ee2bf98 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.262286 Jul 28 11:35:33.858675 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1353/2671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:33 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:33.906529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:33.914463 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfb97ea8-5c3b-46a8-b20f-463acc642796 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1267 microversion: 2.1 time: 0.365122 Jul 28 11:35:33.927641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1319/2672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:33 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:34.579311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:34.580508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:34.601345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:34.615765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:34.616487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:34.618729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:34.620169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:34.623354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:34.634721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:34.640268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:34.641548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:34.643967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.266452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:35.281762 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be614f9e-642b-4c19-bbe9-b7bb15cad2c0 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1313 microversion: 2.1 time: 0.713345 Jul 28 11:35:35.282737 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1354/2673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:34 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:35.294980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:35.295803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:35.310881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:35.311318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.312202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:35.316271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:35.320112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.327573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-99571837-e45a-4b0e-b504-b1e3f6a182d0 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1322 microversion: 2.1 time: 0.717376 Jul 28 11:35:35.331126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1320/2674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:34 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:35.334174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:35.351537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:35.352719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:35.371708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:35.373327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.374397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:35.376529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.569322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:35.587102 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1319bf1-ae0c-42bc-ac2a-b75a8642c316 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1273 microversion: 2.1 time: 0.251687 Jul 28 11:35:35.589156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1321/2675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:35 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:35.610522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3dcf555e-64bb-485a-9a26-36bb685c1125 req-abe015b3-326f-49a3-aa59-06c1ecd343bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afa97e4-3607-47c7-b34e-02acfa522d4e", "name": "network-vif-plugged", "status": "completed", "tag": "8a71ab21-8bc0-44d9-9d8f-70406bbf94b3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:35.652754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3dcf555e-64bb-485a-9a26-36bb685c1125 req-abe015b3-326f-49a3-aa59-06c1ecd343bd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:35.661419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3dcf555e-64bb-485a-9a26-36bb685c1125 req-abe015b3-326f-49a3-aa59-06c1ecd343bd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:35.702334 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3dcf555e-64bb-485a-9a26-36bb685c1125 req-abe015b3-326f-49a3-aa59-06c1ecd343bd service nova] Creating event network-vif-plugged:8a71ab21-8bc0-44d9-9d8f-70406bbf94b3 for instance 4afa97e4-3607-47c7-b34e-02acfa522d4e on n-h1-851368-1 Jul 28 11:35:35.716141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3dcf555e-64bb-485a-9a26-36bb685c1125 req-abe015b3-326f-49a3-aa59-06c1ecd343bd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122983 Jul 28 11:35:35.724807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1322/2676] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:35.798043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:35.813066 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25905a15-3924-4a35-a915-20bd9814a135 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.529011 Jul 28 11:35:35.816181 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1355/2677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:35 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:36.305783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:36.306734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:36.320044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:36.320503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:36.321304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:36.321740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:36.352083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:36.352771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:36.370783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:36.374354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:36.379574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:36.384595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:37.320703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:37.332284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-011aad1a-8ca4-4b46-aad9-1fcac817a506 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1472 microversion: 2.1 time: 0.985985 Jul 28 11:35:37.340572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1356/2678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:36 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1472 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:37.345996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:37.351052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:37.369483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:37.371188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:37.375839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:37.376308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:37.507736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:37.521174 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be37a442-e24f-4507-b66f-28d785c47ac3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1313 microversion: 2.1 time: 1.219969 Jul 28 11:35:37.523237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1323/2679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:36 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1313 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:37.544518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:37.545416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:37.555185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:37.556045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:37.557163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:37.557970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.066066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:38.084944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc9e0940-130b-49e4-9ff0-f44bba308721 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1318 microversion: 2.1 time: 0.552850 Jul 28 11:35:38.088133 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1324/2680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:37 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:38.098672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:38.104648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:38.110627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:38.124073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a00c1574-9840-40f1-b279-68c17edde206 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 0.782124 Jul 28 11:35:38.129535 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1357/2681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:37 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:38.140711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.141588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.142589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.145568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.216621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lazy-loading 'flavor' on Instance uuid 4fcc207c-d481-4ede-a698-a0e6435532f9 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:35:38.370779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f8531991-97cb-4218-8811-e1b1a6417eec tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9/action" status: 202 len: 0 microversion: 2.1 time: 0.279341 Jul 28 11:35:38.374535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1325/2682] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:38 2022] POST /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:35:38.398986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:38.399937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:38.407809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.408438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.409284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.410966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.431006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-8724143", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:38.504740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:38.505798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:38.506687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:38.507337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:38.507981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:38.521267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.522615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.523732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.525030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.550714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Getting quotas for project 7e37c726c17744a780b976d726c77cc3. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:35:38.557596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Getting quotas for user d0c01ebcdc8742c48e40d1b1171fc252 and project 7e37c726c17744a780b976d726c77cc3. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:35:38.580702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:35:38.583586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:35:38.659695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc375040-6fcb-4f1a-8f77-4e6af6e0e027 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.506610 Jul 28 11:35:38.661599 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1358/2683] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:35:38.672219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:38.673057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:38.688938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.689651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:38.692831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:38.693502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:39.889086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:39.898873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b46bee15-958d-4931-af74-b535cfbd3557 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 1.236466 Jul 28 11:35:39.900434 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1359/2684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:38 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:39.939305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:39.949564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:39.959741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:39.962496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:39.963541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:39.964926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:40.002015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a910c53-6094-4b3f-93e0-c43c68915fce tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1631 microversion: 2.1 time: 1.611608 Jul 28 11:35:40.015096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1326/2685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:38 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1631 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:40.015096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:40.015096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:40.031291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:40.031747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:40.036401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:40.036996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:40.709149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:40.719882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:40.733536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:40.743684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:40.752376 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d5a580bf-abe8-4b6b-82d0-21912b13679d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "PUT /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1352 microversion: 2.75 time: 0.813579 Jul 28 11:35:40.769222 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1360/2686] 10.222.0.93 () {62 vars in 1297 bytes} [Thu Jul 28 11:35:39 2022] PUT /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1352 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:40.780080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:40.788104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:40.805924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:40.806624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:40.808628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:40.809278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.368089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:41.380790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4d181c8-334e-472c-8b09-efc0e9bc4233 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1507 microversion: 2.1 time: 1.376594 Jul 28 11:35:41.382325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1327/2687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:40 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1507 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:41.390497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6af87fc3-165c-497f-a3f0-ae455070da76 req-7365ee6b-1ea4-4c1c-9cac-faaa3520b939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7831917-25c6-4655-8e8d-e2ebf6920bea", "tag": "b249cf85-914e-4bdf-a044-ac2ea5b69cdc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:41.418721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6af87fc3-165c-497f-a3f0-ae455070da76 req-7365ee6b-1ea4-4c1c-9cac-faaa3520b939 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:41.419609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6af87fc3-165c-497f-a3f0-ae455070da76 req-7365ee6b-1ea4-4c1c-9cac-faaa3520b939 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.443855 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6af87fc3-165c-497f-a3f0-ae455070da76 req-7365ee6b-1ea4-4c1c-9cac-faaa3520b939 service nova] Creating event network-changed:b249cf85-914e-4bdf-a044-ac2ea5b69cdc for instance c7831917-25c6-4655-8e8d-e2ebf6920bea on n-h2-851368-1 Jul 28 11:35:41.455121 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6af87fc3-165c-497f-a3f0-ae455070da76 req-7365ee6b-1ea4-4c1c-9cac-faaa3520b939 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070043 Jul 28 11:35:41.487180 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1328/2688] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:41.494927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:41.496191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:41.505066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:41.506241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.507440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:41.508044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.728368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:41.802138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:41.862640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:41.876230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:41.908741 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-36dce216-f69c-4421-ad18-1b00eb22fd5d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 1.137396 Jul 28 11:35:41.910794 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1361/2689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:40 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:41.915130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:41.921460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:41.926428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:41.928920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:41.941557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71c8b8cc-fdc8-4dc3-801c-f5751ce45a63 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1414 microversion: 2.75 time: 0.452071 Jul 28 11:35:41.945581 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1329/2690] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:41 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1414 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:41.947338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:41.949654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.952866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:41.953511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:41.959789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:41.961766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:42.014030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:42.017202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:42.020797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:42.024980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:42.887967 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e881e003-5f11-4dc1-b2e3-db0acb9a8661 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1614 microversion: 2.1 time: 0.940950 Jul 28 11:35:42.913178 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1330/2691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:41 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1614 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:42.932313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-33695c59-5c64-470c-b025-906e01a34c84 req-3bf4f6bb-5c29-4721-8e2f-9b41c1aa8ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "tag": "c00016d1-c371-4c27-a936-29bfc1c5a031"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:42.976005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-33695c59-5c64-470c-b025-906e01a34c84 req-3bf4f6bb-5c29-4721-8e2f-9b41c1aa8ff2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:42.980993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:42.994469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-33695c59-5c64-470c-b025-906e01a34c84 req-3bf4f6bb-5c29-4721-8e2f-9b41c1aa8ff2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.013693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b30e8fff-629e-4a8b-a46a-50786363da68 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 1.101090 Jul 28 11:35:43.040234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1362/2692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:41 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:43.057003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:43.057718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:43.082027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.082546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.086196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.086664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.087826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-33695c59-5c64-470c-b025-906e01a34c84 req-3bf4f6bb-5c29-4721-8e2f-9b41c1aa8ff2 service nova] Creating event network-changed:c00016d1-c371-4c27-a936-29bfc1c5a031 for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:35:43.099686 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-33695c59-5c64-470c-b025-906e01a34c84 req-3bf4f6bb-5c29-4721-8e2f-9b41c1aa8ff2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177771 Jul 28 11:35:43.100335 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1331/2693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:43.134691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:43.139165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:43.184305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.186052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.189733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.196661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.399183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4fcc207c-d481-4ede-a698-a0e6435532f9 while it is in vm_state suspended Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Request method failure captured: Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9/action HTTP/1.1 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 15 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRWduZqh3hiDXYQ3nn1dioq2JG9VsmHDj8JKgEB-BRxjNeccD-jThI3P0dgYDulhaUhI_iFM4noOXWUxKpdw3I2LLjJ_2b8P3dV5hBQpOJU4pLzbcMQphZJSCvjFClv9X3pRVBSjHedm_KOgThBt_BCAjBXXg5YG1w3GnAJhhwwjuQ Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}] Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 99a2e0c773024dde81ee7f094ac0b23f Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: {"migrate": {}} Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'migrate' instance 4fcc207c-d481-4ede-a698-a0e6435532f9 while it is in vm_state suspended Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '4fcc207c-d481-4ede-a698-a0e6435532f9', 'body': {'migrate': {}}} Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 in vm_state suspended. Cannot resize while the instance is in this state. Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:43.403897 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4fcc207c-d481-4ede-a698-a0e6435532f9 while it is in vm_state suspended Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4fcc207c-d481-4ede-a698-a0e6435532f9 while it is in vm_state suspended Jul 28 11:35:43.410216 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.415394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Returning 409 to user: Cannot 'migrate' instance 4fcc207c-d481-4ede-a698-a0e6435532f9 while it is in vm_state suspended {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:43.419168 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6e4734d-c9c9-488f-82ab-3f5300f91c11 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9/action" status: 409 len: 148 microversion: 2.1 time: 0.296067 Jul 28 11:35:43.422441 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1332/2694] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:43 2022] POST /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9/action => generated 148 bytes in 302 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:35:43.436012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:43.442366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:43.461981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.462849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.463698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:43.464253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:43.805670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:43.819636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:43.821201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:43.840240 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5b57a3b-d14f-4c1a-8c10-74fcc82fac38 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1414 microversion: 2.75 time: 0.414678 Jul 28 11:35:43.851334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1333/2695] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:43 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1414 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:43.866732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48bfc0bd-23cc-41a9-ba49-4dd2bcb3b2df tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48bfc0bd-23cc-41a9-ba49-4dd2bcb3b2df tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Request method failure captured: Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action HTTP/1.1 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 39 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRWduZqh3hiDXYQ3nn1dioq2JG9VsmHDj8JKgEB-BRxjNeccD-jThI3P0dgYDulhaUhI_iFM4noOXWUxKpdw3I2LLjJ_2b8P3dV5hBQpOJU4pLzbcMQphZJSCvjFClv9X3pRVBSjHedm_KOgThBt_BCAjBXXg5YG1w3GnAJhhwwjuQ Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}] Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 99a2e0c773024dde81ee7f094ac0b23f Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: {"os-resetState": {"state": "invalid"}} Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '39918982-e3fb-4720-a3d9-bd3958b8e6a9', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:35:43.870986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 11:35:43.875311 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.877565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48bfc0bd-23cc-41a9-ba49-4dd2bcb3b2df tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:43.878656 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48bfc0bd-23cc-41a9-ba49-4dd2bcb3b2df tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action" status: 400 len: 144 microversion: 2.1 time: 0.025712 Jul 28 11:35:43.884087 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1334/2696] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:43 2022] POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:35:43.890721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe8985fa-cc2b-4e52-ae6e-13d8c103d8e3 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe8985fa-cc2b-4e52-ae6e-13d8c103d8e3 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Request method failure captured: Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action HTTP/1.1 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 31 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRWduZqh3hiDXYQ3nn1dioq2JG9VsmHDj8JKgEB-BRxjNeccD-jThI3P0dgYDulhaUhI_iFM4noOXWUxKpdw3I2LLjJ_2b8P3dV5hBQpOJU4pLzbcMQphZJSCvjFClv9X3pRVBSjHedm_KOgThBt_BCAjBXXg5YG1w3GnAJhhwwjuQ Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}] Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 99a2e0c773024dde81ee7f094ac0b23f Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: {"os-resetState": {"state": 1}} Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '39918982-e3fb-4720-a3d9-bd3958b8e6a9', 'body': {'os-resetState': {'state': 1}}} Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 1 Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 11:35:43.895205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 11:35:43.899674 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.902279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe8985fa-cc2b-4e52-ae6e-13d8c103d8e3 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:43.903767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe8985fa-cc2b-4e52-ae6e-13d8c103d8e3 tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action" status: 400 len: 120 microversion: 2.1 time: 0.018134 Jul 28 11:35:43.909756 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1335/2697] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:43 2022] POST /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9/action => generated 120 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:35:43.917499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:43.920489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Failed to fetch instance by id 999 {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:35:43.922145 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Request method failure captured: Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 37 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRWduZqh3hiDXYQ3nn1dioq2JG9VsmHDj8JKgEB-BRxjNeccD-jThI3P0dgYDulhaUhI_iFM4noOXWUxKpdw3I2LLjJ_2b8P3dV5hBQpOJU4pLzbcMQphZJSCvjFClv9X3pRVBSjHedm_KOgThBt_BCAjBXXg5YG1w3GnAJhhwwjuQ Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_87bb29514c394a4ea7f241e8a9e338ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/87bb29514c394a4ea7f241e8a9e338ed"}]}] Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 87bb29514c394a4ea7f241e8a9e338ed Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-354689392 Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 99a2e0c773024dde81ee7f094ac0b23f Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-354689392-project-admin Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: {"os-resetState": {"state": "error"}} Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 999 could not be found. Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:43.933476 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:43.938124 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:43.938124 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 28 11:35:43.938124 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:43.943488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:43.944917 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-efe0ddae-4324-4d2a-bc7c-ef0619cdbaae tempest-ServersAdminNegativeTestJSON-354689392 tempest-ServersAdminNegativeTestJSON-354689392-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.033004 Jul 28 11:35:43.946026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1336/2698] 10.222.0.93 () {60 vars in 1179 bytes} [Thu Jul 28 11:35:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:35:43.969344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:43.981487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:44.006346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.007302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:44.008556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.009235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:44.017907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:44.029740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:44.040307 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76a1a3aa-8adb-4e62-82f0-ff20662288ae tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 0.998079 Jul 28 11:35:44.060108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1363/2699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:43 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:44.067878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:44.068757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:44.076682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:44.077242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.078563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:44.079969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.080564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:44.311917 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5f1b74e-18a5-4ebb-892b-39f64ff39469 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 204 len: 0 microversion: 2.1 time: 0.350790 Jul 28 11:35:44.325443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1337/2700] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:43 2022] DELETE /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:35:44.338905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:44.342647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:44.360635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.362598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:44.365011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:44.365947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.061997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:45.083150 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c84e0c9-a5a1-45be-95a2-ee0df630c9b2 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1469 microversion: 2.1 time: 0.748146 Jul 28 11:35:45.087469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1338/2701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:44 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1469 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:45.092784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:45.106579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:45.133030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.133995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.135362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.138155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.249902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:45.269758 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cafdcc32-e8c6-44c8-a3f8-1ce938e3e7b8 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 1.206808 Jul 28 11:35:45.283997 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1364/2702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:44 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:45.313543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:45.314994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:45.327432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:45.338194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.340395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.341635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:45.342412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.342900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.343033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:45.355508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f12f7550-f3ec-45a7-8010-44679c03e114 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1414 microversion: 2.75 time: 0.265522 Jul 28 11:35:45.356115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1339/2703] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:45 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1414 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:45.564293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fad214fe-3df6-4320-8a8a-6f65ab5093dd"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:45.568799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:45.603166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.605416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.607571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:45.608994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:45.815399 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] HTTP exception thrown: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Request method failure captured: Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e/os-volume_attachments/043c538b-d9ae-4ab2-a3f3-834aed4f6a33 HTTP/1.1 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 74 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nQLiZGzllUGooGQmTDY9FivXCsEstXYC9FSQg9CYpPFTo7Qkw3LasOyWzTIdoH-gjDjjAQ9KUsNbqvrmi3I0TcP-V8VLXV-p0umKDPgA9bSNAK0U0WqqUmS_4f0SPiTVmZjJyH4WEGmOA0XQh7IhbE0C7Zws2BBaiteMttd15Zdxoc Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: b47f986e20d14843ae2d027705fa0a06 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b47f986e20d14843ae2d027705fa0a06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b47f986e20d14843ae2d027705fa0a06"}]}] Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: b47f986e20d14843ae2d027705fa0a06 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2001279814 Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesAdminNegativeTest-2001279814-project-admin Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: fe56a7153ce1413ead29528c6fb5025e Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesAdminNegativeTest-2001279814-project-admin Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: {"volumeAttachment": {"volumeId": "fad214fe-3df6-4320-8a8a-6f65ab5093dd"}} Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: exception: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '4afa97e4-3607-47c7-b34e-02acfa522d4e', 'id': '043c538b-d9ae-4ab2-a3f3-834aed4f6a33', 'body': {'volumeAttachment': {'volumeId': 'fad214fe-3df6-4320-8a8a-6f65ab5093dd'}}} Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. (HTTP 404) (Request-ID: req-da0c3cce-b32d-40f3-a683-6e337012dc26) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:35:45.819720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. Jul 28 11:35:45.823824 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:45.828438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] Returning 404 to user: Volume 043c538b-d9ae-4ab2-a3f3-834aed4f6a33 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:45.828907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f2b208d-d89a-467c-9a14-34cfffe96c53 tempest-VolumesAdminNegativeTest-2001279814 tempest-VolumesAdminNegativeTest-2001279814-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e/os-volume_attachments/043c538b-d9ae-4ab2-a3f3-834aed4f6a33" status: 404 len: 109 microversion: 2.1 time: 0.268948 Jul 28 11:35:45.831686 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1340/2704] 10.222.0.93 () {60 vars in 1433 bytes} [Thu Jul 28 11:35:45 2022] PUT /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e/os-volume_attachments/043c538b-d9ae-4ab2-a3f3-834aed4f6a33 => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:35:46.112519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:46.113336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:46.130748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:46.135223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:46.136389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:46.156202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:47.534797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:47.553646 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea0b179f-4ff6-4dbb-a901-ddc3a4a28f32 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 2.266805 Jul 28 11:35:47.572282 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1365/2705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:45 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:47.611934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:47.625276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:47.655156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:47.660217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:47.669894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:47.670742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:48.044246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:48.062797 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36f7129c-e144-40ff-96b0-ded2e7ee93e9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1469 microversion: 2.1 time: 1.951636 Jul 28 11:35:48.076344 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1341/2706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:46 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1469 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:48.101271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:48.112073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:48.147562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:48.160470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:48.164347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:48.164815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:48.538680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:48.573020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=14 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:48.861097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:48.872121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:48.902704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:48.929808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:48.941808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:48.958297 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a577563f-fc67-4bfc-9d40-c260c569213d tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1435 microversion: 2.75 time: 0.867835 Jul 28 11:35:48.959737 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1342/2707] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:48 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1435 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:48.972889 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96ca8891-0107-4e72-9838-bd54096f88d3 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 1.394473 Jul 28 11:35:48.983605 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1366/2708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:47 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:48.990882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-742b6e78-774d-4db1-905f-0a36a5665725 req-ff1c6b81-8482-47fb-880a-faa4b427e54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "tag": "67451ec5-86e4-4e83-97b6-9d847aa1ed5e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:49.022396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:49.025935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:49.034920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-742b6e78-774d-4db1-905f-0a36a5665725 req-ff1c6b81-8482-47fb-880a-faa4b427e54f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.038199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-742b6e78-774d-4db1-905f-0a36a5665725 req-ff1c6b81-8482-47fb-880a-faa4b427e54f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.048831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.050956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.054728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.058862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.092923 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-742b6e78-774d-4db1-905f-0a36a5665725 req-ff1c6b81-8482-47fb-880a-faa4b427e54f service nova] Creating event network-changed:67451ec5-86e4-4e83-97b6-9d847aa1ed5e for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:35:49.117639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-742b6e78-774d-4db1-905f-0a36a5665725 req-ff1c6b81-8482-47fb-880a-faa4b427e54f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151271 Jul 28 11:35:49.118856 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1343/2709] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:49.125213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:49.128442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:49.155047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.155922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.157085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.157759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.366735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:35:49.367540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:35:49.368364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:35:49.371548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:35:49.372241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:35:49.497161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:49.509334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.512605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.531999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.536273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.816693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:49.842739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:49.846962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:49.857810 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fadaae23-5380-400b-a3e9-49ae2c47191a tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "POST /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625/action" status: 202 len: 1492 microversion: 2.75 time: 0.737451 Jul 28 11:35:49.867726 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1344/2710] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:35:49 2022] POST /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625/action => generated 1492 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 11:35:49.893326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:49.894285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:49.902993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.903774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:49.904737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:49.905838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.110509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.119468 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9e793a60-3e8c-4d3a-8323-4377d8a79b05 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 1.134643 Jul 28 11:35:50.135304 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1367/2711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:48 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:50.144305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1d5b62d7-2236-45e9-aa38-14c058442a63 req-995fba7f-720a-4ea0-8395-3e48ea5799de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcc207c-d481-4ede-a698-a0e6435532f9", "name": "network-vif-unplugged", "status": "completed", "tag": "7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:50.156124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1d5b62d7-2236-45e9-aa38-14c058442a63 req-995fba7f-720a-4ea0-8395-3e48ea5799de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:50.156827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1d5b62d7-2236-45e9-aa38-14c058442a63 req-995fba7f-720a-4ea0-8395-3e48ea5799de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.169577 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1d5b62d7-2236-45e9-aa38-14c058442a63 req-995fba7f-720a-4ea0-8395-3e48ea5799de service nova] Creating event network-vif-unplugged:7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08 for instance 4fcc207c-d481-4ede-a698-a0e6435532f9 on n-h2-851368-1 Jul 28 11:35:50.179896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1d5b62d7-2236-45e9-aa38-14c058442a63 req-995fba7f-720a-4ea0-8395-3e48ea5799de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042167 Jul 28 11:35:50.185238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1368/2712] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:50.190772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:50.191697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:50.199926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:50.200601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.201643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:50.202239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.311534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.319945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.321459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.338086 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-434c3c41-f0f8-4080-853a-620eba9c0c87 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.151425 Jul 28 11:35:50.338684 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1369/2713] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:50 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:50.372879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:50.373436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:50.379724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:50.380175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.380975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:50.381868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:50.696456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.726856 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3941975-16aa-4527-9704-d0de0c3136c9 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1469 microversion: 2.1 time: 0.857133 Jul 28 11:35:50.730684 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1345/2714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:49 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1469 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:50.943333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:50.952430 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e896a2a-1ad6-45e4-8c50-480e8468cc15 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.602507 Jul 28 11:35:50.959364 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1370/2715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:50 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:51.159376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:51.160221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:51.180798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.181472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.183324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.184196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.314552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c58d8b56-b063-4a3a-9e3a-759ef4caaff9 req-bf2bf9c0-2cf2-424e-9122-d46ffb22b2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcc207c-d481-4ede-a698-a0e6435532f9", "name": "network-vif-deleted", "tag": "7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:51.339880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c58d8b56-b063-4a3a-9e3a-759ef4caaff9 req-bf2bf9c0-2cf2-424e-9122-d46ffb22b2e3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.340316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c58d8b56-b063-4a3a-9e3a-759ef4caaff9 req-bf2bf9c0-2cf2-424e-9122-d46ffb22b2e3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.402614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c58d8b56-b063-4a3a-9e3a-759ef4caaff9 req-bf2bf9c0-2cf2-424e-9122-d46ffb22b2e3 service nova] Creating event network-vif-deleted:7fb6de66-e95b-4edb-9e8b-2fc7a3e61a08 for instance 4fcc207c-d481-4ede-a698-a0e6435532f9 on n-h2-851368-1 Jul 28 11:35:51.419709 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c58d8b56-b063-4a3a-9e3a-759ef4caaff9 req-bf2bf9c0-2cf2-424e-9122-d46ffb22b2e3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108740 Jul 28 11:35:51.422577 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1371/2716] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:35:51.433743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:51.443430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:51.475000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.479654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.481216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.486350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.614001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:51.670461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eceb6bb1-9541-4173-a27b-abafd8afbac6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 0.520334 Jul 28 11:35:51.672718 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1346/2717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:51 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:51.685280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:51.688209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:51.704928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:51.707860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.708888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.710253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.710960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.715157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:51.716867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:51.723450 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b20ca196-4b23-4fe5-8658-460a79116134 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.299012 Jul 28 11:35:51.731735 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1372/2718] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:51 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:51.762831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:51.763959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:51.771559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.772267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.773559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.774496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.823782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:51.824556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:51.825170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lazy-loading 'fault' on Instance uuid 4fcc207c-d481-4ede-a698-a0e6435532f9 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:35:51.828783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:51.962393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:51.970945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58446c4c-a3ed-4fbd-9550-6eca45b8bd31 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 200 len: 1312 microversion: 2.1 time: 0.214606 Jul 28 11:35:51.978752 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1373/2719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:51 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:51.986071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:51.986818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:52.018246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.019961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.022800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.025061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.122781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:52.149658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:52.157957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:52.162091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:52.171848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a144a32-6c77-4d35-9e4f-ab912ccb7019 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2950 microversion: 2.42 time: 0.496733 Jul 28 11:35:52.174196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1347/2720] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:51 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2950 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:52.185354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:52.187357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:52.216649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.218270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.219518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.227747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.415827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fc9bb6b-4113-488a-98f8-11aecefaa7ed tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 204 len: 0 microversion: 2.1 time: 0.433546 Jul 28 11:35:52.418022 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1374/2721] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:51 2022] DELETE /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:35:52.440396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:52.444123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:52.466074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.468004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.474205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.475817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.600360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:52.616378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce5e5141-75c9-4e8c-a39b-daec46f45046 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.440807 Jul 28 11:35:52.616994 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1348/2722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:52 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:52.632226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3006a77d-14e2-472a-b956-f2a71bec65da req-e6d3e440-6234-4e72-95c9-faad228d926c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7831917-25c6-4655-8e8d-e2ebf6920bea", "name": "network-vif-plugged", "status": "completed", "tag": "b249cf85-914e-4bdf-a044-ac2ea5b69cdc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:52.646301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3006a77d-14e2-472a-b956-f2a71bec65da req-e6d3e440-6234-4e72-95c9-faad228d926c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.646819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3006a77d-14e2-472a-b956-f2a71bec65da req-e6d3e440-6234-4e72-95c9-faad228d926c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.661577 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3006a77d-14e2-472a-b956-f2a71bec65da req-e6d3e440-6234-4e72-95c9-faad228d926c service nova] Creating event network-vif-plugged:b249cf85-914e-4bdf-a044-ac2ea5b69cdc for instance c7831917-25c6-4655-8e8d-e2ebf6920bea on n-h2-851368-1 Jul 28 11:35:52.669699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3006a77d-14e2-472a-b956-f2a71bec65da req-e6d3e440-6234-4e72-95c9-faad228d926c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045393 Jul 28 11:35:52.670921 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1349/2723] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:52.679363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:52.680322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:52.704357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.705079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.707884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.709278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.941816 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74a25d09-8083-483f-bafa-1d26b8bd6ed0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.521497 Jul 28 11:35:52.943724 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1375/2724] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 11:35:52 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a/os-interface => generated 1831 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:52.949236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:52.950359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:52.971592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.972589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:52.974197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:52.974885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.288501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:53.297015 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec7bd650-6697-42a8-a9d5-1c069b76a422 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 0.351993 Jul 28 11:35:53.302082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1376/2725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:52 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:53.308909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:53.309731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:53.311181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:53.317046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.317705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.318937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.319616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.325381 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48678755-91fb-4586-bba7-82bb0e4ae765 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1513 microversion: 2.1 time: 0.650873 Jul 28 11:35:53.336903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1350/2726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:52 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1513 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:53.360901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:53.364941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 4fcc207c-d481-4ede-a698-a0e6435532f9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:53.388119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.391318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.394571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.395214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.433003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:53.438466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] HTTP exception thrown: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Request method failure captured: Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 HTTP/1.1 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRUKtSGxQNwAHitk9SYsMm-hfNIBPQ1W_NrRB1YLe18mVXNH0coAkgLfCPuugN30OqWChHG_77wpNv-PScsnWszSam0aBdbI8ldj36fBJ3JJO6ccAfov1JMDV6aKBslCbe8YWeH6zUMYdW84gjXWmmR1dNEig4qb-zufU5BDmCe5jc Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 10e4941f9f064085aef668b56f0d3b6d Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10e4941f9f064085aef668b56f0d3b6d"}]}] Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 10e4941f9f064085aef668b56f0d3b6d Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-581954984-project Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: efaead1779d443a29706991be48f1282 Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581954984-project Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '4fcc207c-d481-4ede-a698-a0e6435532f9'} Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:53.441613 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. Jul 28 11:35:53.446105 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:53.449070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Returning 404 to user: Instance 4fcc207c-d481-4ede-a698-a0e6435532f9 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:53.452053 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0ec2555-5456-429d-a899-301d333766d1 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9" status: 404 len: 111 microversion: 2.1 time: 0.113021 Jul 28 11:35:53.452422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:53.457592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:53.462208 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1351/2727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:53 2022] GET /compute/v2.1/servers/4fcc207c-d481-4ede-a698-a0e6435532f9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:53.464512 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-583815bf-c32f-439c-83b9-459f1c427712 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.160459 Jul 28 11:35:53.473866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1377/2728] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:53 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:53.480271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:53.480803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:53.497668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.498115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.498884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.499367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.553478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:53.582061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:35:53.647156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:53.648777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:53.666708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.670446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.673860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.675952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.848212 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b740a632-b3ad-4d62-9ec9-4391d0def6b6 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "DELETE /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 204 len: 0 microversion: 2.1 time: 0.382607 Jul 28 11:35:53.850306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1352/2729] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:35:53 2022] DELETE /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:35:53.865953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:53.867277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:53.894278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.895212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:53.896297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:53.899370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.091530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.100828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78749a14-57f6-491f-a33b-ad966cd8754d tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.464065 Jul 28 11:35:54.111653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1378/2730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:53 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:54.213995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.224705 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1dfa8e0-72f4-4726-a3d2-a32b52bfb725 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1478 microversion: 2.1 time: 0.368368 Jul 28 11:35:54.231657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1353/2731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:53 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:54.333557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:54.335215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:54.347103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.347304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.348600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.349146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.393314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Calling method '.version_select at 0x7f2ebc01f550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:54.394449 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:35:54.394449 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:35:54.402263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.403196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.422993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.423963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.439802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.442066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.463270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eee80321-617c-41ff-8255-73ce3960aac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1579667083-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.350066 Jul 28 11:35:54.464599 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1379/2732] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:35:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:54.472197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:54.472841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:54.479826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.480329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.481219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.481670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.556916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.566439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63ce4b41-b83c-48c4-8676-971c7ef96b03 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1315 microversion: 2.1 time: 0.239879 Jul 28 11:35:54.567528 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1354/2733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:54 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:54.589069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:54.590241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:54.597315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.598017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.599174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:54.600227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:54.708274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.712437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.718925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.721116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:54.723941 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca090253-c542-4c82-a370-167f9647ca26 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1513 microversion: 2.1 time: 0.258301 Jul 28 11:35:54.731430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-094a93da-14d0-4d70-a620-caf04e409d92 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.157617 Jul 28 11:35:54.731430 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1355/2734] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:54 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:54.735517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1380/2735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:54 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:55.139292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:55.140552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:55.149158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.150109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.151340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.152338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.249397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:55.250334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:55.269070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.269836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.270848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.271486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.360414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:55.374875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c82a482c-2c3e-4413-a251-09deb6455210 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.246842 Jul 28 11:35:55.390676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1356/2736] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:55 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:55.584325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:55.596251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:55.597139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:55.614776 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5e8ee6b-7c20-43ba-8562-187ab2d8b787 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1478 microversion: 2.1 time: 0.369568 Jul 28 11:35:55.631651 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1381/2737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:55 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1478 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:55.634075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.634855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.636591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.637398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.747707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:55.751430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:55.771309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.771779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:55.776110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:55.777335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.296845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:56.306842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa530b07-d166-4315-a461-24b528d9559f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1502 microversion: 2.1 time: 0.720707 Jul 28 11:35:56.316432 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1357/2738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:55 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1502 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:56.339524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:56.341472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:56.358428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.364985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.367481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.368171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.539291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:56.548800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f37d33bf-ae84-48b4-90d7-c914582aa736 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 200 len: 1513 microversion: 2.1 time: 0.807076 Jul 28 11:35:56.554976 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1382/2739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:55 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 1513 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:35:56.575925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73bf0dd6-e4f7-4c57-a855-662e2f9ea359 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:56.590384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73bf0dd6-e4f7-4c57-a855-662e2f9ea359 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.591761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73bf0dd6-e4f7-4c57-a855-662e2f9ea359 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.651992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73bf0dd6-e4f7-4c57-a855-662e2f9ea359 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:35:56.711522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:56.728209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:56.730933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:56.741497 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-503bfde5-8ac8-4845-a643-97ba35bd1628 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.423665 Jul 28 11:35:56.748555 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1358/2740] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:56 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:56.758591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ff3942e8-27d3-44fb-b176-9462ef5d7d11 req-1c2eeab9-52f8-482d-9d76-a9f495bb900b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afa97e4-3607-47c7-b34e-02acfa522d4e", "name": "network-vif-deleted", "tag": "8a71ab21-8bc0-44d9-9d8f-70406bbf94b3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:56.780220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73bf0dd6-e4f7-4c57-a855-662e2f9ea359 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea/action" status: 202 len: 0 microversion: 2.1 time: 0.223563 Jul 28 11:35:56.781188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1383/2741] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:35:56 2022] POST /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:35:56.786776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:56.789887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:56.806001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.806756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.807830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.808231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ff3942e8-27d3-44fb-b176-9462ef5d7d11 req-1c2eeab9-52f8-482d-9d76-a9f495bb900b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.810906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.811470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ff3942e8-27d3-44fb-b176-9462ef5d7d11 req-1c2eeab9-52f8-482d-9d76-a9f495bb900b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.843394 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ff3942e8-27d3-44fb-b176-9462ef5d7d11 req-1c2eeab9-52f8-482d-9d76-a9f495bb900b service nova] Creating event network-vif-deleted:8a71ab21-8bc0-44d9-9d8f-70406bbf94b3 for instance 4afa97e4-3607-47c7-b34e-02acfa522d4e on n-h1-851368-1 Jul 28 11:35:56.855727 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ff3942e8-27d3-44fb-b176-9462ef5d7d11 req-1c2eeab9-52f8-482d-9d76-a9f495bb900b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102416 Jul 28 11:35:56.857561 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1359/2742] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:56.866760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:56.867509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:56.890135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.890598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:56.892323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:56.892838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.321038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:57.331493 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e3f3dc8-4b1a-4029-8045-a6a2d3e8de93 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.548867 Jul 28 11:35:57.335780 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1384/2743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:56 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:57.341273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:57.341923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:57.361628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.362385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.363365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.374469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.608840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:57.616746 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e41522f0-e541-431c-8057-69167959d879 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1478 microversion: 2.1 time: 0.757882 Jul 28 11:35:57.617340 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1360/2744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:56 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1478 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:57.636645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:57.637299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: 4afa97e4-3607-47c7-b34e-02acfa522d4e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:57.651049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.651572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.652479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.652931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.667303 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] HTTP exception thrown: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Request method failure captured: Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e HTTP/1.1 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nP8O9N8jR1zal4_8xTDjh5q5PfKTYrw6v-XHFaXo1--2JSlXquN_lE593rUnpoy2T6DC9SS2O3d4BRymWAP31zdIoph_aC4WArrXr4sq7DSH3iuHomHGSCJl1I9YnBv0KPYVYMhz9A1tW_FdTnm4DfL0dxbkVUHYCa7PZNFQOX7jlQ Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 2bc1bcff90a247cb9fd3da771b563070 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2bc1bcff90a247cb9fd3da771b563070"}]}] Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 2bc1bcff90a247cb9fd3da771b563070 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesAdminNegativeTest-207472447-project Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d79daea187ea48f6a2dbf47751ea0d84 Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesAdminNegativeTest-207472447-project Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '4afa97e4-3607-47c7-b34e-02acfa522d4e'} Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:35:57.668975 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Returning 404 to user: Instance 4afa97e4-3607-47c7-b34e-02acfa522d4e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a285940b-e66f-43b7-b715-34970aa8b658 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e" status: 404 len: 111 microversion: 2.1 time: 0.038195 Jul 28 11:35:57.674586 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1361/2745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:57 2022] GET /compute/v2.1/servers/4afa97e4-3607-47c7-b34e-02acfa522d4e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:35:57.775657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:57.776561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:57.809710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.810424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:57.814875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:57.815630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.170318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:58.187576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:58.189623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:58.195385 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16ef655b-fee1-4e5b-bb60-65d9018629a3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.423733 Jul 28 11:35:58.200162 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1362/2746] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:57 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:35:58.218370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:58.230006 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59edcb66-7e56-4e2b-b1f6-a30b5676b3c4 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.891940 Jul 28 11:35:58.237013 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1385/2747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:57 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:58.358463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:58.359402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:58.374887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.375696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.376719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.379707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.564742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1458e95b-5e72-4281-b42a-84a39c78043b req-c10a7122-34c8-4cef-b986-c73c894edc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39918982-e3fb-4720-a3d9-bd3958b8e6a9", "name": "network-vif-deleted", "tag": "153e4ab4-6c27-4848-9770-eb3734ecbf9b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:58.642425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1458e95b-5e72-4281-b42a-84a39c78043b req-c10a7122-34c8-4cef-b986-c73c894edc06 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.647635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1458e95b-5e72-4281-b42a-84a39c78043b req-c10a7122-34c8-4cef-b986-c73c894edc06 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.705535 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1458e95b-5e72-4281-b42a-84a39c78043b req-c10a7122-34c8-4cef-b986-c73c894edc06 service nova] Creating event network-vif-deleted:153e4ab4-6c27-4848-9770-eb3734ecbf9b for instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 on n-h2-851368-1 Jul 28 11:35:58.716984 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1458e95b-5e72-4281-b42a-84a39c78043b req-c10a7122-34c8-4cef-b986-c73c894edc06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155930 Jul 28 11:35:58.722748 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1386/2748] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:35:58.739319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:58.740016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:58.793336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.794535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.795671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.796347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.856859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:58.858381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:58.860144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lazy-loading 'fault' on Instance uuid 39918982-e3fb-4720-a3d9-bd3958b8e6a9 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:35:59.045231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaead1779d443a29706991be48f1282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e4941f9f064085aef668b56f0d3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.059032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62f3bba5-1fb6-4eb3-a1f2-683985e1ef34 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 200 len: 1312 microversion: 2.1 time: 0.330739 Jul 28 11:35:59.065014 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1387/2749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:58 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:59.077605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-53f3e6f2-33f9-4f25-9663-1f38321d617d req-fea29666-ab34-4a87-922f-6349ed206101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "name": "network-vif-plugged", "status": "completed", "tag": "67451ec5-86e4-4e83-97b6-9d847aa1ed5e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:35:59.108267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-53f3e6f2-33f9-4f25-9663-1f38321d617d req-fea29666-ab34-4a87-922f-6349ed206101 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:59.110039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-53f3e6f2-33f9-4f25-9663-1f38321d617d req-fea29666-ab34-4a87-922f-6349ed206101 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:59.146124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:35:59.154437 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-53f3e6f2-33f9-4f25-9663-1f38321d617d req-fea29666-ab34-4a87-922f-6349ed206101 service nova] Creating event network-vif-plugged:67451ec5-86e4-4e83-97b6-9d847aa1ed5e for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:35:59.169761 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-53f3e6f2-33f9-4f25-9663-1f38321d617d req-fea29666-ab34-4a87-922f-6349ed206101 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100133 Jul 28 11:35:59.172030 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1388/2750] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:35:59.235185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:59.236855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:59.248033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:59.248775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:59.249774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:59.251873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:59.257918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.267582 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b17b2a67-1993-4090-a68f-9a4ab34313ee tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.913478 Jul 28 11:35:59.283607 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1363/2751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:58 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:35:59.297007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:35:59.300172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:35:59.316200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:59.316922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:59.317955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:35:59.318631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:35:59.366428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.379941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.383302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.393308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8abf952-5cdf-40fd-a64e-6a316eebb6d3 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.167504 Jul 28 11:35:59.428601 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1389/2752] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:35:59 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:35:59.573568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:35:59.584347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34640956-208d-4540-be1d-7d801eda95ce tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.299453 Jul 28 11:35:59.589349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1364/2753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:35:59 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:00.090812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:00.091967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] [instance: 39918982-e3fb-4720-a3d9-bd3958b8e6a9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:00.099591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.100141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.100989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.101635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.119045 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] HTTP exception thrown: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Request method failure captured: Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 HTTP/1.1 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRUKtSGxQNwAHitk9SYsMm-hfNIBPQ1W_NrRB1YLe18mVXNH0coAkgLfCPuugN30OqWChHG_77wpNv-PScsnWszSam0aBdbI8ldj36fBJ3JJO6ccAfov1JMDV6aKBslCbe8YWeH6zUMYdW84gjXWmmR1dNEig4qb-zufU5BDmCe5jc Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 10e4941f9f064085aef668b56f0d3b6d Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10e4941f9f064085aef668b56f0d3b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10e4941f9f064085aef668b56f0d3b6d"}]}] Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 10e4941f9f064085aef668b56f0d3b6d Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581954984 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminNegativeTestJSON-581954984-project Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: efaead1779d443a29706991be48f1282 Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581954984-project Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '39918982-e3fb-4720-a3d9-bd3958b8e6a9'} Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:00.121706 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. Jul 28 11:36:00.127703 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:00.129949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] Returning 404 to user: Instance 39918982-e3fb-4720-a3d9-bd3958b8e6a9 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:00.131052 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fdb84b49-cd91-4a86-a973-8ec72f4cc201 tempest-ServersAdminNegativeTestJSON-581954984 tempest-ServersAdminNegativeTestJSON-581954984-project] 10.222.0.93 "GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9" status: 404 len: 111 microversion: 2.1 time: 0.044717 Jul 28 11:36:00.132183 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1390/2754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:00 2022] GET /compute/v2.1/servers/39918982-e3fb-4720-a3d9-bd3958b8e6a9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:00.297972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:00.299711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:00.307124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.309703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.309703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.309703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.429634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:00.430419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:00.450163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.450618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.461335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.461879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.569403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:00.594915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5aae7a04-037b-4d19-a3a9-61e86c168d13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.300660 Jul 28 11:36:00.599373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1365/2755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:00 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:00.623293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:00.629345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:00.644086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.650703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.653044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:00.653715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:00.717053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:00.725909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:00.737720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:00.751952 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d5c391f-5e33-4170-bedc-e2fa0bb35801 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.332189 Jul 28 11:36:00.752541 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1391/2756] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:00 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:01.214530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e5814392-b5b9-4f4f-8777-92fcd6eb8fbd req-67ac3ec0-6890-40ba-a174-0bf1bca910f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "name": "network-vif-plugged", "status": "completed", "tag": "c00016d1-c371-4c27-a936-29bfc1c5a031"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:01.236556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e5814392-b5b9-4f4f-8777-92fcd6eb8fbd req-67ac3ec0-6890-40ba-a174-0bf1bca910f2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:01.236996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e5814392-b5b9-4f4f-8777-92fcd6eb8fbd req-67ac3ec0-6890-40ba-a174-0bf1bca910f2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:01.251332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e5814392-b5b9-4f4f-8777-92fcd6eb8fbd req-67ac3ec0-6890-40ba-a174-0bf1bca910f2 service nova] Creating event network-vif-plugged:c00016d1-c371-4c27-a936-29bfc1c5a031 for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:36:01.258553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e5814392-b5b9-4f4f-8777-92fcd6eb8fbd req-67ac3ec0-6890-40ba-a174-0bf1bca910f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049544 Jul 28 11:36:01.259831 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1392/2757] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:01.312583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:01.351882 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-64b0435f-2d8b-46ea-b3f0-6f4d90c81533 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.740806 Jul 28 11:36:01.360721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1366/2758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:00 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:01.625780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:01.627307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:01.638820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:01.645621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:01.656795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:01.661099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:01.777975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:01.778990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:01.790834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:01.793310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:01.794314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:01.797870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:02.053044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:02.086096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:02.092494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:02.101429 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-482dc92a-f2a8-4419-893f-c6a774ffa082 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.329441 Jul 28 11:36:02.113347 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1367/2759] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:01 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:02.125793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:02.137953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7a75045-8b05-43dd-a040-60c71127fdfb tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.518228 Jul 28 11:36:02.138891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1393/2760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:01 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:02.382333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:02.383284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:02.390547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:02.392054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:02.393248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:02.393917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:02.467290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:02.724896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:02.736418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-811cdd9c-207a-4234-80a4-22fb744e37eb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.358672 Jul 28 11:36:02.737570 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1368/2761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:02 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:03.131619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:03.132239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:03.141602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.142275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.143232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.143818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.159883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:03.160948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:03.171286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.171749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.172559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.174095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.279477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:03.302208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:03.303959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:03.322681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73d7eb02-ae6d-4592-87b3-06d3a9bbc228 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.197462 Jul 28 11:36:03.344588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1394/2762] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:03 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:03.378224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:03.378779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:03.400268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.400881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.402015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.402542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.453903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:36:03.539631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:03.555152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56282661-d730-4746-a3cd-9cf9e4fe6b2f tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1334 microversion: 2.1 time: 0.395021 Jul 28 11:36:03.567740 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1369/2763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:03 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1334 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:03.624672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:03.630491 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e320d829-1f1a-4d18-9425-f5e3fa5ffd1e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 204 len: 0 microversion: 2.1 time: 0.284204 Jul 28 11:36:03.631421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1395/2764] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:03 2022] DELETE /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:36:03.640621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:03.643450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:03.667308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.672901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.677490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.678256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.766493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:03.767242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:03.777750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.778845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:03.780976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:03.782012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.025628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.036500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b3504bd-493f-451a-9a67-59eda7c5a410 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.274178 Jul 28 11:36:04.040488 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1396/2765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:03 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:04.061838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.070804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34e51166-d9e5-4e67-8dff-b3a1697b08a3 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1678 microversion: 2.1 time: 0.434366 Jul 28 11:36:04.074255 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1370/2766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:03 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1678 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:04.351453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:04.352219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:04.365489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.369002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.370548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.371414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.496938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.514147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.516094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.523316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7b46d2d-6dc2-46fe-bc6a-c541313e564c tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.176929 Jul 28 11:36:04.540944 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1397/2767] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:04 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:04.579375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:04.580137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:04.603106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.606479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.608865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.609689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.832956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:04.846887 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0f33761-71c0-4402-b05a-8d66f598da64 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1668 microversion: 2.1 time: 0.272509 Jul 28 11:36:04.848668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1371/2768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:04 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1668 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:04.868705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:04.869465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:04.876350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.877025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.877802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.878426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.905698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76ddf7aa-1263-459c-a527-cff8302e48e1 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996/ips" status: 200 len: 178 microversion: 2.1 time: 0.040300 Jul 28 11:36:04.912922 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1398/2769] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:36:04 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996/ips => generated 178 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:04.920889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:04.922799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:04.936745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.937580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.938552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:04.939176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:04.991807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:36:05.066744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:05.067386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:05.083558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.084013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.085064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.094925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.193751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f66337a3-f471-475b-856c-e678b0ae902b tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 204 len: 0 microversion: 2.1 time: 0.277498 Jul 28 11:36:05.194558 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1372/2770] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:04 2022] DELETE /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:36:05.199525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:05.200235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:05.220227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.220930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.222262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.222699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.424710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.440567 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1112fc8f-e81b-45bf-8f3b-0f73dd8f6e43 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.380065 Jul 28 11:36:05.442269 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1399/2771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:05 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:05.479154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:05.480555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:05.498481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.499306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.500730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.501856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.503338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.507312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-72b3f339-d33c-4aa4-b49d-f68e71090188 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1678 microversion: 2.1 time: 0.311711 Jul 28 11:36:05.512472 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1373/2772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:05 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1678 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:05.556240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:05.557557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:05.568824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.574054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.575318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:05.575984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:05.750175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.767872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.770878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.787018 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e845e893-9991-4d8c-aef5-ce71d86717e8 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.234706 Jul 28 11:36:05.787915 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1374/2773] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:05 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:05.891062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:05.901305 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed6c87d5-225a-40f5-9698-0431acb89b39 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1674 microversion: 2.1 time: 0.436636 Jul 28 11:36:05.915103 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1400/2774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:05 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1674 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:06.468475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:06.469482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:06.479986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.485520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:06.486630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.487320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:06.536940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:06.538319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:06.553748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.554395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:06.555362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.555949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:06.805893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:06.818496 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-569fae35-5f25-418f-9be1-7326817b8340 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1613 microversion: 2.1 time: 0.283285 Jul 28 11:36:06.832188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1401/2775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:06 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1613 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:06.832188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:06.832188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:06.845938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.846409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:06.847241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:06.852132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.050852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:07.064834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:07.067422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:07.082484 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1144ecf8-85b0-4f8b-a213-3d87612ed166 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.262062 Jul 28 11:36:07.083848 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1402/2776] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:06 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:07.096644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:07.098090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:07.114362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.119164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.122757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.127595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.481383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:07.496116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d326ce6-4572-441d-8964-7950ce00f990 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 1.032790 Jul 28 11:36:07.497599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1375/2777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:06 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:07.665254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:07.674060 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-945d59d2-c051-4c8d-bd3d-e8351a210255 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1674 microversion: 2.1 time: 0.588717 Jul 28 11:36:07.674643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1403/2778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:07 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1674 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:07.747020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-42ba2a6e-446a-4568-8ae2-533653814fc8 req-d97ceb5b-cf29-4d83-b7f6-a40e7ccd1b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b207e98c-1958-45e4-9fee-41ca4e03ab14", "name": "network-vif-deleted", "tag": "c640a81d-2531-4490-b242-181f2b39aa92"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:07.781792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-42ba2a6e-446a-4568-8ae2-533653814fc8 req-d97ceb5b-cf29-4d83-b7f6-a40e7ccd1b81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.782438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-42ba2a6e-446a-4568-8ae2-533653814fc8 req-d97ceb5b-cf29-4d83-b7f6-a40e7ccd1b81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.812979 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-42ba2a6e-446a-4568-8ae2-533653814fc8 req-d97ceb5b-cf29-4d83-b7f6-a40e7ccd1b81 service nova] Creating event network-vif-deleted:c640a81d-2531-4490-b242-181f2b39aa92 for instance b207e98c-1958-45e4-9fee-41ca4e03ab14 on n-h2-851368-1 Jul 28 11:36:07.825098 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-42ba2a6e-446a-4568-8ae2-533653814fc8 req-d97ceb5b-cf29-4d83-b7f6-a40e7ccd1b81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086521 Jul 28 11:36:07.829949 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1376/2779] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:07.841345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:07.841984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:07.852200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.859153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.863438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.867133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.992210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:07.993071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:07.993732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lazy-loading 'fault' on Instance uuid b207e98c-1958-45e4-9fee-41ca4e03ab14 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:08.075671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79daea187ea48f6a2dbf47751ea0d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc1bcff90a247cb9fd3da771b563070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:08.111128 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc976afa-0f16-47a0-9004-5ab35d0ee2e4 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 200 len: 1331 microversion: 2.1 time: 0.274522 Jul 28 11:36:08.113540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:08.115338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:08.116411 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1404/2780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:07 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 1331 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:08.127012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.139858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:08.151202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.152043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:08.333932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:08.360385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:08.373229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:08.375484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:08.393774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-493b5d6e-93c2-4fd9-9716-e219275d1581 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.284644 Jul 28 11:36:08.395402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1377/2781] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:08 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:08.519104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:08.520015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:08.529147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.535148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:08.536444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.537053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:08.593160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:08.702232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:08.708157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:08.723915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.729905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:08.749357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:08.750063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.105113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:09.113105 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-94362d19-2749-4520-b9aa-b1ddd507e5fa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.597785 Jul 28 11:36:09.127332 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1405/2782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:08 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:09.138104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:09.138728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [instance: b207e98c-1958-45e4-9fee-41ca4e03ab14] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:09.149262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:09.149737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.152638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:09.153090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.182788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] HTTP exception thrown: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Request method failure captured: Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 HTTP/1.1 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nP8O9N8jR1zal4_8xTDjh5q5PfKTYrw6v-XHFaXo1--2JSlXquN_lE593rUnpoy2T6DC9SS2O3d4BRymWAP31zdIoph_aC4WArrXr4sq7DSH3iuHomHGSCJl1I9YnBv0KPYVYMhz9A1tW_FdTnm4DfL0dxbkVUHYCa7PZNFQOX7jlQ Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 2bc1bcff90a247cb9fd3da771b563070 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2bc1bcff90a247cb9fd3da771b563070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2bc1bcff90a247cb9fd3da771b563070"}]}] Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 2bc1bcff90a247cb9fd3da771b563070 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-207472447 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesAdminNegativeTest-207472447-project Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d79daea187ea48f6a2dbf47751ea0d84 Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesAdminNegativeTest-207472447-project Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'b207e98c-1958-45e4-9fee-41ca4e03ab14'} Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:09.185197 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Returning 404 to user: Instance b207e98c-1958-45e4-9fee-41ca4e03ab14 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:09.189320 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1dc1b043-897a-4fe3-a50f-f230c71c78c8 tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14" status: 404 len: 111 microversion: 2.1 time: 0.053404 Jul 28 11:36:09.201940 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1406/2783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:09 2022] GET /compute/v2.1/servers/b207e98c-1958-45e4-9fee-41ca4e03ab14 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:36:09.206868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9bc39bd2-f5b3-42d6-8262-8dc8b40a8e2e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] Calling method '.version_select at 0x7f2ebc016790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:09.225389 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9bc39bd2-f5b3-42d6-8262-8dc8b40a8e2e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [7e6317d1-6469-4ac0-a2cf-13efe80257ce] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 11:36:09.233530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:09.244057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b8370fe-4d5e-461c-98c0-f364b0e40073 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1674 microversion: 2.1 time: 0.552649 Jul 28 11:36:09.248969 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1378/2784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:08 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1674 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:09.421124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:09.422455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:09.439134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:09.439905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.441853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:09.442539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.562131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:09.585107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:09.588175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:09.607695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-640ed729-3641-4dfb-bdfc-76fadb94f841 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1444 microversion: 2.75 time: 0.190335 Jul 28 11:36:09.639718 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1379/2785] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:09 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:09.671787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-73573d90-beaf-45ed-b962-28adb82863cc req-18c5ec08-43a8-4961-87cd-a20a30952dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "name": "network-vif-deleted", "tag": "c00016d1-c371-4c27-a936-29bfc1c5a031"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:09.700749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-73573d90-beaf-45ed-b962-28adb82863cc req-18c5ec08-43a8-4961-87cd-a20a30952dc6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:09.701210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-73573d90-beaf-45ed-b962-28adb82863cc req-18c5ec08-43a8-4961-87cd-a20a30952dc6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:09.730618 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-73573d90-beaf-45ed-b962-28adb82863cc req-18c5ec08-43a8-4961-87cd-a20a30952dc6 service nova] Creating event network-vif-deleted:c00016d1-c371-4c27-a936-29bfc1c5a031 for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:36:09.742104 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-73573d90-beaf-45ed-b962-28adb82863cc req-18c5ec08-43a8-4961-87cd-a20a30952dc6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074169 Jul 28 11:36:09.747414 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1380/2786] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:10.134279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:10.135019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:10.154388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.154842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.155655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.156099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.238048 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [None req-9bc39bd2-f5b3-42d6-8262-8dc8b40a8e2e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] [7e6317d1-6469-4ac0-a2cf-13efe80257ce] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 46796. Jul 28 11:36:10.295103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9bc39bd2-f5b3-42d6-8262-8dc8b40a8e2e tempest-VolumesAdminNegativeTest-207472447 tempest-VolumesAdminNegativeTest-207472447-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359614044" status: 202 len: 0 microversion: 2.1 time: 1.091911 Jul 28 11:36:10.301383 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1407/2787] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359614044 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:10.312851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:10.333384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:10.370421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.370784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.371607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.382803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.728372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:10.741097 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7300354d-64ba-4829-967d-55cdff1cc4e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.610596 Jul 28 11:36:10.742821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1381/2788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:10 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:10.757382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-aee0dd1b-3f37-4ee0-ba62-cdd4eaa632b9 req-768f330c-2589-48d6-b6b4-177fbe171d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "name": "network-vif-unplugged", "status": "completed", "tag": "67451ec5-86e4-4e83-97b6-9d847aa1ed5e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:10.787530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aee0dd1b-3f37-4ee0-ba62-cdd4eaa632b9 req-768f330c-2589-48d6-b6b4-177fbe171d70 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.791397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aee0dd1b-3f37-4ee0-ba62-cdd4eaa632b9 req-768f330c-2589-48d6-b6b4-177fbe171d70 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.842422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:10.848481 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-aee0dd1b-3f37-4ee0-ba62-cdd4eaa632b9 req-768f330c-2589-48d6-b6b4-177fbe171d70 service nova] Creating event network-vif-unplugged:67451ec5-86e4-4e83-97b6-9d847aa1ed5e for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:36:10.860773 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a317d142-857a-4d32-8db8-80ab6019aa13 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1653 microversion: 2.1 time: 0.554041 Jul 28 11:36:10.883835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1408/2789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:10 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1653 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:10.894772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-aee0dd1b-3f37-4ee0-ba62-cdd4eaa632b9 req-768f330c-2589-48d6-b6b4-177fbe171d70 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150443 Jul 28 11:36:10.897119 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1382/2790] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:10.900469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:10.901837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:10.911091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.911771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:10.912727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:10.913323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:11.034955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:11.045947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:11.048941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:11.056200 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d71afd08-b40f-4333-b6b7-17428f169944 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1450 microversion: 2.75 time: 0.169634 Jul 28 11:36:11.071961 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1409/2791] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:10 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:11.763818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:11.765194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:11.776917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:11.783127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:11.788717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:11.789399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:11.891476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:11.892746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:11.915843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:11.916646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:11.918864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:11.919537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:12.736755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:12.745841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8f4fe7d-6a9e-4c7f-8db2-aac329f062f2 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1455 microversion: 2.1 time: 0.858101 Jul 28 11:36:12.750777 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1410/2792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:11 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1455 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:12.767345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:12.768615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:12.783862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:12.784538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:12.785549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:12.787623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:13.217337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:13.234122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:13.236162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:13.253333 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-334ef3a0-1a4d-42a8-bb66-927b640436fc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1450 microversion: 2.75 time: 0.500688 Jul 28 11:36:13.253952 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1411/2793] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:12 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1450 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:13.267396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4be0c033-8965-4f35-9a54-5ec1f710ddfd req-3b610119-1eb0-4d88-83f6-97b7c76e2eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1603cebe-05fd-461b-917f-f3c1b6c71996", "name": "network-vif-deleted", "tag": "67451ec5-86e4-4e83-97b6-9d847aa1ed5e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:13.286850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4be0c033-8965-4f35-9a54-5ec1f710ddfd req-3b610119-1eb0-4d88-83f6-97b7c76e2eb3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:13.287602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4be0c033-8965-4f35-9a54-5ec1f710ddfd req-3b610119-1eb0-4d88-83f6-97b7c76e2eb3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:13.307499 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4be0c033-8965-4f35-9a54-5ec1f710ddfd req-3b610119-1eb0-4d88-83f6-97b7c76e2eb3 service nova] Creating event network-vif-deleted:67451ec5-86e4-4e83-97b6-9d847aa1ed5e for instance 1603cebe-05fd-461b-917f-f3c1b6c71996 on n-h1-851368-1 Jul 28 11:36:13.313349 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4be0c033-8965-4f35-9a54-5ec1f710ddfd req-3b610119-1eb0-4d88-83f6-97b7c76e2eb3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Jul 28 11:36:13.314254 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1412/2794] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:13.401669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:13.419794 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6607c7e-add3-4bf7-bafa-8827c73fd79b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 1.660820 Jul 28 11:36:13.436135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1383/2795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:11 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:13.774738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:13.775582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:13.789222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:13.789684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:13.790491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:13.791031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:13.888035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:13.888544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:13.889023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lazy-loading 'fault' on Instance uuid 1603cebe-05fd-461b-917f-f3c1b6c71996 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:14.006299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589864c43174112961a7c1a3c17ee8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94da65f2f5404355bb866482aba46657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:14.018953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6978426a-e18b-49e2-bd27-243a9aa89f28 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 200 len: 1303 microversion: 2.1 time: 0.248424 Jul 28 11:36:14.026790 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1413/2796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:13 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:14.248357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Calling method '.version_select at 0x7f2eb1ce4310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:14.251279 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:36:14.251279 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:36:14.253465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.254243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.272996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.274140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.295283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.296344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.316359 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c01d9d2-78e9-4b93-b269-45d311fa6a1e tempest-PortsAdminExtendedAttrsTestJSON-139356376 tempest-PortsAdminExtendedAttrsTestJSON-139356376-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.311385 Jul 28 11:36:14.336520 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1384/2797] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:36:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:14.354789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:14.360954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:14.379131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.381425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.382868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.383768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.427301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:14.472734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1c5da31-88e5-4b83-b1ac-92ac6d625d59 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Action: 'create', calling method: .version_select at 0x7f2ebbf453a0>, body: {"keypair": {"name": "tempest-keypair-107171982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdm9xiEj3gQ1xBHosL6tBm5F4kW+iOunbnDix8pcr3Ivqv8ArMkHyTMIOO1uKKBS1BqiWxM3ptrBEexvvXcnB6rFsTe2FXBnI6t6vktMedE7f/tnYp1mrs0+Z0asBN8nw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:14.503590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f1c5da31-88e5-4b83-b1ac-92ac6d625d59 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Getting quotas for project 73cae4c754ad49b1888ca5de3da0f4af. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:36:14.512731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f1c5da31-88e5-4b83-b1ac-92ac6d625d59 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Getting quotas for user 591073a571ce4620ab3f396f4f88863e and project 73cae4c754ad49b1888ca5de3da0f4af. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:36:14.551511 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1c5da31-88e5-4b83-b1ac-92ac6d625d59 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.436532 Jul 28 11:36:14.552681 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1414/2798] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:36:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:36:14.553709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:14.565768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:14.566470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:14.567941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:14.568263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:14.576288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.577274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.578798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:14.579568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:14.579695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a7fa99b-343d-49fd-9906-39d1eb251821 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1450 microversion: 2.75 time: 0.240560 Jul 28 11:36:14.580665 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1385/2799] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:14 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1450 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:15.025932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:15.045865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:15.046503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:15.051749 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-071dfc87-2ec9-4c87-be48-93d515070606 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.485002 Jul 28 11:36:15.055471 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1415/2800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:14 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:15.061905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:15.062350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:15.063268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:15.065989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:15.093883 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 HTTP/1.1 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1603cebe-05fd-461b-917f-f3c1b6c71996'} Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:15.096902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:15.101485 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:15.102591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:15.105240 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43144f1a-5a75-422e-8f3c-b8a5c8c5b0b6 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 404 len: 111 microversion: 2.1 time: 0.062495 Jul 28 11:36:15.106205 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1386/2801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:15 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:36:15.616884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:15.618505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:15.672273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:15.672958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:15.676925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:15.677762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:15.839214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:15.866719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:15.872823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:15.883104 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d085469a-bbb6-45fb-9ef0-0960f8fbc6d9 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1435 microversion: 2.75 time: 0.276963 Jul 28 11:36:15.884498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1416/2802] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:15 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1435 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:16.078887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:16.079981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:16.097771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.098596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.099674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.100317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.117860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:16.120817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:16.128519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.128975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.129781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.130224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.250634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:36:16.251454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:36:16.252156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:36:16.252811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:36:16.253338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:36:16.328200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:16.335470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.335931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.336872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.337493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.440835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:16.457557 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22e260df-9fa9-4a44-9e87-3596899f64b9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.383301 Jul 28 11:36:16.458151 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1417/2803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:16 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:16.557726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:16.586277 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfd1692e-8f49-413f-a50d-41ed966583b7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625/action" status: 202 len: 1936 microversion: 2.75 time: 0.660815 Jul 28 11:36:16.587338 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1387/2804] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:36:15 2022] POST /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625/action => generated 1936 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 11:36:16.614294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:16.614921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:16.640852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.642127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:16.643730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:16.644360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:17.007001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:17.054750 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-40695d04-f551-46c5-bf1c-3d7485d7e084 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.444103 Jul 28 11:36:17.087624 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1418/2805] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:16 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:17.129113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba2797b5-db29-4406-9670-99a58109eb8c tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2eb1c98430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1319715910", "description": "tempest-description-1308512921"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:17.485674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:17.488027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:17.497607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:17.498534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:17.499594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:17.500260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:18.207007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:18.226062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46320de9-a787-42ff-8a7f-1485edfee3e2 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.739553 Jul 28 11:36:18.247320 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1419/2806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:17 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:18.293185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:18.294796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:18.301683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:18.302357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:18.305777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:18.306554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:18.526244 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ba2797b5-db29-4406-9670-99a58109eb8c tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.522487 Jul 28 11:36:18.526889 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1388/2807] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:36:17 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:36:18.539936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e5bf803-9260-4c18-a4c2-50df5583cbbb tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbe57ca0>, body: {"security_group_rule": {"parent_group_id": "8c9c6c73-8a21-46a8-92f4-a7df346a6003", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:18.641046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:18.694541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68b0a604-960e-47fd-8ceb-2d884d3243be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.442561 Jul 28 11:36:18.695201 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1420/2808] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:18 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:19.249116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:19.250972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:19.257385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:19.258089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:19.259051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:19.259743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:19.884215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:19.916868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-83f648d2-0566-4768-9a40-578690abd66b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.649067 Jul 28 11:36:19.924298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1421/2809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:19 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:19.939300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:19.941380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:19.964291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:19.965970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:19.967252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:19.968134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:20.009127 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e5bf803-9260-4c18-a4c2-50df5583cbbb tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.473230 Jul 28 11:36:20.010503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1389/2810] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:20.015542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1753237803", "imageRef": "a1b06406-8210-4757-b50d-3e73035455c0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8cd74f5c-1980-455b-862f-5bc9172bc13f"}], "security_groups": [{"name": "tempest-securitygroup--1085350060"}], "key_name": "tempest-keypair-107171982", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:20.180549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:20.225681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f36d503a-4bf4-46d7-9fda-0faa7117be02 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.299766 Jul 28 11:36:20.234028 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1422/2811] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:19 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:20.251721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b41cb37-2889-49c8-a171-73d37c5aa171 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbea9430>, body: {"security_group_rule": {"parent_group_id": "8c9c6c73-8a21-46a8-92f4-a7df346a6003", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:20.405374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] validate_networks() for [('8cd74f5c-1980-455b-862f-5bc9172bc13f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:36:20.517465 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7b41cb37-2889-49c8-a171-73d37c5aa171 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b41cb37-2889-49c8-a171-73d37c5aa171 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 138 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: {"security_group_rule": {"parent_group_id": "8c9c6c73-8a21-46a8-92f4-a7df346a6003", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: exception: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8c9c6c73-8a21-46a8-92f4-a7df346a6003', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:20.530014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b41cb37-2889-49c8-a171-73d37c5aa171 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: This rule already exists in group 8c9c6c73-8a21-46a8-92f4-a7df346a6003 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:20.534085 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7b41cb37-2889-49c8-a171-73d37c5aa171 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.297100 Jul 28 11:36:20.534563 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1423/2812] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:36:20.545234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3dd996b5-e0cc-4dfe-b017-acdc1fae30d7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2eb325e430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:21.320047 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3dd996b5-e0cc-4dfe-b017-acdc1fae30d7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/540c09c4-ea75-4848-824c-498ff76d2324" status: 202 len: 0 microversion: 2.1 time: 0.780932 Jul 28 11:36:21.321365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1424/2813] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Jul 28 11:36:20 2022] DELETE /compute/v2.1/os-security-group-rules/540c09c4-ea75-4848-824c-498ff76d2324 => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:21.332115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:21.332718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:21.342222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.343727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.344733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.345180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.608409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:36:21.609130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:36:21.609920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:36:21.610687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:36:21.611283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:36:21.625872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.626248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.627211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.627665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.647429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Getting quotas for project 73cae4c754ad49b1888ca5de3da0f4af. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:36:21.654279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Getting quotas for user 591073a571ce4620ab3f396f4f88863e and project 73cae4c754ad49b1888ca5de3da0f4af. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:36:21.679799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:21.683342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:36:21.685978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1b06406-8210-4757-b50d-3e73035455c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:36:21.687089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:21.695924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac572b1f-ef98-4aae-a7fc-fdec4304717e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1512 microversion: 2.1 time: 0.366335 Jul 28 11:36:21.696523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1425/2814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:21 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:21.702391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:21.703526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:21.714022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.714782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.717628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:21.718446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:21.784537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3760fe5-64da-4c90-99b0-81225f4aefc4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.768489 Jul 28 11:36:21.785879 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1390/2815] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:36:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:36:21.793538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e675bdbd-21bf-40f8-9886-dfd4b38b7ae7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbee4f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-214859937", "description": "tempest-description-1260440217"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:21.914233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:21.937783 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-08d9e4ce-79d0-43b4-a5f3-fc5675f5005a tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.239939 Jul 28 11:36:21.939099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1426/2816] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:21 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:21.944163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed7dbce3-c8dd-490b-bf60-6fdf23645c17 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:21.944949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed7dbce3-c8dd-490b-bf60-6fdf23645c17 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.057863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed7dbce3-c8dd-490b-bf60-6fdf23645c17 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:22.067623 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed7dbce3-c8dd-490b-bf60-6fdf23645c17 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1245 microversion: 2.1 time: 0.126792 Jul 28 11:36:22.068686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1427/2817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:21 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:22.255481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:22.256313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.264655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.265434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.266418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.267008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.287016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 HTTP/1.1 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1603cebe-05fd-461b-917f-f3c1b6c71996'} Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:22.288953 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.294479 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.300214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.301757 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bbb66867-9a1b-42a3-be96-3bc267788eb7 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 404 len: 111 microversion: 2.1 time: 0.050394 Jul 28 11:36:22.304513 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1428/2818] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:22 2022] DELETE /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:22.313338 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e675bdbd-21bf-40f8-9886-dfd4b38b7ae7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.525764 Jul 28 11:36:22.321516 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1391/2819] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:36:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:22.324544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:22.326656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 1603cebe-05fd-461b-917f-f3c1b6c71996] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.327410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df560196-c4d7-414d-a10b-39a8ee85f014 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbe57f70>, body: {"security_group_rule": {"parent_group_id": "ac793c68-502f-4f6c-ad8d-d8317609c47c", "ip_protocol": "tcp", "from_port": 2055867393, "to_port": 22}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:22.334862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:22.336844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.337581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.338645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.339511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.374788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 HTTP/1.1 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1603cebe-05fd-461b-917f-f3c1b6c71996'} Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.376739 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. Jul 28 11:36:22.380456 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.382330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 1603cebe-05fd-461b-917f-f3c1b6c71996 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.382531 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-794d25e3-5e04-4e70-b83b-292fc8c08dbd tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996" status: 404 len: 111 microversion: 2.1 time: 0.072948 Jul 28 11:36:22.383124 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1429/2820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:22 2022] GET /compute/v2.1/servers/1603cebe-05fd-461b-917f-f3c1b6c71996 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:22.391884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:22.392387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.407407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.407977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.409391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.409898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.428310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 HTTP/1.1 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3ce37e08-94de-44d9-b38e-721822902aa7'} Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:22.430384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.435227 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.437127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.438230 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-17bdb824-8946-48de-91bb-1941a8070361 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 404 len: 111 microversion: 2.1 time: 0.050119 Jul 28 11:36:22.439333 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1430/2821] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:22 2022] DELETE /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:36:22.449105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:22.449767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] [instance: 3ce37e08-94de-44d9-b38e-721822902aa7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.456691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.457146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.457991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.458361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.462002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-df560196-c4d7-414d-a10b-39a8ee85f014 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Invalid port range 2055867393:22. Former value cannot be greater than the later Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df560196-c4d7-414d-a10b-39a8ee85f014 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 146 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: {"security_group_rule": {"parent_group_id": "ac793c68-502f-4f6c-ad8d-d8317609c47c", "ip_protocol": "tcp", "from_port": 2055867393, "to_port": 22}} Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid port range 2055867393:22. Former value cannot be greater than the later Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ac793c68-502f-4f6c-ad8d-d8317609c47c', 'ip_protocol': 'tcp', 'from_port': 2055867393, 'to_port': 22}}} Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2055867393:22. Former value cannot be greater than the later Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2055867393:22. Former value cannot be greater than the later Jul 28 11:36:22.464368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2055867393:22. Former value cannot be greater than the later Jul 28 11:36:22.469043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.472322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df560196-c4d7-414d-a10b-39a8ee85f014 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: Invalid port range 2055867393:22. Former value cannot be greater than the later {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.473340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df560196-c4d7-414d-a10b-39a8ee85f014 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.149982 Jul 28 11:36:22.474381 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1392/2822] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:22 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:36:22.483712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e05cfbc1-83e2-49dc-8431-6931d41828d9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbea99d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-266347131", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:22.485602 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e05cfbc1-83e2-49dc-8431-6931d41828d9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Security group id should be uuid Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e05cfbc1-83e2-49dc-8431-6931d41828d9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 130 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-266347131", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group id should be uuid Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-266347131', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.489670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.495428 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 28 11:36:22.495428 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.497184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] HTTP exception thrown: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Request method failure captured: Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 HTTP/1.1 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nRBVq1jf7foK1yJ-ydL8VSRmi4DC0qhy587l030W5sKLiNkkW-wBd-pYRz9CkhbA8QZcRrvZDvcYyJE-N6uWtK7UrVSYzy98sL8P5KmQUJqFkV48csCn2Sx5hH0iehf1h3Xxlg6DcbWuBTQ0622Pe_sK0tu03uhs-OH1Cxeww0DQ68 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/94da65f2f5404355bb866482aba46657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_94da65f2f5404355bb866482aba46657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/94da65f2f5404355bb866482aba46657"}]}] Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 94da65f2f5404355bb866482aba46657 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestMultiNic-373063118 Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d589864c43174112961a7c1a3c17ee8b Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestMultiNic-373063118-project Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3ce37e08-94de-44d9-b38e-721822902aa7'} Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:22.498753 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] Returning 404 to user: Instance 3ce37e08-94de-44d9-b38e-721822902aa7 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.502588 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-073a7c3f-3852-4e63-b2d4-992761d90982 tempest-ServersTestMultiNic-373063118 tempest-ServersTestMultiNic-373063118-project] 10.222.0.93 "GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7" status: 404 len: 111 microversion: 2.1 time: 0.057030 Jul 28 11:36:22.505292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1431/2823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:22 2022] GET /compute/v2.1/servers/3ce37e08-94de-44d9-b38e-721822902aa7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:36:22.508727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e05cfbc1-83e2-49dc-8431-6931d41828d9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: Security group id should be uuid {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:22.512581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e05cfbc1-83e2-49dc-8431-6931d41828d9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.031949 Jul 28 11:36:22.514507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1393/2824] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:22 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:36:22.522832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4cb71cf3-5ff8-4087-90b2-4b0b5c2004a0 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbf60b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1001280248", "description": "tempest-description-272869808"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:22.723358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:22.723979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:22.752710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.753173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:22.761162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:22.761678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.090128 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4cb71cf3-5ff8-4087-90b2-4b0b5c2004a0 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.571284 Jul 28 11:36:23.091118 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1432/2825] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:36:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:36:23.096220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:23.097617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:23.130278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.130822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.131725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.132230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.146047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:23.156105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-323f4900-b53f-45ef-9c59-426710676ac8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1489 microversion: 2.1 time: 0.440733 Jul 28 11:36:23.159616 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1394/2826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:22 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1489 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:23.168804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:23.171411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:23.193142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.193631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.194408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.194854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.314567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:23.316597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:23.327998 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26b737c4-738a-439d-bc14-7d3545796e92 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1297 microversion: 2.1 time: 0.167223 Jul 28 11:36:23.328751 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1395/2827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:23 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1297 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:23.344428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89730ff0-fd86-449c-b06f-d6710c98fa3f tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbefc670>, body: {"security_group_rule": {"parent_group_id": "e769a3bc-e5ff-4881-b5f9-87fc039f1e6b", "ip_protocol": "tempest-999-1120555054", "from_port": 22, "to_port": 22}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:23.362511 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c32549d4-2ab8-4365-b739-4e299da35f51 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.270235 Jul 28 11:36:23.364818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1433/2828] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:23 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:23.379707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:23.379707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:23.395433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.396332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.397480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.398219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.441162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:36:23.568624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-818c5946-6ddd-4611-8752-a90c905c698b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 204 len: 0 microversion: 2.1 time: 0.197075 Jul 28 11:36:23.571485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1434/2829] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:23 2022] DELETE /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:36:23.585344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:23.585344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:23.595579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.596793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.597848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:23.598657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:23.907428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-89730ff0-fd86-449c-b06f-d6710c98fa3f tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Invalid IP protocol tempest-999-1120555054. Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89730ff0-fd86-449c-b06f-d6710c98fa3f tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 157 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: {"security_group_rule": {"parent_group_id": "e769a3bc-e5ff-4881-b5f9-87fc039f1e6b", "ip_protocol": "tempest-999-1120555054", "from_port": 22, "to_port": 22}} Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid IP protocol tempest-999-1120555054. Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e769a3bc-e5ff-4881-b5f9-87fc039f1e6b', 'ip_protocol': 'tempest-999-1120555054', 'from_port': 22, 'to_port': 22}}} Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1120555054. Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1120555054. Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:23.910274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1120555054. Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89730ff0-fd86-449c-b06f-d6710c98fa3f tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: Invalid IP protocol tempest-999-1120555054. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89730ff0-fd86-449c-b06f-d6710c98fa3f tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.582204 Jul 28 11:36:23.914843 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1396/2830] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:23 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 584 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:36:23.938720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b1f79fc-4e09-40d3-b2fb-bdfd28205eb9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbead280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-672828655", "description": "tempest-description-257953487"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:24.015786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:24.032440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61614924-0802-4722-b1b0-e91f78c48ea6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1495 microversion: 2.1 time: 0.455900 Jul 28 11:36:24.046342 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1435/2831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:23 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1495 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:24.331781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b1f79fc-4e09-40d3-b2fb-bdfd28205eb9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.397313 Jul 28 11:36:24.340743 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1397/2832] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:36:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:24.351129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650f2e8a-86ec-45be-9598-764c2333924d tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2eb282e820>, body: {"security_group_rule": {"parent_group_id": "48134f56-9adc-4efb-bce9-1f55cab6f7e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:24.358469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:24.360902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:24.383434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:24.383893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:24.385225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:24.385664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:24.537565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:24.544307 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-650f2e8a-86ec-45be-9598-764c2333924d tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650f2e8a-86ec-45be-9598-764c2333924d tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 138 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: {"security_group_rule": {"parent_group_id": "48134f56-9adc-4efb-bce9-1f55cab6f7e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'security_group_rule': {'parent_group_id': '48134f56-9adc-4efb-bce9-1f55cab6f7e0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 11:36:24.546585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 11:36:24.550743 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:24.552214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650f2e8a-86ec-45be-9598-764c2333924d tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:24.553219 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-650f2e8a-86ec-45be-9598-764c2333924d tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.210949 Jul 28 11:36:24.554108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1436/2833] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:24 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:36:24.559312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:24.564092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fd219ba-5f1e-4005-b4d1-d95179a4f715 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1303 microversion: 2.1 time: 0.206177 Jul 28 11:36:24.565094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:24.580109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1398/2834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:24 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:24.580109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0eece10-4512-4678-b73e-9d462bbe5b70 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbeadb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1566052083", "description": "tempest-description-1461255619"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:24.586931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:24.587417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:24.588234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:24.591345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:24.731784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:24.784503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f2b6cf5-49f1-4af9-bc82-5a20bcb982be tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.227124 Jul 28 11:36:24.795450 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1437/2835] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:24 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:25.054331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:25.055233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:25.067552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.068651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:25.072538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.073027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:25.516962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0eece10-4512-4678-b73e-9d462bbe5b70 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.945093 Jul 28 11:36:25.517744 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1399/2836] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:36:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:25.531720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99bed575-c97f-4079-9999-d9db4f09d4a2 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbe47310>, body: {"security_group_rule": {"parent_group_id": "3b64292b-faba-4fc7-b8b2-7dd0e2285e37", "ip_protocol": "tcp", "from_port": 22, "to_port": 618284379}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:25.718504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:25.730072 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5a472e4-4a12-4920-8020-c2e4387fe32b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1495 microversion: 2.1 time: 0.680414 Jul 28 11:36:25.732386 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1438/2837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:25 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1495 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:25.746876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:25.749322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:25.763597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.766654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:25.767810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.768447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:25.871893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-99bed575-c97f-4079-9999-d9db4f09d4a2 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99bed575-c97f-4079-9999-d9db4f09d4a2 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 145 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: {"security_group_rule": {"parent_group_id": "3b64292b-faba-4fc7-b8b2-7dd0e2285e37", "ip_protocol": "tcp", "from_port": 22, "to_port": 618284379}} Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3b64292b-faba-4fc7-b8b2-7dd0e2285e37', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 618284379}}} Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 Jul 28 11:36:25.874075 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 Jul 28 11:36:25.878247 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:25.879974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99bed575-c97f-4079-9999-d9db4f09d4a2 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 400 to user: Invalid port range 22:618284379. Valid TCP ports should be between 1-65535 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:25.881022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-99bed575-c97f-4079-9999-d9db4f09d4a2 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.353837 Jul 28 11:36:25.886887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1400/2838] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:25 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:36:25.894320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:25.899975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:25.913276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.913871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:25.915598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:25.917977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:26.025754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:26.040161 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-debe6f2a-2ceb-4cb6-b891-7be50002f8d8 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1303 microversion: 2.1 time: 0.305246 Jul 28 11:36:26.041040 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1439/2839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:25 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1303 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:26.055331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Action: 'create', calling method: .version_select at 0x7f2ebbf3e790>, body: {"security_group_rule": {"parent_group_id": "1a09b826-83b0-4b2a-a1ac-ca043a789989", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:26.126149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:36:26.126885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Neutron security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:36:26.127444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.127444 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 138 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: {"security_group_rule": {"parent_group_id": "1a09b826-83b0-4b2a-a1ac-ca043a789989", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1a09b826-83b0-4b2a-a1ac-ca043a789989', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:36:26.129441 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 404 to user: Security group 1a09b826-83b0-4b2a-a1ac-ca043a789989 does not exist Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-02b3a7e0-6f0e-4d55-b7b5-0227ddf36ec1'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f3f2ed03-c067-4f7e-a073-bebbae097a4b tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.088455 Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1440/2840] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Jul 28 11:36:26 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:26.145896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebbf45790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:26.496247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:36:26.497324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Neutron security group rule ac78d524-9db9-4127-8900-f567d3153955 not found {{(pid=119235) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 28 11:36:26.498101 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] HTTP exception thrown: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.498101 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Request method failure captured: Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-group-rules/ac78d524-9db9-4127-8900-f567d3153955 HTTP/1.1 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nSwTo3i1timaXudcxluSYOJxkSoKX03pQvg2KewczDImGZ065_RDxzA8L4BzZ3W_sckED7rTlbP8GQQEBwp93ffUg48HEDf55F6hzissNvtCfjFn1DibTzPyAO4GFFTmloS3zcw2lSABWnbBuhnhGo8x8n7hZ9dxW9GOAJzv8YIz4Q Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee169cce953c4a578809d9a38eb3a629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee169cce953c4a578809d9a38eb3a629"}]}] Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ee169cce953c4a578809d9a38eb3a629 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 49b9f436d14e4dd4a9d4d67c075ac64d Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-932393272-project Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ac78d524-9db9-4127-8900-f567d3153955'} Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:36:26.502722 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] Jul 28 11:36:26.508008 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:36:26.516035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Returning 404 to user: Security group rule ac78d524-9db9-4127-8900-f567d3153955 does not exist Jul 28 11:36:26.516035 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-859b43c1-2103-4686-afe4-f61930d6f1f1'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:26.517638 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f39e9b46-a614-4fde-a45c-444a84355699 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/ac78d524-9db9-4127-8900-f567d3153955" status: 404 len: 199 microversion: 2.1 time: 0.379301 Jul 28 11:36:26.519061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1441/2841] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Jul 28 11:36:26 2022] DELETE /compute/v2.1/os-security-group-rules/ac78d524-9db9-4127-8900-f567d3153955 => generated 199 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:26.533318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f7ccb6e-f85c-4feb-8d6c-a3723f4848e7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebbf455e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:26.666497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:26.802780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c735aeb3-6476-491d-8769-4face3c8b2d7 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.914119 Jul 28 11:36:26.805931 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1401/2842] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:25 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:26.831311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:26.836461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:26.872123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:26.872924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:26.881323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:26.882296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:28.325926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:28.360412 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9d31388-db56-411f-b9fe-ec462471a2ee tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1495 microversion: 2.1 time: 1.524328 Jul 28 11:36:28.361871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1402/2843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:26 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1495 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:28.367389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:28.368261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:28.374842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:28.376086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:28.377137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:28.377995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:28.430063 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f7ccb6e-f85c-4feb-8d6c-a3723f4848e7 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/3b64292b-faba-4fc7-b8b2-7dd0e2285e37" status: 202 len: 0 microversion: 2.1 time: 1.905922 Jul 28 11:36:28.435041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1442/2844] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:36:26 2022] DELETE /compute/v2.1/os-security-groups/3b64292b-faba-4fc7-b8b2-7dd0e2285e37 => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:36:28.440871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:28.441578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:28.453024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:28.453633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:28.454962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:28.455647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:28.690893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:28.738352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39c6b4fa-43dc-44ea-9316-940b671481ac tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.301774 Jul 28 11:36:28.739360 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1443/2845] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:28 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:28.743975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55e39eac-b2c2-46b6-b3b3-c4cff694d566 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebbebcc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:28.989366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:29.013355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24c9d5cb-9274-4ef8-bf11-4374d5c19323 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1303 microversion: 2.1 time: 0.650049 Jul 28 11:36:29.018566 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1403/2846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:28 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1303 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:29.042148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-aebca615-850c-482d-b9a4-d5243691421a req-2d1e3d5d-1baf-4662-aa68-9a0fc8a1faf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7831917-25c6-4655-8e8d-e2ebf6920bea", "name": "network-vif-unplugged", "status": "completed", "tag": "b249cf85-914e-4bdf-a044-ac2ea5b69cdc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:29.083800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aebca615-850c-482d-b9a4-d5243691421a req-2d1e3d5d-1baf-4662-aa68-9a0fc8a1faf8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.085153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aebca615-850c-482d-b9a4-d5243691421a req-2d1e3d5d-1baf-4662-aa68-9a0fc8a1faf8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:29.105743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-aebca615-850c-482d-b9a4-d5243691421a req-2d1e3d5d-1baf-4662-aa68-9a0fc8a1faf8 service nova] Creating event network-vif-unplugged:b249cf85-914e-4bdf-a044-ac2ea5b69cdc for instance c7831917-25c6-4655-8e8d-e2ebf6920bea on n-h2-851368-1 Jul 28 11:36:29.113356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-aebca615-850c-482d-b9a4-d5243691421a req-2d1e3d5d-1baf-4662-aa68-9a0fc8a1faf8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080176 Jul 28 11:36:29.121554 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1404/2847] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:29.386025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:29.388060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:29.419042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.420858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:29.423323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.427570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:29.645804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:29.678482 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7798315-2684-4649-a830-b8863400fdfe tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1453 microversion: 2.1 time: 0.299429 Jul 28 11:36:29.681211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1405/2848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:29 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1453 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:29.710105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-737a04d1-2534-4e5d-8203-b710fd840ae0 req-4987e17f-cd5f-4325-8d15-444d3be4ddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7831917-25c6-4655-8e8d-e2ebf6920bea", "name": "network-vif-deleted", "tag": "b249cf85-914e-4bdf-a044-ac2ea5b69cdc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:29.788119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-737a04d1-2534-4e5d-8203-b710fd840ae0 req-4987e17f-cd5f-4325-8d15-444d3be4ddd9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.789452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-737a04d1-2534-4e5d-8203-b710fd840ae0 req-4987e17f-cd5f-4325-8d15-444d3be4ddd9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:29.838653 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-737a04d1-2534-4e5d-8203-b710fd840ae0 req-4987e17f-cd5f-4325-8d15-444d3be4ddd9 service nova] Creating event network-vif-deleted:b249cf85-914e-4bdf-a044-ac2ea5b69cdc for instance c7831917-25c6-4655-8e8d-e2ebf6920bea on n-h2-851368-1 Jul 28 11:36:29.858559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-737a04d1-2534-4e5d-8203-b710fd840ae0 req-4987e17f-cd5f-4325-8d15-444d3be4ddd9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172511 Jul 28 11:36:29.862940 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1406/2849] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:29.875314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:29.877526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:29.896354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.897068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:29.899357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:29.901867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:30.386850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:30.421940 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19616072-b27b-4924-9daa-241920b127fc tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.556977 Jul 28 11:36:30.425979 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1407/2850] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:29 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:30.437881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:30.439099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:30.450101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:30.450908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:30.451969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:30.452625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:30.502973 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55e39eac-b2c2-46b6-b3b3-c4cff694d566 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/48134f56-9adc-4efb-bce9-1f55cab6f7e0" status: 202 len: 0 microversion: 2.1 time: 1.762529 Jul 28 11:36:30.503593 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1444/2851] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:36:28 2022] DELETE /compute/v2.1/os-security-groups/48134f56-9adc-4efb-bce9-1f55cab6f7e0 => generated 0 bytes in 1764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:30.517343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7ef19f1-5972-4cb2-b69b-2133d072d249 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebbf45d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:31.293443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:31.338826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e584ef52-e2e0-4973-a149-5ee73a07e0d3 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.911522 Jul 28 11:36:31.350806 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1408/2852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:30 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:31.386531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:31.387777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:31.397520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:31.398322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:31.400056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:31.400699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:31.467583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:31.468643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:31.469863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'fault' on Instance uuid c7831917-25c6-4655-8e8d-e2ebf6920bea {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:31.617147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:31.640365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:31.645642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71a8178b-00e0-4a6e-9db0-9728c5ea573c tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 200 len: 1305 microversion: 2.1 time: 0.266747 Jul 28 11:36:31.646451 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1409/2853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:31 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 1305 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:31.655459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:31.657329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:31.662576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:31.708476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:31.709383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:31.710765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:31.711570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:31.729798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:32.067495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:32.115639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:32.177537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-629aa0c8-5ad0-422d-90ef-8b6fa0f5d986 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.529368 Jul 28 11:36:32.189967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1410/2854] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:31 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:32.374542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:32.377447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:32.397436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:32.398061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:32.398664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:32.399190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:32.444322 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7ef19f1-5972-4cb2-b69b-2133d072d249 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/e769a3bc-e5ff-4881-b5f9-87fc039f1e6b" status: 202 len: 0 microversion: 2.1 time: 1.935736 Jul 28 11:36:32.445270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1445/2855] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:36:30 2022] DELETE /compute/v2.1/os-security-groups/e769a3bc-e5ff-4881-b5f9-87fc039f1e6b => generated 0 bytes in 1938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:32.453425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-587ee3c0-e145-40fd-8cc5-be2425a59890 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebbf45700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:33.283279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:33.297412 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22eb18f4-0cb6-4e2d-bcbe-ea3932b3225b tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.926120 Jul 28 11:36:33.299433 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1411/2856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:32 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:33.316587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:33.317239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:33.340661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:33.343627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:33.349473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:33.351567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:33.393206 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea HTTP/1.1 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c7831917-25c6-4655-8e8d-e2ebf6920bea'} Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:36:33.401050 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:36:33.405931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-924c60b9-ea0f-4ac5-b303-dc65735865cb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 404 len: 111 microversion: 2.1 time: 0.102211 Jul 28 11:36:33.407817 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1412/2857] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:33 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:36:33.432796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:33.433422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:33.447685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:33.448140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:33.456508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:33.457044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:34.078864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:34.131175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f089e45a-4242-4b1f-8c0b-6640d8f305ff tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.702178 Jul 28 11:36:34.132259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1413/2858] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:33 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:34.153984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-251345002", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2812d6f8-d304-45b0-ac63-546141d3c0fb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:34.271249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] validate_networks() for [('2812d6f8-d304-45b0-ac63-546141d3c0fb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:36:34.626393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-587ee3c0-e145-40fd-8cc5-be2425a59890 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ac793c68-502f-4f6c-ad8d-d8317609c47c" status: 202 len: 0 microversion: 2.1 time: 2.172652 Jul 28 11:36:34.630424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1446/2859] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:36:32 2022] DELETE /compute/v2.1/os-security-groups/ac793c68-502f-4f6c-ad8d-d8317609c47c => generated 0 bytes in 2181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:36:34.636234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:34.640899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:34.653477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:34.654391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:34.655856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:34.657063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:35.350639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:35.359408 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a00cb9fc-d1a1-4cf3-af29-223b7638a038 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.727746 Jul 28 11:36:35.360002 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1447/2860] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:34 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:35.375558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60682f9e-95cd-4036-80fe-17e244f89eb9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] Calling method '.version_select at 0x7f2ebc016310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:35.716200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:36:35.719321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:36:35.721073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:36:35.721859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:36:35.722732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:36:35.780017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:35.784085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:35.785328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:35.792933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:35.830059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:36:35.835167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:35.864106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Getting quotas for user 040c0446ea5e4e69b6f4958a66c32bef and project cf9e7882e1b64ab6871246a0853d7e82. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:36:35.885463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:36:35.885463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:36:35.977755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fc895ff-0d9f-4cf2-8596-3c63f6b6256f tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.843334 Jul 28 11:36:35.980115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1414/2861] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:36:35.989142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:35.989773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:36.000862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:36.001483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:36.002318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:36.002794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:36.190106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:36.246623 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24162270-76a0-4b4c-a8e7-7ba8350c38e6 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.265338 Jul 28 11:36:36.247198 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1415/2862] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:35 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:36.265061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-28742a32-8252-4d97-8544-b31478d15249 req-fd1441d1-2d01-4d26-aa9a-773377ec458a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea93ec7e-49f0-4717-912c-6571fcdb1fa8", "tag": "aae72f29-b7b2-4870-aff4-96cd2a61de84"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:36.289877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-28742a32-8252-4d97-8544-b31478d15249 req-fd1441d1-2d01-4d26-aa9a-773377ec458a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:36.290372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-28742a32-8252-4d97-8544-b31478d15249 req-fd1441d1-2d01-4d26-aa9a-773377ec458a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:36.326617 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-28742a32-8252-4d97-8544-b31478d15249 req-fd1441d1-2d01-4d26-aa9a-773377ec458a service nova] Creating event network-changed:aae72f29-b7b2-4870-aff4-96cd2a61de84 for instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 on n-h2-851368-1 Jul 28 11:36:36.337988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-28742a32-8252-4d97-8544-b31478d15249 req-fd1441d1-2d01-4d26-aa9a-773377ec458a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088910 Jul 28 11:36:36.338395 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60682f9e-95cd-4036-80fe-17e244f89eb9 tempest-SecurityGroupRulesNegativeTestJSON-932393272 tempest-SecurityGroupRulesNegativeTestJSON-932393272-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/8c9c6c73-8a21-46a8-92f4-a7df346a6003" status: 202 len: 0 microversion: 2.1 time: 0.976730 Jul 28 11:36:36.339857 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1448/2863] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:36:35 2022] DELETE /compute/v2.1/os-security-groups/8c9c6c73-8a21-46a8-92f4-a7df346a6003 => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:36.345003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d16f3e8f-31e5-4ab4-af63-d73b9b967464 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:36.345835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d16f3e8f-31e5-4ab4-af63-d73b9b967464 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:36.348496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1416/2864] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:36.388283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:36.389124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:36.398453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:36.399359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:36.401103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:36.401824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:36.461007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d16f3e8f-31e5-4ab4-af63-d73b9b967464 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:36.472832 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d16f3e8f-31e5-4ab4-af63-d73b9b967464 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1214 microversion: 2.1 time: 0.129591 Jul 28 11:36:36.474662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1449/2865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:36 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:36.742047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:36.752516 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9fea9a8b-6bcb-4a1e-8632-1e9cab761307 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.371446 Jul 28 11:36:36.753076 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1417/2866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:36 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:37.275997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:37.277053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:37.285305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.286147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:37.287219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.287893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:37.377362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:37.404917 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ee5c493-f7eb-4770-a89e-efb749a0bc04 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.132941 Jul 28 11:36:37.406327 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1450/2867] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:37 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:37.496169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:37.496906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:37.504244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.504990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:37.505966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.506574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:37.581395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:37.591545 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c888e34c-fd00-48a8-a5af-370604f6b0f6 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1218 microversion: 2.1 time: 0.099639 Jul 28 11:36:37.592242 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1418/2868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:37 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:37.776548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:37.777513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:37.788500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.789409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:37.791139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:37.793321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:38.046045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:38.060115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ca149b1-565e-494d-83c5-11993e929eba tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.289391 Jul 28 11:36:38.060740 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1451/2869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:37 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:38.434902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:38.436149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:38.442755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:38.444269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:38.445243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:38.445757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:38.606343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:38.613233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:38.613833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:38.631181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:38.631830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:38.632801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:38.633387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:38.652818 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b7183e7-1775-4d0e-a8ef-ea3034ca8a9e tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.221697 Jul 28 11:36:38.653723 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1419/2870] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:38 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:38.918298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:38.923340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:38.936847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac141774-7a5b-4533-889d-3c33e54d4906 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1272 microversion: 2.1 time: 0.327603 Jul 28 11:36:38.952398 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1452/2871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:38 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:39.081646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:39.082280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:39.092532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.092988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.093779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.096935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.680259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:39.682617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:39.690613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.691659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.692961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.693561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.899343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:39.958773 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b351d27-bd83-472e-8e86-63177af6568c tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.281954 Jul 28 11:36:39.959943 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1453/2872] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:39 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:39.973770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:39.974649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:39.988291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.988864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.989670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:39.990604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:39.997170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:40.007579 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0c91d58-34cc-40c7-b404-00c48d6b4816 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.929813 Jul 28 11:36:40.011410 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1420/2873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:39 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:40.153835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:40.174419 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-712d66d7-6299-4276-9ab5-5c9edd7ba369 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1272 microversion: 2.1 time: 0.208472 Jul 28 11:36:40.189155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1454/2874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:39 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:40.929391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d6a5f639-49d9-4fce-a738-7be08f48796f req-22023449-9491-465a-afbe-1914232cd016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93ec7e-49f0-4717-912c-6571fcdb1fa8", "name": "network-vif-plugged", "status": "completed", "tag": "aae72f29-b7b2-4870-aff4-96cd2a61de84"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:40.968257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6a5f639-49d9-4fce-a738-7be08f48796f req-22023449-9491-465a-afbe-1914232cd016 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:40.971143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6a5f639-49d9-4fce-a738-7be08f48796f req-22023449-9491-465a-afbe-1914232cd016 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:40.988056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:40.988963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:41.007972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.009991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.010911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.016467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.026135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d6a5f639-49d9-4fce-a738-7be08f48796f req-22023449-9491-465a-afbe-1914232cd016 service nova] Creating event network-vif-plugged:aae72f29-b7b2-4870-aff4-96cd2a61de84 for instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 on n-h2-851368-1 Jul 28 11:36:41.049366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d6a5f639-49d9-4fce-a738-7be08f48796f req-22023449-9491-465a-afbe-1914232cd016 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124955 Jul 28 11:36:41.051544 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1421/2875] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:41.065674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:41.071060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:41.101397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.102565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.106631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.108093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.421731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:41.511553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75583652-37f9-4a99-b738-e5d236c133e1 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.526682 Jul 28 11:36:41.514648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1455/2876] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:40 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:41.525426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:41.542742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:41.566237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.569507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.571882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:41.572664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:41.987675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:42.015930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6d7e8a9-6080-4aff-b0d6-8241ac10c06e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 0.962182 Jul 28 11:36:42.017680 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1422/2877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:41 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:42.236726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:42.246661 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6aa0ee1-23c3-447f-ae10-c8c13eed4d7e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 0.730767 Jul 28 11:36:42.247838 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1456/2878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:41 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:42.542246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:42.543640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:42.551637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:42.552233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:42.553137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:42.553807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:42.700047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:42.719968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fa0b471-073e-408c-b6f8-891bda8fd74b tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.183040 Jul 28 11:36:42.720899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1423/2879] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:42 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:43.038371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:43.039359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:43.051492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:43.053185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:43.057055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:43.059228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:43.269643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:43.271313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:43.285080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:43.288151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:43.292512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:43.293890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:44.175858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:44.189320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c77ece2-26fb-4ae2-bd7c-b8a86e933bf9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 0.924252 Jul 28 11:36:44.189924 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1424/2880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:43 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:44.203037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:44.203721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:44.219384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:44.220023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:44.220830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:44.221275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:44.232392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:44.241185 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8469153-0a54-4b32-abd7-0dfcc0553812 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1371 microversion: 2.1 time: 1.207603 Jul 28 11:36:44.241778 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1457/2881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:43 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1371 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:44.512421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-488994384", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "b1b90e83-739a-4b36-b293-5239dc145739"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:44.587935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] validate_networks() for [('b1b90e83-739a-4b36-b293-5239dc145739', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:36:44.615512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:44.660691 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-52b050b7-eb3f-45bf-b6fd-20adc9ace2b8 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.469001 Jul 28 11:36:44.661604 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1425/2882] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:44 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:45.214435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:45.215095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:45.223979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:45.224974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:45.226009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:45.233323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:45.818323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:45.872130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:46.134555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:36:46.134985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:36:46.135668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:36:46.136288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:36:46.136856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:36:46.162579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:46.171052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:46.172284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:46.172904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:46.260263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Getting quotas for project 01a99f350ace40128f4d41b8ad13205a. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:36:46.276591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Getting quotas for user cffcef8907df4283ac3109e9235d31e8 and project 01a99f350ace40128f4d41b8ad13205a. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:36:46.304137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:36:46.308710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:36:46.406882 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10445d85-0a8f-4773-8721-b5f8f39d7cf1 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155660 Jul 28 11:36:46.411238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1458/2883] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:36:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:36:46.423960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:46.425027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:46.458043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:46.462582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:46.463755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:46.468253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:46.891537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:46.905489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-699f51d9-3355-400e-b7cb-f84b9dc30e7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 1.694884 Jul 28 11:36:46.923869 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1426/2884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:45 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:36:46.940494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-166dbfb2-c9b3-4950-959a-3b50686679b9 req-adb7c46f-8e05-45c3-9f6e-db7661f3f810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04fab4a7-1ee7-48f9-ab8c-950365e45ded", "tag": "69a6390b-da97-4612-99f8-6d573a7a0576"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:47.006224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-166dbfb2-c9b3-4950-959a-3b50686679b9 req-adb7c46f-8e05-45c3-9f6e-db7661f3f810 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:47.006877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-166dbfb2-c9b3-4950-959a-3b50686679b9 req-adb7c46f-8e05-45c3-9f6e-db7661f3f810 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:47.041549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-166dbfb2-c9b3-4950-959a-3b50686679b9 req-adb7c46f-8e05-45c3-9f6e-db7661f3f810 service nova] Creating event network-changed:69a6390b-da97-4612-99f8-6d573a7a0576 for instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded on n-h2-851368-1 Jul 28 11:36:47.058225 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-166dbfb2-c9b3-4950-959a-3b50686679b9 req-adb7c46f-8e05-45c3-9f6e-db7661f3f810 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131113 Jul 28 11:36:47.064208 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1427/2885] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:47.082625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:47.083627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:47.102947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:47.104004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:47.107166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:47.107777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:47.114435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:47.945082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:47.984913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:47.989669 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f8430c4-d4b7-491a-9f3d-6b9a278bfa91 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1923 microversion: 2.75 time: 0.921820 Jul 28 11:36:47.990661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1428/2886] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:47 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1923 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:47.997992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:47.998958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:48.021562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.022005 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f67e760-9539-465f-a70e-31f5bbce6b57 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1557 microversion: 2.1 time: 1.608362 Jul 28 11:36:48.022126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.022610 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1459/2887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:46 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1557 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:48.022781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.028190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.042055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:48.042679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:48.053166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.054152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.055139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.055777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.279265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:48.291614 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-754f424c-9a30-41bc-b572-949a90cf9122 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1235 microversion: 2.1 time: 0.299071 Jul 28 11:36:48.293051 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1429/2888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:47 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1235 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:48.298186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:48.298936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:48.310349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.313398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.314309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:48.315550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:48.530392 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f4cbbcc1-f551-4fa6-82c4-67fa9684b517 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235983 Jul 28 11:36:48.530990 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1430/2889] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:36:48 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:48.648451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:48.658467 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0382a208-4de4-4253-9ce7-f2d32779c6f8 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 0.634777 Jul 28 11:36:48.666313 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1460/2890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:48 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:49.020017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:49.020646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:49.035539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.035916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.036723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.037172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.208038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:49.230466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-353ec64e-992d-409d-9257-c50eb5294ca3 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1929 microversion: 2.75 time: 0.214076 Jul 28 11:36:49.248122 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1431/2891] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:49 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1929 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:49.313397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:49.314708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:49.322935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.323808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.324858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.325521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.495869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:49.507410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c0ab57a-dbaa-42eb-ad87-597f332ab73e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1301 microversion: 2.1 time: 0.198188 Jul 28 11:36:49.508641 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1461/2892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:49 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1301 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:49.681338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:49.682278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:49.708081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.708539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.709337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:49.710062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:49.981635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ef46a5c6-e4b6-41f0-998f-c736b6582470 req-598d2574-a5d0-4556-bb86-f432f4922b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea93ec7e-49f0-4717-912c-6571fcdb1fa8", "tag": "aae72f29-b7b2-4870-aff4-96cd2a61de84"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:50.005583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ef46a5c6-e4b6-41f0-998f-c736b6582470 req-598d2574-a5d0-4556-bb86-f432f4922b82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:50.006299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ef46a5c6-e4b6-41f0-998f-c736b6582470 req-598d2574-a5d0-4556-bb86-f432f4922b82 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:50.031322 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ef46a5c6-e4b6-41f0-998f-c736b6582470 req-598d2574-a5d0-4556-bb86-f432f4922b82 service nova] Creating event network-changed:aae72f29-b7b2-4870-aff4-96cd2a61de84 for instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 on n-h2-851368-1 Jul 28 11:36:50.044371 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ef46a5c6-e4b6-41f0-998f-c736b6582470 req-598d2574-a5d0-4556-bb86-f432f4922b82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067787 Jul 28 11:36:50.046085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1462/2893] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:36:50.271318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:50.272946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:50.284550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:50.288718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:50.289718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:50.291222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:50.564764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:50.575311 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31ee2d7a-3c90-4b61-977d-ea8a5ef81157 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 0.898867 Jul 28 11:36:50.593523 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1432/2894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:49 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:50.603050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:50.603738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:50.619781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:50.620504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:50.621459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:50.622463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:50.624283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:50.676788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c5d1b36-4d45-40d6-9f8a-6638c4b3da3f tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1929 microversion: 2.75 time: 0.421820 Jul 28 11:36:50.678617 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1463/2895] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:50 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1929 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:50.956101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:50.973115 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca275f09-e8ea-4fb6-bcbc-02d5ed8d3261 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1301 microversion: 2.1 time: 0.378330 Jul 28 11:36:50.991690 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1433/2896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:50 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1301 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:51.607710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:51.608982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:51.655596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:51.664314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:51.670269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:51.674449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:51.704733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:51.711292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:51.720191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:51.720902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:51.721874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:51.722456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:52.199896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:52.254949 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6cb3f30e-bade-4c4f-8be0-a9f550ff1558 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1929 microversion: 2.75 time: 0.554935 Jul 28 11:36:52.256077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1434/2897] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:51 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1929 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:36:52.261788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:52.263107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:52.274719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:52.275203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:52.276252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:52.276894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:52.517683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:52.529883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:52.538458 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce0883a3-4cdb-4332-b868-b4ca769975b9 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1289 microversion: 2.1 time: 0.281116 Jul 28 11:36:52.539620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c37e93dd-8491-4d65-a651-116eed0d4bf7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 0.942366 Jul 28 11:36:52.544475 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1464/2898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:51 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:52.556551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1435/2899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:52 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1289 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:53.287230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:53.288497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:53.297424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:53.305267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.306046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.307233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.308013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.447865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b6fd1398-3d09-4672-83ca-b0af48957562 req-2fb3001c-d95d-4110-9a66-ad968b8646f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fab4a7-1ee7-48f9-ab8c-950365e45ded", "name": "network-vif-plugged", "status": "completed", "tag": "69a6390b-da97-4612-99f8-6d573a7a0576"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:53.472065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b6fd1398-3d09-4672-83ca-b0af48957562 req-2fb3001c-d95d-4110-9a66-ad968b8646f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.472519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b6fd1398-3d09-4672-83ca-b0af48957562 req-2fb3001c-d95d-4110-9a66-ad968b8646f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.514208 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b6fd1398-3d09-4672-83ca-b0af48957562 req-2fb3001c-d95d-4110-9a66-ad968b8646f1 service nova] Creating event network-vif-plugged:69a6390b-da97-4612-99f8-6d573a7a0576 for instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded on n-h2-851368-1 Jul 28 11:36:53.526223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b6fd1398-3d09-4672-83ca-b0af48957562 req-2fb3001c-d95d-4110-9a66-ad968b8646f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083452 Jul 28 11:36:53.529658 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1436/2900] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:36:53.564779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:53.565725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:53.584036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.587468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.588595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.590420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.614656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] Lazy-loading 'services' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:53.678184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5b47460-c516-44c3-97ca-982a90bdc853 tempest-ServersAdmin275Test-1340906742 tempest-ServersAdmin275Test-1340906742-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1914 microversion: 2.75 time: 0.401553 Jul 28 11:36:53.679390 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1465/2901] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:53 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1914 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:53.684815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:53.687048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:53.694784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.695508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:53.697046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:53.697677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:54.601343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:54.610351 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8723d111-3d1f-47da-881d-3b929e7c61e6 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 1.052002 Jul 28 11:36:54.614190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1437/2902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:53 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:54.639835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:54.642502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:54.659235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:54.660007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:54.661785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:54.668342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:54.735865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:54.755740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b340c94-9f3c-48e3-9934-78bc2c8d4abb tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1314 microversion: 2.1 time: 1.075030 Jul 28 11:36:54.759807 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1466/2903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:53 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:54.766565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8a5e1386-0e02-4415-8e5d-892186fe8340 req-18eb3a18-d9d6-4283-a045-1a5ab485f18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d0f79f-17dd-4cfb-b620-8478a592169c", "tag": "ec53165b-f601-493d-8690-4688d617926b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:54.771291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:36:54.794790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8a5e1386-0e02-4415-8e5d-892186fe8340 req-18eb3a18-d9d6-4283-a045-1a5ab485f18b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:54.795754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8a5e1386-0e02-4415-8e5d-892186fe8340 req-18eb3a18-d9d6-4283-a045-1a5ab485f18b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:54.812897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8a5e1386-0e02-4415-8e5d-892186fe8340 req-18eb3a18-d9d6-4283-a045-1a5ab485f18b service nova] Creating event network-changed:ec53165b-f601-493d-8690-4688d617926b for instance f1d0f79f-17dd-4cfb-b620-8478a592169c on n-h1-851368-1 Jul 28 11:36:54.828204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8a5e1386-0e02-4415-8e5d-892186fe8340 req-18eb3a18-d9d6-4283-a045-1a5ab485f18b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065261 Jul 28 11:36:54.832248 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1467/2904] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:36:54.954034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-935df30d-ef00-4562-b25e-437e289206cc tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 204 len: 0 microversion: 2.75 time: 0.323680 Jul 28 11:36:54.967025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:54.967575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:54.970665 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1438/2905] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:36:54 2022] DELETE /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:36:54.974337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:54.975006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:54.975995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:54.976652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:55.357980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:55.366397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:55.367960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:55.377198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b18a8cc-5930-4b05-b0d4-10b805249fac tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1441 microversion: 2.75 time: 0.415869 Jul 28 11:36:55.380424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1468/2906] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:54 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1441 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:55.635148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:55.642112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:55.658373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:55.659274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:55.660518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:55.661186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:55.782007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:55.782626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:55.801481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:55.808129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:55.809277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:55.809790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.225407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:56.294776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:56.485582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:56.496542 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2fb049d8-5041-48c0-b54c-f745523b4041 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1501 microversion: 2.1 time: 0.721126 Jul 28 11:36:56.519918 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1469/2907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:55 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1501 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:56.529405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:56.531663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:56.538459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.539999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.541034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.541665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:56.541868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.546816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:56.554906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d54972f0-8797-437e-9af0-d6bcfdc549df tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.923564 Jul 28 11:36:56.564455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1439/2908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:55 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:56.582497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:36:56.586240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:56.600873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.601703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.604019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.604700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.664294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'flavor' on Instance uuid 04fab4a7-1ee7-48f9-ab8c-950365e45ded {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:56.848608 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6f2f6523-1467-48df-80a5-bb1eaa5ba959 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "POST /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded/action" status: 202 len: 0 microversion: 2.1 time: 0.282266 Jul 28 11:36:56.854106 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1440/2909] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:36:56 2022] POST /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:36:56.861607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:56.886751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:56.889229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:56.892511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:56.894594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:56.905645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45cb6a3b-e648-46ec-9486-cc9372225247 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1441 microversion: 2.75 time: 0.384487 Jul 28 11:36:56.909407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1470/2910] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:56 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1441 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:56.912724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.913610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.915189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:56.915860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:56.958204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:36:57.379878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:57.391956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6943e1c9-c4e3-467b-b3cb-be5fffab1682 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1509 microversion: 2.1 time: 0.516327 Jul 28 11:36:57.394644 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1441/2911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:56 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1509 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:57.581247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:57.582267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:57.590490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:57.591312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:57.592194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:57.592692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:57.937185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:57.938094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:57.959815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:57.960531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:57.962106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:57.962768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:57.980969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:57.996181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3cff752e-36c4-420d-a395-c48d5d2084ba tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.418881 Jul 28 11:36:57.998187 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1471/2912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:57 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:58.416723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:58.417675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:58.428598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:58.429905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:58.432016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:58.432721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:58.440286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:58.456223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:58.457752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:58.474069 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b17d1f5f-f7e0-4797-b274-e034c0b5e4ca tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1441 microversion: 2.75 time: 0.542668 Jul 28 11:36:58.474667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1442/2913] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:57 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1441 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:58.862376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:58.877444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e239a2f-b592-464f-aeb0-3efb520934ba tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1492 microversion: 2.1 time: 0.464677 Jul 28 11:36:58.881292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1472/2914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:58 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1492 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:58.908773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:58.909855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:58.918472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:58.919601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:58.920711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:58.921627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:58.982810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:36:59.020408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:59.021596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:59.033866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.034814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.042296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.043264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.178652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3866e39c-a1b2-46d8-84f4-6f3a3c73625b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 204 len: 0 microversion: 2.1 time: 0.276759 Jul 28 11:36:59.180406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1443/2915] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:36:58 2022] DELETE /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:36:59.209429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:59.212102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:59.244661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.245303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.246242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.246693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.612474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:59.643614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-003f92b9-4b9e-450b-8ff1-d0b9a1f28a74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.617032 Jul 28 11:36:59.648595 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1473/2916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:59 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:36:59.662962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:36:59.664196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:36:59.689995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.690705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.693324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.694077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.795279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:36:59.795921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:36:59.797738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lazy-loading 'fault' on Instance uuid 0dd56522-e61e-4b80-9dc1-454bde5dd625 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:36:59.916231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:59.924733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:59.926531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0c01ebcdc8742c48e40d1b1171fc252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e37c726c17744a780b976d726c77cc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:59.928564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:36:59.937742 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0abceda-6cc2-45b1-b5b8-1b551a791542 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1498 microversion: 2.1 time: 0.732851 Jul 28 11:36:59.938638 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e10ee647-1b61-4541-b71b-521e2aa92de0 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 200 len: 1446 microversion: 2.75 time: 0.285339 Jul 28 11:36:59.939324 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1474/2917] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:36:59 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 1446 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:36:59.960474 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1444/2918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:36:59 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1498 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:00.476652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-640acce6-b6bd-44bf-900e-2e3857c5a520 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: .version_select at 0x7f2ebbea2700>, body: {"keypair": {"name": "tempest-keypair-217522076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuHn/YD3aj69riPlciDe1xIQvHhFuw8ckoErgKxw/ohD/lqP7fWhKGMP4y/Xj/PdSzwh2ztkgQR/Th6RjhO98M0Xx3jhGmyWsiMph4L6BEwWPZI5+J/rpmMlCpBYhn7ng=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:00.506556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-640acce6-b6bd-44bf-900e-2e3857c5a520 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:00.513931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-640acce6-b6bd-44bf-900e-2e3857c5a520 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:00.574713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-640acce6-b6bd-44bf-900e-2e3857c5a520 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.355148 Jul 28 11:37:00.576561 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1475/2919] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:37:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:00.675973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:00.680847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:00.702889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:00.703887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:00.706082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:00.706841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:00.976793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:00.979395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] [instance: 0dd56522-e61e-4b80-9dc1-454bde5dd625] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:01.000117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:01.000926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:01.002269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:01.002866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:01.007549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:01.019890 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] HTTP exception thrown: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Request method failure captured: Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 HTTP/1.1 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nSI3vxO5TmrQWxq-M3ZvdwltW83xEvtxdsHwFVeT1wneK6qkGPYVGFyytExkSiuWuM2kcJkFsovusTtx-vD-zrMAUszFI1QNzwxD14Fajf1CAQ_MKJIlW9zl6pmCC6MDaKpN98fBA8cT5IKH6V3ha4HZzjDsJ6vAktQinEYsPvq2KA Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.75 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 7e37c726c17744a780b976d726c77cc3 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdmin275Test-1307189727 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e37c726c17744a780b976d726c77cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7e37c726c17744a780b976d726c77cc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7e37c726c17744a780b976d726c77cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e37c726c17744a780b976d726c77cc3"}]}] Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdmin275Test-1307189727 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 7e37c726c17744a780b976d726c77cc3 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdmin275Test-1307189727 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdmin275Test-1307189727-project Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d0c01ebcdc8742c48e40d1b1171fc252 Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdmin275Test-1307189727-project Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0dd56522-e61e-4b80-9dc1-454bde5dd625'} Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:01.021827 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. Jul 28 11:37:01.027349 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:01.028824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] Returning 404 to user: Instance 0dd56522-e61e-4b80-9dc1-454bde5dd625 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:01.030032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2dc1c9cf-74e8-488d-b3bd-89f26d96ac74 tempest-ServersAdmin275Test-1307189727 tempest-ServersAdmin275Test-1307189727-project] 10.222.0.93 "GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625" status: 404 len: 111 microversion: 2.75 time: 0.059368 Jul 28 11:37:01.031063 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1476/2920] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:37:00 2022] GET /compute/v2.1/servers/0dd56522-e61e-4b80-9dc1-454bde5dd625 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:37:01.031818 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ead6f80-291c-432b-9399-c90101a50f95 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.366679 Jul 28 11:37:01.032703 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1445/2921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:00 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:01.036501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:01.037448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:01.045250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:01.045921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:01.046923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:01.047657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:01.629328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1b9b2fc4-5085-4777-b9ef-e2e03c5a8aab req-1f05b30c-821d-45e9-a5f8-54f600df20f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d0f79f-17dd-4cfb-b620-8478a592169c", "name": "network-vif-plugged", "status": "completed", "tag": "ec53165b-f601-493d-8690-4688d617926b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:01.634664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:01.660029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1b9b2fc4-5085-4777-b9ef-e2e03c5a8aab req-1f05b30c-821d-45e9-a5f8-54f600df20f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:01.660539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1b9b2fc4-5085-4777-b9ef-e2e03c5a8aab req-1f05b30c-821d-45e9-a5f8-54f600df20f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:01.700072 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1b9b2fc4-5085-4777-b9ef-e2e03c5a8aab req-1f05b30c-821d-45e9-a5f8-54f600df20f7 service nova] Creating event network-vif-plugged:ec53165b-f601-493d-8690-4688d617926b for instance f1d0f79f-17dd-4cfb-b620-8478a592169c on n-h1-851368-1 Jul 28 11:37:01.708844 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1b9b2fc4-5085-4777-b9ef-e2e03c5a8aab req-1f05b30c-821d-45e9-a5f8-54f600df20f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083050 Jul 28 11:37:01.713026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1446/2922] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:01.742478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:01.777090 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7638c07b-d057-4b5a-9722-2ed19e2fc691 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1498 microversion: 2.1 time: 0.744436 Jul 28 11:37:01.779116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1477/2923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:01 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1498 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:02.057347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:02.058168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:02.069786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:02.070242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:02.075617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:02.076074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:02.189742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1456835090", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "20f996ca-5b02-429c-bb19-139987284c00"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:02.296594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] validate_networks() for [('20f996ca-5b02-429c-bb19-139987284c00', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:37:02.781710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:02.804210 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6482ea8a-09f4-4915-ba3e-f2519c638b74 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.754359 Jul 28 11:37:02.809057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1478/2924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:02 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:02.835464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-294f82ad-bd92-479f-9031-928f866e33e4 req-19d2329a-4062-484c-a0a8-332248dcf9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fab4a7-1ee7-48f9-ab8c-950365e45ded", "name": "network-vif-deleted", "tag": "69a6390b-da97-4612-99f8-6d573a7a0576"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:02.891845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-294f82ad-bd92-479f-9031-928f866e33e4 req-19d2329a-4062-484c-a0a8-332248dcf9fe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:02.892310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-294f82ad-bd92-479f-9031-928f866e33e4 req-19d2329a-4062-484c-a0a8-332248dcf9fe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:02.919463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-294f82ad-bd92-479f-9031-928f866e33e4 req-19d2329a-4062-484c-a0a8-332248dcf9fe service nova] Creating event network-vif-deleted:69a6390b-da97-4612-99f8-6d573a7a0576 for instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded on n-h2-851368-1 Jul 28 11:37:02.933926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-294f82ad-bd92-479f-9031-928f866e33e4 req-19d2329a-4062-484c-a0a8-332248dcf9fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115856 Jul 28 11:37:02.935990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1479/2925] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:02.968628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:02.982650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:02.998229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:02.998694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:02.999511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:02.999956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:03.075289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:03.075931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:03.076436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lazy-loading 'fault' on Instance uuid 04fab4a7-1ee7-48f9-ab8c-950365e45ded {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:37:03.267270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040c0446ea5e4e69b6f4958a66c32bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9e7882e1b64ab6871246a0853d7e82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:03.284212 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f813e3e7-0ef2-4ff3-8fb7-fcc0c408752b tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 200 len: 1304 microversion: 2.1 time: 0.338133 Jul 28 11:37:03.285227 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1480/2926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:02 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:03.825484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:03.828314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:03.837351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:03.838316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:03.839423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:03.840836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.175334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:37:04.176341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:37:04.176986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:37:04.177850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:37:04.178499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:37:04.208282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.212656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.224631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.228395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.294937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:04.296425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Getting quotas for project 7d4dcde321f84ca69621c6c830318a04. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:04.304566 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd4e6ba6-1ea2-403b-8387-09248f995ce5 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1331 microversion: 2.1 time: 0.483953 Jul 28 11:37:04.308330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Getting quotas for user f6c9e1937d5f4f8f99204370d99ce6ac and project 7d4dcde321f84ca69621c6c830318a04. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:04.337754 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1481/2927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:03 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1331 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:04.344043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:37:04.346881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.347541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.348707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:37:04.362481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.362964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.365424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.365868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.398227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded HTTP/1.1 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '04fab4a7-1ee7-48f9-ab8c-950365e45ded'} Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.400806 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.405198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.406820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.410209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b60933f0-a86a-497b-9592-3cc56a7f42e9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 404 len: 111 microversion: 2.1 time: 0.071292 Jul 28 11:37:04.411800 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1482/2928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:04 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.460409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40e178ce-1e5f-42ab-8489-64529d7795a3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493418 Jul 28 11:37:04.461118 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1447/2929] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:37:04.467659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.468484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.474984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51e482b9-28f7-4d0f-9949-52631a56d4c8 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.475762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51e482b9-28f7-4d0f-9949-52631a56d4c8 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.492252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.494841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.495819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.496379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.553064 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded HTTP/1.1 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '04fab4a7-1ee7-48f9-ab8c-950365e45ded'} Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.554840 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.559694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.562931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.564196 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b44a5402-2412-472d-b515-cc75b734009e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 404 len: 111 microversion: 2.1 time: 0.128999 Jul 28 11:37:04.565452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1483/2930] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:04 2022] DELETE /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.581584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.583716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 04fab4a7-1ee7-48f9-ab8c-950365e45ded] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.604738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.605374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.606054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.606633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.632838 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded HTTP/1.1 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '04fab4a7-1ee7-48f9-ab8c-950365e45ded'} Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.634936 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.639578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 04fab4a7-1ee7-48f9-ab8c-950365e45ded could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.644232 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b90ad41-9d5b-484c-ae0c-f47538db92ed tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded" status: 404 len: 111 microversion: 2.1 time: 0.069567 Jul 28 11:37:04.644846 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1484/2931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:04 2022] GET /compute/v2.1/servers/04fab4a7-1ee7-48f9-ab8c-950365e45ded => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.655885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.656559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.663181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.664088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.665518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.666300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.688857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51e482b9-28f7-4d0f-9949-52631a56d4c8 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:04.721637 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51e482b9-28f7-4d0f-9949-52631a56d4c8 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1217 microversion: 2.1 time: 0.252618 Jul 28 11:37:04.724762 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1448/2932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:04 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:04.739159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea HTTP/1.1 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c7831917-25c6-4655-8e8d-e2ebf6920bea'} Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.740750 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.746179 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-94191dc9-adc8-4a18-8c23-ebda6ec12995 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 404 len: 111 microversion: 2.1 time: 0.091958 Jul 28 11:37:04.753994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1485/2933] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:04 2022] DELETE /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.763244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.764162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: c7831917-25c6-4655-8e8d-e2ebf6920bea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.785928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.788963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.790807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.791377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.827672 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea HTTP/1.1 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c7831917-25c6-4655-8e8d-e2ebf6920bea'} Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.831314 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.835392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance c7831917-25c6-4655-8e8d-e2ebf6920bea could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.839003 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80c633f6-d2fb-471a-825d-c6b3d22786f9 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea" status: 404 len: 111 microversion: 2.1 time: 0.080883 Jul 28 11:37:04.840065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1449/2934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:04 2022] GET /compute/v2.1/servers/c7831917-25c6-4655-8e8d-e2ebf6920bea => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.848164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.849796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.864027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.866258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.867005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.870557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.918061 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f HTTP/1.1 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f'} Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:04.920096 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:04.924467 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:04.927278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:04.928343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc2f9f4b-234a-4a73-8a9a-101046ab6caa tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 404 len: 111 microversion: 2.1 time: 0.084180 Jul 28 11:37:04.929335 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1486/2935] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:04 2022] DELETE /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:04.941759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:04.943316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:04.958325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.958851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:04.959933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:04.960374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.007706 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f HTTP/1.1 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f'} Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.009927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. Jul 28 11:37:05.013926 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.014347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:05.015032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f9401be-0dca-47f5-98e0-29ba8371bf63 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f" status: 404 len: 111 microversion: 2.1 time: 0.080253 Jul 28 11:37:05.027241 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1450/2936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:04 2022] GET /compute/v2.1/servers/cc1da3b7-0bf9-4731-920d-1aaad2c6eb6f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:05.030328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.031621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.045354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.046174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.047124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.050389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.091676 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e HTTP/1.1 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cbe9ae38-2d4a-46ad-9c98-379998279c3e'} Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:05.097032 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d679fd9-af41-4941-b633-90c8b7400da7 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 404 len: 111 microversion: 2.1 time: 0.075446 Jul 28 11:37:05.100803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1487/2937] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:05 2022] DELETE /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:05.109893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.110650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cbe9ae38-2d4a-46ad-9c98-379998279c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.121071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.125983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.128221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.132371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.170878 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e HTTP/1.1 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cbe9ae38-2d4a-46ad-9c98-379998279c3e'} Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.177338 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cbe9ae38-2d4a-46ad-9c98-379998279c3e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:05.183646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42aca43a-27ba-466d-9339-171914be3678 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e" status: 404 len: 111 microversion: 2.1 time: 0.074326 Jul 28 11:37:05.185840 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1451/2938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:05 2022] GET /compute/v2.1/servers/cbe9ae38-2d4a-46ad-9c98-379998279c3e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:05.191612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.193329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.201254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.202813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.204261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.204938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.249667 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e HTTP/1.1 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '84d34105-31ce-4d7a-9cac-b7dd06589c3e'} Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:05.253875 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:05.257604 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8a6d8c5-eb86-4ae9-844d-0b98e3811b7d tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 404 len: 111 microversion: 2.1 time: 0.069323 Jul 28 11:37:05.267763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.268463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 84d34105-31ce-4d7a-9cac-b7dd06589c3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.276418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1488/2939] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:05 2022] DELETE /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:05.286191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.286665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.287875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.288329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.313800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e HTTP/1.1 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '84d34105-31ce-4d7a-9cac-b7dd06589c3e'} Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:05.315581 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 84d34105-31ce-4d7a-9cac-b7dd06589c3e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:05.319526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f8889a5-ff14-4e11-8f7d-5fe269ca7f11 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e" status: 404 len: 111 microversion: 2.1 time: 0.054459 Jul 28 11:37:05.321516 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1452/2940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:05 2022] GET /compute/v2.1/servers/84d34105-31ce-4d7a-9cac-b7dd06589c3e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:05.339158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.340219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.351966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.353507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.355487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.356964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.691478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:05.702156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e4d88e8-1121-44e5-98db-e983e3f9a502 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1535 microversion: 2.1 time: 0.367569 Jul 28 11:37:05.703351 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1489/2941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:05 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1535 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:05.725360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0be4849-44d7-43b2-94a7-df2fd9be3157 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'create', calling method: .version_select at 0x7f2ebbead3a0>, body: {"pool": "b9bbc579-ce4a-4d49-9295-6e1fd796851b"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:05.746350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:05.747340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:05.761977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.762836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:05.763909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:05.764570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:06.321686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:06.332091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-715530ea-dab6-422c-b93f-e3c22e6f0968 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1213 microversion: 2.1 time: 0.591024 Jul 28 11:37:06.336073 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1490/2942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:05 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1213 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:06.820576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2145fba6-9d6a-4389-839a-7a2e4eab7413 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.193913 Jul 28 11:37:06.821394 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1491/2943] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Jul 28 11:37:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 11:37:06.831985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8a974aa-287e-40b0-aa7b-ab625eb4eede tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Calling method '.version_select at 0x7f2ebbf3e280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:06.860227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a8a974aa-287e-40b0-aa7b-ab625eb4eede tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] HTTP exception thrown: Image not found. Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8a974aa-287e-40b0-aa7b-ab625eb4eede tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Request method failure captured: Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTijmzU1D9DwVNqKDElSmiTWU48hTABc6aqlYmrtkkECbOUlGM82UPT3MtmJfWfKPezxfAZyRqcXJ3xR-6EZ5jCvRayyOQ4_MsBzzR4IJEcG12p413vDetb70MYwS5N7ao5IcALBnDa6Bx8NhQRn94U_bNsUSl44i3V4Yd7ekQHP1s Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}] Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 89d35ba69905496a88eb487774b7cdfa Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '-1'} Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.862384 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8a974aa-287e-40b0-aa7b-ab625eb4eede tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8a974aa-287e-40b0-aa7b-ab625eb4eede tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.035878 Jul 28 11:37:06.866819 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1492/2944] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Jul 28 11:37:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:37:06.876120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5eee7eea-4b9e-44e1-97c4-3e1f250e0edc tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Calling method '.version_select at 0x7f2ebbea2820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:06.905619 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-5eee7eea-4b9e-44e1-97c4-3e1f250e0edc tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] HTTP exception thrown: Image not found. Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5eee7eea-4b9e-44e1-97c4-3e1f250e0edc tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Request method failure captured: Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/f326c8d6-de1a-422f-8233-802036f53a8j HTTP/1.1 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTijmzU1D9DwVNqKDElSmiTWU48hTABc6aqlYmrtkkECbOUlGM82UPT3MtmJfWfKPezxfAZyRqcXJ3xR-6EZ5jCvRayyOQ4_MsBzzR4IJEcG12p413vDetb70MYwS5N7ao5IcALBnDa6Bx8NhQRn94U_bNsUSl44i3V4Yd7ekQHP1s Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}] Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 89d35ba69905496a88eb487774b7cdfa Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f326c8d6-de1a-422f-8233-802036f53a8j'} Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f326c8d6-de1a-422f-8233-802036f53a8j to delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f326c8d6-de1a-422f-8233-802036f53a8j could not be found. Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.907568 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5eee7eea-4b9e-44e1-97c4-3e1f250e0edc tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5eee7eea-4b9e-44e1-97c4-3e1f250e0edc tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/f326c8d6-de1a-422f-8233-802036f53a8j" status: 404 len: 62 microversion: 2.1 time: 0.036871 Jul 28 11:37:06.912951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1493/2945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:06 2022] DELETE /compute/v2.1/images/f326c8d6-de1a-422f-8233-802036f53a8j => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:37:06.922047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56981287-3d5f-47ce-b351-e618395086e0 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Calling method '.version_select at 0x7f2ebbedfc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:06.955796 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-56981287-3d5f-47ce-b351-e618395086e0 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] HTTP exception thrown: Image not found. Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56981287-3d5f-47ce-b351-e618395086e0 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Request method failure captured: Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/f5ea5c7e-0735-4e62-b1b7-98bf8087eb811 HTTP/1.1 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTijmzU1D9DwVNqKDElSmiTWU48hTABc6aqlYmrtkkECbOUlGM82UPT3MtmJfWfKPezxfAZyRqcXJ3xR-6EZ5jCvRayyOQ4_MsBzzR4IJEcG12p413vDetb70MYwS5N7ao5IcALBnDa6Bx8NhQRn94U_bNsUSl44i3V4Yd7ekQHP1s Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}] Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 89d35ba69905496a88eb487774b7cdfa Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f5ea5c7e-0735-4e62-b1b7-98bf8087eb811'} Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5ea5c7e-0735-4e62-b1b7-98bf8087eb811 to delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5ea5c7e-0735-4e62-b1b7-98bf8087eb811 could not be found. Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.957632 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56981287-3d5f-47ce-b351-e618395086e0 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56981287-3d5f-47ce-b351-e618395086e0 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/f5ea5c7e-0735-4e62-b1b7-98bf8087eb811" status: 404 len: 62 microversion: 2.1 time: 0.041483 Jul 28 11:37:06.964168 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1494/2946] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:06 2022] DELETE /compute/v2.1/images/f5ea5c7e-0735-4e62-b1b7-98bf8087eb811 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:37:06.981599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab37b564-e8d2-4f32-8c1d-9fafd6d508c6 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Calling method '.version_select at 0x7f2ebbea21f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:07.021928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ab37b564-e8d2-4f32-8c1d-9fafd6d508c6 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] HTTP exception thrown: Image not found. Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab37b564-e8d2-4f32-8c1d-9fafd6d508c6 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Request method failure captured: Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/tempest-invalid-1422275324 HTTP/1.1 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTijmzU1D9DwVNqKDElSmiTWU48hTABc6aqlYmrtkkECbOUlGM82UPT3MtmJfWfKPezxfAZyRqcXJ3xR-6EZ5jCvRayyOQ4_MsBzzR4IJEcG12p413vDetb70MYwS5N7ao5IcALBnDa6Bx8NhQRn94U_bNsUSl44i3V4Yd7ekQHP1s Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}] Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 89d35ba69905496a88eb487774b7cdfa Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'tempest-invalid-1422275324'} Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1422275324 to delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1422275324 could not be found. Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.024553 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:37:07.028396 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.031988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab37b564-e8d2-4f32-8c1d-9fafd6d508c6 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:07.033165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab37b564-e8d2-4f32-8c1d-9fafd6d508c6 tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/tempest-invalid-1422275324" status: 404 len: 62 microversion: 2.1 time: 0.058584 Jul 28 11:37:07.034302 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1495/2947] 10.222.0.93 () {58 vars in 1206 bytes} [Thu Jul 28 11:37:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1422275324 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:37:07.045797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37c709eb-14fd-4e3d-a927-64984a2f179d tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Calling method '.version_select at 0x7f2ebbf3eb80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:07.073271 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-37c709eb-14fd-4e3d-a927-64984a2f179d tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] HTTP exception thrown: Image not found. Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37c709eb-14fd-4e3d-a927-64984a2f179d tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Request method failure captured: Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/93034531-7f00-4f68-986a-08990555b7f0 HTTP/1.1 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTijmzU1D9DwVNqKDElSmiTWU48hTABc6aqlYmrtkkECbOUlGM82UPT3MtmJfWfKPezxfAZyRqcXJ3xR-6EZ5jCvRayyOQ4_MsBzzR4IJEcG12p413vDetb70MYwS5N7ao5IcALBnDa6Bx8NhQRn94U_bNsUSl44i3V4Yd7ekQHP1s Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab59dd5ddba54f199328161f387ff1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab59dd5ddba54f199328161f387ff1f0"}]}] Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ab59dd5ddba54f199328161f387ff1f0 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-830299709 Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 89d35ba69905496a88eb487774b7cdfa Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-830299709-project Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '93034531-7f00-4f68-986a-08990555b7f0'} Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 93034531-7f00-4f68-986a-08990555b7f0 to delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 93034531-7f00-4f68-986a-08990555b7f0 could not be found. Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.075514 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:37:07.079259 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:07.083583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37c709eb-14fd-4e3d-a927-64984a2f179d tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:07.086953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37c709eb-14fd-4e3d-a927-64984a2f179d tempest-ImagesDeleteNegativeTestJSON-830299709 tempest-ImagesDeleteNegativeTestJSON-830299709-project] 10.222.0.93 "DELETE /compute/v2.1/images/93034531-7f00-4f68-986a-08990555b7f0" status: 404 len: 62 microversion: 2.1 time: 0.042846 Jul 28 11:37:07.088065 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1496/2948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:07 2022] DELETE /compute/v2.1/images/93034531-7f00-4f68-986a-08990555b7f0 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:37:07.357086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:07.358694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:07.378525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:07.378988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:07.379804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:07.380250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:07.631950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:07.642336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c0fcbb3-decf-46bd-b54d-a8c3e549023d tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1275 microversion: 2.1 time: 0.291373 Jul 28 11:37:07.643217 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1497/2949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:07 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:07.659974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2060253763", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe6b5fcd-50fa-4151-8267-beaa12b03a0e"}], "security_groups": [{"name": "tempest-securitygroup--1109473023"}], "key_name": "tempest-keypair-217522076", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:08.002028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] validate_networks() for [('fe6b5fcd-50fa-4151-8267-beaa12b03a0e', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:37:09.440750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:37:09.442573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:37:09.443122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:37:09.443539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:37:09.443961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:37:09.463510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:09.472119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:09.473045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:09.473496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:09.522430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:09.538320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:09.575248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:37:09.578576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:37:09.697759 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45c1e184-b17f-4426-ab59-41decafecbbe tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.048813 Jul 28 11:37:09.698825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1498/2950] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:37:09.704786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:09.705855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:09.722391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:09.723340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:09.724621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:09.725330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:10.469179 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0be4849-44d7-43b2-94a7-df2fd9be3157 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.747641 Jul 28 11:37:10.470778 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1453/2951] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:37:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:10.482881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5ce623e-4692-4035-a80e-640fbe8b1746 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:10.489467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d5ce623e-4692-4035-a80e-640fbe8b1746 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:10.604717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d5ce623e-4692-4035-a80e-640fbe8b1746 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:10.625551 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5ce623e-4692-4035-a80e-640fbe8b1746 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1238 microversion: 2.1 time: 0.153344 Jul 28 11:37:10.626577 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1454/2952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:10 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1238 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:10.640193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:10.645551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.225"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:10.650410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:10.654264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:10.665603 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eebeaa26-5740-4a65-8873-dd1cc4040b15 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.965429 Jul 28 11:37:10.675765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:10.683794 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1499/2953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:09 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:10.684486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:10.685535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:10.686080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:10.756150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Acquired lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:37:11.016833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:11.017771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:11.027874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.034143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.035597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.038878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.089953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 HTTP/1.1 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '8401aefb-db11-41da-9b69-503f6d0ac0e8'} Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:11.094662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.101715 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.109782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:11.112872 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-935bda55-87b9-4fdf-a85f-ac0cc735f2f0 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 404 len: 111 microversion: 2.1 time: 0.100370 Jul 28 11:37:11.121098 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1500/2954] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:11 2022] DELETE /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:11.132597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:11.145626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: 8401aefb-db11-41da-9b69-503f6d0ac0e8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:11.172778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.173790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.176635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.177652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.233020 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 HTTP/1.1 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '8401aefb-db11-41da-9b69-503f6d0ac0e8'} Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.238496 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. Jul 28 11:37:11.243162 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.246274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance 8401aefb-db11-41da-9b69-503f6d0ac0e8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:11.249887 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5be8df0e-2a22-4785-8662-d1998ea34d5e tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8" status: 404 len: 111 microversion: 2.1 time: 0.121484 Jul 28 11:37:11.252166 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1501/2955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:11 2022] GET /compute/v2.1/servers/8401aefb-db11-41da-9b69-503f6d0ac0e8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:11.265798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:11.266791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:11.274512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:11.288440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.290195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.293218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.295533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.352323 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 HTTP/1.1 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cca86860-f570-459e-9250-ea5ab4f49488'} Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:11.358299 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.363280 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.365676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:11.368110 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11538a98-4549-4289-ae74-76f12e935817 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 404 len: 111 microversion: 2.1 time: 0.110997 Jul 28 11:37:11.373304 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1502/2956] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:11 2022] DELETE /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:11.389988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:11.390786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] [instance: cca86860-f570-459e-9250-ea5ab4f49488] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:11.410671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.411154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.411969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.431090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.478976 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] HTTP exception thrown: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Request method failure captured: Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 HTTP/1.1 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nNWUL7SieifVSHbfM0ZTYN9SxXSWfBop8OHbEkkJJ1seCEUOC_NuKSwSXiBM9nIUpTXCpUZvVcfqnl5ACfC_GjWGMz8q3Vu5Tj0MukqghhPKv3KK8X0HINQQMkh8PaqQEkQu8BXI9FJu8bIiG57ju87p8b5TRntHCUUWRO1PyAMY8o Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cf9e7882e1b64ab6871246a0853d7e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cf9e7882e1b64ab6871246a0853d7e82"}]}] Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cf9e7882e1b64ab6871246a0853d7e82 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1949955454 Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 040c0446ea5e4e69b6f4958a66c32bef Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-1949955454-project Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cca86860-f570-459e-9250-ea5ab4f49488'} Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:11.480585 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:11.484374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] Returning 404 to user: Instance cca86860-f570-459e-9250-ea5ab4f49488 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:11.486252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8592f09-d5a3-4df3-8287-7f7f30b11b12 tempest-DeleteServersTestJSON-1949955454 tempest-DeleteServersTestJSON-1949955454-project] 10.222.0.93 "GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488" status: 404 len: 111 microversion: 2.1 time: 0.108632 Jul 28 11:37:11.491175 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1503/2957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:11 2022] GET /compute/v2.1/servers/cca86860-f570-459e-9250-ea5ab4f49488 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:11.654100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:11.654935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:11.693331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.694245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:11.694610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:11.695057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:12.063232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:12.121769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e10535f-f64c-4ee1-92e3-b0034e6a6ee0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1298 microversion: 2.1 time: 0.468935 Jul 28 11:37:12.128420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1504/2958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:11 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1298 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:12.142253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:12.142884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:12.160983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:12.163685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:12.165265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:12.169922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:13.298289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:13.307658 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-549481e6-52c5-41a6-88b1-666167225563 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 1.178114 Jul 28 11:37:13.308532 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1505/2959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:12 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:13.335507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:13.337619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:13.347709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:13.348733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:13.350008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:13.350649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:13.463914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:13.472290 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-29502a81-c706-4d31-b5aa-1547e65f1d4f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1296 microversion: 2.1 time: 0.144005 Jul 28 11:37:13.474735 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1506/2960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:13 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:13.657690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4fdaeb5d-e87f-4de4-bf17-10b90071f9f0 req-703dbda8-18ff-4fed-a1d6-8665cfba92c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98ab839-d8b1-433c-86c2-8eee43e6fc96", "tag": "e0369b69-3ede-4ead-a2d5-2b90433c977f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:13.674864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4fdaeb5d-e87f-4de4-bf17-10b90071f9f0 req-703dbda8-18ff-4fed-a1d6-8665cfba92c4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:13.678203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4fdaeb5d-e87f-4de4-bf17-10b90071f9f0 req-703dbda8-18ff-4fed-a1d6-8665cfba92c4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:13.690126 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4fdaeb5d-e87f-4de4-bf17-10b90071f9f0 req-703dbda8-18ff-4fed-a1d6-8665cfba92c4 service nova] Creating event network-changed:e0369b69-3ede-4ead-a2d5-2b90433c977f for instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 on n-h2-851368-1 Jul 28 11:37:13.696800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4fdaeb5d-e87f-4de4-bf17-10b90071f9f0 req-703dbda8-18ff-4fed-a1d6-8665cfba92c4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042657 Jul 28 11:37:13.697881 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1507/2961] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:14.262935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:14.332500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:14.333425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:14.346203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:14.347011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:14.347918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:14.348432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:14.903410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:14.913805 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0602701c-18b6-4a17-b35d-04b413414662 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.586740 Jul 28 11:37:14.915121 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1508/2962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:14 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:14.920971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:14.924109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:14.943022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:14.944681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:14.956987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:14.958244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:15.454448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:15.484742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a60838d-0e49-4a45-85d6-7f70bb291a9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1296 microversion: 2.1 time: 0.565721 Jul 28 11:37:15.488621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1509/2963] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:14 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1296 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:15.936630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:15.937236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:15.943418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:15.943875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:15.944655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:15.945094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:16.426346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:37:16.525545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:16.535807 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a9b08f7-b11c-4aed-8118-551efb3dc38b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.602922 Jul 28 11:37:16.541493 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1510/2964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:15 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:16.546636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-eb92b2df-24c3-4c9b-a332-0c4c81ce952a req-8495a8bc-a181-4f6b-ba8b-8fc2d0a759e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d0f79f-17dd-4cfb-b620-8478a592169c", "tag": "ec53165b-f601-493d-8690-4688d617926b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:16.576529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-eb92b2df-24c3-4c9b-a332-0c4c81ce952a req-8495a8bc-a181-4f6b-ba8b-8fc2d0a759e6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:16.576994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-eb92b2df-24c3-4c9b-a332-0c4c81ce952a req-8495a8bc-a181-4f6b-ba8b-8fc2d0a759e6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:16.610270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-eb92b2df-24c3-4c9b-a332-0c4c81ce952a req-8495a8bc-a181-4f6b-ba8b-8fc2d0a759e6 service nova] Creating event network-changed:ec53165b-f601-493d-8690-4688d617926b for instance f1d0f79f-17dd-4cfb-b620-8478a592169c on n-h1-851368-1 Jul 28 11:37:16.620956 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-eb92b2df-24c3-4c9b-a332-0c4c81ce952a req-8495a8bc-a181-4f6b-ba8b-8fc2d0a759e6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078045 Jul 28 11:37:16.622249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1511/2965] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:16.635211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:16.637550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:16.653648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:16.655525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:16.656797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:16.660647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:18.253630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:18.275244 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5d50424-30e7-457b-ad4e-944e57b30d45 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 1.647225 Jul 28 11:37:18.277695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1512/2966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:18.296746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:18.297679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:18.314076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:18.315289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:18.316242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:18.316978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:19.133350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:19.186019 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7347e664-11c0-49a3-a956-613d0950d19b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.904533 Jul 28 11:37:19.188948 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1513/2967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:18 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:19.302335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:19.303960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:19.330059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:19.330582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:19.331434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:19.331886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:19.507030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:19.563879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:20.565191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:20.575695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7e25909-44be-438c-bd32-a04c56e61d5b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 1.279144 Jul 28 11:37:20.577165 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1514/2968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:19 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:20.582190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df684381-b74a-40fd-976d-c3f8a524c25a"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:20.584605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:20.599764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:20.600232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:20.601042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:20.601532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:20.624935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:20.669243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:20.832984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Updating instance_info_cache with network_info: [{"id": "ec53165b-f601-493d-8690-4688d617926b", "address": "fa:16:3e:9e:a1:d6", "network": {"id": "b1b90e83-739a-4b36-b293-5239dc145739", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-243586754-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01a99f350ace40128f4d41b8ad13205a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapec53165b-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:37:20.852511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Releasing lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:37:20.853495 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-20685aeb-9882-47d2-b6ab-62c09a989d3e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 202 len: 0 microversion: 2.1 time: 10.225715 Jul 28 11:37:20.857329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1455/2969] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:10 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 0 bytes in 10230 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:37:20.862270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:20.862906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:20.880767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:20.881233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:20.882063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:20.882543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:21.050080 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff988f90-7613-40ec-869b-e4671538252a tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "POST /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468773 Jul 28 11:37:21.051816 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1515/2970] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:37:20 2022] POST /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:21.413220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1818757305", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fa82a175-031e-4adf-9f10-53e44f495282"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:21.539799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] validate_networks() for [('fa82a175-031e-4adf-9f10-53e44f495282', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:37:21.583485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:21.599305 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d1b4b90-7280-47b8-880c-a40370aaff0e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.738441 Jul 28 11:37:21.603620 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1456/2971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:20 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:21.614086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfb09d7c-69c1-4279-a797-dafad93b696f tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'create', calling method: .version_select at 0x7f2ebbeef5e0>, body: {"pool": "b9bbc579-ce4a-4d49-9295-6e1fd796851b"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:23.852993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:37:23.854435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:37:23.855100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:37:23.856426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:37:23.857001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:37:23.877757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:23.879345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:23.887471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:23.889500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:23.939463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:23.947126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for user ee97a9f08e1f4bdc84e6811281002555 and project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:23.964268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:37:23.967935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:37:24.033923 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b4e1045-95e6-4da6-ac20-7b105b2ecd65 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.980373 Jul 28 11:37:24.035477 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1516/2972] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:37:24.041395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d4769179-980b-4ed9-b8d0-3ae647ce0bb1 req-23528a9b-1cc7-479d-87f5-4996fe3afd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98ab839-d8b1-433c-86c2-8eee43e6fc96", "name": "network-vif-plugged", "status": "completed", "tag": "e0369b69-3ede-4ead-a2d5-2b90433c977f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:24.055392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d4769179-980b-4ed9-b8d0-3ae647ce0bb1 req-23528a9b-1cc7-479d-87f5-4996fe3afd4c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.056656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d4769179-980b-4ed9-b8d0-3ae647ce0bb1 req-23528a9b-1cc7-479d-87f5-4996fe3afd4c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:24.078307 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d4769179-980b-4ed9-b8d0-3ae647ce0bb1 req-23528a9b-1cc7-479d-87f5-4996fe3afd4c service nova] Creating event network-vif-plugged:e0369b69-3ede-4ead-a2d5-2b90433c977f for instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 on n-h2-851368-1 Jul 28 11:37:24.089813 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d4769179-980b-4ed9-b8d0-3ae647ce0bb1 req-23528a9b-1cc7-479d-87f5-4996fe3afd4c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051615 Jul 28 11:37:24.091817 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1517/2973] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:24.104133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:24.105208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:24.119739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.120853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:24.122492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.123133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:24.490108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:24.502737 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-395b927c-3c28-4aab-8978-b4d13c32a79d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 0.408887 Jul 28 11:37:24.509578 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1518/2974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:24 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:24.514991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4a9e06f3-1731-49a7-a4f2-33eb7df26190 req-b9f390d5-de03-41c3-8e8c-26d11f5482cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:24.536651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4a9e06f3-1731-49a7-a4f2-33eb7df26190 req-b9f390d5-de03-41c3-8e8c-26d11f5482cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.537006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4a9e06f3-1731-49a7-a4f2-33eb7df26190 req-b9f390d5-de03-41c3-8e8c-26d11f5482cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:24.553930 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4a9e06f3-1731-49a7-a4f2-33eb7df26190 req-b9f390d5-de03-41c3-8e8c-26d11f5482cf service nova] Creating event network-changed:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:37:24.565887 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4a9e06f3-1731-49a7-a4f2-33eb7df26190 req-b9f390d5-de03-41c3-8e8c-26d11f5482cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054918 Jul 28 11:37:24.569556 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1519/2975] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:24.578767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:24.582206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:24.606187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.606636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:24.607460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:24.607908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:25.017900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:25.047896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3ecbea8-6c2d-4dec-a11d-9bde423aacd5 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.476351 Jul 28 11:37:25.048748 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1520/2976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:24 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:25.061677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:25.064637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:25.087646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:25.089310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:25.091359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:25.093187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:25.100977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:25.316270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:25.327518 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1fd1dd66-0e85-4921-84d2-1d3e04c8fb2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1214 microversion: 2.1 time: 0.276715 Jul 28 11:37:25.344128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1521/2977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:25 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:25.526676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:25.527414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:25.541746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:25.544367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:25.545260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:25.546614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:25.884347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:25.897032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d26b38a-ecec-41aa-b980-f5203eabdf1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 0.374068 Jul 28 11:37:25.911193 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1522/2978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:25 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:26.083498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:26.084146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:26.092976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.093428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.094225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.094664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.426476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:26.438308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-431f9537-4ee1-44f8-a8a5-db297cd34b76 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1317 microversion: 2.1 time: 0.358851 Jul 28 11:37:26.438906 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1523/2979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:26 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:26.452704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:26.453701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:26.465026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.469101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.471116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.474944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.513434 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfb09d7c-69c1-4279-a797-dafad93b696f tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.908654 Jul 28 11:37:26.526433 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1457/2980] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:37:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:26.534089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.202"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:26.537533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:26.550661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.551480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.552462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.553068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.582315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:26.586557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Acquired lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:37:26.603700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aac4d0cf-da28-4889-af46-1992f3302a5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1276 microversion: 2.1 time: 0.150401 Jul 28 11:37:26.617225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1524/2981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:26 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:26.922278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:26.923325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:26.958861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.960684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:26.962116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:26.965519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:27.354836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:27.371304 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d9502c9d-27f3-4b7a-a9eb-a3d9271181b8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 0.455497 Jul 28 11:37:27.374539 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1525/2982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:26 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:27.468946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:27.469666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:27.484878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:27.486199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:27.488401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:27.492376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:27.875528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b.", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:37:27.876306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Releasing lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:37:27.876881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.876881 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Request method failure captured: Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action HTTP/1.1 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 46 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nTL7BrryFBAcq2NzfkBY2qp4DXtR1Gsi_n9CusunNwYqWjJTKH06awM9sDlvYNMKZBm4RS0xiG7kauyEAt3aMcwRHnvIbS-TlNZ9iFUnXQBcwkaxAx-hCuD-iMf1bDCk2QQ93vz8i03ORicFARJ-BJx2_3V8OH3pD-dLDCi8ZzhDxw Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}] Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: cffcef8907df4283ac3109e9235d31e8 Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: {"addFloatingIp": {"address": "172.25.3.202"}} Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f1d0f79f-17dd-4cfb-b620-8478a592169c', 'body': {'addFloatingIp': {'address': '172.25.3.202'}}} Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:37:27.879035 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] Jul 28 11:37:27.884094 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:27.888126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Returning 400 to user: Cannot associate floating IP 172.25.3.202 (2b03579a-932d-4aa4-ae02-63de3b751f2e) with port ec53165b-f601-493d-8690-4688d617926b using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network b9bbc579-ce4a-4d49-9295-6e1fd796851b. Jul 28 11:37:27.888126 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-34d42774-dafa-4b1b-9d42-8b7cf23fb294'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:27.888126 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0868fde0-8390-47b4-919f-e891fe95317e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 400 len: 382 microversion: 2.1 time: 1.351052 Jul 28 11:37:27.888126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1458/2983] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:26 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 382 bytes in 1352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:37:27.890028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:27.890625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:27.934643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:27.935174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:27.940223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:27.940888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:27.949651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:28.006101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:28.015795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5a562640-85cf-4397-a6c6-9f0384dbe3fc tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1506 microversion: 2.1 time: 0.555315 Jul 28 11:37:28.030747 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1526/2984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:27 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:28.039232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1bf0ce7-fe7f-4f29-b623-9425ca2b2380 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '.version_select at 0x7f2ebbe82dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:28.061412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:28.070506 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fba8a214-4780-42b4-9add-b8d838ac2466 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1276 microversion: 2.1 time: 0.183350 Jul 28 11:37:28.071508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1459/2985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:27 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:28.088961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:28.091222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:28.102379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.102840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:28.103693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.104136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:28.184743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:28.186151 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54e11630-0cdf-4f49-bea5-3b4ba80ed5d3 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/os-instance-actions/req-40e178ce-1e5f-42ab-8489-64529d7795a3" status: 200 len: 313 microversion: 2.1 time: 0.113521 Jul 28 11:37:28.187259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1460/2986] 10.222.0.93 () {58 vars in 1419 bytes} [Thu Jul 28 11:37:28 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/os-instance-actions/req-40e178ce-1e5f-42ab-8489-64529d7795a3 => generated 313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:28.203090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:28.206241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:28.214192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.214984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:28.217485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.218100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:28.368646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0793340d-27e8-4f63-8bc1-702355c52c1e tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "POST /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/action" status: 202 len: 0 microversion: 2.1 time: 0.167422 Jul 28 11:37:28.373168 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1461/2987] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:28 2022] POST /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:37:28.381661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:28.385654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:28.403215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.403884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:28.405248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:28.407577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:29.062382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:29.075694 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00d53503-78a0-4ba4-b8f9-1b7d6634efbe tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1508 microversion: 2.1 time: 0.699926 Jul 28 11:37:29.096794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1462/2988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:28 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:29.102604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:29.109872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:29.122840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:29.123340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:29.124282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:29.124728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:29.743640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:29.753065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0077f4b4-0e0b-4651-89c3-6ffd7f2b62db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 0.654785 Jul 28 11:37:29.753654 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1463/2989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:29 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:29.762505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:29.763155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:29.778366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:29.779093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:29.780796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:29.781589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.115641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:30.132086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a0a7d381-9ec9-41f6-86eb-61bde3e86943 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.376769 Jul 28 11:37:30.134598 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1464/2990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:29 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:30.140498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-65f7fa70-7fcb-40bf-b391-6f42d07bcd50 req-f466a7d0-920e-4e68-a5a0-63364dec8bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-plugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:30.163267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-65f7fa70-7fcb-40bf-b391-6f42d07bcd50 req-f466a7d0-920e-4e68-a5a0-63364dec8bfb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.164403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-65f7fa70-7fcb-40bf-b391-6f42d07bcd50 req-f466a7d0-920e-4e68-a5a0-63364dec8bfb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.192046 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-65f7fa70-7fcb-40bf-b391-6f42d07bcd50 req-f466a7d0-920e-4e68-a5a0-63364dec8bfb service nova] Creating event network-vif-plugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:37:30.201777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-65f7fa70-7fcb-40bf-b391-6f42d07bcd50 req-f466a7d0-920e-4e68-a5a0-63364dec8bfb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065079 Jul 28 11:37:30.203284 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1465/2991] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:30.275355 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1bf0ce7-fe7f-4f29-b623-9425ca2b2380 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/2b03579a-932d-4aa4-ae02-63de3b751f2e" status: 202 len: 0 microversion: 2.1 time: 2.242494 Jul 28 11:37:30.277219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1527/2992] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:37:28 2022] DELETE /compute/v2.1/os-floating-ips/2b03579a-932d-4aa4-ae02-63de3b751f2e => generated 0 bytes in 2246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:37:30.283341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:30.298336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:30.308438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.316896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.318428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.321846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.439730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29c09aa5-5df8-4e32-9120-a54ae3073efc tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-425744706", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:30.444658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-29c09aa5-5df8-4e32-9120-a54ae3073efc tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] HTTP exception thrown: min_count must be <= max_count Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29c09aa5-5df8-4e32-9120-a54ae3073efc tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Request method failure captured: Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 183 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nT5ECXl0vrQh66B_HAhMY7v7CteVWAeYfcor2XiZvkk_XgiutthM63E6LC_gSuSpF3vdESMB5Bi6thxuSf6mebTPOklksxng4tII2SO_VF3W8O8-gXQqixOsk0Scs9Z5b5nBZqXuwyjNe5tzxJS0-LLLSPXuVq7_sK-lWlPab2SOMk Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}] Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d468b1fb313349a5abad646fab0a0bae Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-425744706", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: exception: min_count must be <= max_count Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-425744706', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 28 11:37:30.446865 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:37:30.453762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29c09aa5-5df8-4e32-9120-a54ae3073efc tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Returning 400 to user: min_count must be <= max_count {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:30.455055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29c09aa5-5df8-4e32-9120-a54ae3073efc tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.248738 Jul 28 11:37:30.455838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1466/2993] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:30 2022] POST /compute/v2.1/servers => generated 74 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 11:37:30.473280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-77b5db13-ec6b-4622-b74c-c2536fffa392 req-188ddb24-d9b7-4501-8eee-b2484b3c40b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a70dc22-0b38-4f37-919a-45cde364058a", "tag": "f4abea6e-2221-447e-9aed-e0d91f746b17"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:30.492559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-77b5db13-ec6b-4622-b74c-c2536fffa392 req-188ddb24-d9b7-4501-8eee-b2484b3c40b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.493015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-77b5db13-ec6b-4622-b74c-c2536fffa392 req-188ddb24-d9b7-4501-8eee-b2484b3c40b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.508613 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-77b5db13-ec6b-4622-b74c-c2536fffa392 req-188ddb24-d9b7-4501-8eee-b2484b3c40b4 service nova] Creating event network-changed:f4abea6e-2221-447e-9aed-e0d91f746b17 for instance 3a70dc22-0b38-4f37-919a-45cde364058a on n-h1-851368-1 Jul 28 11:37:30.514581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-77b5db13-ec6b-4622-b74c-c2536fffa392 req-188ddb24-d9b7-4501-8eee-b2484b3c40b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045009 Jul 28 11:37:30.515681 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1467/2994] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:30.521514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.225"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:30.987023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:30.994336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.994799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:30.995655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:30.996217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:31.004602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:31.013204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e0b6d8b-e7df-4ab0-905c-1e411214cb57 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1513 microversion: 2.1 time: 0.734521 Jul 28 11:37:31.014112 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1528/2995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:30 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1513 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:31.018960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd407cd0-937d-4d86-b890-687e8297174b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1210405679", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "max_count": 0}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd407cd0-937d-4d86-b890-687e8297174b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Request method failure captured: Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 168 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nT5ECXl0vrQh66B_HAhMY7v7CteVWAeYfcor2XiZvkk_XgiutthM63E6LC_gSuSpF3vdESMB5Bi6thxuSf6mebTPOklksxng4tII2SO_VF3W8O8-gXQqixOsk0Scs9Z5b5nBZqXuwyjNe5tzxJS0-LLLSPXuVq7_sK-lWlPab2SOMk Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}] Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d468b1fb313349a5abad646fab0a0bae Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1210405679", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "max_count": 0}} Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1210405679', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'max_count': 0}}} Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 0 Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:37:31.024075 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.028328 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.030326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd407cd0-937d-4d86-b890-687e8297174b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:31.031605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd407cd0-937d-4d86-b890-687e8297174b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016004 Jul 28 11:37:31.032623 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1529/2996] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:37:31.037850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:31.038726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:31.047499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:31.048134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:31.049545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:31.050409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:31.297054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:31.303444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Acquired lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:37:31.304723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-021de630-a82c-4844-ad1a-e48804467ec6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1364 microversion: 2.1 time: 0.270930 Jul 28 11:37:31.305292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1530/2997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:31 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:31.310120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b19c073f-3a71-4e56-ae9c-a60f7958dd02 tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2038527978", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "max_count": 2.5}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b19c073f-3a71-4e56-ae9c-a60f7958dd02 tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Request method failure captured: Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 170 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nT5ECXl0vrQh66B_HAhMY7v7CteVWAeYfcor2XiZvkk_XgiutthM63E6LC_gSuSpF3vdESMB5Bi6thxuSf6mebTPOklksxng4tII2SO_VF3W8O8-gXQqixOsk0Scs9Z5b5nBZqXuwyjNe5tzxJS0-LLLSPXuVq7_sK-lWlPab2SOMk Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}] Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d468b1fb313349a5abad646fab0a0bae Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2038527978", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "max_count": 2.5}} Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2038527978', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'max_count': 2.5}}} Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:37:31.314183 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.318837 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.321233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b19c073f-3a71-4e56-ae9c-a60f7958dd02 tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:31.322113 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b19c073f-3a71-4e56-ae9c-a60f7958dd02 tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015736 Jul 28 11:37:31.322672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1531/2998] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:37:31.327334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:31.328128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:31.339666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:31.340742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:31.341547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:31.341996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:31.575492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:31.584949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4801aeb3-b63e-484a-8952-987bfd0429f3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.260829 Jul 28 11:37:31.591274 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1532/2999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:31 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:31.595014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0e9963b-7310-46f3-8106-41491a56115f tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1318593357", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 0}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0e9963b-7310-46f3-8106-41491a56115f tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Request method failure captured: Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 168 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nT5ECXl0vrQh66B_HAhMY7v7CteVWAeYfcor2XiZvkk_XgiutthM63E6LC_gSuSpF3vdESMB5Bi6thxuSf6mebTPOklksxng4tII2SO_VF3W8O8-gXQqixOsk0Scs9Z5b5nBZqXuwyjNe5tzxJS0-LLLSPXuVq7_sK-lWlPab2SOMk Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}] Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d468b1fb313349a5abad646fab0a0bae Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1318593357", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 0}} Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1318593357', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'min_count': 0}}} Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 0 Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:37:31.599405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0e9963b-7310-46f3-8106-41491a56115f tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0e9963b-7310-46f3-8106-41491a56115f tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014742 Jul 28 11:37:31.603951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1533/3000] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:37:31.655684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b23da9a1-592b-4639-bf74-a2617fff691b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924852724", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 2.5}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b23da9a1-592b-4639-bf74-a2617fff691b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Request method failure captured: Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 170 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nT5ECXl0vrQh66B_HAhMY7v7CteVWAeYfcor2XiZvkk_XgiutthM63E6LC_gSuSpF3vdESMB5Bi6thxuSf6mebTPOklksxng4tII2SO_VF3W8O8-gXQqixOsk0Scs9Z5b5nBZqXuwyjNe5tzxJS0-LLLSPXuVq7_sK-lWlPab2SOMk Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_351c33ff2bbc447e9a50a57810df995e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/351c33ff2bbc447e9a50a57810df995e"}]}] Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 351c33ff2bbc447e9a50a57810df995e Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1747697448 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d468b1fb313349a5abad646fab0a0bae Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1747697448-project Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924852724", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 2.5}} Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1924852724', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'min_count': 2.5}}} Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:37:31.660660 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 11:37:31.664880 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:31.667376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b23da9a1-592b-4639-bf74-a2617fff691b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:31.668357 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b23da9a1-592b-4639-bf74-a2617fff691b tempest-MultipleCreateNegativeTestJSON-1747697448 tempest-MultipleCreateNegativeTestJSON-1747697448-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016784 Jul 28 11:37:31.669426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1534/3001] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:37:32.036476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:32.037179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:32.044579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.045376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.046233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.046741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.086413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:37:32.478328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:32.487409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d08f7b9c-a27a-49ed-a17b-d44ee609eff1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1506 microversion: 2.1 time: 0.454660 Jul 28 11:37:32.503835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1535/3002] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:32 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:32.512514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cd433322-067e-45d6-b58f-8eb3ae4022d1 req-391f9780-5ba1-4dbb-83ed-cb2bf0bd84f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d0f79f-17dd-4cfb-b620-8478a592169c", "tag": "ec53165b-f601-493d-8690-4688d617926b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:32.523388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cd433322-067e-45d6-b58f-8eb3ae4022d1 req-391f9780-5ba1-4dbb-83ed-cb2bf0bd84f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.524392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cd433322-067e-45d6-b58f-8eb3ae4022d1 req-391f9780-5ba1-4dbb-83ed-cb2bf0bd84f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.537116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cd433322-067e-45d6-b58f-8eb3ae4022d1 req-391f9780-5ba1-4dbb-83ed-cb2bf0bd84f0 service nova] Creating event network-changed:ec53165b-f601-493d-8690-4688d617926b for instance f1d0f79f-17dd-4cfb-b620-8478a592169c on n-h1-851368-1 Jul 28 11:37:32.543691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cd433322-067e-45d6-b58f-8eb3ae4022d1 req-391f9780-5ba1-4dbb-83ed-cb2bf0bd84f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 Jul 28 11:37:32.544872 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1536/3003] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:32.551200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:32.552386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:32.562044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.562689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.563790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.564545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.850567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:32.866293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-939121a0-2b55-4d1c-9062-61d30dde81dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1551 microversion: 2.1 time: 0.319266 Jul 28 11:37:32.867564 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1537/3004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1551 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:32.880041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Updating instance_info_cache with network_info: [{"id": "ec53165b-f601-493d-8690-4688d617926b", "address": "fa:16:3e:9e:a1:d6", "network": {"id": "b1b90e83-739a-4b36-b293-5239dc145739", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-243586754-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01a99f350ace40128f4d41b8ad13205a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapec53165b-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:37:32.893861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Releasing lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:37:32.894529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '.version_select at 0x7f2ebbe36430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:32.895148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:32.895786 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56a7d4c8-a1f1-4746-8f12-230f58526a02 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 202 len: 0 microversion: 2.1 time: 2.378587 Jul 28 11:37:32.901406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1468/3005] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:30 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 0 bytes in 2385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:37:32.904421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.904887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.905669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.906106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.908209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:32.909093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:32.918530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.919362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.920310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.920922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.983424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9388e4ba-f0fb-409d-aa99-072df8244f8b tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.099748 Jul 28 11:37:32.984858 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1538/3006] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Jul 28 11:37:32 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96/os-instance-actions => generated 611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:32.990266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:32.990993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:32.998060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:32.998748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:32.999711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:33.000330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:33.181818 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad61b5fd-5e0c-4c57-85b0-1ae48639efb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195631 Jul 28 11:37:33.182413 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1539/3007] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:37:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:33.187366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7a54159-a7bc-46c8-81a2-9569a6ad928f tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '.version_select at 0x7f2ebbe604c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:33.429568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:33.437427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9d941d19-e1b9-47b1-b507-58cf7d98af7a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.534546 Jul 28 11:37:33.451992 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1469/3008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:32 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:33.463961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:33.464742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:33.471720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:33.472467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:33.474511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:33.475147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:33.520043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:37:33.680655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4047674-aed0-478b-8023-3331a79118c6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 204 len: 0 microversion: 2.1 time: 0.226833 Jul 28 11:37:33.681583 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1470/3009] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:33 2022] DELETE /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:33.691897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:33.693932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:33.701853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:33.703015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:33.706655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:33.707260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:33.919017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:33.957422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:34.212798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:34.221767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fdedf69b-f546-48c6-aea1-b0ca981181a6 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1512 microversion: 2.1 time: 0.534274 Jul 28 11:37:34.228459 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1471/3010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:33 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:34.464687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:34.465234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:34.474027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:34.474697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:34.475534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:34.476494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:35.004402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:35.020031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe958368-b9de-42eb-ac56-41c3827161fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.559500 Jul 28 11:37:35.033159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1472/3011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:34 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:35.248887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:35.250309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:35.264224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:35.264832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:35.265841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:35.266455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:35.874329 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7a54159-a7bc-46c8-81a2-9569a6ad928f tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/f79ac8ea-afb6-4c93-ad18-97de1b8d7e9d" status: 202 len: 0 microversion: 2.1 time: 2.690101 Jul 28 11:37:35.875367 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1540/3012] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:37:33 2022] DELETE /compute/v2.1/os-floating-ips/f79ac8ea-afb6-4c93-ad18-97de1b8d7e9d => generated 0 bytes in 2692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:37:35.888051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e24ada99-31f9-4ffe-a73d-cc4f003d88f0 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:35.894587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e24ada99-31f9-4ffe-a73d-cc4f003d88f0 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Request method failure captured: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action HTTP/1.1 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 34 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTL7BrryFBAcq2NzfkBY2qp4DXtR1Gsi_n9CusunNwYqWjJTKH06awM9sDlvYNMKZBm4RS0xiG7kauyEAt3aMcwRHnvIbS-TlNZ9iFUnXQBcwkaxAx-hCuD-iMf1bDCk2QQ93vz8i03ORicFARJ-BJx2_3V8OH3pD-dLDCi8ZzhDxw Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}] Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cffcef8907df4283ac3109e9235d31e8 Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: {"addFloatingIp": {"address": ""}} Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f1d0f79f-17dd-4cfb-b620-8478a592169c', 'body': {'addFloatingIp': {'address': ''}}} Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi '' Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:37:35.907054 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 11:37:35.916891 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:35.921049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e24ada99-31f9-4ffe-a73d-cc4f003d88f0 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:35.922397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e24ada99-31f9-4ffe-a73d-cc4f003d88f0 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 400 len: 142 microversion: 2.1 time: 0.041688 Jul 28 11:37:35.927019 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3eabdb9b-85a5-4d03-bc57-663e6a7c218a tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1512 microversion: 2.1 time: 0.688498 Jul 28 11:37:35.930716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1541/3013] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:35 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 142 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:37:35.936987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:35.939662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:35.949057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:35.949814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:35.951432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:35.952083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:35.953100 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1473/3014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:35 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1512 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:35.993700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Acquired lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:37:36.046463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:36.047016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:36.057138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.060138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.061055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.061694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.093453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:36.249388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Releasing lock "refresh_cache-f1d0f79f-17dd-4cfb-b620-8478a592169c" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:37:36.250633 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] HTTP exception thrown: floating IP not found Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Request method failure captured: Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action HTTP/1.1 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 41 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTL7BrryFBAcq2NzfkBY2qp4DXtR1Gsi_n9CusunNwYqWjJTKH06awM9sDlvYNMKZBm4RS0xiG7kauyEAt3aMcwRHnvIbS-TlNZ9iFUnXQBcwkaxAx-hCuD-iMf1bDCk2QQ93vz8i03ORicFARJ-BJx2_3V8OH3pD-dLDCi8ZzhDxw Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}] Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cffcef8907df4283ac3109e9235d31e8 Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: exception: floating IP not found Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f1d0f79f-17dd-4cfb-b620-8478a592169c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 28 11:37:36.256768 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 28 11:37:36.263165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.268252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Returning 404 to user: floating IP not found {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:36.271343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90cc5f06-2b66-48d0-9b63-1a0f1e746680 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 404 len: 67 microversion: 2.1 time: 0.336659 Jul 28 11:37:36.278130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1542/3015] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:35 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 67 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:37:36.292383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3989b6f8-7064-49ce-b92d-5617e4c78ffe tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:36.429562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-3989b6f8-7064-49ce-b92d-5617e4c78ffe tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3989b6f8-7064-49ce-b92d-5617e4c78ffe tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Request method failure captured: Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action HTTP/1.1 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 44 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTL7BrryFBAcq2NzfkBY2qp4DXtR1Gsi_n9CusunNwYqWjJTKH06awM9sDlvYNMKZBm4RS0xiG7kauyEAt3aMcwRHnvIbS-TlNZ9iFUnXQBcwkaxAx-hCuD-iMf1bDCk2QQ93vz8i03ORicFARJ-BJx2_3V8OH3pD-dLDCi8ZzhDxw Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}] Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cffcef8907df4283ac3109e9235d31e8 Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: exception: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f1d0f79f-17dd-4cfb-b620-8478a592169c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 28 11:37:36.431545 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3989b6f8-7064-49ce-b92d-5617e4c78ffe tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3989b6f8-7064-49ce-b92d-5617e4c78ffe tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action" status: 404 len: 88 microversion: 2.1 time: 0.147132 Jul 28 11:37:36.435803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1543/3016] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:36 2022] POST /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c/action => generated 88 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:37:36.443047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:36.446524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:36.478420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.478698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.479896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.481112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.550545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:37:36.714585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c108f1d5-61ce-4031-8f94-fc77b9b34fa8 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 204 len: 0 microversion: 2.1 time: 0.275598 Jul 28 11:37:36.717765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1544/3017] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:36 2022] DELETE /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:36.732586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-15546427-0063-4db1-b3d6-9935f9b93bbd req-5d9a73c5-47fa-4aea-af5c-54853e9b5c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:36.764031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15546427-0063-4db1-b3d6-9935f9b93bbd req-5d9a73c5-47fa-4aea-af5c-54853e9b5c08 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.764483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15546427-0063-4db1-b3d6-9935f9b93bbd req-5d9a73c5-47fa-4aea-af5c-54853e9b5c08 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.786329 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-15546427-0063-4db1-b3d6-9935f9b93bbd req-5d9a73c5-47fa-4aea-af5c-54853e9b5c08 service nova] Creating event network-changed:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:37:36.808723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-15546427-0063-4db1-b3d6-9935f9b93bbd req-5d9a73c5-47fa-4aea-af5c-54853e9b5c08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089272 Jul 28 11:37:36.809334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1545/3018] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:36.817143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:36.817858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:36.841370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.843050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.849490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:36.853900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:36.895651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:36.930894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:36.961905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6fb497a-ea89-4bf8-a0cb-8b3e87cb9045 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.921696 Jul 28 11:37:36.962531 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1474/3019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:36 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:36.987975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:36.993600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:37.001902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.002639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.003637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.004242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.059428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7fa11319-9872-4656-b725-f595ec88b3ed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078377 Jul 28 11:37:37.067395 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1475/3020] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:37:36 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:37.084092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:37.087439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:37.106352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.107431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.108612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.109325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.297908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:37.307380 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6076bf90-a704-4cd1-8676-d50519c7a00e tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1541 microversion: 2.1 time: 0.496630 Jul 28 11:37:37.310990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1546/3021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:36 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1541 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:37.328882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:37.329724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:37.350637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c9e1937d5f4f8f99204370d99ce6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4dcde321f84ca69621c6c830318a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:37.351841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.353642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.355111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.355619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.362890 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33e63fa3-e218-456f-9327-9aa3618fc1a1 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 200 len: 1470 microversion: 2.1 time: 0.291934 Jul 28 11:37:37.378275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1476/3022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:37 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:37.479801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lazy-loading 'services' on Instance uuid ea93ec7e-49f0-4717-912c-6571fcdb1fa8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:37:37.575412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05bc063c-b0e9-4b79-8af2-299b961d94e1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments/df684381-b74a-40fd-976d-c3f8a524c25a" status: 202 len: 0 microversion: 2.1 time: 0.262817 Jul 28 11:37:37.576014 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1547/3023] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:37:37 2022] DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments/df684381-b74a-40fd-976d-c3f8a524c25a => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:37:37.803590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6a9393ea-8a61-44cf-81e5-b9cb651c76e2 req-79bd3348-5783-4150-b163-71f6a8839273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70dc22-0b38-4f37-919a-45cde364058a", "name": "network-vif-plugged", "status": "completed", "tag": "f4abea6e-2221-447e-9aed-e0d91f746b17"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:37.841658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6a9393ea-8a61-44cf-81e5-b9cb651c76e2 req-79bd3348-5783-4150-b163-71f6a8839273 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:37.842686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6a9393ea-8a61-44cf-81e5-b9cb651c76e2 req-79bd3348-5783-4150-b163-71f6a8839273 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:37.866559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6a9393ea-8a61-44cf-81e5-b9cb651c76e2 req-79bd3348-5783-4150-b163-71f6a8839273 service nova] Creating event network-vif-plugged:f4abea6e-2221-447e-9aed-e0d91f746b17 for instance 3a70dc22-0b38-4f37-919a-45cde364058a on n-h1-851368-1 Jul 28 11:37:37.875844 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6a9393ea-8a61-44cf-81e5-b9cb651c76e2 req-79bd3348-5783-4150-b163-71f6a8839273 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079098 Jul 28 11:37:37.877750 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1477/3024] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:37.988253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:37.989273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:38.038955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.039676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.040776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.041656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.326869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:38.337355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:38.338182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:38.346640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c3c3be6-9196-4f38-8a1b-83a652092fe5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.364393 Jul 28 11:37:38.347584 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1548/3025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:37 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:38.355110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.355937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.357208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.357804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.385880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:38.386767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] [instance: e98ab839-d8b1-433c-86c2-8eee43e6fc96] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:38.393900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.394768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.395768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:38.396476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:38.411528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] HTTP exception thrown: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Request method failure captured: Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 HTTP/1.1 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTdu7K2sKtRnjyLxHeJLBndSBXzXv5Ms9KvFL7n6M9191jIglBx03fd3aK2tbLraauUTDMmL7Qh2syYKgtFqXvBNYGT5BRthIFfPf4RmyFCv-MgH3ctzQhF67_ip0yo8nigQZZr2dtmSt9CeMg8VzwQtKn0Hq3GSyB-wKynhZozbn4 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 7d4dcde321f84ca69621c6c830318a04 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceActionsTestJSON-446734952 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7d4dcde321f84ca69621c6c830318a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7d4dcde321f84ca69621c6c830318a04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7d4dcde321f84ca69621c6c830318a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7d4dcde321f84ca69621c6c830318a04"}]}] Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceActionsTestJSON-446734952 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 7d4dcde321f84ca69621c6c830318a04 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceActionsTestJSON-446734952 Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceActionsTestJSON-446734952-project Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: f6c9e1937d5f4f8f99204370d99ce6ac Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceActionsTestJSON-446734952-project Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e98ab839-d8b1-433c-86c2-8eee43e6fc96'} Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:38.413905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. Jul 28 11:37:38.417950 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:38.421642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] Returning 404 to user: Instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:38.425624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f82f346b-cf0a-4c04-93c9-4f85cc075667 tempest-InstanceActionsTestJSON-446734952 tempest-InstanceActionsTestJSON-446734952-project] 10.222.0.93 "GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96" status: 404 len: 111 microversion: 2.1 time: 0.041340 Jul 28 11:37:38.425624 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1549/3026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:38 2022] GET /compute/v2.1/servers/e98ab839-d8b1-433c-86c2-8eee43e6fc96 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:37:38.751909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:38.769657 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4526d8c-9dbd-406d-9f1c-ddf6b1a8dd2c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1541 microversion: 2.1 time: 0.440019 Jul 28 11:37:38.789847 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1478/3027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:38 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1541 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:39.369249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:39.370454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:39.379354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:39.391774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:39.392447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:39.393751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:39.394373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:39.405654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-64bffaa3-d8a9-4749-9753-1424fdae24c5 req-3a59ad82-d042-4e2e-bccc-b41e28b96956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98ab839-d8b1-433c-86c2-8eee43e6fc96", "name": "network-vif-deleted", "tag": "e0369b69-3ede-4ead-a2d5-2b90433c977f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:39.427990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-64bffaa3-d8a9-4749-9753-1424fdae24c5 req-3a59ad82-d042-4e2e-bccc-b41e28b96956 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:39.433073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-64bffaa3-d8a9-4749-9753-1424fdae24c5 req-3a59ad82-d042-4e2e-bccc-b41e28b96956 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:39.461260 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-64bffaa3-d8a9-4749-9753-1424fdae24c5 req-3a59ad82-d042-4e2e-bccc-b41e28b96956 service nova] Creating event network-vif-deleted:e0369b69-3ede-4ead-a2d5-2b90433c977f for instance e98ab839-d8b1-433c-86c2-8eee43e6fc96 on n-h2-851368-1 Jul 28 11:37:39.489618 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-64bffaa3-d8a9-4749-9753-1424fdae24c5 req-3a59ad82-d042-4e2e-bccc-b41e28b96956 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092101 Jul 28 11:37:39.490605 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1479/3028] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:39.641426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:39.649155 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9c55c8fe-3e20-469d-b4da-cfa5d1fbde21 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1318 microversion: 2.1 time: 0.284637 Jul 28 11:37:39.655783 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1550/3029] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:39 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:39.798058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:39.798793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:39.827176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:39.827638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:39.835160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:39.835634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:40.116439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:40.132300 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6ce294d-8520-4cd8-bf0e-accdb0cb432c tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1541 microversion: 2.1 time: 0.338770 Jul 28 11:37:40.144005 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1480/3030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:39 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1541 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:40.545433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7c20263b-b3cf-4660-901a-d9f786f87631 req-496e5f07-eee1-4d4e-82fa-b5666e1b40b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d0f79f-17dd-4cfb-b620-8478a592169c", "name": "network-vif-deleted", "tag": "ec53165b-f601-493d-8690-4688d617926b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:40.582892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7c20263b-b3cf-4660-901a-d9f786f87631 req-496e5f07-eee1-4d4e-82fa-b5666e1b40b0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:40.585655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7c20263b-b3cf-4660-901a-d9f786f87631 req-496e5f07-eee1-4d4e-82fa-b5666e1b40b0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:40.637082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7c20263b-b3cf-4660-901a-d9f786f87631 req-496e5f07-eee1-4d4e-82fa-b5666e1b40b0 service nova] Creating event network-vif-deleted:ec53165b-f601-493d-8690-4688d617926b for instance f1d0f79f-17dd-4cfb-b620-8478a592169c on n-h1-851368-1 Jul 28 11:37:40.653074 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7c20263b-b3cf-4660-901a-d9f786f87631 req-496e5f07-eee1-4d4e-82fa-b5666e1b40b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112772 Jul 28 11:37:40.658984 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1551/3031] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:40.678788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:40.679672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:40.724323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:40.725706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:40.727238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:40.728360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.159498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:41.161760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:41.173849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.175206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.176751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.178143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.189446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:41.201663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1133eccd-32bd-4fd0-ba41-39d5ae86c7a1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1508 microversion: 2.1 time: 0.528235 Jul 28 11:37:41.202535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1481/3032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:40 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1508 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:41.228148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:41.229017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:41.242863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.243286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.244052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.244662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.268307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.270075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.272065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lazy-loading 'fault' on Instance uuid f1d0f79f-17dd-4cfb-b620-8478a592169c {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:37:41.395681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffcef8907df4283ac3109e9235d31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a99f350ace40128f4d41b8ad13205a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:41.405662 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be65fe18-8285-4e1a-a3cb-e7c285122689 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 200 len: 1321 microversion: 2.1 time: 0.254407 Jul 28 11:37:41.407654 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1552/3033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:41 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:41.754671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:41.814159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bdce92aa-bdc0-4c63-a763-3a80f9f7e5d8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1508 microversion: 2.1 time: 0.572789 Jul 28 11:37:41.823434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1482/3034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:41 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:41.834316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:41.837522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:41.844829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.845608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.846619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:41.847322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:41.965412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:37:41.965845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:37:41.966325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:37:41.967539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:37:41.967968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:37:42.090630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:42.097583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.098417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.100211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.100973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.155208 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3912c65-5176-4e2f-9639-011391dcfdad tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "POST /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a/action" status: 202 len: 1110 microversion: 2.1 time: 0.323646 Jul 28 11:37:42.169484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1553/3035] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:37:41 2022] POST /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a/action => generated 1110 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 11:37:42.175448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:42.176737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:42.187955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.190532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.192051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.197205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.429473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:42.430220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] [instance: f1d0f79f-17dd-4cfb-b620-8478a592169c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:42.440851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.441407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.442238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:42.442683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:42.480248 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] HTTP exception thrown: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Request method failure captured: Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c HTTP/1.1 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTL7BrryFBAcq2NzfkBY2qp4DXtR1Gsi_n9CusunNwYqWjJTKH06awM9sDlvYNMKZBm4RS0xiG7kauyEAt3aMcwRHnvIbS-TlNZ9iFUnXQBcwkaxAx-hCuD-iMf1bDCk2QQ93vz8i03ORicFARJ-BJx2_3V8OH3pD-dLDCi8ZzhDxw Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_01a99f350ace40128f4d41b8ad13205a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/01a99f350ace40128f4d41b8ad13205a"}]}] Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 01a99f350ace40128f4d41b8ad13205a Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: cffcef8907df4283ac3109e9235d31e8 Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f1d0f79f-17dd-4cfb-b620-8478a592169c'} Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. Jul 28 11:37:42.484234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] Returning 404 to user: Instance f1d0f79f-17dd-4cfb-b620-8478a592169c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:42.488801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8a1ab3fb-8376-4424-80e7-e793ce816195 tempest-FloatingIPsAssociationNegativeTestJSON-376033120 tempest-FloatingIPsAssociationNegativeTestJSON-376033120-project] 10.222.0.93 "GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c" status: 404 len: 111 microversion: 2.1 time: 0.062012 Jul 28 11:37:42.490371 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1554/3036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:42 2022] GET /compute/v2.1/servers/f1d0f79f-17dd-4cfb-b620-8478a592169c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:37:43.140712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:43.151793 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e447c4c-a1fa-4f39-8b40-1f13b0cef068 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.980877 Jul 28 11:37:43.167249 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1483/3037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:42 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:44.176663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:44.177296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:44.190429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:44.191171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:44.199961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:44.200620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:44.666489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:44.677958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89f952ae-14e8-412e-8b4f-856cb817a3df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.505563 Jul 28 11:37:44.692828 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1555/3038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:44 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:45.433674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:45.436481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:45.454413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.454934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.458464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.459033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.504578 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48118849-0916-4bf1-979f-e7b82b15c364 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076386 Jul 28 11:37:45.510940 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1484/3039] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:37:45 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:37:45.612343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:45.617253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:45.633714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.634469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.635784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.636413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.690321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e380009d-aa83-47c4-abd2-ac81435a7a85 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078841 Jul 28 11:37:45.699811 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1556/3040] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:37:45 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:37:45.705287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:45.708501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:45.721875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.722390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.723330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.723779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.858456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:45.859223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:45.867453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.868100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.869261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:45.869888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:45.901016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:37:46.004387 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4be838e8-f846-433f-9333-bde666413a4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 204 len: 0 microversion: 2.1 time: 0.148192 Jul 28 11:37:46.005909 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1557/3041] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:37:45 2022] DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:37:46.019404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:46.020422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:46.031493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:46.043487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:46.049428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:46.050639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:46.136033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:46.145360 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a46ec89b-daed-41db-8c65-55a4fb8ea372 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.445074 Jul 28 11:37:46.162245 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1485/3042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:45 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:46.478225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:46.486184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8330cfa-66ce-49dd-9c3f-17bc231a9bed tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1682 microversion: 2.1 time: 0.474647 Jul 28 11:37:46.493119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1558/3043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:46 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1682 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:47.171199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:47.172627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:47.188499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:47.190554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:47.191530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:47.192437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:47.510738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:47.512316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:47.530506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:47.532643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:47.536914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:47.537541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:48.090341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:48.097360 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e30e805-2541-4fb4-b2cc-bc06e1c515e4 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1682 microversion: 2.1 time: 0.591415 Jul 28 11:37:48.111765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1559/3044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:47 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1682 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:37:48.257522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:48.271380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0de90566-b5bb-4d44-bfab-236348be78ed tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 1.104129 Jul 28 11:37:48.283101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1486/3045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:47 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:48.401363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: .version_select at 0x7f2ebbe320d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-528491140", "policies": ["affinity"]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:48.449605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.455729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:48.551943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.559362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:48.587388 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f727aaa-a6f9-446f-a029-633a9bc43820 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.472493 Jul 28 11:37:48.595064 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1560/3046] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Jul 28 11:37:48 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:48.599224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: .version_select at 0x7f2eb34ce9d0>, body: {"server_group": {"name": "tempest-server-group-660408002", "policies": ["affinity"]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:48.654761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.660777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:48.737032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.747367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:48.764860 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c4edc00-768a-438c-9cb7-9188584e2066 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.169274 Jul 28 11:37:48.765781 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1487/3047] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:37:48 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:48.781172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: .version_select at 0x7f2ebbebbdc0>, body: {"server_group": {"name": "tempest-server-group-660408002", "policies": ["affinity"]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:48.806889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.818886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:48.971126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:48.984710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:49.025729 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1ca1092-88ec-4d1f-b860-5a17f5698df9 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.250220 Jul 28 11:37:49.026479 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1561/3048] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:37:48 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:49.038333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8917c854-db09-4cbe-9d4a-99b949b3fa47 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.122577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.122906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8917c854-db09-4cbe-9d4a-99b949b3fa47 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/464ea612-d6b0-411d-b7f4-035264a5cabe" status: 204 len: 0 microversion: 2.1 time: 0.088862 Jul 28 11:37:49.123383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:49.127757 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1488/3049] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:37:49 2022] DELETE /compute/v2.1/os-server-groups/464ea612-d6b0-411d-b7f4-035264a5cabe => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:49.133628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-976adcd7-5860-4e36-9b21-d743ec13e603 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.139529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:49.141840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:49.146953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:49.150444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:49.169519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:49.178027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:49.182594 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-976adcd7-5860-4e36-9b21-d743ec13e603 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.053408 Jul 28 11:37:49.194712 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1489/3050] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:37:49 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:49.208988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9a259b6-2dbf-4ba6-82f3-3049f77a934b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.275041 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9a259b6-2dbf-4ba6-82f3-3049f77a934b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/f0d7c06a-4d22-4a1f-a17e-0a4981210e40" status: 204 len: 0 microversion: 2.1 time: 0.078792 Jul 28 11:37:49.285851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1490/3051] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:37:49 2022] DELETE /compute/v2.1/os-server-groups/f0d7c06a-4d22-4a1f-a17e-0a4981210e40 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:49.300269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6ac094b0-270f-49e2-9680-15a8ca522777 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.329399 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6ac094b0-270f-49e2-9680-15a8ca522777 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.033463 Jul 28 11:37:49.330471 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1491/3052] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:37:49 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:49.345224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:49.351644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:49.364179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:49.364642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:49.365440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:49.365910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:49.844417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:49.847898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:49.858383 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94838311-c365-4060-9c2a-1e01eb80163a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.517145 Jul 28 11:37:49.863669 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4af521b4-4669-4e76-8f22-f7597fa0d2d1 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1682 microversion: 2.1 time: 0.743259 Jul 28 11:37:49.864775 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1492/3053] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:49 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:49.869697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: .version_select at 0x7f2eb2c08f70>, body: {"server_group": {"name": "tempest-server-group-103167056", "policies": ["affinity"]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:49.881329 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1562/3054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:49 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1682 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:49.914734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:49.928355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:50.037538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:50.051711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:50.070355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9bd5a20f-7695-4b82-a56f-47da3b9ddd18 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.204336 Jul 28 11:37:50.075727 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1493/3055] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:37:49 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:50.082372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dfb58c1e-928f-4a2f-9201-f8cb14d3f441 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:50.135123 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dfb58c1e-928f-4a2f-9201-f8cb14d3f441 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/efd5a2bd-aa42-41c1-bc6b-87957f6161d0" status: 204 len: 0 microversion: 2.1 time: 0.057494 Jul 28 11:37:50.135622 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1563/3056] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:37:50 2022] DELETE /compute/v2.1/os-server-groups/efd5a2bd-aa42-41c1-bc6b-87957f6161d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:50.144484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a229055f-a73e-41b7-95c0-791cae9c4b21 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:50.158785 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a229055f-a73e-41b7-95c0-791cae9c4b21 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018041 Jul 28 11:37:50.166191 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1494/3057] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:37:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:50.178059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: .version_select at 0x7f2ebbe11af0>, body: {"server_group": {"name": "tempest-server-group-201762026", "policies": ["anti-affinity"]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:50.193585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:50.208543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:50.217094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:50.274510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:50.280890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:50.299864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-272ee832-19d6-4d73-9fb1-19925fd191ee tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.125909 Jul 28 11:37:50.301052 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1564/3058] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:37:50 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:37:50.311717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-463277df-056c-4dad-acfa-b36d4112729a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:50.360203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-463277df-056c-4dad-acfa-b36d4112729a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/be812d16-bb1e-4a18-bd8c-45d9115a1a5b" status: 204 len: 0 microversion: 2.1 time: 0.052834 Jul 28 11:37:50.363987 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1495/3059] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:37:50 2022] DELETE /compute/v2.1/os-server-groups/be812d16-bb1e-4a18-bd8c-45d9115a1a5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:37:50.369171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-01babd39-4fde-4cd4-925e-4a96d5f831fb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:50.385441 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-01babd39-4fde-4cd4-925e-4a96d5f831fb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020010 Jul 28 11:37:50.402661 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1565/3060] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:37:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:50.622378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-158971466", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "92b8ab66-32fa-4dea-b39d-ee422bda5f8d"}]}, "os:scheduler_hints": {"group": "825d348b-ddb7-4288-afd8-0f5b4600f7e0"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:50.723958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] validate_networks() for [('92b8ab66-32fa-4dea-b39d-ee422bda5f8d', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:37:50.891637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:50.892262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:50.903296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:50.904019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:50.905365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:50.905816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:51.225041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591073a571ce4620ab3f396f4f88863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cae4c754ad49b1888ca5de3da0f4af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:51.263262 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa637b84-10e1-4eb8-9b42-0bd674275d47 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 200 len: 1614 microversion: 2.1 time: 0.379192 Jul 28 11:37:51.266519 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1566/3061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:50 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 1614 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:51.283215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:51.283834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:51.315162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:51.315561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:51.316348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:51.327672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:51.771375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:51.783634 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05626903-d0f4-4715-aec9-3fcb2d841a9b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.508246 Jul 28 11:37:51.784280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1567/3062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:51 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:51.793321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5fa68fa6-7107-403d-99b1-2de0ac14593f req-137b617b-758a-495b-9e65-c4e983ad8dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93ec7e-49f0-4717-912c-6571fcdb1fa8", "name": "network-vif-deleted", "tag": "aae72f29-b7b2-4870-aff4-96cd2a61de84"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:51.822856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5fa68fa6-7107-403d-99b1-2de0ac14593f req-137b617b-758a-495b-9e65-c4e983ad8dbe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:51.824438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5fa68fa6-7107-403d-99b1-2de0ac14593f req-137b617b-758a-495b-9e65-c4e983ad8dbe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:51.855344 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5fa68fa6-7107-403d-99b1-2de0ac14593f req-137b617b-758a-495b-9e65-c4e983ad8dbe service nova] Creating event network-vif-deleted:aae72f29-b7b2-4870-aff4-96cd2a61de84 for instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 on n-h2-851368-1 Jul 28 11:37:51.861497 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5fa68fa6-7107-403d-99b1-2de0ac14593f req-137b617b-758a-495b-9e65-c4e983ad8dbe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074104 Jul 28 11:37:51.862614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1568/3063] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:52.119110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:37:52.120369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:37:52.121194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:37:52.121878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:37:52.122542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:37:52.161545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.162338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:52.163945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.164639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:52.189833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:52.202872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:52.221652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:37:52.226122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:37:52.292726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:52.293425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:52.305358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.305810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:52.310184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.310640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:52.314922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:52.330139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:52.346238 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] HTTP exception thrown: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Request method failure captured: Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 HTTP/1.1 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nR9dK04UFW0rRSoPWcOyHwj4GlzknX3H6NiVksaegLHd8qZTBOUpLWUIEOIdDNEPhjqNq87eS8PtJ3FNh77DSm0f0SG9KNa5hNSKJGH7Fl0Gd_XVTcQvRyxsWNeF_CPNuAjU28IUWlnVorodiUWEVtfy5O6wAen_zRUyT3djyujeNU Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}] Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 591073a571ce4620ab3f396f4f88863e Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ea93ec7e-49f0-4717-912c-6571fcdb1fa8'} Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:37:52.349408 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:37:52.354405 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:37:52.357939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Returning 404 to user: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:37:52.361169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca69ae6f-8c31-4bdf-8e81-47c5888b7378 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 404 len: 111 microversion: 2.1 time: 0.074117 Jul 28 11:37:52.362974 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1569/3064] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:52 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:37:52.382150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37228e7f-1ba6-415e-9f77-ca9b1f3cfc4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '.version_select at 0x7f2ebbe36160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:52.420560 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37228e7f-1ba6-415e-9f77-ca9b1f3cfc4e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107171982" status: 202 len: 0 microversion: 2.1 time: 0.050041 Jul 28 11:37:52.424476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for project 1310834be8974de8b79c96b2937b8671. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:52.424679 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1570/3065] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107171982 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:37:52.436896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Getting quotas for user d989b25a604d4e689535d4447110c8e4 and project 1310834be8974de8b79c96b2937b8671. Resources: {'server_group_members'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:52.487142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97386ac9-6fde-4af3-82d2-f612008527af tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868642 Jul 28 11:37:52.488440 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1496/3066] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:37:52.505067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4774fa4a-88b1-49cb-bb93-9d49c5d9ce46 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:52.505833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4774fa4a-88b1-49cb-bb93-9d49c5d9ce46 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:52.659597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4774fa4a-88b1-49cb-bb93-9d49c5d9ce46 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:52.675660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4774fa4a-88b1-49cb-bb93-9d49c5d9ce46 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1212 microversion: 2.1 time: 0.174389 Jul 28 11:37:52.682189 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1571/3067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:52 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:52.805783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:52.806622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:52.816221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.824537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:52.825631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:52.830248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:53.380890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:53.391814 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a57f563-1038-4ad6-8efa-73e2594de714 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.589919 Jul 28 11:37:53.406960 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1497/3068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:52 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:53.702256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:53.702872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:53.717105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:53.717560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:53.718348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:53.718789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:53.988693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:53.998596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56b99404-d691-4b0a-97df-731251d8d4c3 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1208 microversion: 2.1 time: 0.300068 Jul 28 11:37:54.007536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1572/3069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:53 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1208 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:54.414751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:54.415530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:54.437596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:54.438051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:54.438836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:54.439306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:55.028735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:55.029536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:55.033638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:55.045432 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-415386ad-12be-4705-9587-f55128189b42 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.635165 Jul 28 11:37:55.048332 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1498/3070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:54 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:55.048695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:55.049151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:55.052357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:55.052907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:55.556274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:55.571623 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-641a8502-e53f-43e6-afbe-234787d108b2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1270 microversion: 2.1 time: 0.544059 Jul 28 11:37:55.572707 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1573/3071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:55 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1270 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:56.073936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:56.075691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:56.091131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:56.094297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:56.095448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:56.096399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:56.595513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:56.596074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:56.611087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:56.611555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:56.618793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:56.619396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:57.331986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:57.347972 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65ac8348-f45f-417a-80e6-ab66a5a88097 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 1.279922 Jul 28 11:37:57.370326 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1499/3072] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:56 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:57.381669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa76de16-ed5b-473e-82ad-1d133c4e7343 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbee4940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:57.457377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa76de16-ed5b-473e-82ad-1d133c4e7343 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5" status: 200 len: 635 microversion: 2.1 time: 0.084960 Jul 28 11:37:57.468565 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1500/3073] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:37:57 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5 => generated 635 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:57.478576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:57.483155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71987c9e-6314-43c5-afbb-7088423061de tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2f01670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:57.491857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb8a6362-3c26-4041-a284-ac8afd19d8a2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.902248 Jul 28 11:37:57.493714 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1574/3074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:56 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:57.567336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:37:57.590593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-71987c9e-6314-43c5-afbb-7088423061de tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:57.608075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-71987c9e-6314-43c5-afbb-7088423061de tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:58.185514 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71987c9e-6314-43c5-afbb-7088423061de tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.707902 Jul 28 11:37:58.200054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1501/3075] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:37:57 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:37:58.205558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c0e1499-ae83-4a81-8f37-c9cb9a7d8e18 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbded0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:58.380648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:58.381318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:58.403579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:58.404054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:58.411571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:58.412148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:58.656655 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c0e1499-ae83-4a81-8f37-c9cb9a7d8e18 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "DELETE /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.455055 Jul 28 11:37:58.657551 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1575/3076] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Jul 28 11:37:58 2022] DELETE /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_version => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:37:58.665576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:58.666198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:37:58.682952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:58.683870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:58.684670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:58.685114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:59.213278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:59.222841 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aff32f7b-b72d-41bf-9398-d3356207e7ae tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.849320 Jul 28 11:37:59.235113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1502/3077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:58 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:59.248998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e75bbd81-798c-4bce-b9aa-43d68e983466 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2eb30218b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:37:59.309741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:37:59.329295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c449ebb5-a9e7-4957-82b3-c827dcf20d1c tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.668911 Jul 28 11:37:59.329929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1576/3078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:37:58 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:37:59.352583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-923882fd-2d48-42a9-83f9-1d1d8100a47d req-6a5c3e76-2b36-442c-a4a6-da20c70cc2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b541d9-6153-4903-9e34-c450b547fcec", "tag": "5bb739cf-b608-44c3-9126-f53a76756b6a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:59.357421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e75bbd81-798c-4bce-b9aa-43d68e983466 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 37 microversion: 2.1 time: 0.132851 Jul 28 11:37:59.358012 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1503/3079] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:37:59 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 37 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:37:59.374810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36873357-34ea-47f0-80b0-7796f47f6a2e tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2eb351de50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:37:59.379697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-923882fd-2d48-42a9-83f9-1d1d8100a47d req-6a5c3e76-2b36-442c-a4a6-da20c70cc2a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:37:59.380143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-923882fd-2d48-42a9-83f9-1d1d8100a47d req-6a5c3e76-2b36-442c-a4a6-da20c70cc2a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:37:59.420843 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-923882fd-2d48-42a9-83f9-1d1d8100a47d req-6a5c3e76-2b36-442c-a4a6-da20c70cc2a7 service nova] Creating event network-changed:5bb739cf-b608-44c3-9126-f53a76756b6a for instance 33b541d9-6153-4903-9e34-c450b547fcec on n-h2-851368-1 Jul 28 11:37:59.437558 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-923882fd-2d48-42a9-83f9-1d1d8100a47d req-6a5c3e76-2b36-442c-a4a6-da20c70cc2a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106441 Jul 28 11:37:59.456759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1577/3080] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:37:59.467798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-36873357-34ea-47f0-80b0-7796f47f6a2e tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:37:59.477985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-36873357-34ea-47f0-80b0-7796f47f6a2e tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:37:59.996476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36873357-34ea-47f0-80b0-7796f47f6a2e tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.625723 Jul 28 11:37:59.997089 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1504/3081] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:37:59 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:00.008164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f9bb125-0aac-4906-a8f6-6c9a7026c4f9 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2eb347fb80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:00.068603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f9bb125-0aac-4906-a8f6-6c9a7026c4f9 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.061468 Jul 28 11:38:00.073032 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1505/3082] 10.222.0.93 () {58 vars in 1290 bytes} [Thu Jul 28 11:38:00 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:38:00.098123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f004bad-609a-4010-a75a-869df468de27 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2f019d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:00.195786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8f004bad-609a-4010-a75a-869df468de27 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:00.209003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8f004bad-609a-4010-a75a-869df468de27 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:00.389748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:00.391107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:00.408529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.416267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:00.417935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.418550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:00.449647 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f004bad-609a-4010-a75a-869df468de27 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.369557 Jul 28 11:38:00.450939 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1506/3083] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:00 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:00.455759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:00.456471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:00.472792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.473979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:00.476294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.477136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:00.547723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:00.847417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:00.855476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:38:00.857302 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7930c0b2-ab82-4c33-b29f-d836bbb53c25 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.404962 Jul 28 11:38:00.858019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1507/3084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:00 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:00.862958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:00.863880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:00.871322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.872057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:00.873450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:00.874100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:01.197361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28a14daf-9ea9-4d07-b526-a27336f4210a tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 204 len: 0 microversion: 2.42 time: 1.225435 Jul 28 11:38:01.202297 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1578/3085] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:37:59 2022] DELETE /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 0 bytes in 1227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:38:01.212816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:01.215588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3f4c142-f2e1-44a3-a792-b2db72744a37 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbe1ba60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:01.228321 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae119b08-b059-4377-9319-74e180e91945 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.368837 Jul 28 11:38:01.228961 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1508/3086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:00 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:01.243223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:01.244158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:01.258522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:01.262256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:01.263140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:01.263593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:01.281477 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3f4c142-f2e1-44a3-a792-b2db72744a37 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.077548 Jul 28 11:38:01.292384 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1579/3087] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:38:01 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:01.312018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e96d1c2-f091-455e-bd76-87797055a997 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2ebbded9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:01.393739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3e96d1c2-f091-455e-bd76-87797055a997 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:01.408037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3e96d1c2-f091-455e-bd76-87797055a997 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:01.600188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:01.621217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:01.623197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:01.625083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4da802a7-976f-47dd-aedd-d0ee817ccc3d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2956 microversion: 2.42 time: 0.394976 Jul 28 11:38:01.651717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1509/3088] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:01 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2956 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:01.666175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e96d1c2-f091-455e-bd76-87797055a997 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.366901 Jul 28 11:38:01.666695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1580/3089] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:01 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:01.690344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3819c8e6-4e03-409b-828c-453a6f1495f2 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2f8b040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:01.804014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3819c8e6-4e03-409b-828c-453a6f1495f2 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:01.823785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3819c8e6-4e03-409b-828c-453a6f1495f2 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:01.895484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:01.898275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:01.918951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:01.921340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:01.924661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:01.928865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:02.179233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:02.302752 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3819c8e6-4e03-409b-828c-453a6f1495f2 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.628598 Jul 28 11:38:02.304125 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1510/3090] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:01 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 64 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:02.309760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:02.311123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:02.317874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:02.318725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:02.320040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:02.320949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:02.355835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:02.366317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-720f8d7f-86ea-4877-b265-447187d69135 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.487153 Jul 28 11:38:02.387686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1581/3091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:01 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:02.399387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eee06ded-8340-44d9-bd3d-42571e7bc99b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbded670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:02.473970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eee06ded-8340-44d9-bd3d-42571e7bc99b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 64 microversion: 2.1 time: 0.084640 Jul 28 11:38:02.481166 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1582/3092] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:38:02 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 64 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:02.563333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1919558404", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "754571b0-d8bd-4643-80c3-420b55aef962"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:02.622728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:02.631777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9415bb0f-81d3-4a45-a9f1-073b74b3753e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.326335 Jul 28 11:38:02.635923 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1511/3093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:02 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:02.640575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] validate_networks() for [('754571b0-d8bd-4643-80c3-420b55aef962', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:38:02.651016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:02.651771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:02.660649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:02.661376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:02.672233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:02.672937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:02.694661 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] HTTP exception thrown: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Request method failure captured: Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 HTTP/1.1 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nR9dK04UFW0rRSoPWcOyHwj4GlzknX3H6NiVksaegLHd8qZTBOUpLWUIEOIdDNEPhjqNq87eS8PtJ3FNh77DSm0f0SG9KNa5hNSKJGH7Fl0Gd_XVTcQvRyxsWNeF_CPNuAjU28IUWlnVorodiUWEVtfy5O6wAen_zRUyT3djyujeNU Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}] Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 591073a571ce4620ab3f396f4f88863e Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'ea93ec7e-49f0-4717-912c-6571fcdb1fa8'} Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:02.708668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:02.714226 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:02.715808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Returning 404 to user: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:02.717217 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2da12a4a-037e-4bc2-af5c-651b6d54db72 tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 404 len: 111 microversion: 2.1 time: 0.078143 Jul 28 11:38:02.717983 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1512/3094] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:38:02 2022] DELETE /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:02.726342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-838b6071-4427-4192-89b3-1eb30538f8da tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2f01670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:02.860245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-838b6071-4427-4192-89b3-1eb30538f8da tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:02.888861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-838b6071-4427-4192-89b3-1eb30538f8da tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:03.455471 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-838b6071-4427-4192-89b3-1eb30538f8da tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.733466 Jul 28 11:38:03.456710 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1513/3095] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:02 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:03.475111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:03.475943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:03.487208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:38:03.487745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:38:03.488090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:38:03.488506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:38:03.488914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:38:03.500163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.500600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.501585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.502434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.522900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Getting quotas for project 540068d9769a45faa2eb822c0466a931. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:03.523144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.529179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Getting quotas for user 164ab6e24d1b4d19a1028b2bc0741151 and project 540068d9769a45faa2eb822c0466a931. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:03.529612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.531019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.531848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.547033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:38:03.549764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:38:03.605777 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-87c27e4a-14f7-46e5-b0a3-d4c51b2de761 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.123388 Jul 28 11:38:03.606949 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1583/3096] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:38:03.619474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:03.620480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] [instance: ea93ec7e-49f0-4717-912c-6571fcdb1fa8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:03.630765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.631770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.632848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.633531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.666010 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] HTTP exception thrown: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Request method failure captured: Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 HTTP/1.1 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nR9dK04UFW0rRSoPWcOyHwj4GlzknX3H6NiVksaegLHd8qZTBOUpLWUIEOIdDNEPhjqNq87eS8PtJ3FNh77DSm0f0SG9KNa5hNSKJGH7Fl0Gd_XVTcQvRyxsWNeF_CPNuAjU28IUWlnVorodiUWEVtfy5O6wAen_zRUyT3djyujeNU Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_73cae4c754ad49b1888ca5de3da0f4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73cae4c754ad49b1888ca5de3da0f4af"}]}] Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 73cae4c754ad49b1888ca5de3da0f4af Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2080454135 Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 591073a571ce4620ab3f396f4f88863e Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2080454135-project Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ea93ec7e-49f0-4717-912c-6571fcdb1fa8'} Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:03.671305 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] Returning 404 to user: Instance ea93ec7e-49f0-4717-912c-6571fcdb1fa8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:03.675944 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b84139cc-8378-4db0-9884-b4ce0c7df70e tempest-AttachSCSIVolumeTestJSON-2080454135 tempest-AttachSCSIVolumeTestJSON-2080454135-project] 10.222.0.93 "GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8" status: 404 len: 111 microversion: 2.1 time: 0.066023 Jul 28 11:38:03.680941 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1584/3097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:03 2022] GET /compute/v2.1/servers/ea93ec7e-49f0-4717-912c-6571fcdb1fa8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:03.712504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:03.713160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:03.731907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.735933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:03.737089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:03.739198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:04.002884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.014752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.021319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.030120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92d745fe-65d9-4a24-a3e5-80cea2bebb57 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2956 microversion: 2.42 time: 0.571351 Jul 28 11:38:04.033055 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1514/3098] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:03 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2956 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:04.048542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-66cceed5-4748-435f-a1de-ad2966a1f2c4 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update', calling method: .version_select at 0x7f2eb344f550>, body: {"meta": {"os_version": "alt"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:04.081663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.094144 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-18ce5a79-e4d7-45de-8be6-1df368ce7d68 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.405316 Jul 28 11:38:04.095432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1585/3099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:03 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:04.108340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:04.111152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:04.149629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-66cceed5-4748-435f-a1de-ad2966a1f2c4 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:04.159914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-66cceed5-4748-435f-a1de-ad2966a1f2c4 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:04.227041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.247595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.250638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.252057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab4e7b00-2f6a-4562-9804-b6af422b804c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1259 microversion: 2.21 time: 0.153805 Jul 28 11:38:04.253517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1586/3100] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:04 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:04.274172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:04.275051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:04.299353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:04.299776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:04.301864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:04.304161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:04.635517 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-66cceed5-4748-435f-a1de-ad2966a1f2c4 tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.599623 Jul 28 11:38:04.640543 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1515/3101] 10.222.0.93 () {60 vars in 1313 bytes} [Thu Jul 28 11:38:04 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata/os_version => generated 31 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:04.653878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a0a0d63-5438-40f9-9a5f-2715595d9e7b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbea2280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:04.685099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:04.702589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c65b54d5-dd58-4956-aa5b-6035f53ef475 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.446604 Jul 28 11:38:04.709582 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a0a0d63-5438-40f9-9a5f-2715595d9e7b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 58 microversion: 2.1 time: 0.063340 Jul 28 11:38:04.710425 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1516/3102] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:38:04 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 58 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:38:04.711950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1587/3103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:04 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:04.726908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2a018f9-18ca-413f-a40c-2a5c780525ff tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'update_all', calling method: .version_select at 0x7f2ebbead3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:04.813948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b2a018f9-18ca-413f-a40c-2a5c780525ff tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:04.828492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b2a018f9-18ca-413f-a40c-2a5c780525ff tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:05.061472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:05.062390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:05.074976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.079240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.080300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.085240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.359964 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2a018f9-18ca-413f-a40c-2a5c780525ff tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 61 microversion: 2.1 time: 0.640248 Jul 28 11:38:05.364838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1517/3104] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:04 2022] PUT /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 61 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:38:05.367379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:05.368012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:05.377775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.378625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.379740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.380652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.689548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.697548 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-923bc715-1228-4da5-961b-42934c9dc8c6 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.335569 Jul 28 11:38:05.698396 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1518/3105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:05 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:05.714916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:05.715597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:05.727580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.728038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.729026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.729632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:05.730300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.767559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.770938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.774290 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a03b8c4d-4267-434d-aa83-2b23e9158d85 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2956 microversion: 2.42 time: 0.717080 Jul 28 11:38:05.776242 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1588/3106] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:05 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2956 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:05.799277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-121e5408-dbff-4467-8a0c-61ec1b0bfb1b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Action: 'create', calling method: .version_select at 0x7f2ebbf3e160>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:05.876676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-121e5408-dbff-4467-8a0c-61ec1b0bfb1b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:05.879175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:05.886689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-121e5408-dbff-4467-8a0c-61ec1b0bfb1b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Getting quotas for user f9fbd11ce45f4e2e9a5b1c09fbb32016 and project c5e12a028ba94ed184090a494ff0cfc0. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:05.905111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.924977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.926652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:05.927957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afee63cd-9ea4-458b-baca-60f9186242ee tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1317 microversion: 2.21 time: 0.228511 Jul 28 11:38:05.928653 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1519/3107] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:05 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:05.946498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6d567eac-a319-43ae-882f-5808cdaed4b5 req-7ae6bc19-46b1-4033-b57c-1a17267b6eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b541d9-6153-4903-9e34-c450b547fcec", "name": "network-vif-plugged", "status": "completed", "tag": "5bb739cf-b608-44c3-9126-f53a76756b6a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:05.993356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6d567eac-a319-43ae-882f-5808cdaed4b5 req-7ae6bc19-46b1-4033-b57c-1a17267b6eed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:05.997055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6d567eac-a319-43ae-882f-5808cdaed4b5 req-7ae6bc19-46b1-4033-b57c-1a17267b6eed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.022463 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6d567eac-a319-43ae-882f-5808cdaed4b5 req-7ae6bc19-46b1-4033-b57c-1a17267b6eed service nova] Creating event network-vif-plugged:5bb739cf-b608-44c3-9126-f53a76756b6a for instance 33b541d9-6153-4903-9e34-c450b547fcec on n-h2-851368-1 Jul 28 11:38:06.033197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6d567eac-a319-43ae-882f-5808cdaed4b5 req-7ae6bc19-46b1-4033-b57c-1a17267b6eed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099468 Jul 28 11:38:06.033840 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1520/3108] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:06.041519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:06.044561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:06.062710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.063199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.064128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.064568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.491361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-121e5408-dbff-4467-8a0c-61ec1b0bfb1b tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "POST /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.712893 Jul 28 11:38:06.492012 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1589/3109] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Jul 28 11:38:05 2022] POST /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 85 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:38:06.502658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cacc9d68-aad0-4a07-bab1-93ce67c2affd tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] Calling method '.version_select at 0x7f2ebbe9a8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:06.531246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:06.544331 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3407d199-0e1f-4496-a2a9-f0d4df4c0b1b tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1312 microversion: 2.1 time: 0.509088 Jul 28 11:38:06.559361 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1521/3110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:06 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:06.578859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cacc9d68-aad0-4a07-bab1-93ce67c2affd tempest-ImagesMetadataTestJSON-1534127868 tempest-ImagesMetadataTestJSON-1534127868-project] 10.222.0.93 "GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080645 Jul 28 11:38:06.580042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1590/3111] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 11:38:06 2022] GET /compute/v2.1/images/a17f5014-38c2-4b60-97e2-5f68ff41b1a5/metadata => generated 85 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:38:06.719637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:06.720517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:06.732881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.733626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.734580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.735583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.814331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:06.814331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:06.852888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.854054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:06.856555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:06.861461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.197977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.208677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef85e9f6-42ad-4c4f-a5fc-96e863361e5e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 1.493085 Jul 28 11:38:08.211682 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1522/3112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:06 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:08.229080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:08.230155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:08.248306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:08.249172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.251907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:08.253453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.678034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.702256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.718711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.724875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-774c59a0-89c0-49dd-b4c6-b5fbed5d2045 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 0.511162 Jul 28 11:38:08.725739 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1523/3113] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:08 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:08.735226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:08.736399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:08.758207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.760187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:08.763498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.765046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:08.765685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.773085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.776400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:08.778908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7de8f6d-899f-44e7-8866-131977de1420 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2956 microversion: 2.42 time: 1.981375 Jul 28 11:38:08.796952 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1591/3114] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:06 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2956 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:08.810531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a6657cb7-99b4-4f1b-b0d2-9fa7691b217b req-b50eef07-1fe0-47ed-b35e-3e77874cfff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-unplugged", "status": "completed", "tag": "c1fba3ac-4c0c-450f-ae53-952d5aa51f4e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:08.827655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a6657cb7-99b4-4f1b-b0d2-9fa7691b217b req-b50eef07-1fe0-47ed-b35e-3e77874cfff6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:08.828471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a6657cb7-99b4-4f1b-b0d2-9fa7691b217b req-b50eef07-1fe0-47ed-b35e-3e77874cfff6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:08.845121 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a6657cb7-99b4-4f1b-b0d2-9fa7691b217b req-b50eef07-1fe0-47ed-b35e-3e77874cfff6 service nova] Creating event network-vif-unplugged:c1fba3ac-4c0c-450f-ae53-952d5aa51f4e for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:08.852811 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a6657cb7-99b4-4f1b-b0d2-9fa7691b217b req-b50eef07-1fe0-47ed-b35e-3e77874cfff6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054406 Jul 28 11:38:08.854035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1592/3115] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:09.209534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:09.229715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-392cad46-55e5-47f1-beca-e1fa78a5adea tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1497 microversion: 2.1 time: 0.500946 Jul 28 11:38:09.230320 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1524/3116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:08 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1497 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:09.248096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:09.248851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:09.269519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87d4511b-74ec-43c6-984e-7eee1aa3d4d6 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:09.270068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.270614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.272384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.273326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.285606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:09.307976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_groups [None req-87d4511b-74ec-43c6-984e-7eee1aa3d4d6 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Querying cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) for 1 instances {{(pid=119236) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 11:38:09.309428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87d4511b-74ec-43c6-984e-7eee1aa3d4d6 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.310272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87d4511b-74ec-43c6-984e-7eee1aa3d4d6 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.396832 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87d4511b-74ec-43c6-984e-7eee1aa3d4d6 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0" status: 200 len: 221 microversion: 2.1 time: 0.134288 Jul 28 11:38:09.398909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1525/3117] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:38:09 2022] GET /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0 => generated 221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:38:09.422542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:09.424505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:09.443049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.445481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.447945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.448722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.564452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:38:09.787819 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c84de935-dbe5-4812-a386-c9950601cf58 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 204 len: 0 microversion: 2.1 time: 0.374832 Jul 28 11:38:09.790642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1526/3118] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:38:09 2022] DELETE /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:38:09.807449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:09.811002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:09.832761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.834178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:09.837534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:09.838669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.118478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:10.129282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce77d7af-b7c6-4e6f-8a1a-aac53704ad51 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1515 microversion: 2.1 time: 0.883657 Jul 28 11:38:10.129282 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1593/3119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:09 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1515 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:10.140080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:10.141079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:10.155937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.157212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.158405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.158962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.546724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:10.567862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76bcf71a-01b5-4fe7-8f38-818e4f44e92e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.774677 Jul 28 11:38:10.569902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1527/3120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:09 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:10.600693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:10.601349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:10.614383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.614847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.616250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.616693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.749161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:10.762758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:10.770255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:10.781972 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8693d2e-c4cd-44e2-a38e-1103197a489e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 0.647734 Jul 28 11:38:10.784205 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1594/3121] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:10 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:10.820833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:10.824339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:10.837804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.842925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:10.848027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:10.853300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.101279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:11.105735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:11.118832 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c4a5e40-4285-492a-b3a2-f914d8bd71f2 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1503 microversion: 2.1 time: 0.529414 Jul 28 11:38:11.145091 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1528/3122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:10 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:11.158907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6b4a99b1-01ba-4dd1-9d54-ee6caf731fd1 req-77a073f9-45d6-481c-bd28-a3c615a3fbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-deleted", "tag": "76e66cec-d53f-4daf-a198-0b75991865a7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:11.184006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:11.186925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6b4a99b1-01ba-4dd1-9d54-ee6caf731fd1 req-77a073f9-45d6-481c-bd28-a3c615a3fbdd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.187419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6b4a99b1-01ba-4dd1-9d54-ee6caf731fd1 req-77a073f9-45d6-481c-bd28-a3c615a3fbdd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.219378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6b4a99b1-01ba-4dd1-9d54-ee6caf731fd1 req-77a073f9-45d6-481c-bd28-a3c615a3fbdd service nova] Creating event network-vif-deleted:76e66cec-d53f-4daf-a198-0b75991865a7 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:11.231805 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6b4a99b1-01ba-4dd1-9d54-ee6caf731fd1 req-77a073f9-45d6-481c-bd28-a3c615a3fbdd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082925 Jul 28 11:38:11.235174 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1529/3123] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:11.248658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:11.249443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:11.263605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.264065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.264849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.265288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.493331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:11.511814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:11.513817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:11.515359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6362154-019d-4340-a17c-bf7e58b3a74b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2868 microversion: 2.42 time: 0.729587 Jul 28 11:38:11.516155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1595/3124] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:10 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2868 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:11.531050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-unplugged", "status": "completed", "tag": "66490c9f-860d-4659-a0f8-fb12c956cbda"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-unplugged", "status": "completed", "tag": "76e66cec-d53f-4daf-a198-0b75991865a7"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-unplugged", "status": "completed", "tag": "af75dad6-3f30-441e-ad60-3c2fb5b737d9"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-unplugged", "status": "completed", "tag": "dbcb2a40-88e7-4d42-9494-b9bb721bdde3"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:11.542210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.542659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.556455 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Creating event network-vif-unplugged:66490c9f-860d-4659-a0f8-fb12c956cbda for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:11.557028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Creating event network-vif-unplugged:76e66cec-d53f-4daf-a198-0b75991865a7 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:11.557537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Creating event network-vif-unplugged:af75dad6-3f30-441e-ad60-3c2fb5b737d9 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:11.558088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] Creating event network-vif-unplugged:dbcb2a40-88e7-4d42-9494-b9bb721bdde3 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:11.565530 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3347ca5d-61d7-4905-ad37-9d1a2c8e0138 req-61d7b69d-4d71-439c-815a-1bbecc2a647e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.047965 Jul 28 11:38:11.566692 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1596/3125] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:11.573095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:11.574302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:11.582196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.582916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.584365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.589283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.923856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:11.942673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24599355-de33-461c-9c34-32e359e5102e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.706220 Jul 28 11:38:11.948709 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1530/3126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:11 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:11.977428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:11.983619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:11.997003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:11.997771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:11.999754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:12.001465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:12.174964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:12.188468 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e04c083-14a3-4e65-9161-85e0ab861448 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 0.620246 Jul 28 11:38:12.195681 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1597/3127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:11 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:12.213078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:12.227703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:12.246716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:12.248878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:12.250367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:12.251029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:13.155539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:13.167806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:13.169543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:13.170838 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1503a052-c9db-4ed4-bd15-83b406f5956b tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 1.219700 Jul 28 11:38:13.171896 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1531/3128] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:11 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:13.178350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:13.179273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:13.185720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:13.187592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:13.192682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:13.193913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:13.441044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:13.450256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0d0088d-d7ea-466b-b55b-28647ee5b22b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 1.253159 Jul 28 11:38:13.451438 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1598/3129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:12 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:13.458578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ff36ece4-4205-4a28-8e96-1ca29ea74cc6 req-7c1c9010-d734-4b2c-8e99-a0d4719c6ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b50771-15aa-4cbf-b2b4-d8dbd81a2339", "tag": "e0c8ef38-15d9-442d-90b0-03a2dcab7249"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:13.471685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ff36ece4-4205-4a28-8e96-1ca29ea74cc6 req-7c1c9010-d734-4b2c-8e99-a0d4719c6ccb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:13.472510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ff36ece4-4205-4a28-8e96-1ca29ea74cc6 req-7c1c9010-d734-4b2c-8e99-a0d4719c6ccb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:13.488122 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ff36ece4-4205-4a28-8e96-1ca29ea74cc6 req-7c1c9010-d734-4b2c-8e99-a0d4719c6ccb service nova] Creating event network-changed:e0c8ef38-15d9-442d-90b0-03a2dcab7249 for instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 on n-h2-851368-1 Jul 28 11:38:13.495768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ff36ece4-4205-4a28-8e96-1ca29ea74cc6 req-7c1c9010-d734-4b2c-8e99-a0d4719c6ccb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041976 Jul 28 11:38:13.499652 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1599/3130] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:13.505397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:13.506465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:13.525964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:13.528416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:13.529193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:13.530335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:13.530963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.251262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:14.266160 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6ef35f7-1f25-427d-9a37-d7035669f4b4 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1503 microversion: 2.1 time: 1.092954 Jul 28 11:38:14.269527 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1532/3131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:13 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1503 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:14.278338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:14.289575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:14.316445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.316904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.317744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.324671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.369263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:14.407265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:14.412826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:14.416789 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a0760d3-94b6-44a1-94b8-147a5f8c1859 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2662 microversion: 2.42 time: 0.915653 Jul 28 11:38:14.421309 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1600/3132] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:13 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2662 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:14.449365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cb4c1179-5fed-466f-a677-bf123b5b6f67 req-ded0612b-b72e-4815-8dfe-abc597d1cd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-deleted", "tag": "af75dad6-3f30-441e-ad60-3c2fb5b737d9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:14.472556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cb4c1179-5fed-466f-a677-bf123b5b6f67 req-ded0612b-b72e-4815-8dfe-abc597d1cd2d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.473041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cb4c1179-5fed-466f-a677-bf123b5b6f67 req-ded0612b-b72e-4815-8dfe-abc597d1cd2d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.516075 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cb4c1179-5fed-466f-a677-bf123b5b6f67 req-ded0612b-b72e-4815-8dfe-abc597d1cd2d service nova] Creating event network-vif-deleted:af75dad6-3f30-441e-ad60-3c2fb5b737d9 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:14.532959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cb4c1179-5fed-466f-a677-bf123b5b6f67 req-ded0612b-b72e-4815-8dfe-abc597d1cd2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109974 Jul 28 11:38:14.533866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1601/3133] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:14.539675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1586472817"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:14.542176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:14.554235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.567766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.569652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.570261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.853412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=58 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:14.888944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:14.902283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce8972b6-face-4c93-9a31-6727f383d001 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.365296 Jul 28 11:38:14.902995 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1602/3134] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:38:14 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 11:38:14.904840 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d690bbc-ad59-40ce-9466-35d037920efe tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 0.630303 Jul 28 11:38:14.905447 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1533/3135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:14 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:14.923151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e8a0b105-9777-49a5-875b-4117972b254e req-676685db-fab6-48be-8418-a94e003f0022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70dc22-0b38-4f37-919a-45cde364058a", "name": "network-vif-unplugged", "status": "completed", "tag": "f4abea6e-2221-447e-9aed-e0d91f746b17"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:14.934144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:14.934871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:14.946527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e8a0b105-9777-49a5-875b-4117972b254e req-676685db-fab6-48be-8418-a94e003f0022 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.954014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e8a0b105-9777-49a5-875b-4117972b254e req-676685db-fab6-48be-8418-a94e003f0022 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.960776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.967261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.968482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:14.969100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:14.984366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e8a0b105-9777-49a5-875b-4117972b254e req-676685db-fab6-48be-8418-a94e003f0022 service nova] Creating event network-vif-unplugged:f4abea6e-2221-447e-9aed-e0d91f746b17 for instance 3a70dc22-0b38-4f37-919a-45cde364058a on n-h1-851368-1 Jul 28 11:38:15.001283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e8a0b105-9777-49a5-875b-4117972b254e req-676685db-fab6-48be-8418-a94e003f0022 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094557 Jul 28 11:38:15.002406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1534/3136] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:15.291312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:15.292028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:15.301112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.301575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.302365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.302846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.316785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:15.336984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:15.343690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:15.345266 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c14de447-b608-41f0-a540-6af895e32574 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 0.429858 Jul 28 11:38:15.349376 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1603/3137] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:14 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:15.397396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.398139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.398966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lazy-loading 'fault' on Instance uuid 33b541d9-6153-4903-9e34-c450b547fcec {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:38:15.449923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:15.450628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:15.470611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.471685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.481186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.482045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.511535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd989b25a604d4e689535d4447110c8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310834be8974de8b79c96b2937b8671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:15.532140 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae6ef283-e7ae-4e87-877e-f0129d14055e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 200 len: 1302 microversion: 2.1 time: 0.245486 Jul 28 11:38:15.550062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1535/3138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:15 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 1302 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:15.641007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6bc3db91-af05-43b2-9c18-e01f1181389a req-f287c06d-e5ce-4ebd-befd-3d3ef06b659d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b541d9-6153-4903-9e34-c450b547fcec", "name": "network-vif-deleted", "tag": "5bb739cf-b608-44c3-9126-f53a76756b6a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:15.663412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6bc3db91-af05-43b2-9c18-e01f1181389a req-f287c06d-e5ce-4ebd-befd-3d3ef06b659d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.664130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6bc3db91-af05-43b2-9c18-e01f1181389a req-f287c06d-e5ce-4ebd-befd-3d3ef06b659d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.695638 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6bc3db91-af05-43b2-9c18-e01f1181389a req-f287c06d-e5ce-4ebd-befd-3d3ef06b659d service nova] Creating event network-vif-deleted:5bb739cf-b608-44c3-9126-f53a76756b6a for instance 33b541d9-6153-4903-9e34-c450b547fcec on n-h2-851368-1 Jul 28 11:38:15.706304 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6bc3db91-af05-43b2-9c18-e01f1181389a req-f287c06d-e5ce-4ebd-befd-3d3ef06b659d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068964 Jul 28 11:38:15.715862 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1536/3139] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:15.904282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=42 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:15.938714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:15.939692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:15.973549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.974019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:15.974875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:15.975357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.232011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:16.246642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:16.253885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:16.255460 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24ff30fa-996b-4668-99e8-d603bc362443 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2548 microversion: 2.42 time: 0.810534 Jul 28 11:38:16.273318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1604/3140] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:15 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2548 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:16.380954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:16.381586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:16.401909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.402371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.403571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.404021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.651998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:16.662587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b03a3f1f-f69e-4ff7-b028-4b185eb329ef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 0.733338 Jul 28 11:38:16.666873 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1537/3141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:15 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:16.692244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:16.697035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:16.711513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.713816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.717016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.721661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.762336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec HTTP/1.1 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '33b541d9-6153-4903-9e34-c450b547fcec'} Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:16.764355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:16.771029 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c89fb68-87c3-4a05-a7d1-5a08e79597bd tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 404 len: 111 microversion: 2.1 time: 0.082062 Jul 28 11:38:16.777832 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1538/3142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:16 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:16.784603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-deleted", "tag": "66490c9f-860d-4659-a0f8-fb12c956cbda"}, {"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-deleted", "tag": "dbcb2a40-88e7-4d42-9494-b9bb721bdde3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:16.798308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.800485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.828272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] Creating event network-vif-deleted:66490c9f-860d-4659-a0f8-fb12c956cbda for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:16.842456 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] Creating event network-vif-deleted:dbcb2a40-88e7-4d42-9494-b9bb721bdde3 for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:16.850044 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-670c3329-2266-4ae9-a0ac-e55e6f185b06 req-687f6fb8-e97e-45ff-a514-411f54a358c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068269 Jul 28 11:38:16.850933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1539/3143] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:16.858814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-701c7071-a5dd-494d-81ba-d03d50d1ce4e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:16.910865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_groups [None req-701c7071-a5dd-494d-81ba-d03d50d1ce4e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Querying cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) for 1 instances {{(pid=119236) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 11:38:16.912905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701c7071-a5dd-494d-81ba-d03d50d1ce4e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.913865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701c7071-a5dd-494d-81ba-d03d50d1ce4e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.928613 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-701c7071-a5dd-494d-81ba-d03d50d1ce4e tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.075029 Jul 28 11:38:16.929385 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1540/3144] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:38:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:16.945408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9534049-aba0-44c8-9036-ad6a1a83e7cb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:16.978490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_groups [None req-c9534049-aba0-44c8-9036-ad6a1a83e7cb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Querying cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) for 1 instances {{(pid=119236) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 11:38:16.979576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9534049-aba0-44c8-9036-ad6a1a83e7cb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:16.980196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9534049-aba0-44c8-9036-ad6a1a83e7cb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:16.993654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9534049-aba0-44c8-9036-ad6a1a83e7cb tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0" status: 200 len: 183 microversion: 2.1 time: 0.052373 Jul 28 11:38:17.001602 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1541/3145] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:38:16 2022] GET /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0 => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:17.009780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.010435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:17.016971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.017512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.018453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.018961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.035402 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec HTTP/1.1 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '33b541d9-6153-4903-9e34-c450b547fcec'} Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:17.037249 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.041782 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.043777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.044877 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c0e4b8f-aa16-425a-9275-688cbf2c3492 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 404 len: 111 microversion: 2.1 time: 0.042073 Jul 28 11:38:17.048859 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1542/3146] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.054009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.054730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] [instance: 33b541d9-6153-4903-9e34-c450b547fcec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:17.061639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.062171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.063062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.063795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.105531 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec HTTP/1.1 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '33b541d9-6153-4903-9e34-c450b547fcec'} Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.108982 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. Jul 28 11:38:17.112922 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.113701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance 33b541d9-6153-4903-9e34-c450b547fcec could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.116317 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7145d87f-f3b7-4941-835a-2670a1c99673 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec" status: 404 len: 111 microversion: 2.1 time: 0.065089 Jul 28 11:38:17.117109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1543/3147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:17 2022] GET /compute/v2.1/servers/33b541d9-6153-4903-9e34-c450b547fcec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.127126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-02be39df-328c-4d0f-bbac-ddd894ade34d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.147921 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-02be39df-328c-4d0f-bbac-ddd894ade34d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-02be39df-328c-4d0f-bbac-ddd894ade34d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-server-groups/be812d16-bb1e-4a18-bd8c-45d9115a1a5b HTTP/1.1 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'be812d16-bb1e-4a18-bd8c-45d9115a1a5b'} Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.156600 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-02be39df-328c-4d0f-bbac-ddd894ade34d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance group be812d16-bb1e-4a18-bd8c-45d9115a1a5b could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.160541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-02be39df-328c-4d0f-bbac-ddd894ade34d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/be812d16-bb1e-4a18-bd8c-45d9115a1a5b" status: 404 len: 117 microversion: 2.1 time: 0.036249 Jul 28 11:38:17.161568 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1544/3148] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/os-server-groups/be812d16-bb1e-4a18-bd8c-45d9115a1a5b => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.176332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1f40442-0f9b-48a7-9250-9ce59fd3669d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.196049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a1f40442-0f9b-48a7-9250-9ce59fd3669d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1f40442-0f9b-48a7-9250-9ce59fd3669d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-server-groups/efd5a2bd-aa42-41c1-bc6b-87957f6161d0 HTTP/1.1 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'efd5a2bd-aa42-41c1-bc6b-87957f6161d0'} Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.206407 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1f40442-0f9b-48a7-9250-9ce59fd3669d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance group efd5a2bd-aa42-41c1-bc6b-87957f6161d0 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1f40442-0f9b-48a7-9250-9ce59fd3669d tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/efd5a2bd-aa42-41c1-bc6b-87957f6161d0" status: 404 len: 117 microversion: 2.1 time: 0.041414 Jul 28 11:38:17.214540 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1545/3149] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/os-server-groups/efd5a2bd-aa42-41c1-bc6b-87957f6161d0 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.223298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f62edb9-571a-4c4c-92c7-4e190f111642 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.241699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0f62edb9-571a-4c4c-92c7-4e190f111642 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f62edb9-571a-4c4c-92c7-4e190f111642 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-server-groups/f0d7c06a-4d22-4a1f-a17e-0a4981210e40 HTTP/1.1 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f0d7c06a-4d22-4a1f-a17e-0a4981210e40'} Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.243308 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f62edb9-571a-4c4c-92c7-4e190f111642 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance group f0d7c06a-4d22-4a1f-a17e-0a4981210e40 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.247740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f62edb9-571a-4c4c-92c7-4e190f111642 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/f0d7c06a-4d22-4a1f-a17e-0a4981210e40" status: 404 len: 117 microversion: 2.1 time: 0.026180 Jul 28 11:38:17.252452 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1546/3150] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/os-server-groups/f0d7c06a-4d22-4a1f-a17e-0a4981210e40 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.257593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6e94aea-fc2d-4be4-bbe5-2cfa6d97a36a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.281304 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d6e94aea-fc2d-4be4-bbe5-2cfa6d97a36a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] HTTP exception thrown: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6e94aea-fc2d-4be4-bbe5-2cfa6d97a36a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Request method failure captured: Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-server-groups/464ea612-d6b0-411d-b7f4-035264a5cabe HTTP/1.1 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nULwIo4kBp2MoB6HyI0Lt7ZwkXSQlymOidL_Kot2xm2BHhHyoZRzUrhd31NBOp4RSXWnwxvWNX1MJ0alaQAl0PLmhdoy79gX3KutbyqX65QZGk0Iu5WCG92RzujUhrOtMux4_uML5YdM-Cf9Lt1oXAlzz2qDwKxuDX3PYgCpZ1hkWw Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1310834be8974de8b79c96b2937b8671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1310834be8974de8b79c96b2937b8671"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1310834be8974de8b79c96b2937b8671"}]}] Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1310834be8974de8b79c96b2937b8671 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroupTestJSON-1197064272 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d989b25a604d4e689535d4447110c8e4 Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroupTestJSON-1197064272-project Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '464ea612-d6b0-411d-b7f4-035264a5cabe'} Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.287980 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6e94aea-fc2d-4be4-bbe5-2cfa6d97a36a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Returning 404 to user: Instance group 464ea612-d6b0-411d-b7f4-035264a5cabe could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6e94aea-fc2d-4be4-bbe5-2cfa6d97a36a tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/464ea612-d6b0-411d-b7f4-035264a5cabe" status: 404 len: 117 microversion: 2.1 time: 0.036063 Jul 28 11:38:17.291856 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1547/3151] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/os-server-groups/464ea612-d6b0-411d-b7f4-035264a5cabe => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:38:17.304678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.305566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:17.313986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.314779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.315795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.316627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.604464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:17.629573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:17.635504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:17.637824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0b6a6eb-e656-4f59-a881-37adf5420b7d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 1.266756 Jul 28 11:38:17.655407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1605/3152] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:16 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:17.674597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5db3fdd-4851-4a71-a6f6-16a855bf9c57 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.741417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5db3fdd-4851-4a71-a6f6-16a855bf9c57 tempest-ServerGroupTestJSON-1197064272 tempest-ServerGroupTestJSON-1197064272-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0" status: 204 len: 0 microversion: 2.1 time: 0.084528 Jul 28 11:38:17.742883 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1606/3153] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Jul 28 11:38:17 2022] DELETE /compute/v2.1/os-server-groups/825d348b-ddb7-4288-afd8-0f5b4600f7e0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:38:17.769968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:17.770914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:17.788119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.790012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:17.791807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:17.792805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:18.280427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:18.292874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:18.294685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:18.296244 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec229acd-a5fd-46ba-b292-64e624b2a93c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 2231 microversion: 2.42 time: 1.003832 Jul 28 11:38:18.297342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1548/3154] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:17 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 2231 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:18.669635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:18.670960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:18.694465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:18.695590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:18.696680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:18.699164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:18.941762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:18.955106 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed412532-3684-49d5-9b00-e79e5445d838 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 1.210160 Jul 28 11:38:18.956250 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1607/3155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:17 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:18.988430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c6c86601-b220-478e-8344-38cb13dad819 req-0856eef2-13fa-48ad-bdb7-63f208a1ad2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aa2aa8-82d1-445a-af29-c51f041c331a", "name": "network-vif-deleted", "tag": "c1fba3ac-4c0c-450f-ae53-952d5aa51f4e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:19.007976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c6c86601-b220-478e-8344-38cb13dad819 req-0856eef2-13fa-48ad-bdb7-63f208a1ad2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:19.008669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c6c86601-b220-478e-8344-38cb13dad819 req-0856eef2-13fa-48ad-bdb7-63f208a1ad2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:19.038450 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c6c86601-b220-478e-8344-38cb13dad819 req-0856eef2-13fa-48ad-bdb7-63f208a1ad2e service nova] Creating event network-vif-deleted:c1fba3ac-4c0c-450f-ae53-952d5aa51f4e for instance a4aa2aa8-82d1-445a-af29-c51f041c331a on n-h1-851368-1 Jul 28 11:38:19.044695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c6c86601-b220-478e-8344-38cb13dad819 req-0856eef2-13fa-48ad-bdb7-63f208a1ad2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060017 Jul 28 11:38:19.045807 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1608/3156] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:38:19.320992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:19.321704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:19.340193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:19.340749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:19.341571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:19.342019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:19.747250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.760628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.762311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.768644 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c4a5d07-3010-4ac9-8bd9-a92eac5d294d tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 1.099044 Jul 28 11:38:19.770289 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1549/3157] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:18 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:19.779411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.806095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.818808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:19.822035 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02e298c6-5121-424c-9b85-00549eab2fe9 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.505797 Jul 28 11:38:19.842660 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1609/3158] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:19 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:19.982860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:19.984454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:19.995900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.003489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:20.004627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.006212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:20.722243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:20.735669 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92f5c518-5431-4c7e-b27b-7e5df94b2fa3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 0.757821 Jul 28 11:38:20.744558 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1550/3159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:19 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:20.796457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:20.797976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:20.813417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.817581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:20.821374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.824242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:20.850674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:20.851363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:20.862431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.864467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:20.866040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:20.868712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:21.139314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.149603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.151144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.164647 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9f6316f-c9a5-4912-be87-68f5ae3a9144 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.318651 Jul 28 11:38:21.165651 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1551/3160] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:20 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:21.445987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.460359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.462191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:21.473196 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-87937400-498c-44a1-9a16-8b79d782d2b3 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 0.682614 Jul 28 11:38:21.474952 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1610/3161] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:20 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:21.761452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:21.762346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:21.775244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:21.775911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:21.788326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:21.789034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:22.156464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8f86e256-f839-4f8d-85dc-261eb21bc07c req-efa90242-bffc-4902-91fa-1f000ff1a7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70dc22-0b38-4f37-919a-45cde364058a", "name": "network-vif-plugged", "status": "completed", "tag": "f4abea6e-2221-447e-9aed-e0d91f746b17"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:22.174820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8f86e256-f839-4f8d-85dc-261eb21bc07c req-efa90242-bffc-4902-91fa-1f000ff1a7e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:22.175303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8f86e256-f839-4f8d-85dc-261eb21bc07c req-efa90242-bffc-4902-91fa-1f000ff1a7e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:22.246282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8f86e256-f839-4f8d-85dc-261eb21bc07c req-efa90242-bffc-4902-91fa-1f000ff1a7e7 service nova] Creating event network-vif-plugged:f4abea6e-2221-447e-9aed-e0d91f746b17 for instance 3a70dc22-0b38-4f37-919a-45cde364058a on n-h1-851368-1 Jul 28 11:38:22.256820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8f86e256-f839-4f8d-85dc-261eb21bc07c req-efa90242-bffc-4902-91fa-1f000ff1a7e7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103885 Jul 28 11:38:22.257463 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1611/3162] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:38:22.283728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:22.284479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:22.324559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:22.325184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:22.326226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:22.326893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:22.710448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:22.714385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:22.734586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:22.736485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:22.748666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b953f26-e761-4013-a433-3b710f187c3c tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.489846 Jul 28 11:38:22.749956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1612/3163] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:22 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:22.766353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:22.768337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:22.782081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:22.786255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:22.789042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:22.793066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:23.679908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:23.689646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1dec2e8-ca53-40bc-8090-5f2884c52a3f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1521 microversion: 2.1 time: 1.931943 Jul 28 11:38:23.695316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1552/3164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:21 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1521 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:23.913438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2119426992", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "961a9b15-0870-4716-afa2-9403d248bf26"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:24.043594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] validate_networks() for [('961a9b15-0870-4716-afa2-9403d248bf26', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:38:24.149872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.165482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.167220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.169995 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5cb51862-545b-4720-9dc5-a36f477c445e tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 1.418565 Jul 28 11:38:24.172984 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1613/3165] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:22 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:24.181445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:24.183786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:24.205441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:24.208311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:24.211528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:24.212111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:24.437856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.451045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.453179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:24.454736 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5523a19-770c-49c6-92bc-3d3a2587c69e tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.280667 Jul 28 11:38:24.455890 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1614/3166] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:24 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:24.466644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dc987d3c-1880-4f97-8d19-bdfd397630c5 req-e92e1f50-fe4f-40c4-89f9-07d216e0eda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b50771-15aa-4cbf-b2b4-d8dbd81a2339", "name": "network-vif-plugged", "status": "completed", "tag": "e0c8ef38-15d9-442d-90b0-03a2dcab7249"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:24.496404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc987d3c-1880-4f97-8d19-bdfd397630c5 req-e92e1f50-fe4f-40c4-89f9-07d216e0eda4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:24.497133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc987d3c-1880-4f97-8d19-bdfd397630c5 req-e92e1f50-fe4f-40c4-89f9-07d216e0eda4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:24.530059 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dc987d3c-1880-4f97-8d19-bdfd397630c5 req-e92e1f50-fe4f-40c4-89f9-07d216e0eda4 service nova] Creating event network-vif-plugged:e0c8ef38-15d9-442d-90b0-03a2dcab7249 for instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 on n-h2-851368-1 Jul 28 11:38:24.541786 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dc987d3c-1880-4f97-8d19-bdfd397630c5 req-e92e1f50-fe4f-40c4-89f9-07d216e0eda4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084510 Jul 28 11:38:24.542652 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1615/3167] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:24.716332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:24.717371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:24.731116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:24.734241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:24.735491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:24.738830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:25.568789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:25.568789 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0ac58e0e-bdcc-42ef-972e-42478c588c0b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1506 microversion: 2.1 time: 0.834536 Jul 28 11:38:25.568789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1616/3168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:24 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:25.568789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:25.568789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:25.579323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:25.579781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:25.580568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:25.588854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:26.293235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:26.306035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:26.308436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:26.327198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99b887e6-5acc-4e00-b051-3f125ff6f481 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1359 microversion: 2.21 time: 0.749687 Jul 28 11:38:26.328139 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1617/3169] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:25 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1359 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:26.339946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:26.342494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:26.357177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:26.360856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:26.363570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:26.368637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.099717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:38:27.100155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:38:27.100624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:38:27.101045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:38:27.101481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:38:27.129468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.129923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.131314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.131761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.191977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:27.199506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for user 5b9d61f656eb49ae95e22e56412c55fd and project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:27.216340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:38:27.219320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:38:27.240973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:27.257964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:27.260873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:27.268496 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ddf7b82-4f85-42ec-b552-559fd86093d3 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.938577 Jul 28 11:38:27.272561 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1618/3170] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:26 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:27.285059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:27.285876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:27.351298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-092ba199-64e2-4841-836e-79e17d5cfbeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.653650 Jul 28 11:38:27.351298 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1553/3171] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:38:27.377777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.382663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.385445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-df62a7a5-d17b-4586-8447-968b6750965c req-ad0cfc4e-86ac-45f0-9be5-24e9f5afab2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-plugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:27.393143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.410869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.446942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-df62a7a5-d17b-4586-8447-968b6750965c req-ad0cfc4e-86ac-45f0-9be5-24e9f5afab2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.448275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-df62a7a5-d17b-4586-8447-968b6750965c req-ad0cfc4e-86ac-45f0-9be5-24e9f5afab2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.516471 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-df62a7a5-d17b-4586-8447-968b6750965c req-ad0cfc4e-86ac-45f0-9be5-24e9f5afab2e service nova] Creating event network-vif-plugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:38:27.522425 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-df62a7a5-d17b-4586-8447-968b6750965c req-ad0cfc4e-86ac-45f0-9be5-24e9f5afab2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159035 Jul 28 11:38:27.523513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1554/3172] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:27.530233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:27.535860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:27.551129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.559823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:27.564261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:27.566050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.106260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.128821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecf6ce65-1741-4d7b-ba24-b575758b3e6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 200 len: 1506 microversion: 2.1 time: 1.848684 Jul 28 11:38:29.136653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1619/3173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:27 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 1506 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:29.153278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.169162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:29.169719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:29.176969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.179633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.180876 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b291f66-4a9d-42e0-9a45-8c81634d53f1 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1553 microversion: 2.21 time: 1.655716 Jul 28 11:38:29.193848 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1555/3174] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:27 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1553 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:29.198773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:29.201638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:29.215401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.215864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.216659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.217103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.231961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.235483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.238114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.238583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.310487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:29.500300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.512605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b94e1491-4765-4221-af4d-d5c360eaa132 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1204 microversion: 2.1 time: 0.370637 Jul 28 11:38:29.513568 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1620/3175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:29 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1204 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:29.523305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:29.523455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.527718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:29.539432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.539703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.541158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:29.542811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.549708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.550675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.553886 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d94c9c2c-c7a4-45f5-bf51-2ffc67b666cb tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.352593 Jul 28 11:38:29.554554 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1556/3176] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:29 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:29.595624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:29.596187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:29.622798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.624122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.624984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:29.625431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:29.675094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:38:29.748129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:38:29.945193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c87b7c77-b0bf-4586-b87a-e29240a840df tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 204 len: 0 microversion: 2.1 time: 0.430119 Jul 28 11:38:29.954349 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1621/3177] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:38:29 2022] DELETE /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:38:30.032094 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4be5738b-40f5-4d04-9405-8bca674913fe tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "DELETE /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 204 len: 0 microversion: 2.21 time: 0.462022 Jul 28 11:38:30.037719 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1557/3178] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:29 2022] DELETE /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:38:30.043886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:30.044920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:30.075170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:30.079578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:30.080494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:30.081062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:30.300205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1277089270", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fa82a175-031e-4adf-9f10-53e44f495282"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:30.417876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] validate_networks() for [('fa82a175-031e-4adf-9f10-53e44f495282', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:38:30.985263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.000250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.002024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.005340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-547d2c52-a503-436b-9a4b-6e685bf7571c tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1559 microversion: 2.21 time: 0.966178 Jul 28 11:38:31.009082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1622/3179] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:30 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1559 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:31.018097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:31.019157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:31.038469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:31.043930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:31.044985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:31.049770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:31.376829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.407885 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef225709-17ec-43d1-94d9-582cefc2501a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1278 microversion: 2.1 time: 0.389240 Jul 28 11:38:31.409300 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1623/3180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:31 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:31.420220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:31.431587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:31.454436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:31.459642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:31.462300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:31.462930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:31.938236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.975711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.978233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:31.979703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13ad40dd-f308-4aba-9903-cd25280d0655 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.569270 Jul 28 11:38:31.981010 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1624/3181] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:31 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:32.035819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:32.037477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:32.051296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:32.052048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:32.053083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:32.053731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.198414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:38:33.199134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:38:33.199726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:38:33.200427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:38:33.201079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:38:33.216502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:33.227183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:33.230636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.235116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.238880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.239666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.239974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:33.243800 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2a01f30-bfc0-4672-b33b-c155400b06f0 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1559 microversion: 2.21 time: 1.211979 Jul 28 11:38:33.261007 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1625/3182] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:32 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1559 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:33.272428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:33.274511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:33.288159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.292666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.297054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.297795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.305121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:38:33.316155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for user ee97a9f08e1f4bdc84e6811281002555 and project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:38:33.357932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:38:33.382299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:38:33.545825 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1676797-5700-4580-a4a1-1c0f02b4fda5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.248003 Jul 28 11:38:33.550806 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1558/3183] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:38:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:38:33.563771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:33.570566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:33.588995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:33.600052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.600482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.603467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:33.604153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:33.947716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:33.957776 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0c6ec44-a6cf-456a-b09b-d2758b5ae912 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1266 microversion: 2.1 time: 0.695205 Jul 28 11:38:33.960372 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1626/3184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:33 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1266 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:33.987351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1f632f3-bf2d-40d7-b2a1-611e2234f2c3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:33.988197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b1f632f3-bf2d-40d7-b2a1-611e2234f2c3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:35.379267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.415088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.433273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.438821 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eebdf86e-f249-4315-bb4b-d7f162c153b7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 1.882555 Jul 28 11:38:35.453228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1559/3185] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:33 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:35.490771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:35.493196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:35.538181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:35.541079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:35.545470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:35.546307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:35.641357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b1f632f3-bf2d-40d7-b2a1-611e2234f2c3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.651279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1f632f3-bf2d-40d7-b2a1-611e2234f2c3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1218 microversion: 2.1 time: 1.689622 Jul 28 11:38:35.661863 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1627/3186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:33 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1218 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:35.667965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:35.684011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:35.697187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:35.707825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:35.709437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:35.714180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:35.774144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.799861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.805041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '164ab6e24d1b4d19a1028b2bc0741151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540068d9769a45faa2eb822c0466a931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.820060 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-03e9de1f-dc04-4883-bc50-22841f2a5b04 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 200 len: 1517 microversion: 2.21 time: 0.358361 Jul 28 11:38:35.822054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1560/3187] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:35 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:35.848587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:35.857220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2a2513f-9997-4b73-b6c1-0d7d42a3c8f5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1266 microversion: 2.1 time: 0.193984 Jul 28 11:38:35.861617 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1628/3188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:35 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:35.913624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d79e283e-0b1f-4d08-b6e1-87182ad1cd46 req-353ede5c-344e-466b-ad08-ddef123e7cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b50771-15aa-4cbf-b2b4-d8dbd81a2339", "name": "network-vif-deleted", "tag": "e0c8ef38-15d9-442d-90b0-03a2dcab7249"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:35.940289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-327cb685-6e62-4d2d-9444-2296a75f1a6a req-98f53ce5-91de-45df-bbc3-91437be3cf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70dc22-0b38-4f37-919a-45cde364058a", "name": "network-vif-deleted", "tag": "f4abea6e-2221-447e-9aed-e0d91f746b17"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:35.979636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:35.995388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d79e283e-0b1f-4d08-b6e1-87182ad1cd46 req-353ede5c-344e-466b-ad08-ddef123e7cd8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.001765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-327cb685-6e62-4d2d-9444-2296a75f1a6a req-98f53ce5-91de-45df-bbc3-91437be3cf6b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.002202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d79e283e-0b1f-4d08-b6e1-87182ad1cd46 req-353ede5c-344e-466b-ad08-ddef123e7cd8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:36.007986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-327cb685-6e62-4d2d-9444-2296a75f1a6a req-98f53ce5-91de-45df-bbc3-91437be3cf6b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:36.061569 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d79e283e-0b1f-4d08-b6e1-87182ad1cd46 req-353ede5c-344e-466b-ad08-ddef123e7cd8 service nova] Creating event network-vif-deleted:e0c8ef38-15d9-442d-90b0-03a2dcab7249 for instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 on n-h2-851368-1 Jul 28 11:38:36.089914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-327cb685-6e62-4d2d-9444-2296a75f1a6a req-98f53ce5-91de-45df-bbc3-91437be3cf6b service nova] Creating event network-vif-deleted:f4abea6e-2221-447e-9aed-e0d91f746b17 for instance 3a70dc22-0b38-4f37-919a-45cde364058a on n-h1-851368-1 Jul 28 11:38:36.123538 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-327cb685-6e62-4d2d-9444-2296a75f1a6a req-98f53ce5-91de-45df-bbc3-91437be3cf6b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181238 Jul 28 11:38:36.125706 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1629/3189] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:36.138692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d79e283e-0b1f-4d08-b6e1-87182ad1cd46 req-353ede5c-344e-466b-ad08-ddef123e7cd8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231323 Jul 28 11:38:36.142043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1561/3190] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:38:36.481917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:36.484239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:36.511449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.512125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:36.516943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.517631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:36.556187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:36.691403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:36.692299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:36.720969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.722362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:36.728410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:36.729589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.246356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:37.270371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:37.285583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:37.292503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c0cb884f-8254-40bd-80b5-3f4879a8296b tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.812497 Jul 28 11:38:37.310017 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1630/3191] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:36 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:37.310017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:37.310017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:37.342247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.349394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.352507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.355895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.428036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] HTTP exception thrown: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Request method failure captured: Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 HTTP/1.1 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nUaZHXBBKwhsLv5YSke48j2WvhoY6pT9vkO5Ri0Rdo_nod7EzjRf64ysVhgE_klBCQS6UVV91U3MPICtL0diMbz3TN738_FlcMMNrbvA3cljKO8CdEl9HByjZipKOV9eGtgpMYljF37hva1CvzBgEaBPvPm2fWEVJ-UUjIjIhrwaL8 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540068d9769a45faa2eb822c0466a931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540068d9769a45faa2eb822c0466a931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}] Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 164ab6e24d1b4d19a1028b2bc0741151 Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '19b50771-15aa-4cbf-b2b4-d8dbd81a2339'} Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.441379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.446262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Returning 404 to user: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:37.447025 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66c374f9-3d1c-4abf-80f7-bab8508343b9 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 404 len: 111 microversion: 2.21 time: 0.147435 Jul 28 11:38:37.456314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1631/3192] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:37 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:38:37.479349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:37.484088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:37.519602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.523721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.530338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.531826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.592097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:37.604942 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ead6fcab-178c-4e57-a413-25bcd9f55217 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1278 microversion: 2.1 time: 0.930380 Jul 28 11:38:37.605764 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1562/3193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:36 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1278 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:37.623867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '.version_select at 0x7f2eb29b4e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:37.629486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:37.643658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.645118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.651937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.659777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.850418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1e4fc73-2fae-4ec7-b96a-7846096c148a tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.240119 Jul 28 11:38:37.859377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1563/3194] 10.222.0.93 () {60 vars in 1337 bytes} [Thu Jul 28 11:38:37 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339/os-instance-actions => generated 611 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:38:37.877589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:37.880806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:37.937596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.938067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.938889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:37.939371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:37.978883 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] HTTP exception thrown: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Request method failure captured: Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 HTTP/1.1 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUaZHXBBKwhsLv5YSke48j2WvhoY6pT9vkO5Ri0Rdo_nod7EzjRf64ysVhgE_klBCQS6UVV91U3MPICtL0diMbz3TN738_FlcMMNrbvA3cljKO8CdEl9HByjZipKOV9eGtgpMYljF37hva1CvzBgEaBPvPm2fWEVJ-UUjIjIhrwaL8 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540068d9769a45faa2eb822c0466a931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540068d9769a45faa2eb822c0466a931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}] Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 164ab6e24d1b4d19a1028b2bc0741151 Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '19b50771-15aa-4cbf-b2b4-d8dbd81a2339'} Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:37.992261 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Returning 404 to user: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:37.996734 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31521680-e2bc-47e6-9a9c-d28c0312ad69 tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "DELETE /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 404 len: 111 microversion: 2.21 time: 0.132987 Jul 28 11:38:38.008463 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1564/3195] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:38:37 2022] DELETE /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:38:38.014832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:38.019148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] [instance: 19b50771-15aa-4cbf-b2b4-d8dbd81a2339] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:38.037775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.040916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.041953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.042569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.164847 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] HTTP exception thrown: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Request method failure captured: Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 HTTP/1.1 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUaZHXBBKwhsLv5YSke48j2WvhoY6pT9vkO5Ri0Rdo_nod7EzjRf64ysVhgE_klBCQS6UVV91U3MPICtL0diMbz3TN738_FlcMMNrbvA3cljKO8CdEl9HByjZipKOV9eGtgpMYljF37hva1CvzBgEaBPvPm2fWEVJ-UUjIjIhrwaL8 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540068d9769a45faa2eb822c0466a931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540068d9769a45faa2eb822c0466a931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540068d9769a45faa2eb822c0466a931"}]}] Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 540068d9769a45faa2eb822c0466a931 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1931161235 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 164ab6e24d1b4d19a1028b2bc0741151 Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-InstanceActionsV221TestJSON-1931161235-project Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '19b50771-15aa-4cbf-b2b4-d8dbd81a2339'} Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:38.171849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. Jul 28 11:38:38.176391 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:38:38.188150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] Returning 404 to user: Instance 19b50771-15aa-4cbf-b2b4-d8dbd81a2339 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:38.189608 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6121eba4-da19-42ba-a687-5aa9ee63f70f tempest-InstanceActionsV221TestJSON-1931161235 tempest-InstanceActionsV221TestJSON-1931161235-project] 10.222.0.93 "GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339" status: 404 len: 111 microversion: 2.21 time: 0.179062 Jul 28 11:38:38.201745 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1565/3196] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:38 2022] GET /compute/v2.1/servers/19b50771-15aa-4cbf-b2b4-d8dbd81a2339 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:38:38.326999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:38.327669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:38.345286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.345764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.346552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.346997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.654108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:38.665356 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d110c2ac-51ee-4134-b20f-bbfe246a6afb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.206906 Jul 28 11:38:38.666075 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1632/3197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:37 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:38.724774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:38.731417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:38.755192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:38.764733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:38.769657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.771007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.773001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:38.777521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:38.779090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9dfc3e62-0737-473e-9b74-d6130a6d39d8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.465741 Jul 28 11:38:38.780309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:38.781021 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1566/3198] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:38 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:39.230425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:39.244835 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9be46161-c6cd-4210-8489-9e08c61b6a2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1276 microversion: 2.1 time: 0.542046 Jul 28 11:38:39.253061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1633/3199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:38 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1276 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:39.692919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:39.693540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:39.702980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:39.721127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:39.722201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:39.725817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:39.808153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:39.809579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:39.827374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:39.827811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:39.828606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:39.829042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:40.512120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:40.525701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:40.534997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:40.540687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae2d82e1-5b26-4edf-b161-b7dea2d45faf tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.736292 Jul 28 11:38:40.555894 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1634/3200] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:39 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:40.563678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:40.576054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:40.582628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:40.583388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:40.584330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:40.585174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:41.011446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:41.019179 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c06b6154-7a07-41d4-b9c6-7de3e77c828e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.461865 Jul 28 11:38:41.023464 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1635/3201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:40 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:41.063889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:41.081190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5b9c4cb-9a37-4cf5-adaa-1db1a2f8fc67 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.392853 Jul 28 11:38:41.083594 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1567/3202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:39 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:41.570528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:41.571171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:41.585750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:41.586212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:41.587002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:41.587473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:42.040900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:42.041898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:42.063137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:42.063890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:42.066080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:42.068742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:42.140633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:42.167335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:42.169169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:42.170410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9f02482-0a56-45ac-8c4e-aca9d6a317c8 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.604957 Jul 28 11:38:42.176268 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1636/3203] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:41 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:42.197457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:42.203820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:42.218796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:42.227881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:42.228961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:42.229563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:43.277702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:43.335966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:43.836565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:43.848295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4149f036-2afd-4ed6-8930-63836098dda8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.654583 Jul 28 11:38:43.862403 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1637/3204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:42 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:43.877620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:43.892038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:43.917224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:43.917987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:43.922664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:43.923790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:44.060850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:44.072055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a24c19aa-ba81-49ca-ad13-9cfb413f3607 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 2.035894 Jul 28 11:38:44.072391 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1568/3205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:42 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:44.102577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d8b91e25-95ec-4a67-9bbe-9aa614cf3d73 req-f72b78de-6108-4c54-9a24-38e3c2a69cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47e80e3-0309-4e90-8975-92a0a6287584", "tag": "1b91bf2a-f720-4e08-904a-61b65c2efbcd"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:44.153057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d8b91e25-95ec-4a67-9bbe-9aa614cf3d73 req-f72b78de-6108-4c54-9a24-38e3c2a69cbc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:44.153520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d8b91e25-95ec-4a67-9bbe-9aa614cf3d73 req-f72b78de-6108-4c54-9a24-38e3c2a69cbc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:44.218499 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d8b91e25-95ec-4a67-9bbe-9aa614cf3d73 req-f72b78de-6108-4c54-9a24-38e3c2a69cbc service nova] Creating event network-changed:1b91bf2a-f720-4e08-904a-61b65c2efbcd for instance a47e80e3-0309-4e90-8975-92a0a6287584 on n-h1-851368-1 Jul 28 11:38:44.233632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d8b91e25-95ec-4a67-9bbe-9aa614cf3d73 req-f72b78de-6108-4c54-9a24-38e3c2a69cbc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147686 Jul 28 11:38:44.240147 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1569/3206] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:44.292304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:44.309555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:44.313328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:44.314938 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1928c822-0420-476b-90ca-3b112fec5746 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.451276 Jul 28 11:38:44.331825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1638/3207] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:43 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:44.698097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ce60ef61-30a3-4b50-81e8-b85a192b0ca3 req-974e2588-f471-4b1e-ad8a-8e5149392fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d738d032-8063-4a65-b8bf-ef5d59ddd66d", "tag": "34bf5818-1edb-4eca-9329-40efe66ca604"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:44.757892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ce60ef61-30a3-4b50-81e8-b85a192b0ca3 req-974e2588-f471-4b1e-ad8a-8e5149392fa5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:44.758397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ce60ef61-30a3-4b50-81e8-b85a192b0ca3 req-974e2588-f471-4b1e-ad8a-8e5149392fa5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:44.824417 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ce60ef61-30a3-4b50-81e8-b85a192b0ca3 req-974e2588-f471-4b1e-ad8a-8e5149392fa5 service nova] Creating event network-changed:34bf5818-1edb-4eca-9329-40efe66ca604 for instance d738d032-8063-4a65-b8bf-ef5d59ddd66d on n-h2-851368-1 Jul 28 11:38:44.865307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ce60ef61-30a3-4b50-81e8-b85a192b0ca3 req-974e2588-f471-4b1e-ad8a-8e5149392fa5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167677 Jul 28 11:38:44.866647 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1570/3208] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:44.873293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:44.874262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:44.887097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:44.887566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:44.888361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:44.888806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:45.093414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:45.094240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:45.115284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:45.118232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:45.119371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:45.120106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:45.646242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:46.303108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:46.316547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5875a52-8b68-41b3-b55d-486f3c26427c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.449779 Jul 28 11:38:46.320743 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1639/3209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:44 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:46.333427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:46.336248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:46.353461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:46.354087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:46.357308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:46.359482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:46.512645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:46.527053 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05aeb4bf-1e98-4210-8134-3dbc181cb6a0 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 1.438693 Jul 28 11:38:46.533375 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1571/3210] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:45 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:46.736138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:46.750172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:46.756772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:46.759288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b29a5b5e-73a0-4e94-b23d-aae7957fd77d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.436899 Jul 28 11:38:46.764039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1640/3211] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:46 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:38:47.341800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:47.342433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:47.359995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.360455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:47.361262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.361698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:47.555467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:47.556735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:47.575478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.585629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:47.586733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.587447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:47.727734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:47.738124 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5dcdd6c8-829e-4f53-9b1a-6cbd64ac147e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 0.400240 Jul 28 11:38:47.742814 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1572/3212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:47 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:47.789798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:47.790435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:47.805311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.806213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:47.807281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:47.807738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:48.079594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:48.096852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:48.099230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9076d0f6075a4e6aad7a2dfd2797b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced4fe632ca9495d9e703b2488d55094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:48.102716 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-acd8d7cd-cf23-4f00-9524-a7ef4873c9cc tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 200 len: 1604 microversion: 2.42 time: 0.315370 Jul 28 11:38:48.103391 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1573/3213] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:47 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 1604 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:38:48.338401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:48.353547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10ad6c71-9595-4570-a862-7600b7a48cea tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.802579 Jul 28 11:38:48.359314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1641/3214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:47 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:48.762740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:48.763625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:48.777915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:48.778373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:48.779202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:48.779650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:49.132758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:49.134336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:49.150011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:49.150764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:49.166081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:49.169290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:49.200774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] HTTP exception thrown: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Request method failure captured: Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a HTTP/1.1 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nO04u9peZdDcIyHLr2JwCuWlx1cekqL85a1eADuKZPSbpwMQMfcCpverqPmj2-wUugeYDv7zMqpvdKr86Scr7PJhZT5S64A_H9Q-18yY9W9vIPCEgmQn9zsr7zAx36FaHiLSgEXZLv6qIwWTmLntqwuxNXAFs_oyqikb1CeDWjZ_X4 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}] Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9076d0f6075a4e6aad7a2dfd2797b1a8 Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'a4aa2aa8-82d1-445a-af29-c51f041c331a'} Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:49.202747 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Returning 404 to user: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8cc3d226-4208-44fa-b150-8909574bd93d tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 404 len: 111 microversion: 2.42 time: 0.078137 Jul 28 11:38:49.210207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1642/3215] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:38:49 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:38:49.218154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b35e6fb-5253-4cf4-8c3e-f438e7376db7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '.version_select at 0x7f2ebbe609d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:49.250592 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b35e6fb-5253-4cf4-8c3e-f438e7376db7 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424257062" status: 204 len: 0 microversion: 2.42 time: 0.037264 Jul 28 11:38:49.255516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1643/3216] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Jul 28 11:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424257062 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 11:38:49.374271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:49.374900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:49.394061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:49.394759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:49.397296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:49.397913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:49.924171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:49.941908 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7517ba84-52f3-429e-bdde-1905220653fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.183022 Jul 28 11:38:49.946437 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1574/3217] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:48 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:50.659537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:50.669640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b18fbdbc-0522-4b07-8e3e-0df550ac987e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 1.299607 Jul 28 11:38:50.676365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1644/3218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:49 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:50.980175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:50.980964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:51.014991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:51.015624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:51.016523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:51.017044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:51.088281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:51.718370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:51.720042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:51.753091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:51.754022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:51.754532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:51.758016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:51.907562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:51.917769 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-455066d7-b5d7-4092-9648-289b637ea2ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 0.943429 Jul 28 11:38:51.921172 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1575/3219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:50 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:52.270463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:52.305229 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d67a6279-8e8d-4f24-a2c0-d4dcfdc048b2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.608604 Jul 28 11:38:52.307686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1645/3220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:51 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:52.846183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:52.846814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:52.854772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:52.855269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:52.856068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:52.856513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:52.941122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:52.943018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:52.952844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:52.953312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:52.954111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:52.954562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:53.078554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:53.086919 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d51598f2-277c-44f5-b5b7-5469196759b9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.244808 Jul 28 11:38:53.088515 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1576/3221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:52 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:53.108302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1730542817"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:53.112660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:53.121328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:53.122046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:53.123048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:53.123721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:53.222718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:53.232021 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-489ac930-177d-49e9-82bd-4a93898b99a1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 0.294801 Jul 28 11:38:53.234162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1646/3222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:52 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:53.329108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:53.329802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:53.342813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:53.343386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:53.344238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:53.344755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:53.428083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04e88026-694f-434c-9a9a-352ff651dbe6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.322962 Jul 28 11:38:53.429372 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1577/3223] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:38:53 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 11:38:53.977067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:54.008612 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d8352225-6cda-43f8-8c2b-edfce9d5b2e4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.675594 Jul 28 11:38:54.013401 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1647/3224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:53 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:54.206972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4507b97b-ca53-4645-b65b-bb12114fac49 req-bc45b548-bea3-428b-8283-a5ba929c81c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d738d032-8063-4a65-b8bf-ef5d59ddd66d", "name": "network-vif-plugged", "status": "completed", "tag": "34bf5818-1edb-4eca-9329-40efe66ca604"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:54.227717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4507b97b-ca53-4645-b65b-bb12114fac49 req-bc45b548-bea3-428b-8283-a5ba929c81c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:54.228165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4507b97b-ca53-4645-b65b-bb12114fac49 req-bc45b548-bea3-428b-8283-a5ba929c81c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:54.256382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:54.257017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:54.263665 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4507b97b-ca53-4645-b65b-bb12114fac49 req-bc45b548-bea3-428b-8283-a5ba929c81c9 service nova] Creating event network-vif-plugged:34bf5818-1edb-4eca-9329-40efe66ca604 for instance d738d032-8063-4a65-b8bf-ef5d59ddd66d on n-h2-851368-1 Jul 28 11:38:54.284811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:54.285473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:54.301479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:54.301956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:54.312919 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4507b97b-ca53-4645-b65b-bb12114fac49 req-bc45b548-bea3-428b-8283-a5ba929c81c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110084 Jul 28 11:38:54.319167 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1578/3225] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:38:55.031309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:55.031794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:55.044330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:55.045943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:55.049079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:55.050398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:55.677861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:55.698637 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aaaacd6b-fc0c-4baa-868f-cff33b2d78df tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 1.448677 Jul 28 11:38:55.699257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1648/3226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:54 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:55.828010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:55.834205 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d00551de-9961-466f-b82a-da681cb73226 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.808016 Jul 28 11:38:55.847877 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1579/3227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:55 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:56.720517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:56.721746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:56.739656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:56.740535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:56.741622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:56.742215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:56.829356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:38:56.838136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e80e3-0309-4e90-8975-92a0a6287584", "name": "network-vif-plugged", "status": "completed", "tag": "1b91bf2a-f720-4e08-904a-61b65c2efbcd"}, {"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:38:56.858021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:56.863033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:56.891998 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] Creating event network-vif-plugged:1b91bf2a-f720-4e08-904a-61b65c2efbcd for instance a47e80e3-0309-4e90-8975-92a0a6287584 on n-h1-851368-1 Jul 28 11:38:56.892672 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] Creating event network-vif-unplugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:38:56.906933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-13ef87ae-a359-4336-b885-be2dc6cf1d39 req-01979c34-cb37-49c2-af10-91c9e23cbf5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.073285 Jul 28 11:38:56.908255 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1580/3228] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:38:56.916068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:56.916774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:56.929828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:56.930533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:56.931595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:56.932189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:57.464444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:57.488246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53750685-8f03-401a-994f-3db00bd5bbd4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1308 microversion: 2.1 time: 0.772814 Jul 28 11:38:57.489385 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1649/3229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:56 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1308 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:38:57.739832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:38:57.753120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e11741cd-dd69-46bb-980e-14d4b711638d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 0.842335 Jul 28 11:38:57.771754 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1581/3230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:56 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:38:58.510418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:58.511040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:58.530677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:58.531455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:58.532422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:58.533020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:58.787755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:38:58.788383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:38:58.806724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:58.807196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:38:58.807989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:38:58.808429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:00.303180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:00.320900 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-361cfd91-c700-475d-86ef-c5e96518ebe9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1318 microversion: 2.1 time: 1.539352 Jul 28 11:39:00.323670 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1582/3231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:58 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1318 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:39:00.595945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f48e0fcc-15c8-41a1-a503-26ee531f87b6 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Calling method '.version_select at 0x7f2eb3593af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:00.899686 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f48e0fcc-15c8-41a1-a503-26ee531f87b6 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.574162 Jul 28 11:39:00.900536 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1583/3232] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:39:00 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:39:00.915001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-449ae55a-ecc2-49d4-acc4-de2f51187385 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Action: 'create', calling method: .version_select at 0x7f2eb30a3160>, body: {"pool": "non_exist_pool"} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:01.032041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:01.044422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a5837e0-4a6d-4884-9780-42326a52bcc7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1488 microversion: 2.1 time: 2.535672 Jul 28 11:39:01.046611 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1650/3233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:38:58 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1488 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:01.068424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:01.069287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:01.085234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.086161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:01.094954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-449ae55a-ecc2-49d4-acc4-de2f51187385 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] HTTP exception thrown: Floating IP pool not found. Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-449ae55a-ecc2-49d4-acc4-de2f51187385 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Request method failure captured: Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 26 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVTmtMlXHBhp5ohJ45J38L9VRZS8sdwt87H7mmD-qgFqeUCeM3OCCJFGEdWZd9delCidwBqpNDuGmaQlM_D4Ogf8AQTPBcGLk5V-TcArpbWIYt6ZoDWeTv9mczal63wpnMMru8oMbHs2xw4sfWZqEyLyUfo5ME3nnOxqfr7PTGFOqo Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 719f461c53ad4633bb805b383532691a Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/719f461c53ad4633bb805b383532691a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/719f461c53ad4633bb805b383532691a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_719f461c53ad4633bb805b383532691a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/719f461c53ad4633bb805b383532691a"}]}] Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 719f461c53ad4633bb805b383532691a Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPsNegativeTestJSON-1417438452-project Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 496b758f2ae14e87bd24a9b113ac141b Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1417438452-project Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: {"pool": "non_exist_pool"} Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: exception: Floating IP pool not found. Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:39:01.098608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:39:01.103156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 28 11:39:01.103156 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.105755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-449ae55a-ecc2-49d4-acc4-de2f51187385 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Returning 404 to user: Floating IP pool not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:39:01.107165 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-449ae55a-ecc2-49d4-acc4-de2f51187385 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.197639 Jul 28 11:39:01.107947 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1584/3234] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:39:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:39:01.109314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.110045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:01.131093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Calling method '.version_select at 0x7f2eb25bf940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:01.275451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-954d75be-9913-407a-90fa-d73af1f5503c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d/action" status: 202 len: 0 microversion: 2.1 time: 0.211981 Jul 28 11:39:01.277132 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1651/3235] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:39:01 2022] POST /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:39:01.300716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:01.302464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:01.344638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.347214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:01.350154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.353832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:01.498537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 27960d36-7d38-4185-b473-e6b094579f89 could not be found", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:39:01.501201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] HTTP exception thrown: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Request method failure captured: Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-floating-ips/27960d36-7d38-4185-b473-e6b094579f89 HTTP/1.1 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVTmtMlXHBhp5ohJ45J38L9VRZS8sdwt87H7mmD-qgFqeUCeM3OCCJFGEdWZd9delCidwBqpNDuGmaQlM_D4Ogf8AQTPBcGLk5V-TcArpbWIYt6ZoDWeTv9mczal63wpnMMru8oMbHs2xw4sfWZqEyLyUfo5ME3nnOxqfr7PTGFOqo Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 719f461c53ad4633bb805b383532691a Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/719f461c53ad4633bb805b383532691a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/719f461c53ad4633bb805b383532691a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_719f461c53ad4633bb805b383532691a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/719f461c53ad4633bb805b383532691a"}]}] Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 719f461c53ad4633bb805b383532691a Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1417438452 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-FloatingIPsNegativeTestJSON-1417438452-project Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 496b758f2ae14e87bd24a9b113ac141b Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1417438452-project Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: exception: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '27960d36-7d38-4185-b473-e6b094579f89'} Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 27960d36-7d38-4185-b473-e6b094579f89 could not be found Jul 28 11:39:01.504054 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1177b83-e0e2-4da4-977e-660c8ec1e2ac'] Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89. Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89 Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89 Jul 28 11:39:01.508508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:01.514746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] Returning 404 to user: Floating IP not found for ID 27960d36-7d38-4185-b473-e6b094579f89 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:39:01.516854 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-528bb919-46be-4c75-b35c-ce8ecc665fc5 tempest-FloatingIPsNegativeTestJSON-1417438452 tempest-FloatingIPsNegativeTestJSON-1417438452-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/27960d36-7d38-4185-b473-e6b094579f89" status: 404 len: 111 microversion: 2.1 time: 0.402030 Jul 28 11:39:01.518203 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1585/3236] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:39:01 2022] DELETE /compute/v2.1/os-floating-ips/27960d36-7d38-4185-b473-e6b094579f89 => generated 111 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:39:01.541508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:01.542664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:01.572978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.576589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:01.580254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:01.580739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:02.660179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:02.669522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:02.677235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a5dfbab-d3a7-4082-b528-06a12d885fc5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1493 microversion: 2.1 time: 1.395071 Jul 28 11:39:02.697703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1652/3237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:01 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1493 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:02.702446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34bf2fb8-732f-450b-98ea-eab8907238c2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1508 microversion: 2.1 time: 1.173409 Jul 28 11:39:02.715103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1586/3238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:01 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1508 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:02.720718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f0b082ba-081c-4580-80ff-5b387ac9c49d req-0351d76a-ed2f-4ef2-a795-e76b2ecfd164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-plugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:02.729829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:02.730460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:02.740926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:02.741452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:02.742255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:02.742701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:02.816332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0b082ba-081c-4580-80ff-5b387ac9c49d req-0351d76a-ed2f-4ef2-a795-e76b2ecfd164 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:02.819747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f0b082ba-081c-4580-80ff-5b387ac9c49d req-0351d76a-ed2f-4ef2-a795-e76b2ecfd164 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:02.866698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f0b082ba-081c-4580-80ff-5b387ac9c49d req-0351d76a-ed2f-4ef2-a795-e76b2ecfd164 service nova] Creating event network-vif-plugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:39:02.884947 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f0b082ba-081c-4580-80ff-5b387ac9c49d req-0351d76a-ed2f-4ef2-a795-e76b2ecfd164 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181019 Jul 28 11:39:02.885853 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1653/3239] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:03.125584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:03.143022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-892bc107-3a34-4132-b3b8-c04d9e58fd9e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1508 microversion: 2.1 time: 0.409433 Jul 28 11:39:03.143657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1587/3240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:02 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1508 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:39:03.170118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:03.173659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:03.199413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.200332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:03.201460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.202303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:03.444348 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58432d2d-5681-4c60-b6fa-6fda9466657a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "PUT /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1080 microversion: 2.1 time: 0.280015 Jul 28 11:39:03.445174 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1654/3241] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:39:03 2022] PUT /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1080 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:03.462164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:03.462994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:03.474773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.477057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:03.479046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.481167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:03.697991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:03.698811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:03.717678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.724127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:03.728106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:03.730420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:04.541941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:04.559263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:04.561767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b19d400-a89d-4cc4-960e-92050fb37c4b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1506 microversion: 2.1 time: 1.103590 Jul 28 11:39:04.577137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1588/3242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:03 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1506 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:04.577473 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7cb91fa6-f058-4e6d-8c54-cfea2410d1c1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 200 len: 1473 microversion: 2.1 time: 0.878231 Jul 28 11:39:04.583902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1655/3243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:03 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 1473 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:04.587145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:04.587823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:04.598918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1155694750"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:04.601704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:04.612356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=53 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:04.614782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:04.615305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:04.616162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:04.616634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:04.620435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:04.620900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:04.621695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:04.622139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:05.157656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd7b1389-495f-4027-ac5c-45ed72d95db3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d/action" status: 202 len: 0 microversion: 2.1 time: 0.562958 Jul 28 11:39:05.158718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1656/3244] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:39:04 2022] POST /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 28 11:39:05.173731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f876e96-3ad2-4a8c-98c6-84808a1ff098 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebc016d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:05.285018 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f876e96-3ad2-4a8c-98c6-84808a1ff098 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.119741 Jul 28 11:39:05.286339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1657/3245] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:05 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:39:05.485078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:05.494705 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b9a7071-d5eb-41eb-afda-548cf4960326 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1506 microversion: 2.1 time: 0.915865 Jul 28 11:39:05.499886 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1589/3246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:04 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1506 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:05.532171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:05.535369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:05.561699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:05.562088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:05.562920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:05.563406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:05.766079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:05.770740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:05.771470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:05.771883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:05.772306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:05.952636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:05.978851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:05.979455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:05.980312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:05.980958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:06.041090 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31a1bf80-7df0-4088-8082-1d4b457ff9fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "POST /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584/action" status: 202 len: 1112 microversion: 2.1 time: 0.512793 Jul 28 11:39:06.053805 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1658/3247] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:39:05 2022] POST /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584/action => generated 1112 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 11:39:06.069485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:06.071971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:06.106183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:06.106641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:06.121661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:06.122422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:06.315938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7076d4d-1213-4694-aa90-017f8de9fd0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbded1f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:06.412704 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7076d4d-1213-4694-aa90-017f8de9fd0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.113126 Jul 28 11:39:06.415566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1659/3248] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:06 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:07.368876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:07.377579 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-99b6be8b-ca83-446f-9c04-40767054a1b9 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1517 microversion: 2.1 time: 1.312916 Jul 28 11:39:07.393941 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1590/3249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:06 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1517 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:07.432555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6590043-7ca3-4a6c-94b1-f4e49b458225 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebc01fdc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:07.513665 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6590043-7ca3-4a6c-94b1-f4e49b458225 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.087543 Jul 28 11:39:07.514836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1660/3250] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:07 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:08.224967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:08.225898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:08.245101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.245571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.247340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.247790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.286105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] HTTP exception thrown: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Request method failure captured: Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a HTTP/1.1 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nO04u9peZdDcIyHLr2JwCuWlx1cekqL85a1eADuKZPSbpwMQMfcCpverqPmj2-wUugeYDv7zMqpvdKr86Scr7PJhZT5S64A_H9Q-18yY9W9vIPCEgmQn9zsr7zAx36FaHiLSgEXZLv6qIwWTmLntqwuxNXAFs_oyqikb1CeDWjZ_X4 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}] Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 9076d0f6075a4e6aad7a2dfd2797b1a8 Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'a4aa2aa8-82d1-445a-af29-c51f041c331a'} Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:39:08.291775 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.296621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Returning 404 to user: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:39:08.298167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e94a58aa-dee8-48df-840f-f07f3f267129 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 404 len: 111 microversion: 2.42 time: 0.077707 Jul 28 11:39:08.302066 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1591/3251] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:39:08 2022] DELETE /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:39:08.308127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:08.308919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] [instance: a4aa2aa8-82d1-445a-af29-c51f041c331a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:08.324689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:08.355216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.358228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.359174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.359634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.401932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:08.403465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:08.417536 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] HTTP exception thrown: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.420321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.420783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Request method failure captured: Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a HTTP/1.1 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nO04u9peZdDcIyHLr2JwCuWlx1cekqL85a1eADuKZPSbpwMQMfcCpverqPmj2-wUugeYDv7zMqpvdKr86Scr7PJhZT5S64A_H9Q-18yY9W9vIPCEgmQn9zsr7zAx36FaHiLSgEXZLv6qIwWTmLntqwuxNXAFs_oyqikb1CeDWjZ_X4 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ced4fe632ca9495d9e703b2488d55094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ced4fe632ca9495d9e703b2488d55094"}]}] Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ced4fe632ca9495d9e703b2488d55094 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-681546454 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9076d0f6075a4e6aad7a2dfd2797b1a8 Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TaggedBootDevicesTest_v242-681546454-project Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'a4aa2aa8-82d1-445a-af29-c51f041c331a'} Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.422200 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:39:08.426174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] Returning 404 to user: Instance a4aa2aa8-82d1-445a-af29-c51f041c331a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:39:08.426741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:08.426741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:08.433081 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d63b3ab4-116e-476a-aa34-d22566c27ce0 tempest-TaggedBootDevicesTest_v242-681546454 tempest-TaggedBootDevicesTest_v242-681546454-project] 10.222.0.93 "GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a" status: 404 len: 111 microversion: 2.42 time: 0.129062 Jul 28 11:39:08.449359 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1661/3252] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:08 2022] GET /compute/v2.1/servers/a4aa2aa8-82d1-445a-af29-c51f041c331a => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:39:08.530244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7f77de0-eee4-4baa-b4eb-e2265e66bd4e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb27e59d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:09.313000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:09.327000 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f562d53-9322-4cb4-84ce-dbeaf4d20e1d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1517 microversion: 2.1 time: 0.929980 Jul 28 11:39:09.332676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1592/3253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:08 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1517 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:10.353973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:10.355673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:10.369449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:10.371586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:10.372657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:10.376757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:12.358117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:12.386269 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5250fe7b-df62-4e0a-a965-7824541ea982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1517 microversion: 2.1 time: 2.038669 Jul 28 11:39:12.405652 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1593/3254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:10 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1517 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:12.580813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1836526155", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "edb8997c-1e7b-46b4-8c0b-4dc17e42cda9"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:18.416195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:18.417739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:22.386433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:22.748806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=11 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:25.203252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7f77de0-eee4-4baa-b4eb-e2265e66bd4e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 16.675928 Jul 28 11:39:25.203863 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1662/3255] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:08 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 16679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:25.220531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:25.221155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:25.233015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:25.233530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:25.234328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:25.235359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:25.442822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] validate_networks() for [('edb8997c-1e7b-46b4-8c0b-4dc17e42cda9', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:26.574417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:26.584936 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f809dde6-6097-49d3-b523-f0327e25ccc2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1517 microversion: 2.1 time: 1.380014 Jul 28 11:39:26.592219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1663/3256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:25 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1517 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:27.325533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1399578314", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:27.437593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] validate_networks() for [('4b82a6bf-cc91-456c-82fe-865a1ae14648', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:27.856179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:27.856704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:27.857076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:27.857492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:27.857914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:27.879296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:27.879751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:27.880562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:27.881004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:27.945753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Getting quotas for project 91afeb2f85334598abadeb8ac8deb181. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:39:27.975498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Getting quotas for user 3a09424fec5e437b9e28f420a0d4f30d and project 91afeb2f85334598abadeb8ac8deb181. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:39:28.008608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:39:28.010910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:39:28.123322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fff999b-feef-4c79-8623-1e4e41643ccc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 15.714907 Jul 28 11:39:28.125882 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1594/3257] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 15720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:39:28.150161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d0a37ecd-1967-49ff-bfe6-1956b8d667ed req-db29fd4b-668b-409d-a768-1a77b7ba8d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d738d032-8063-4a65-b8bf-ef5d59ddd66d", "name": "network-vif-plugged", "status": "completed", "tag": "34bf5818-1edb-4eca-9329-40efe66ca604"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:28.181748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d0a37ecd-1967-49ff-bfe6-1956b8d667ed req-db29fd4b-668b-409d-a768-1a77b7ba8d8a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:28.184138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d0a37ecd-1967-49ff-bfe6-1956b8d667ed req-db29fd4b-668b-409d-a768-1a77b7ba8d8a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:28.218741 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d0a37ecd-1967-49ff-bfe6-1956b8d667ed req-db29fd4b-668b-409d-a768-1a77b7ba8d8a service nova] Creating event network-vif-plugged:34bf5818-1edb-4eca-9329-40efe66ca604 for instance d738d032-8063-4a65-b8bf-ef5d59ddd66d on n-h2-851368-1 Jul 28 11:39:28.234954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d0a37ecd-1967-49ff-bfe6-1956b8d667ed req-db29fd4b-668b-409d-a768-1a77b7ba8d8a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104149 Jul 28 11:39:28.239259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1595/3258] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:28.254214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:28.257107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:28.265820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:28.266666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:28.270895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:28.271711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:28.884394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:28.894724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7362b324-854b-4d2f-89fb-94a4e8a8bdb1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.652789 Jul 28 11:39:28.910203 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1596/3259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:28 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:28.929011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe479aaa-3ad6-4dd3-b2f8-480982bcf453 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2881af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:29.041186 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe479aaa-3ad6-4dd3-b2f8-480982bcf453 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.128449 Jul 28 11:39:29.041853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1597/3260] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:28 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:29.046553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:29.065319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:29.077109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.077568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.078350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.086117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.289989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:29.290964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:29.291658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:29.292261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:29.292872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:29.307645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.308377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.313328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.316659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.358989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:39:29.369137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for user dc8e6648280a4851ac6428027a0414fe and project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:39:29.397366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:39:29.400455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:39:29.509838 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af2a9912-fc4b-4a36-90b8-1fb7e340951e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.913767 Jul 28 11:39:29.510450 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1664/3261] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:39:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:39:29.529300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:29.531504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:29.570951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.571451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.572269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.572719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.809102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:29.824086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:29.839352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:29.841792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f8609df-d61a-43ba-8b30-e03c9bf126f7 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1266 microversion: 2.26 time: 0.330230 Jul 28 11:39:29.857595 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1665/3262] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:29 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:29.869329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1929646667"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:29.872685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:29.889257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.891125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:29.892900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:29.895248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:30.409050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:30.427866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df0adc46-d9d2-4545-8e0b-da77ebbcdc2a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 1.384679 Jul 28 11:39:30.450794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1598/3263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:29 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:30.474558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:30.496480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:30.498106 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c73a6246-53aa-4deb-9d2d-75baa46ee383 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.632412 Jul 28 11:39:30.502252 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1666/3264] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:39:29 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 11:39:30.518138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:30.520368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9120b3d1-ec9c-44a6-8fa5-9f23580ec188 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbf6f0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:30.520892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:30.522871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:30.524821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:30.647981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9120b3d1-ec9c-44a6-8fa5-9f23580ec188 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.139274 Jul 28 11:39:30.650572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1667/3265] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:30 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:30.664633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:30.665834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:30.681857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:30.684500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:30.685562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:30.686241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:31.618561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:31.637542 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80c0ed32-850c-4a94-8231-252c9cec2deb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1226 microversion: 2.1 time: 1.180208 Jul 28 11:39:31.667775 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1599/3266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:30 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1226 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:31.698750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:31.699436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:31.723711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:31.724174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:31.724983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:31.725429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:32.151901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:32.161560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:32.173459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:32.175288 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-674c9219-5624-4460-8155-01546e1661cc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1314 microversion: 2.26 time: 0.505759 Jul 28 11:39:32.176022 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1600/3267] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:31 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:32.185013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:32.188944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:32.216093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:32.219061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:32.220629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:32.227716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:32.565035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:32.579457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1052320d-104f-4e95-853c-5868f20e9998 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 1.927440 Jul 28 11:39:32.581067 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1668/3268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:30 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:32.597967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d64d601d-c681-4a6a-b69e-e79b1c8add76 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb282e4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:32.717266 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d64d601d-c681-4a6a-b69e-e79b1c8add76 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1412 microversion: 2.1 time: 0.134858 Jul 28 11:39:32.721578 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1669/3269] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:32 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:32.729803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1624164831", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:32.857447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] validate_networks() for [('4b82a6bf-cc91-456c-82fe-865a1ae14648', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:32.902945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:32.917572 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a992a8a-f2c7-48b2-9cb8-3013dc48c96a tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 0.734822 Jul 28 11:39:32.919301 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1601/3270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:32 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:32.932468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dac1c566-d94e-4ffb-af56-7a481ce8a5eb req-508028f6-17d9-4060-88e4-92c9d7024f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:32.956828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dac1c566-d94e-4ffb-af56-7a481ce8a5eb req-508028f6-17d9-4060-88e4-92c9d7024f81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:32.959789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dac1c566-d94e-4ffb-af56-7a481ce8a5eb req-508028f6-17d9-4060-88e4-92c9d7024f81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:32.992072 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-dac1c566-d94e-4ffb-af56-7a481ce8a5eb req-508028f6-17d9-4060-88e4-92c9d7024f81 service nova] Creating event network-vif-unplugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:39:33.006986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dac1c566-d94e-4ffb-af56-7a481ce8a5eb req-508028f6-17d9-4060-88e4-92c9d7024f81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083894 Jul 28 11:39:33.007651 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1602/3271] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:33.199812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:33.200588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:33.219508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:33.219974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:33.220788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:33.221223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:33.589823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:33.604567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:33.608543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:33.616508 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98bc2cea-a63f-43ca-87ec-0dfd555d0251 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1320 microversion: 2.26 time: 0.420718 Jul 28 11:39:33.625630 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1603/3272] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:33 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:33.636777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:33.640046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:33.655678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:33.656421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:33.664216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:33.668930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:35.348851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:35.380102 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eb177f49-5e90-48df-9012-5a62deb4fe5f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1688 microversion: 2.1 time: 1.750731 Jul 28 11:39:35.391737 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1604/3273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:33 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1688 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:35.405457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df5c006e-9761-4a3e-8036-24bf17066eb5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb24e0160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:35.567525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:35.571745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:35.573196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:35.573742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:35.574284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:35.604463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:35.605308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:35.612948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:35.614059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:35.698001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:39:35.718722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for user dc8e6648280a4851ac6428027a0414fe and project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:39:35.770815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:39:35.779885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:39:35.909354 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61fd6800-c27b-4539-a7e9-5e73a7ff523f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.183438 Jul 28 11:39:35.910287 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1670/3274] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:39:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:39:35.924613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:35.925563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:35.955920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:35.956940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:35.962791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:35.969738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.100728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df5c006e-9761-4a3e-8036-24bf17066eb5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1421 microversion: 2.1 time: 1.707435 Jul 28 11:39:37.101466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1605/3275] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:35 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1421 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:37.128811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:37.129464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:37.171759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:37.185721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.186622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:37.187112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.733997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:37.745652 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b49fcbc3-2461-4cdf-8677-01f49c0f7ade tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 1.828130 Jul 28 11:39:37.746469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1671/3276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:35 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:37.756083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2c3694ae-e41f-430f-b81c-cca66b2c7c8f req-8c6bbb5f-5101-4b7a-b442-c23ae6eaf644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e80e3-0309-4e90-8975-92a0a6287584", "name": "network-vif-unplugged", "status": "completed", "tag": "1b91bf2a-f720-4e08-904a-61b65c2efbcd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:37.777607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2c3694ae-e41f-430f-b81c-cca66b2c7c8f req-8c6bbb5f-5101-4b7a-b442-c23ae6eaf644 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:37.779655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2c3694ae-e41f-430f-b81c-cca66b2c7c8f req-8c6bbb5f-5101-4b7a-b442-c23ae6eaf644 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.812829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2c3694ae-e41f-430f-b81c-cca66b2c7c8f req-8c6bbb5f-5101-4b7a-b442-c23ae6eaf644 service nova] Creating event network-vif-unplugged:1b91bf2a-f720-4e08-904a-61b65c2efbcd for instance a47e80e3-0309-4e90-8975-92a0a6287584 on n-h1-851368-1 Jul 28 11:39:37.822704 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2c3694ae-e41f-430f-b81c-cca66b2c7c8f req-8c6bbb5f-5101-4b7a-b442-c23ae6eaf644 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073431 Jul 28 11:39:37.825071 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1672/3277] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:37.836286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:37.841607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:37.863524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:37.863993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.869131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:37.869790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:37.906964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:37.918992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:37.926804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:37.935342 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-49789661-a148-4fc4-a825-10a7a89bac50 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 0.832579 Jul 28 11:39:37.942639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1606/3278] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:37 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:37.964302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:37.965312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:37.985560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:38.000750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:38.001552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:38.004560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:38.007813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:38.008637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:38.071819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:38.096817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9056b2b-bab5-4530-bd86-6d32702ae0f3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1274 microversion: 2.1 time: 0.269143 Jul 28 11:39:38.097857 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1673/3279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:37 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:38.113756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2bd48c8-ca2b-4845-8573-662c673a6a0a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbed4af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:38.288383 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2bd48c8-ca2b-4845-8573-662c673a6a0a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 200 len: 1421 microversion: 2.1 time: 0.186794 Jul 28 11:39:38.288990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1674/3280] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:39:38 2022] GET /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 1421 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:38.312236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7496efc-aca4-4ec5-bd5b-7adbc110f02c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb34a90d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:39.374993 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7496efc-aca4-4ec5-bd5b-7adbc110f02c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 204 len: 0 microversion: 2.1 time: 1.076051 Jul 28 11:39:39.376637 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1675/3281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:38 2022] DELETE /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:39:39.383880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:39.384891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:39.396196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:39.397891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:39.400619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:39.401321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:40.305594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:40.324411 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8b86f2e-b9b6-4ad3-96f3-53d7517bbba5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 2.374723 Jul 28 11:39:40.331932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1607/3282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:37 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:40.354941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:40.357004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:40.397816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:40.398292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:40.400193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:40.401528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.180307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:41.191722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f01a59c-a496-4d4d-bb90-e44d5471c20f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 1.812575 Jul 28 11:39:41.200788 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1676/3283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:39 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:41.211959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:41.212994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:41.220219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.233251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.240937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.242440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.417150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:41.437146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:41.438843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:41.442433 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-342f15a9-a948-44a4-99a3-b4167a8bbad1 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 1.107001 Jul 28 11:39:41.459768 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1608/3284] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:40 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:41.480551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:41.481253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:41.488146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.488875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.490818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.495236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.576496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:39:41.649312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:41.663982 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9c2c66d2-e9b2-43a6-b334-6c8574562c2e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1280 microversion: 2.1 time: 0.461796 Jul 28 11:39:41.687988 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1677/3285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:41 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1280 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:41.693660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7350b9b4-8a7d-4feb-b407-02611b6203e7 req-90162882-be62-45cd-9004-bd1303227216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8", "tag": "1f307096-1cd1-4897-80de-79e94f05a970"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:41.730035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7350b9b4-8a7d-4feb-b407-02611b6203e7 req-90162882-be62-45cd-9004-bd1303227216 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.737466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7350b9b4-8a7d-4feb-b407-02611b6203e7 req-90162882-be62-45cd-9004-bd1303227216 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.773511 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7350b9b4-8a7d-4feb-b407-02611b6203e7 req-90162882-be62-45cd-9004-bd1303227216 service nova] Creating event network-changed:1f307096-1cd1-4897-80de-79e94f05a970 for instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 on n-h1-851368-1 Jul 28 11:39:41.796073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7350b9b4-8a7d-4feb-b407-02611b6203e7 req-90162882-be62-45cd-9004-bd1303227216 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106197 Jul 28 11:39:41.804106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1678/3286] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:41.829965 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b59da05-9cfd-458c-814a-48d313944bff tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 204 len: 0 microversion: 2.1 time: 0.361704 Jul 28 11:39:41.833140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:41.834137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1609/3287] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:39:41 2022] DELETE /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:39:41.834780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:41.891909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.897343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:41.902176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:41.903641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:42.133685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1802192422", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "961a9b15-0870-4716-afa2-9403d248bf26"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:42.247568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] validate_networks() for [('961a9b15-0870-4716-afa2-9403d248bf26', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:43.268488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:43.282119 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb73dad8-c3e8-450c-9250-d5e7ac341fb7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 1.472744 Jul 28 11:39:43.286213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1679/3288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:41 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:43.297343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:43.301065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:43.317079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:43.317914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:43.319368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:43.324673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:44.941630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:44.957464 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b054aafa-0f3e-40cc-b1b3-cd2c47adbab7 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 1.668003 Jul 28 11:39:44.963574 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1680/3289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:43 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:44.978256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:44.979260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:44.997524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:45.002324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:45.004167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:45.012939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:45.672152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:45.757474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:46.422912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:46.424101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:46.425987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:46.426644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:46.427330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:46.478738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:46.480787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:46.485252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:46.487917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:46.554552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:39:46.562301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for user 5b9d61f656eb49ae95e22e56412c55fd and project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:39:46.575638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:46.587841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:46.589382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:46.606153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74599a5f-03de-4a38-bc21-84f88dbf832f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 1.640516 Jul 28 11:39:46.606830 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1681/3290] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:44 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:46.609025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:39:46.619787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:46.620953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:46.626119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:39:46.650783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:46.653377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:46.658069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:46.662967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:46.781891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6771ce0e-bd2c-4cee-b9a9-6cba0c1fad9b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.652802 Jul 28 11:39:46.789560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1610/3291] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:39:46.817245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-01d848b9-0ba9-453b-b583-afe32e38eb08 req-859c73a5-4b0e-4132-bc89-779bc3eb7069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e80e3-0309-4e90-8975-92a0a6287584", "name": "network-vif-plugged", "status": "completed", "tag": "1b91bf2a-f720-4e08-904a-61b65c2efbcd"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:46.870441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-01d848b9-0ba9-453b-b583-afe32e38eb08 req-859c73a5-4b0e-4132-bc89-779bc3eb7069 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:46.871236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-01d848b9-0ba9-453b-b583-afe32e38eb08 req-859c73a5-4b0e-4132-bc89-779bc3eb7069 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:46.912190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-01d848b9-0ba9-453b-b583-afe32e38eb08 req-859c73a5-4b0e-4132-bc89-779bc3eb7069 service nova] Creating event network-vif-plugged:1b91bf2a-f720-4e08-904a-61b65c2efbcd for instance a47e80e3-0309-4e90-8975-92a0a6287584 on n-h1-851368-1 Jul 28 11:39:46.944099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-01d848b9-0ba9-453b-b583-afe32e38eb08 req-859c73a5-4b0e-4132-bc89-779bc3eb7069 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148396 Jul 28 11:39:46.944709 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1611/3292] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:46.978033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:47.002627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:47.044548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:47.045016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:47.055619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:47.060892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:48.012364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:48.028554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-972b7b4b-743b-4765-9f56-1cd1052fde8c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 1.413731 Jul 28 11:39:48.032562 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1682/3293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:46 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:48.042692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5ee10b28-ae1c-440f-a89e-19ec9db672da req-669e99bc-362b-46b7-bfbd-98b0ffdbce52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81709a7c-41ea-4c87-82ac-2e64604a82ea", "tag": "9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:48.091224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5ee10b28-ae1c-440f-a89e-19ec9db672da req-669e99bc-362b-46b7-bfbd-98b0ffdbce52 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:48.091693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5ee10b28-ae1c-440f-a89e-19ec9db672da req-669e99bc-362b-46b7-bfbd-98b0ffdbce52 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:48.125150 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5ee10b28-ae1c-440f-a89e-19ec9db672da req-669e99bc-362b-46b7-bfbd-98b0ffdbce52 service nova] Creating event network-changed:9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a for instance 81709a7c-41ea-4c87-82ac-2e64604a82ea on n-h1-851368-1 Jul 28 11:39:48.135674 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5ee10b28-ae1c-440f-a89e-19ec9db672da req-669e99bc-362b-46b7-bfbd-98b0ffdbce52 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099470 Jul 28 11:39:48.142892 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1683/3294] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:48.161107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:48.161887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:48.172524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:48.172986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:48.173784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:48.177281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:48.276754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:48.309086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15004e5b-d4ab-4258-9383-0e105a3a1023 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 1.324657 Jul 28 11:39:48.310206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1612/3295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:46 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:48.336433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:48.338249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:48.379461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:48.380307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:48.384047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:48.387299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:49.342821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:49.383778 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a639217-35ae-42d5-b349-d0686dd192e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1204 microversion: 2.1 time: 1.064051 Jul 28 11:39:49.384455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1613/3296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:48 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1204 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:49.607655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-782499781", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "c35081d9-b9cf-42e3-aa93-42892e8cd59a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:49.726695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] validate_networks() for [('c35081d9-b9cf-42e3-aa93-42892e8cd59a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:50.369579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:50.376462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:50.386764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee0992d2-7bf6-4911-800d-e94cb8695880 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1523 microversion: 2.1 time: 2.236043 Jul 28 11:39:50.388425 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1684/3297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:48 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1523 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:50.401376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:50.406154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:50.430559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:50.448020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:50.451844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:50.453035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:50.456967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:51.287801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:51.307996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:51.309668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:51.320037 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea21c5d7-3b2e-4ac1-ad1a-10cbeacca4ca tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 0.930321 Jul 28 11:39:51.320825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1685/3298] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:50 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:51.325620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:51.330177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:51.349111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:51.352250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:51.353240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:51.355466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:51.842729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:51.858974 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-207f49e5-16a7-4cf9-aeae-2947037481bc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 0.535099 Jul 28 11:39:51.861298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1686/3299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:51 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:51.870275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-plugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}, {"server_uuid": "d738d032-8063-4a65-b8bf-ef5d59ddd66d", "name": "network-vif-unplugged", "status": "completed", "tag": "34bf5818-1edb-4eca-9329-40efe66ca604"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:51.921005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:51.923748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:51.962310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] Creating event network-vif-plugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:39:51.972608 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] Creating event network-vif-unplugged:34bf5818-1edb-4eca-9329-40efe66ca604 for instance d738d032-8063-4a65-b8bf-ef5d59ddd66d on n-h2-851368-1 Jul 28 11:39:51.994236 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c3432e56-cbf9-4205-bba0-50bbc4120d1d req-6c778f4f-7b3d-4a97-89a0-729c3257922f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.129106 Jul 28 11:39:51.997786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1687/3300] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:52.014628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:52.028807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:52.066823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:52.067330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:52.068152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:52.068605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.222202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:39:53.224463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:39:53.225223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:39:53.225867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:39:53.226520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:39:53.238374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:53.251121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.253367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.256467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.257164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.321145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:53.324596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:39:53.340707 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0bec2a90-d417-4163-8dde-5d917abcc563 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 1.337228 Jul 28 11:39:53.344731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1688/3301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:51 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:53.350545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Getting quotas for project 4ae7f24a0313467faeea0b42228c6109. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:39:53.359784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-29919a13-91cf-49c1-aa64-d20f20bddb27 req-a6da2541-d5cc-4896-b368-1fe66b362ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d738d032-8063-4a65-b8bf-ef5d59ddd66d", "name": "network-vif-deleted", "tag": "34bf5818-1edb-4eca-9329-40efe66ca604"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:53.366596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Getting quotas for user 11c2646aee7140a5a93be0b1cc8247d3 and project 4ae7f24a0313467faeea0b42228c6109. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:39:53.374326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-29919a13-91cf-49c1-aa64-d20f20bddb27 req-a6da2541-d5cc-4896-b368-1fe66b362ea0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.375459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-29919a13-91cf-49c1-aa64-d20f20bddb27 req-a6da2541-d5cc-4896-b368-1fe66b362ea0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.399476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-29919a13-91cf-49c1-aa64-d20f20bddb27 req-a6da2541-d5cc-4896-b368-1fe66b362ea0 service nova] Creating event network-vif-deleted:34bf5818-1edb-4eca-9329-40efe66ca604 for instance d738d032-8063-4a65-b8bf-ef5d59ddd66d on n-h2-851368-1 Jul 28 11:39:53.405112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:39:53.407180 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-29919a13-91cf-49c1-aa64-d20f20bddb27 req-a6da2541-d5cc-4896-b368-1fe66b362ea0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059824 Jul 28 11:39:53.407453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:39:53.408960 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1689/3302] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:53.417577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:53.419010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:53.427310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.428147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.429885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.430602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.564955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f86ceed-f523-4742-82a3-22cd65430a0f tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.155187 Jul 28 11:39:53.574157 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1614/3303] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:39:53.598283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:53.600228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:53.610367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.611001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.612619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.613231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.864586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:53.875130 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebf32ad2-046c-4bbe-a3a1-ff2d9398298a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.464432 Jul 28 11:39:53.881536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1690/3304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:53 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:53.899875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:53.908573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:53.948540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.954904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:53.957905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:53.961524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:54.366718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:54.375991 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e70a5e5-d173-409d-9335-b9cc5be1a970 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1508 microversion: 2.1 time: 0.800628 Jul 28 11:39:54.376577 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1615/3305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:53 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1508 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:54.393802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:54.405846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:54.406475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:54.410157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:54.417328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:54.420032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a96109fa-8c9e-4fc2-b1e0-8564bf49b404 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 0.523594 Jul 28 11:39:54.420032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1691/3306] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:53 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:54.420439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:54.420889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:54.425220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:54.428524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:54.432514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ac62cca-7bc1-420a-84f4-70f74025be70 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:54.438269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ac62cca-7bc1-420a-84f4-70f74025be70 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:54.761304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8ac62cca-7bc1-420a-84f4-70f74025be70 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:54.797899 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ac62cca-7bc1-420a-84f4-70f74025be70 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1215 microversion: 2.1 time: 0.371386 Jul 28 11:39:54.801681 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1692/3307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:54 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:54.827792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2e2f33cd-2fbc-4d13-bad0-2e7ead7ce8fa req-9573a8a3-87e7-4fdd-8dcc-4449805bca4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8", "name": "network-vif-plugged", "status": "completed", "tag": "1f307096-1cd1-4897-80de-79e94f05a970"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:54.879432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2e2f33cd-2fbc-4d13-bad0-2e7ead7ce8fa req-9573a8a3-87e7-4fdd-8dcc-4449805bca4b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:54.880195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2e2f33cd-2fbc-4d13-bad0-2e7ead7ce8fa req-9573a8a3-87e7-4fdd-8dcc-4449805bca4b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:54.898706 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2e2f33cd-2fbc-4d13-bad0-2e7ead7ce8fa req-9573a8a3-87e7-4fdd-8dcc-4449805bca4b service nova] Creating event network-vif-plugged:1f307096-1cd1-4897-80de-79e94f05a970 for instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 on n-h1-851368-1 Jul 28 11:39:54.906163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2e2f33cd-2fbc-4d13-bad0-2e7ead7ce8fa req-9573a8a3-87e7-4fdd-8dcc-4449805bca4b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098559 Jul 28 11:39:54.911792 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1693/3308] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:54.922161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:54.923871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:54.944346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:54.945041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:54.946651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:54.947331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.560497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:55.572220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-77834e86-b3fa-4b8b-a49a-18e22bc20663 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 1.171336 Jul 28 11:39:55.573059 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1616/3309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:54 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:55.578500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:55.586993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:55.603454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.604338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.606991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.607745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.718840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:55.730847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ebfa3df6-d5e5-42fb-b9be-a4519e518c5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 0.817380 Jul 28 11:39:55.735572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1694/3310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:54 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:55.751517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:55.755978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:55.766908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.771797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.772921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.773521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.892069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:55.909662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c01e5c66-66ae-4b57-b27f-46b05f41bdef tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 200 len: 1508 microversion: 2.1 time: 0.334092 Jul 28 11:39:55.917207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1617/3311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:55 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:55.931595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:55.933622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:55.955056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.962230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:55.972937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:55.973671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.659345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:56.664938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:56.673828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5680eb4a-e1d5-41ae-a533-4d9d92e52125 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.936304 Jul 28 11:39:56.679736 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1695/3312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:55 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:56.698377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:56.702630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8135499f-403a-4fad-8f53-dfdbb0e6f64f req-59a02c46-a471-4e4a-a25e-4a1d36722c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7713992f-bcca-49f0-ab20-ce960564cd34", "tag": "b624c477-b32a-4fe7-976e-9ab87b211f25"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:56.705046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:56.720251 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee92d761-985c-4126-afd5-31bc7af518d4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1362 microversion: 2.26 time: 0.796023 Jul 28 11:39:56.720893 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1618/3313] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:55 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1362 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:39:56.740813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8d2726cf-ca09-4df6-a8df-c254d533e8b4 req-2766004a-fb62-47a7-82b4-1c014c198bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30be6610-ed09-4773-9b5b-4a176e0a3ba8", "tag": "5d3d7e60-2622-4a14-8863-ab772c85aaa8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:56.745285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8135499f-403a-4fad-8f53-dfdbb0e6f64f req-59a02c46-a471-4e4a-a25e-4a1d36722c4e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.747084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8135499f-403a-4fad-8f53-dfdbb0e6f64f req-59a02c46-a471-4e4a-a25e-4a1d36722c4e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.791158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8d2726cf-ca09-4df6-a8df-c254d533e8b4 req-2766004a-fb62-47a7-82b4-1c014c198bc7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.791596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8d2726cf-ca09-4df6-a8df-c254d533e8b4 req-2766004a-fb62-47a7-82b4-1c014c198bc7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.792645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8135499f-403a-4fad-8f53-dfdbb0e6f64f req-59a02c46-a471-4e4a-a25e-4a1d36722c4e service nova] Creating event network-changed:b624c477-b32a-4fe7-976e-9ab87b211f25 for instance 7713992f-bcca-49f0-ab20-ce960564cd34 on n-h2-851368-1 Jul 28 11:39:56.798402 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8135499f-403a-4fad-8f53-dfdbb0e6f64f req-59a02c46-a471-4e4a-a25e-4a1d36722c4e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113819 Jul 28 11:39:56.799789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1696/3314] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:56.806737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:56.807876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:56.818324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.818798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.819623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.821919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.868954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8d2726cf-ca09-4df6-a8df-c254d533e8b4 req-2766004a-fb62-47a7-82b4-1c014c198bc7 service nova] Creating event network-changed:5d3d7e60-2622-4a14-8863-ab772c85aaa8 for instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 on n-h2-851368-1 Jul 28 11:39:56.891575 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8d2726cf-ca09-4df6-a8df-c254d533e8b4 req-2766004a-fb62-47a7-82b4-1c014c198bc7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166950 Jul 28 11:39:56.908565 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1619/3315] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:56.943300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:56.944052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:56.972674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.975484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:56.976783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:56.982121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.044661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:39:57.070375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:57.085545 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f850711-9297-4065-a274-f92d0e06956d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1285 microversion: 2.1 time: 0.283552 Jul 28 11:39:57.103025 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1697/3316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:56 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:57.110037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:57.110888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:57.118149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:57.118861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.119953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:57.120598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.247868 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4dfee40e-e814-4322-898a-9bb5814696cc tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 204 len: 0 microversion: 2.1 time: 0.334192 Jul 28 11:39:57.248470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1620/3317] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:39:56 2022] DELETE /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:39:57.258823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:57.262006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:57.290719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:57.291499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.293078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:57.293698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.568977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:57.583881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fea3f658-1f17-4f5c-87ad-6bcf868ff1ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 0.479323 Jul 28 11:39:57.584480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1698/3318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:57 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:57.617844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1983402751", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fa82a175-031e-4adf-9f10-53e44f495282"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:57.726550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] validate_networks() for [('fa82a175-031e-4adf-9f10-53e44f495282', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:39:57.869815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:57.879704 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8d1f698-ebb0-4c37-b16b-e90033793f5e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 0.629973 Jul 28 11:39:57.880302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1621/3319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:57 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:57.908033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-21668744-e461-43f7-a58a-fb5994a4ce2f req-82a92e20-848c-4b6e-9fd6-f31a197be143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81709a7c-41ea-4c87-82ac-2e64604a82ea", "name": "network-vif-plugged", "status": "completed", "tag": "9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:39:57.933646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-21668744-e461-43f7-a58a-fb5994a4ce2f req-82a92e20-848c-4b6e-9fd6-f31a197be143 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:57.937569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-21668744-e461-43f7-a58a-fb5994a4ce2f req-82a92e20-848c-4b6e-9fd6-f31a197be143 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:57.967422 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-21668744-e461-43f7-a58a-fb5994a4ce2f req-82a92e20-848c-4b6e-9fd6-f31a197be143 service nova] Creating event network-vif-plugged:9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a for instance 81709a7c-41ea-4c87-82ac-2e64604a82ea on n-h1-851368-1 Jul 28 11:39:57.981667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-21668744-e461-43f7-a58a-fb5994a4ce2f req-82a92e20-848c-4b6e-9fd6-f31a197be143 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077090 Jul 28 11:39:57.982624 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1622/3320] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:39:57.987790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:57.995017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:58.005569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:58.006022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:58.008491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:58.009925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:59.574300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:39:59.586857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-57bee5f3-a399-4a62-a84b-d6450f724d47 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 1.602986 Jul 28 11:39:59.603795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1623/3321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:39:57 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:39:59.609388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:39:59.616020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:39:59.632247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:59.633103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:39:59.634127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:39:59.634797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.092266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:00.107583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:00.109475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:00.110951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83da79ad-5cba-4345-a12c-249b72570591 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1546 microversion: 2.26 time: 0.505482 Jul 28 11:40:00.129562 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1624/3322] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:39:59 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1546 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:40:00.136213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:00.143747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:00.156396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.166167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.167615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.168317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.219035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:40:00.220265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:40:00.220769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:40:00.221369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:40:00.221810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:40:00.241298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.241762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.242590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.244675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.287156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:00.292819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:40:00.299660 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d132510-4792-4833-9ccf-539325e84437 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1273 microversion: 2.1 time: 0.168000 Jul 28 11:40:00.308058 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1625/3323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:00 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:00.320738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Getting quotas for user ee97a9f08e1f4bdc84e6811281002555 and project 6a71e0861b4540459987082bc918fbdf. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:40:00.333529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:00.335203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:00.350046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:40:00.352430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:40:00.355942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.366017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.373726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.374996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.455742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cef92dfb-3692-44fd-a461-7c26af3bdb28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.850034 Jul 28 11:40:00.457083 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1699/3324] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:40:00.462842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:00.463829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:00.471529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.473430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.474707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:00.475406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:00.913734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:00.932172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cedd758e-eda8-4ec1-a51c-5efeb1cbdf08 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 0.622739 Jul 28 11:40:00.937406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1626/3325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:00 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:01.005639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d5e0c031-7a8c-48c6-99b2-b29eac85dffe req-6fe06a86-d503-4ca1-8bcd-9e102b5bb955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7713992f-bcca-49f0-ab20-ce960564cd34", "name": "network-vif-plugged", "status": "completed", "tag": "b624c477-b32a-4fe7-976e-9ab87b211f25"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:01.057175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d5e0c031-7a8c-48c6-99b2-b29eac85dffe req-6fe06a86-d503-4ca1-8bcd-9e102b5bb955 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.057640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d5e0c031-7a8c-48c6-99b2-b29eac85dffe req-6fe06a86-d503-4ca1-8bcd-9e102b5bb955 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.089980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:01.098422 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d5e0c031-7a8c-48c6-99b2-b29eac85dffe req-6fe06a86-d503-4ca1-8bcd-9e102b5bb955 service nova] Creating event network-vif-plugged:b624c477-b32a-4fe7-976e-9ab87b211f25 for instance 7713992f-bcca-49f0-ab20-ce960564cd34 on n-h2-851368-1 Jul 28 11:40:01.104094 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da75f801-5a05-407e-a9e3-8fc307903f51 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 0.645693 Jul 28 11:40:01.107650 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1700/3326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:00 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:01.120778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb2848ca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:01.125611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d5e0c031-7a8c-48c6-99b2-b29eac85dffe req-6fe06a86-d503-4ca1-8bcd-9e102b5bb955 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146597 Jul 28 11:40:01.126227 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1627/3327] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:01.154753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e53ff9ab-6feb-439a-933e-b83a10a26dcf tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:01.157564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e53ff9ab-6feb-439a-933e-b83a10a26dcf tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:01.170224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.172937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.173541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:01.219990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.223624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.240243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.242661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.372871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.375552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.379021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e53ff9ab-6feb-439a-933e-b83a10a26dcf tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:01.386986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e53ff9ab-6feb-439a-933e-b83a10a26dcf tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1218 microversion: 2.1 time: 0.251904 Jul 28 11:40:01.407482 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1628/3328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:01 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:01.419095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.419508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.425687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:01.426628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:01.462207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.462674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.470559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.474457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.519660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:01.579571 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1425f3d4-d7d4-4f98-b4de-147625a2ad0e tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-388762246" status: 201 len: 0 microversion: 2.26 time: 0.470719 Jul 28 11:40:01.580601 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1701/3329] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Jul 28 11:40:01 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-388762246 => generated 0 bytes in 472 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 28 11:40:01.595006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:01.599454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:01.619433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.622622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.623737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:01.624353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:01.981358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:01.990846 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95cef085-19e8-4eaa-8c6d-c762f6a88501 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1273 microversion: 2.1 time: 0.409176 Jul 28 11:40:02.011830 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1702/3330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:01 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1273 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.035834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e136736a-211a-41ed-99a0-7f58ec834001 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2ebc061700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.063478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e136736a-211a-41ed-99a0-7f58ec834001 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.067927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e136736a-211a-41ed-99a0-7f58ec834001 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.105100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e136736a-211a-41ed-99a0-7f58ec834001 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-388762246" status: 204 len: 0 microversion: 2.26 time: 0.091583 Jul 28 11:40:02.108670 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1703/3331] 10.222.0.93 () {60 vars in 1358 bytes} [Thu Jul 28 11:40:02 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-388762246 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:02.138282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-53c486c6-254c-4c4d-be4f-fcb97406b5aa req-29bb104a-56dd-41ce-9976-dd987ad434ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e80e3-0309-4e90-8975-92a0a6287584", "name": "network-vif-deleted", "tag": "1b91bf2a-f720-4e08-904a-61b65c2efbcd"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:02.167255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-53c486c6-254c-4c4d-be4f-fcb97406b5aa req-29bb104a-56dd-41ce-9976-dd987ad434ff service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.168053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-53c486c6-254c-4c4d-be4f-fcb97406b5aa req-29bb104a-56dd-41ce-9976-dd987ad434ff service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.197830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-53c486c6-254c-4c4d-be4f-fcb97406b5aa req-29bb104a-56dd-41ce-9976-dd987ad434ff service nova] Creating event network-vif-deleted:1b91bf2a-f720-4e08-904a-61b65c2efbcd for instance a47e80e3-0309-4e90-8975-92a0a6287584 on n-h1-851368-1 Jul 28 11:40:02.209849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-53c486c6-254c-4c4d-be4f-fcb97406b5aa req-29bb104a-56dd-41ce-9976-dd987ad434ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098634 Jul 28 11:40:02.215505 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1704/3332] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:02.224661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.226613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:02.241757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.242226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.245545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.250847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.256058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:02.268636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:02.283890 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0e872b8-7f87-45cf-8023-1bbcb4809448 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.874422 Jul 28 11:40:02.286449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1629/3333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:01 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.294626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb339c430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.307986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.308950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.309754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:02.316795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.317669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.318673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.319359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.416028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.417595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.465944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:02.511862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac117733-f919-4607-9bee-502f59855db9 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 204 len: 0 microversion: 2.26 time: 0.223664 Jul 28 11:40:02.517124 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1630/3334] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Jul 28 11:40:02 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:02.523156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.524001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:02.531228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.531942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.532887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.534560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.639600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:02.651500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e2a22d6-02f2-428e-9bd8-76f8570d315b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1322 microversion: 2.1 time: 0.434439 Jul 28 11:40:02.652119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1705/3335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:02 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.656813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.657431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:02.675411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.675785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.676623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.677081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.806522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:02.816547 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f3f16ab-3f4c-434f-b46f-99c8ab4f078e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1214 microversion: 2.1 time: 0.163342 Jul 28 11:40:02.818624 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1706/3336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:02 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.823685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-349c507b-f9b2-459d-9202-558985cb5e38 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb266f820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.837598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:02.849592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349c507b-f9b2-459d-9202-558985cb5e38 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.850184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9eabda71-c8c2-4548-9314-ab0702e9f263 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 0.327974 Jul 28 11:40:02.852052 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1631/3337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:02 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.852742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349c507b-f9b2-459d-9202-558985cb5e38 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.862656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-349c507b-f9b2-459d-9202-558985cb5e38 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 12 microversion: 2.26 time: 0.042954 Jul 28 11:40:02.873669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb30a3160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:02.879050 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1707/3338] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Jul 28 11:40:02 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:02.884403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.885110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.885912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:02.893781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.894562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.895760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.896418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.920504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:02.933505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.935349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:02.957432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:02.958156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.020821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.021864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:03.033592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:03.037081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.038127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.040795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.042193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.092259 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-907430d4-db4b-4fa5-80a4-bb6992a0ea43 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-279213455" status: 201 len: 0 microversion: 2.26 time: 0.222094 Jul 28 11:40:03.093654 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1632/3339] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Jul 28 11:40:02 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-279213455 => generated 0 bytes in 225 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 28 11:40:03.104796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5fe465b-361d-427c-9393-c87d0b59c7d5 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb24e09d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.129635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5fe465b-361d-427c-9393-c87d0b59c7d5 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.132208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5fe465b-361d-427c-9393-c87d0b59c7d5 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.169189 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5fe465b-361d-427c-9393-c87d0b59c7d5 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 35 microversion: 2.26 time: 0.055816 Jul 28 11:40:03.178458 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1633/3340] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Jul 28 11:40:03 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 35 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:03.190879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb2488160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.207950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.230235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.231175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:03.256663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.257132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.257955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.258415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.328255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:03.335664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.336111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.421368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:03.444487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:03.461523 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8ced256-9144-4782-906a-767b245655d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.444376 Jul 28 11:40:03.463451 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1708/3341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:03 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:03.470732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.472111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:03.479011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.479721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.480744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.482789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.489201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c56261d-b35e-45de-8013-6ab6400cfd76 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-279213455" status: 204 len: 0 microversion: 2.26 time: 0.303765 Jul 28 11:40:03.489201 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1634/3342] 10.222.0.93 () {60 vars in 1361 bytes} [Thu Jul 28 11:40:03 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-279213455 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:03.497917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-894516c0-70e9-4cfd-ba40-92985811b52a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb233c280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.522597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-894516c0-70e9-4cfd-ba40-92985811b52a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.523617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-894516c0-70e9-4cfd-ba40-92985811b52a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.547660 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-894516c0-70e9-4cfd-ba40-92985811b52a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 12 microversion: 2.26 time: 0.053373 Jul 28 11:40:03.552531 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1635/3343] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Jul 28 11:40:03 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 12 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:03.566636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb22fb3a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.587849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.588635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.589386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:03.598582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.600059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.603177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.604567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.633799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.635426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.650480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:03.671233 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e15cd07b-fda2-44da-97d0-f861ab6ecdac tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 204 len: 0 microversion: 2.26 time: 0.111901 Jul 28 11:40:03.672521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1636/3344] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Jul 28 11:40:03 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:03.678606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:03.679993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:03.695624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.697533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.698634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:03.699935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:03.991617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:04.007336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a248904a-8d96-4635-a470-5fb803978d66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.540777 Jul 28 11:40:04.008365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1709/3345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:03 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:04.038093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2ebbf6fa60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:04.083674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.092094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.093187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.110891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.112302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.115371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.116136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.179123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.179785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.197502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.198130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.237532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:04.261069 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b156c7f2-e559-4bff-8f27-5272f61cc2a2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-610375052" status: 201 len: 0 microversion: 2.26 time: 0.249771 Jul 28 11:40:04.262548 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1710/3346] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Jul 28 11:40:04 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-610375052 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 28 11:40:04.270996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:04.271664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.280162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.280682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.282596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.283047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.353855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:04.370865 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67866cdf-3d14-42ea-ab62-1ce5d22df35a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1517 microversion: 2.1 time: 0.696028 Jul 28 11:40:04.375122 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1637/3347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:03 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1517 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:04.388868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:04.389730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.400938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.401381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.402651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.402651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.500502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:04.513522 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5838041-6500-485b-923c-b6814190c982 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1276 microversion: 2.1 time: 0.248968 Jul 28 11:40:04.514695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1711/3348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:04 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:04.520134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb2686550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:04.531836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.534326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.535346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.542745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.543664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.545379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.546303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.587424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.588342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.607394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.608245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.654320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:04.685937 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f674be4e-3872-40cb-a7ac-8c27fd8f0e74 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-612702358" status: 201 len: 0 microversion: 2.26 time: 0.169838 Jul 28 11:40:04.692705 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1712/3349] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Jul 28 11:40:04 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-612702358 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 28 11:40:04.703707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:04.707284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.716154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.716859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.717836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.718436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.766844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:04.769741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'flavor' on Instance uuid 7713992f-bcca-49f0-ab20-ce960564cd34 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:04.778713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b3381aa-f095-4d1f-8e25-80977c7c1463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1683 microversion: 2.1 time: 0.402460 Jul 28 11:40:04.785113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1638/3350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:04 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1683 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:04.789980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:04.794447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:04.807476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.816091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.817577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:04.818251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:04.940625 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fc0234c-a2c0-43a6-9d5e-a1116cfaf6e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action" status: 200 len: 32 microversion: 2.1 time: 0.242450 Jul 28 11:40:04.942060 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1713/3351] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:04 2022] POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:40:04.950811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb320e3a0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:05.015904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.016967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.019252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:05.033353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.034561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.036429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.037477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.083667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.084120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.107809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:05.136561 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddf5f01c-1902-467c-a547-ddf497cad08a tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 204 len: 0 microversion: 2.26 time: 0.193083 Jul 28 11:40:05.137675 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1714/3352] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Jul 28 11:40:04 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:05.142458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:05.150999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:05.157098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.157578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.158383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.158832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.202642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:05.215804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b63e24f-19e2-4903-a5f5-f183305f5b02 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.429386 Jul 28 11:40:05.227095 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1639/3353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:04 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:05.227095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:05.227095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:05.243779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.244606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.246378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.247274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.806028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:05.814191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e0de6be-408b-435b-b142-3bb7091982a8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.675280 Jul 28 11:40:05.828042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1715/3354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:05 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:05.834278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47cc38b5-6f5f-4668-9796-551f44d444a6 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2ebbed4f70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:05.842522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47cc38b5-6f5f-4668-9796-551f44d444a6 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.843255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47cc38b5-6f5f-4668-9796-551f44d444a6 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.846980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:05.854109 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47cc38b5-6f5f-4668-9796-551f44d444a6 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 12 microversion: 2.26 time: 0.024001 Jul 28 11:40:05.860067 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1716/3355] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Jul 28 11:40:05 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:05.866212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:05.867046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:05.873329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.874031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:05.874973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:05.875733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.004230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:06.014712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:06.019770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09faf065-2078-4b30-bcc4-e92ea635ef0c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.801862 Jul 28 11:40:06.022551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3099195d-99b6-48e9-b5fa-4d830ddc6a29 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1276 microversion: 2.1 time: 0.161114 Jul 28 11:40:06.038024 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1717/3356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:05 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:06.038024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-475e4b92-bf95-4406-bd66-2b1fee7535a8 req-1eb53aee-c20b-4f35-b239-e91135e6d94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30be6610-ed09-4773-9b5b-4a176e0a3ba8", "name": "network-vif-plugged", "status": "completed", "tag": "5d3d7e60-2622-4a14-8863-ab772c85aaa8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:06.038920 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1640/3357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:05 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:06.060652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-475e4b92-bf95-4406-bd66-2b1fee7535a8 req-1eb53aee-c20b-4f35-b239-e91135e6d94a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.061115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-475e4b92-bf95-4406-bd66-2b1fee7535a8 req-1eb53aee-c20b-4f35-b239-e91135e6d94a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.062147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:06.063215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:06.073582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.074382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.075718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.076435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.089294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-475e4b92-bf95-4406-bd66-2b1fee7535a8 req-1eb53aee-c20b-4f35-b239-e91135e6d94a service nova] Creating event network-vif-plugged:5d3d7e60-2622-4a14-8863-ab772c85aaa8 for instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 on n-h2-851368-1 Jul 28 11:40:06.098164 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-475e4b92-bf95-4406-bd66-2b1fee7535a8 req-1eb53aee-c20b-4f35-b239-e91135e6d94a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069665 Jul 28 11:40:06.098815 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1718/3358] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:06.114923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb2cbf430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:06.138980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.140015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.140176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:06.151833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.152293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.153099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.153541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.208514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.209014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.221285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:06.242541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dcd9385d-5e81-46c4-95da-4cbc070a22fc tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 204 len: 0 microversion: 2.26 time: 0.138458 Jul 28 11:40:06.244481 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1719/3359] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Jul 28 11:40:06 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:06.249823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:06.251338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:06.261013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.262511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.264603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.265639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.542098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:06.555464 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-69412e44-64f6-48bb-ad12-a76890693349 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.511068 Jul 28 11:40:06.567859 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1641/3360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:06 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:06.578065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb30a33a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:06.589755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.590410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.591100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:06.629799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.630437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.631499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.632098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.682036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.692852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.702605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.703095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.760395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:06.793320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c5df74f-72e0-4b72-bd9a-69bffe60b4b0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-2056461905" status: 201 len: 0 microversion: 2.26 time: 0.223480 Jul 28 11:40:06.794249 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1642/3361] 10.222.0.93 () {62 vars in 1380 bytes} [Thu Jul 28 11:40:06 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-2056461905 => generated 0 bytes in 226 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 11:40:06.804478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:06.805108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:06.811701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.812151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:06.812938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:06.813485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.323717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:07.341295 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f05d10dd-a151-473b-8d0a-dbfa7ec80db7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 1.095473 Jul 28 11:40:07.341950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1720/3362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:06 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:07.352892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb27e5700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:07.400712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.401598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.410061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:07.417378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:07.419593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.420290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.421344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.422087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.494387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.495187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.520903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.524265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.561729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:07.579969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:07.586084 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9c1329b-20f8-4200-a65b-cfe7c43b5fa4 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-1992738237" status: 201 len: 0 microversion: 2.26 time: 0.239530 Jul 28 11:40:07.586767 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1721/3363] 10.222.0.93 () {62 vars in 1380 bytes} [Thu Jul 28 11:40:07 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags/tempest-tag-1992738237 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 11:40:07.590707 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c761254d-8436-4f4a-af36-a6e5f0b941c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.795319 Jul 28 11:40:07.593297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:07.593915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:07.596998 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1643/3364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:06 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:07.602469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:07.607618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:07.620351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.620761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.621587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.622038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.623248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.625727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:07.628198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:07.629819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.207229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:08.209812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:08.217607 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-454a1845-c816-431a-a9df-ec4a13786b21 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1308 microversion: 2.1 time: 0.619261 Jul 28 11:40:08.224219 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1644/3365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:07 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:08.233864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:08.241824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:08.246267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:08.250754 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f28f3b4-cd90-4532-9382-03c328ef552b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.662858 Jul 28 11:40:08.258940 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1722/3366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:07 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:08.264472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0dfa1b11-6781-491b-90a9-459bf1999e21 req-021f852c-436e-449d-920c-bc56a2da31b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ba6677-4f7c-48cb-913e-f7f6bfa10192", "tag": "728ec7b4-04c9-4977-b413-54408569c949"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:08.272757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.287817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.288683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.294751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.319512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0dfa1b11-6781-491b-90a9-459bf1999e21 req-021f852c-436e-449d-920c-bc56a2da31b8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.319865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0dfa1b11-6781-491b-90a9-459bf1999e21 req-021f852c-436e-449d-920c-bc56a2da31b8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.349404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0dfa1b11-6781-491b-90a9-459bf1999e21 req-021f852c-436e-449d-920c-bc56a2da31b8 service nova] Creating event network-changed:728ec7b4-04c9-4977-b413-54408569c949 for instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 on n-h1-851368-1 Jul 28 11:40:08.355283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0dfa1b11-6781-491b-90a9-459bf1999e21 req-021f852c-436e-449d-920c-bc56a2da31b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093561 Jul 28 11:40:08.356461 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1723/3367] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:08.366347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Action: 'update_all', calling method: .version_select at 0x7f2eb2cd9280>, body: {"tags": ["tempest-tag-350870393", "tempest-tag-157035150"]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:08.407646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.408108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.408759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:08.449578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.449899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.450694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.451218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.509017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.509475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.541611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:08.574507 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-09059ecd-695f-4f95-81ed-6e3f49dc257d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 60 microversion: 2.26 time: 0.216120 Jul 28 11:40:08.576728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1724/3368] 10.222.0.93 () {62 vars in 1312 bytes} [Thu Jul 28 11:40:08 2022] PUT /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 60 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:08.598964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6b620cf2-5950-4b87-acc8-a0d888e5b2a4 req-2d1fc07a-d148-4563-b309-76927951f664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:08.614728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6b620cf2-5950-4b87-acc8-a0d888e5b2a4 req-2d1fc07a-d148-4563-b309-76927951f664 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.615604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6b620cf2-5950-4b87-acc8-a0d888e5b2a4 req-2d1fc07a-d148-4563-b309-76927951f664 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.658509 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6b620cf2-5950-4b87-acc8-a0d888e5b2a4 req-2d1fc07a-d148-4563-b309-76927951f664 service nova] Creating event network-vif-unplugged:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:40:08.673056 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6b620cf2-5950-4b87-acc8-a0d888e5b2a4 req-2d1fc07a-d148-4563-b309-76927951f664 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094857 Jul 28 11:40:08.674369 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1725/3369] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:08.684084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:08.684850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:08.704660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.705170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:08.706068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:08.706401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.228759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:09.238153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:09.241470 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a54ffec-5265-44cf-8374-542a62eb24fa tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 1.015905 Jul 28 11:40:09.243126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1645/3370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:08 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:09.248266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec58dabb-4cab-45e4-b2dc-d745e41e0048 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb24e01f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.259312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7ceaa02-22cf-4f65-b30b-73d11b3b6fea tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.579468 Jul 28 11:40:09.262893 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1726/3371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:08 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:09.279483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.280256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:09.280392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec58dabb-4cab-45e4-b2dc-d745e41e0048 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.282783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec58dabb-4cab-45e4-b2dc-d745e41e0048 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.302216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.303152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.308131 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec58dabb-4cab-45e4-b2dc-d745e41e0048 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 200 len: 60 microversion: 2.26 time: 0.061699 Jul 28 11:40:09.308326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.309489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.311178 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1646/3372] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Jul 28 11:40:09 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 60 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:09.320377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.321008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:09.337453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.337911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.339024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.341749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.749480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:09.769201 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a2c4ec2-ed92-4949-a16c-ccf963874c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.504961 Jul 28 11:40:09.771274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:09.773108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1727/3373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:09 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:09.779605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.780512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:09.782850 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fb466ea-9ceb-4b38-9b82-1cc3345b304e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1489 microversion: 2.1 time: 0.469153 Jul 28 11:40:09.784581 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1647/3374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:09 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1489 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:09.790902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '.version_select at 0x7f2eb2f210d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.804988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.806379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.807335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.808017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.829102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.830316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.830827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:09.846868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:09.849649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.850176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.850973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.851458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.886921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.887420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.915510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'flavor' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:09.944188 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2aadd906-2c77-4b64-9875-4b3a11132720 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags" status: 204 len: 0 microversion: 2.26 time: 0.157583 Jul 28 11:40:09.949369 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1648/3375] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Jul 28 11:40:09 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:09.954485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:09.958378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:09.967390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.968100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:09.970236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:09.974100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.270517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:10.310182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:10.333935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f2c4c6ba-17ee-4ace-8229-8b2a617531ca tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.559396 Jul 28 11:40:10.334554 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1728/3376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:09 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:10.358480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b73adf8f-14af-4ecf-bf11-03f284726e45 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:10.378039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:10.383709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b73adf8f-14af-4ecf-bf11-03f284726e45 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.385339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b73adf8f-14af-4ecf-bf11-03f284726e45 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.423012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b73adf8f-14af-4ecf-bf11-03f284726e45 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:40:10.442469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:10.451434 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f78ccfb6-6285-4ba6-8aa2-c3fc7b290ff5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.500706 Jul 28 11:40:10.456290 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1649/3377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:09 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:10.466568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-20c82ca1-a193-4f98-9858-c68e7e50d7fe req-5c2d73cd-825d-4821-840e-63f00a290793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadcf824-cdae-453a-85eb-2f8c94bb16c1", "tag": "1ea298a8-8b1a-4e22-89c6-848c6568e900"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:10.490522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20c82ca1-a193-4f98-9858-c68e7e50d7fe req-5c2d73cd-825d-4821-840e-63f00a290793 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.491833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20c82ca1-a193-4f98-9858-c68e7e50d7fe req-5c2d73cd-825d-4821-840e-63f00a290793 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.500027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b73adf8f-14af-4ecf-bf11-03f284726e45 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8/action" status: 202 len: 0 microversion: 2.1 time: 0.164222 Jul 28 11:40:10.512434 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1729/3378] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:10 2022] POST /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:40:10.545252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:10.545903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:10.550741 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-20c82ca1-a193-4f98-9858-c68e7e50d7fe req-5c2d73cd-825d-4821-840e-63f00a290793 service nova] Creating event network-changed:1ea298a8-8b1a-4e22-89c6-848c6568e900 for instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 on n-h2-851368-1 Jul 28 11:40:10.556649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.557327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.558518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.559198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.562884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-20c82ca1-a193-4f98-9858-c68e7e50d7fe req-5c2d73cd-825d-4821-840e-63f00a290793 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104297 Jul 28 11:40:10.564145 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1650/3379] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:10.575568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:10.577845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:10.591121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.592614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.594288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.594972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.645610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:40:10.653385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:10.754088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2370762a-396b-44d7-bf4d-6e4d694489d2 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 204 len: 0 microversion: 2.26 time: 0.236627 Jul 28 11:40:10.755155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1730/3380] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:40:10 2022] DELETE /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:40:10.770468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:10.771466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:10.789557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.790055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.790869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.791342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.923598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:10.934755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-525aab07-9ecf-4784-a605-679a93379301 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.366215 Jul 28 11:40:10.936929 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1651/3381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:10 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:10.942751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:10.943645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:10.951515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.952251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:10.953257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:10.953930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.144762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.161116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31f039d6-67b8-4d74-abc8-0cc660610b8a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.402989 Jul 28 11:40:11.178457 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1731/3382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:10 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:11.182480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:11.183241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.191992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.192792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.193222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.193665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.316189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.324704 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-692676c4-4d1c-4637-a8e4-9969b9a01dde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.386238 Jul 28 11:40:11.325656 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1652/3383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:10 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:11.331704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:11.332582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.339278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.340300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.341313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.341981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.393408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:11.412315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.428477 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f68989f-e5b8-4f93-ba4e-60d4eb69f320 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.244191 Jul 28 11:40:11.429137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1732/3384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:11 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:11.437723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:11.442385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.458543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.459005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.460625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.461077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.580721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.581443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b705bae-bbd6-4c6d-88b9-8fd390de4d55 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.150863 Jul 28 11:40:11.582093 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1733/3385] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:11 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:40:11.591578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.593385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.593574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:11.594290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.595165 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-943ddfd0-0674-470a-9bba-de4595c189c0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1552 microversion: 2.26 time: 0.268198 Jul 28 11:40:11.596788 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1653/3386] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:40:11 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1552 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:40:11.601470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:11.602240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.608508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.609147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.610107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.610692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.617243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.617947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.618929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.619564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.842546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.853959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aad42222-edfd-45ed-9cf7-f224b9396e25 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.269651 Jul 28 11:40:11.868865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1734/3387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:11 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:11.900293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:11.908349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8567f5a7-0286-4e4c-825e-c2a147b2082a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1672 microversion: 2.1 time: 0.310308 Jul 28 11:40:11.909683 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1654/3388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:11 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:11.960041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:11.960927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:11.975976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.976674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:11.977765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:11.978575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.183767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:12.184742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:12.195599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.196048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.207149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.207594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.376515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:12.392795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da6b2d6e-2819-4431-af38-64f464b43ac3 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.438521 Jul 28 11:40:12.395347 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1735/3389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:11 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:12.450152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:12.450943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:12.463532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.464246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.475052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.475688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.564840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:12.587015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ec35814-428d-4311-a9a3-b1c2412135b7 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.408487 Jul 28 11:40:12.600754 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1655/3390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:12 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:12.629205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:12.631774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:12.649011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.649773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:12.655052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:12.655547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.322228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.333428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b60728ea-6c26-4e98-80a9-071eb23a3c07 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.887643 Jul 28 11:40:13.334833 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1736/3391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:12 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:13.341045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:13.341222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.342035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:13.349823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.350492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.351323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.352288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.354705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.360420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.361734 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26fecf1f-e294-45ed-b7a0-f5eee69f3dbd tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1552 microversion: 2.26 time: 0.738004 Jul 28 11:40:13.362322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1656/3392] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:40:12 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1552 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:40:13.376376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:13.377540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:13.386331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.387013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.387969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.388638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.735558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.750124 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-248eac5d-7412-49e1-9900-112046177fe9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.412701 Jul 28 11:40:13.751347 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1737/3393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:13 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:13.761117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:13.761940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:13.769012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.769203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:13.770142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.771104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.771708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.780263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-90fb449a-8785-4ef7-8571-9d30e7b01411 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1672 microversion: 2.1 time: 0.416879 Jul 28 11:40:13.792845 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1657/3394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:13 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1672 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:13.805451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:13.806500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:13.816698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.817607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:13.818727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:13.819451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.173613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.174417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.184704 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2cdcdfd4-0d94-42c8-adee-d1c0844a9613 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.384943 Jul 28 11:40:14.189975 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1658/3395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:13 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:14.192414 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73a995a9-9f24-4c54-8365-a167da861c3d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.439034 Jul 28 11:40:14.195453 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1738/3396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:13 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:14.198871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f298840d-4bfb-4e95-b3f1-2e87ab667bba req-5aad7cdd-4332-4572-8bb7-844a961b3f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ba6677-4f7c-48cb-913e-f7f6bfa10192", "name": "network-vif-plugged", "status": "completed", "tag": "728ec7b4-04c9-4977-b413-54408569c949"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:14.219134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f298840d-4bfb-4e95-b3f1-2e87ab667bba req-5aad7cdd-4332-4572-8bb7-844a961b3f4b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.223015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f298840d-4bfb-4e95-b3f1-2e87ab667bba req-5aad7cdd-4332-4572-8bb7-844a961b3f4b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.247170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f298840d-4bfb-4e95-b3f1-2e87ab667bba req-5aad7cdd-4332-4572-8bb7-844a961b3f4b service nova] Creating event network-vif-plugged:728ec7b4-04c9-4977-b413-54408569c949 for instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 on n-h1-851368-1 Jul 28 11:40:14.255541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f298840d-4bfb-4e95-b3f1-2e87ab667bba req-5aad7cdd-4332-4572-8bb7-844a961b3f4b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063954 Jul 28 11:40:14.257077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1659/3397] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:14.362836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:14.364305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:14.376393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.377536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.378536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.379748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.386526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:14.388436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:14.402966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.403466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.404262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.404703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.863728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.871195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.876616 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8952402-4f0a-4234-8ece-8e3acd758b60 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.523702 Jul 28 11:40:14.881566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1739/3398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:14 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:14.887935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:14.888284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.889888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:14.893743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ca512d8-f6e2-4c1a-9589-a646fe63838f tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1552 microversion: 2.26 time: 0.511567 Jul 28 11:40:14.895621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:14.904173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.905170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.906270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.906940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.909234 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1660/3399] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:40:14 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1552 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:40:14.917568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:14.919390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:14.935927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.936742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:14.938762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:14.971127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.432727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:15.448713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cd4200c-606b-404a-8695-a15ad82147b2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1677 microversion: 2.1 time: 0.532551 Jul 28 11:40:15.449549 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1661/3400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:14 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1677 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:15.462818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fa983715-f339-4176-90f4-27dba9bd8eb4 req-407bd6dc-506f-4079-96ac-e59aaddb0cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8", "name": "network-vif-deleted", "tag": "1f307096-1cd1-4897-80de-79e94f05a970"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:15.487965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa983715-f339-4176-90f4-27dba9bd8eb4 req-407bd6dc-506f-4079-96ac-e59aaddb0cec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.488540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa983715-f339-4176-90f4-27dba9bd8eb4 req-407bd6dc-506f-4079-96ac-e59aaddb0cec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.513252 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fa983715-f339-4176-90f4-27dba9bd8eb4 req-407bd6dc-506f-4079-96ac-e59aaddb0cec service nova] Creating event network-vif-deleted:1f307096-1cd1-4897-80de-79e94f05a970 for instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 on n-h1-851368-1 Jul 28 11:40:15.523783 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fa983715-f339-4176-90f4-27dba9bd8eb4 req-407bd6dc-506f-4079-96ac-e59aaddb0cec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072635 Jul 28 11:40:15.524408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1662/3401] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:15.537163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:15.537887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:15.553222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:15.554027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.554497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.563936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.564282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8175c07-1627-414b-93fa-db4b21435e91 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.681135 Jul 28 11:40:15.565155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.578240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1740/3402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:14 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:15.587802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:15.589308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:15.592838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:15.601052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.602515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.603983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.604981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.928307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:15.936597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab355de9-15ed-4848-b3ad-741e9f5ff4c9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1315 microversion: 2.1 time: 0.409967 Jul 28 11:40:15.956631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:15.963993 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1663/3403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:15 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:15.975351 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5880f336-1ee6-43e1-b3c3-5efa26a5459e tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.392713 Jul 28 11:40:15.976215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1741/3404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:15 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:15.979126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:15.980100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:15.986749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.987520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:15.991523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:15.992456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:15.996334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:15.999132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.003789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.005958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.008270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.009461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.056639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.057202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.058008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lazy-loading 'fault' on Instance uuid cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:16.158956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.173134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.174250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a09424fec5e437b9e28f420a0d4f30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91afeb2f85334598abadeb8ac8deb181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.178998 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-656b01db-4c71-42f5-83f7-f7f4afe85de0 tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 200 len: 1352 microversion: 2.26 time: 0.197880 Jul 28 11:40:16.180012 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1742/3405] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:40:15 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 1352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:40:16.287442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-349165a0-e4b3-4805-995f-eb97af46c0c2 req-e554dce1-ae96-4703-86ba-2380db89dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8", "name": "network-vif-unplugged", "status": "completed", "tag": "1f307096-1cd1-4897-80de-79e94f05a970"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:16.318526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-349165a0-e4b3-4805-995f-eb97af46c0c2 req-e554dce1-ae96-4703-86ba-2380db89dd26 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.322142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-349165a0-e4b3-4805-995f-eb97af46c0c2 req-e554dce1-ae96-4703-86ba-2380db89dd26 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.376044 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-349165a0-e4b3-4805-995f-eb97af46c0c2 req-e554dce1-ae96-4703-86ba-2380db89dd26 service nova] Creating event network-vif-unplugged:1f307096-1cd1-4897-80de-79e94f05a970 for instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 on n-h1-851368-1 Jul 28 11:40:16.382793 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-349165a0-e4b3-4805-995f-eb97af46c0c2 req-e554dce1-ae96-4703-86ba-2380db89dd26 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102638 Jul 28 11:40:16.383734 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1743/3406] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:16.387759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.397021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8ce01a9-93d3-4763-af17-ada3527d7da9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.431581 Jul 28 11:40:16.398674 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1664/3407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:15 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:16.476270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:16.476985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:16.484005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.484678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.485469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.485915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.586234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:16.586941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:16.593692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.594441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.595958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.596616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.838052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.846579 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5033d05-8c6e-4049-998b-eafdcf3837f4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.374119 Jul 28 11:40:16.862582 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1744/3408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:16.867809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:16.870102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:16.876192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.876660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.877678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.878301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.882277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:16.945881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ca9c0aa-62f4-4348-95f6-99d19f863334 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 200 len: 322 microversion: 2.1 time: 0.081563 Jul 28 11:40:16.947281 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1745/3409] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:16 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 322 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:16.960570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:16.962574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:16.962888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:16.982876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.983378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.984189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:16.984638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:16.989468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad9ff92a-dc89-4a9f-9571-b86cf9abc456 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.407584 Jul 28 11:40:16.990321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1665/3410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:16 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:16.997024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:16.997656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:17.014710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.015536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.016671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.017353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.686009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:17.695352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aecbb41a-81eb-4247-9f21-54c22ad7feab tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1503 microversion: 2.1 time: 0.741295 Jul 28 11:40:17.697999 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1746/3411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:16 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1503 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:17.702892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:17.703624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:17.710044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:17.721021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9403b80b-2f0b-4693-a630-ee66b08dc635 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.727725 Jul 28 11:40:17.721615 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1666/3412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:17.724332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.726540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:17.727186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] [instance: cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:17.727320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.728141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.728577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.739289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.739743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.740725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.741172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.761987 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] HTTP exception thrown: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Request method failure captured: Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 HTTP/1.1 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVeB-c-4Kzw90JXq6DuLvV141OBrRm3qdBhGSx-co-xJp3lRsL7Hi5TShBV56NVRRw8NMz5DgKeRpfmo-c11LfF1XJTC0kA431zaOvTHdmP3XVBEdc2aknV9FpCYijh4iGC5BitawKtC90qq6ag1cQe3HKB48Ioo4LhcIqU1eUradk Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.26 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 91afeb2f85334598abadeb8ac8deb181 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerTagsTestJSON-283698982 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/91afeb2f85334598abadeb8ac8deb181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/91afeb2f85334598abadeb8ac8deb181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_91afeb2f85334598abadeb8ac8deb181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/91afeb2f85334598abadeb8ac8deb181"}]}] Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerTagsTestJSON-283698982 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 91afeb2f85334598abadeb8ac8deb181 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerTagsTestJSON-283698982 Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerTagsTestJSON-283698982-project Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a09424fec5e437b9e28f420a0d4f30d Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerTagsTestJSON-283698982-project Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8'} Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:17.764009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] Returning 404 to user: Instance cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf88f7c8-299e-4659-b7c9-6bad8021a43d tempest-ServerTagsTestJSON-283698982 tempest-ServerTagsTestJSON-283698982-project] 10.222.0.93 "GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8" status: 404 len: 111 microversion: 2.26 time: 0.045727 Jul 28 11:40:17.770265 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1667/3413] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:40:17 2022] GET /compute/v2.1/servers/cb22cdd7-700e-4c4b-bf2b-9b8d17d431b8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:40:17.778498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:17.779495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:17.788112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.788602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:17.789404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:17.790290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.209899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:18.223048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:18.225722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-01d99993-6e9d-43f3-909e-752992f72ca1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.525931 Jul 28 11:40:18.226887 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1747/3414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:17 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:18.233254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:18.234054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:18.234207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca03b380-fd6f-4fdf-993d-88b1c12e2aa8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.461064 Jul 28 11:40:18.243100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.243283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.248668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.248668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.249822 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1668/3415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:17 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:18.264107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:18.264737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:18.278139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.278604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.279424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.280567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.314644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:40:18.523862 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b254a281-50a0-4e59-999f-8c63abe86eb9 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "DELETE /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 204 len: 0 microversion: 2.1 time: 0.295045 Jul 28 11:40:18.524774 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1748/3416] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:18 2022] DELETE /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:40:18.533209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:18.533931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:18.552159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.552436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.553179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.558706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.687148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:18.702628 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f51f18c4-5927-427d-b8e8-113fe6d96097 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.442411 Jul 28 11:40:18.710059 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1669/3417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:18 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:18.715325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4588facc-d5b9-40d5-8159-2d4f1ac5b3b6 req-39191647-831e-4345-a42d-c2ed3f6789aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcf824-cdae-453a-85eb-2f8c94bb16c1", "name": "network-vif-plugged", "status": "completed", "tag": "1ea298a8-8b1a-4e22-89c6-848c6568e900"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:18.754413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4588facc-d5b9-40d5-8159-2d4f1ac5b3b6 req-39191647-831e-4345-a42d-c2ed3f6789aa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.755302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4588facc-d5b9-40d5-8159-2d4f1ac5b3b6 req-39191647-831e-4345-a42d-c2ed3f6789aa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.771673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4588facc-d5b9-40d5-8159-2d4f1ac5b3b6 req-39191647-831e-4345-a42d-c2ed3f6789aa service nova] Creating event network-vif-plugged:1ea298a8-8b1a-4e22-89c6-848c6568e900 for instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 on n-h2-851368-1 Jul 28 11:40:18.778983 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4588facc-d5b9-40d5-8159-2d4f1ac5b3b6 req-39191647-831e-4345-a42d-c2ed3f6789aa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066931 Jul 28 11:40:18.780162 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1670/3418] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:18.789617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:18.790340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:18.801198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.802095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.803668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.804457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.851511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:18.861896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c29bfce7-9bfe-4528-8f6d-6e7bcfa53da9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.335125 Jul 28 11:40:18.879216 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1749/3419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:18 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:18.879216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:18.879216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:18.894389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.896429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:18.897498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:18.900181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.247436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:19.257991 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7d0a1b4c-c891-4533-8aeb-780222886609 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.389705 Jul 28 11:40:19.271663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:19.272919 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1750/3420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:18 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:19.280936 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65678f91-fb2f-408e-91eb-6ebfe442ea69 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1509 microversion: 2.1 time: 0.498702 Jul 28 11:40:19.281785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:19.281942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1671/3421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:18 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:19.292906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:19.293530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:19.296502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:19.306112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.306584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.307410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.307857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.310097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.310956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.313357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.314619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.638933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:19.644636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:19.666065 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e94a5d23-0ede-48d9-bccf-138133fe8147 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1318 microversion: 2.1 time: 0.389169 Jul 28 11:40:19.668488 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1751/3422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:19 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:19.672444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a6709f0-aeef-4537-845a-9c7225c2b9f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.386230 Jul 28 11:40:19.686748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:19.686748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:19.687281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1672/3423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:19 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:19.693007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.693432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.694649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.694805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.888535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:19.890700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:19.905751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.910693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.911869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:19.914512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:19.950442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:19.964776 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1209d52d-a033-4227-a05a-27ec57e53248 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.292800 Jul 28 11:40:19.965367 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1752/3424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:19 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:20.114225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-906145950", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fe6b5fcd-50fa-4151-8267-beaa12b03a0e"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:20.209754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] validate_networks() for [('fe6b5fcd-50fa-4151-8267-beaa12b03a0e', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:40:20.506850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:20.543022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2c8443e-a0cb-41b5-a19e-56a59638cadf tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.655311 Jul 28 11:40:20.556749 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1673/3425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:19 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:20.581376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:20.582254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:20.591965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:20.593389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:20.595828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:20.596935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:21.346093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c2646aee7140a5a93be0b1cc8247d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae7f24a0313467faeea0b42228c6109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:21.355231 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a8132ea-6072-4186-a0f1-a1a77a522a7d tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 200 len: 1509 microversion: 2.1 time: 0.779670 Jul 28 11:40:21.356533 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1674/3426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:20 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 1509 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:21.372505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:21.373415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:21.385691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:21.397120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:21.398928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:21.400168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.500523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:22.508953 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af990dd9-5ea2-4ad1-92d6-54bd1e5bb4ba tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1507 microversion: 2.1 time: 1.151108 Jul 28 11:40:22.515086 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1675/3427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:21 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1507 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:22.534287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:22.534903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:22.544820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.545283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.546427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.546818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:40:22.547465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.550431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:40:22.552008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:40:22.552659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:40:22.553321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:40:22.575349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.575813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.576720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.577177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.615629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:40:22.623373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:40:22.645891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:40:22.649169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:40:22.716182 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55153310-7bd5-48b2-8ccc-1192f3a0e748 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.606021 Jul 28 11:40:22.724333 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1753/3428] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:40:22.731784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:22.732555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:22.746545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.747633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:22.748130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:22.748800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.134183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:23.149471 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9b21015-eb2b-4078-9c41-cf4a5d3b9e20 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.631985 Jul 28 11:40:23.164469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1676/3429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:22 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:23.255113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:23.267580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ccfef4f-3085-4472-b338-a83922991b68 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.541555 Jul 28 11:40:23.268165 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1754/3430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:22 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:23.286101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.288556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.303665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.304370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.306016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.308170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.351794 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 HTTP/1.1 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '04ba6677-4f7c-48cb-913e-f7f6bfa10192'} Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.356154 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.360354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.362517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.364785 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-33eb6249-34c6-4474-a2cd-319a7a7979d8 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 404 len: 111 microversion: 2.1 time: 0.094651 Jul 28 11:40:23.367399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1755/3431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:23 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.372383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.382070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.384812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:23.397988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.398728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.400039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.400672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.403806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-824c51e5-5385-4ef1-bfdf-1bc6e6b55ba6 req-ba925ccd-1a35-4068-8cf8-c888175d8bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ba6677-4f7c-48cb-913e-f7f6bfa10192", "name": "network-vif-deleted", "tag": "728ec7b4-04c9-4977-b413-54408569c949"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.428880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-824c51e5-5385-4ef1-bfdf-1bc6e6b55ba6 req-ba925ccd-1a35-4068-8cf8-c888175d8bfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.431987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-824c51e5-5385-4ef1-bfdf-1bc6e6b55ba6 req-ba925ccd-1a35-4068-8cf8-c888175d8bfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.451253 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-824c51e5-5385-4ef1-bfdf-1bc6e6b55ba6 req-ba925ccd-1a35-4068-8cf8-c888175d8bfd service nova] Creating event network-vif-deleted:728ec7b4-04c9-4977-b413-54408569c949 for instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 on n-h1-851368-1 Jul 28 11:40:23.456298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-824c51e5-5385-4ef1-bfdf-1bc6e6b55ba6 req-ba925ccd-1a35-4068-8cf8-c888175d8bfd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292220 Jul 28 11:40:23.456906 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1677/3432] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:23.462242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.462946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.471280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.471743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.472661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.473105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.559808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:23.568945 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55b3d2fa-c1d9-48ba-bc4a-0cad2339385d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1218 microversion: 2.1 time: 0.110804 Jul 28 11:40:23.583092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1678/3433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:23 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:23.584133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1331898659", "metadata": {"image_type": "test"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.589624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.599044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.599822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.600941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.601542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.624214 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192/action HTTP/1.1 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 112 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1331898659", "metadata": {"image_type": "test"}}} Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '04ba6677-4f7c-48cb-913e-f7f6bfa10192', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1331898659', 'metadata': {'image_type': 'test'}}}} Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:40:23.626890 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.631434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.633120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a77e51b1-1d8c-4da4-a84a-ac8a49f3892a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "POST /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192/action" status: 404 len: 111 microversion: 2.1 time: 0.056034 Jul 28 11:40:23.639121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:23.641648 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1679/3434] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 28 11:40:23 2022] POST /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.649510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1818784119", "metadata": {"image_type": "test"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.653739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Failed to fetch instance by id tempest-invalid-75808828 {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:40:23.654266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance tempest-invalid-75808828 could not be found. Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/tempest-invalid-75808828/action HTTP/1.1 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 112 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1818784119", "metadata": {"image_type": "test"}}} Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance tempest-invalid-75808828 could not be found. Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'tempest-invalid-75808828', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1818784119', 'metadata': {'image_type': 'test'}}}} Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-75808828 could not be found. Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-75808828 could not be found. Jul 28 11:40:23.656360 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-75808828 could not be found. Jul 28 11:40:23.662914 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.664036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-170c20a7-abbf-49f9-9e90-73854f194f28 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1507 microversion: 2.1 time: 0.294482 Jul 28 11:40:23.667113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance tempest-invalid-75808828 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.667113 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-743a9842-cb2c-473d-aa29-bc9cea8affdd tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "POST /compute/v2.1/servers/tempest-invalid-75808828/action" status: 404 len: 99 microversion: 2.1 time: 0.022654 Jul 28 11:40:23.667113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1680/3435] 10.222.0.93 () {60 vars in 1243 bytes} [Thu Jul 28 11:40:23 2022] POST /compute/v2.1/servers/tempest-invalid-75808828/action => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:40:23.675849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1756/3436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:23 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:23.676407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-153463925"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.679151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:40:23.679861 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 56 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-test-snap-153463925"}} Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-153463925'}}} Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.682568 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.686693 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.688043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.688438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.689645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-488d1b29-0a41-4940-9695-c3beb6f7a0ff tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017616 Jul 28 11:40:23.690634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.690807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1681/3437] 10.222.0.93 () {60 vars in 1275 bytes} [Thu Jul 28 11:40:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.700777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1834213796"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:23.705548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:40:23.706295 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 57 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: {"createImage": {"name": "tempest-test-snap-1834213796"}} Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1834213796'}}} Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.708837 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 11:40:23.714128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.714819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.714819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.715928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.717006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fef7ad8d-4b00-4c3d-b8cd-8b37ee5df58a tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020928 Jul 28 11:40:23.717998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.718398 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1682/3438] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Jul 28 11:40:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.718520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.753890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.761051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.779721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.781772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.782680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.787236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.812588 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 HTTP/1.1 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '04ba6677-4f7c-48cb-913e-f7f6bfa10192'} Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.816991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.821044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.824976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.826149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6f77b99e-adeb-48e3-8a1f-3f3595a771e3 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "DELETE /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 404 len: 111 microversion: 2.1 time: 0.100854 Jul 28 11:40:23.831316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1683/3439] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:23 2022] DELETE /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.838113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.839028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] [instance: 04ba6677-4f7c-48cb-913e-f7f6bfa10192] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.847197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.848049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.849085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.849749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.868049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] HTTP exception thrown: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Request method failure captured: Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 HTTP/1.1 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWCnxqbd2aU-kTTsxEkfCHZIpMASKn1LwsqhTZ844dvIUeiroZqtmiu_PgbkH6z3-xxIkF10Gu8_wZhGp_tbn5i8EHWytDxMXdAI_Qic1xWP5MYz6hx74PQ-MgknA_G17D7INKD3SWRtmcJZ7QijhA8L4WnZoQk1S0TowkbKfE7f8E Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4ae7f24a0313467faeea0b42228c6109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4ae7f24a0313467faeea0b42228c6109"}]}] Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4ae7f24a0313467faeea0b42228c6109 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1980360478 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 11c2646aee7140a5a93be0b1cc8247d3 Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesNegativeTestJSON-1980360478-project Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '04ba6677-4f7c-48cb-913e-f7f6bfa10192'} Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:23.870000 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. Jul 28 11:40:23.874115 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:23.877763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] Returning 404 to user: Instance 04ba6677-4f7c-48cb-913e-f7f6bfa10192 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:23.879095 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28f7f056-ba61-4fc4-9bad-f63518dc9969 tempest-ImagesNegativeTestJSON-1980360478 tempest-ImagesNegativeTestJSON-1980360478-project] 10.222.0.93 "GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192" status: 404 len: 111 microversion: 2.1 time: 0.046366 Jul 28 11:40:23.893488 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1684/3440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:23 2022] GET /compute/v2.1/servers/04ba6677-4f7c-48cb-913e-f7f6bfa10192 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:23.900852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-87477c2c-4ddf-4a63-94fb-4f2a3757beca tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "PUT /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1079 microversion: 2.1 time: 0.217796 Jul 28 11:40:23.915211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1757/3441] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:40:23 2022] PUT /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1079 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:23.919502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:23.920396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:23.928800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.929613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:23.930633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:23.931336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:24.303994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1991190293", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:24.420799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] validate_networks() for [('dfd82bc3-3a82-4137-89dc-f46871c8bc57', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:40:24.770876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:24.785262 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65921e5f-c4a0-470d-831f-9a690d3879c1 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1505 microversion: 2.1 time: 0.864857 Jul 28 11:40:24.786930 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1685/3442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:23 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:24.792008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:24.804083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:24.822492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:24.823172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:24.824129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:24.824735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:25.420541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:25.435831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d26f3a0-c380-444f-81e9-fd08f5d72d5e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.647604 Jul 28 11:40:25.449693 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1686/3443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:24 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:25.455240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:25.460839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:25.480069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:25.480725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:25.481728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:25.482171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:25.486795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:25.848891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:25.857071 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e80f5d8-51a5-46e8-8f88-0b0a4ae53f34 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.406191 Jul 28 11:40:25.860017 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1687/3444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:25 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:25.875790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:25.879210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:25.899285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:25.899285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:25.899285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:25.899285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.216054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:40:26.217052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:40:26.218383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:40:26.219227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:40:26.219890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:40:26.231816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.232274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.233266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.233940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.282077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Getting quotas for project 619a89b0148340b4a9e79785f3021233. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:40:26.285542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:26.304610 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5743b07a-a2a6-49c3-a62d-11dad2376c1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.443427 Jul 28 11:40:26.315101 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1688/3445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:25 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:26.315809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Getting quotas for user d5941defd0a44f07a644a9777c1842ea and project 619a89b0148340b4a9e79785f3021233. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:40:26.323614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:26.324370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:26.333638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.334088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.334863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.354106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:40:26.356547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:40:26.360078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.467415 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d064801d-706f-47aa-a67a-a64dd31652d9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.301107 Jul 28 11:40:26.475854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1758/3446] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:40:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:40:26.488441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:26.489426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:26.502875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.503622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:26.504635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:26.505283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:27.122817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:27.133658 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f39ce93e-713e-4c51-86b9-e1a70773353f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.654107 Jul 28 11:40:27.134516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1759/3447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:26 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:27.148622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34703958-bceb-4cfb-a2cf-db54e51b6087 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:27.150616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34703958-bceb-4cfb-a2cf-db54e51b6087 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:27.787222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34703958-bceb-4cfb-a2cf-db54e51b6087 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:27.795392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34703958-bceb-4cfb-a2cf-db54e51b6087 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1214 microversion: 2.1 time: 0.656728 Jul 28 11:40:27.806854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1760/3448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:27 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1214 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:27.824801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:27.825444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:27.846832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:27.847478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:27.850454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:27.851964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:27.900341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:27.909595 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3e6d68f-f144-4ddd-8a5b-7929d19a1031 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1505 microversion: 2.1 time: 1.601441 Jul 28 11:40:27.910190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1689/3449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:26 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1505 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:27.928592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:27.934016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:27.954625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:27.955122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:27.955916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:27.956373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.468005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:28.480452 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-405557ce-2df3-49f0-913e-fe826064dcc4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.566831 Jul 28 11:40:28.481040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1690/3450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:27 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:28.520342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:28.525199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:28.541652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.542128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.542924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.545893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.750468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a63b27f-85cb-435d-b1b8-79a07e79018d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "PUT /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1081 microversion: 2.1 time: 0.245620 Jul 28 11:40:28.757136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:28.765727 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1691/3451] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:40:28 2022] PUT /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1081 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:28.769656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a86592b-3df5-4159-aa0a-9bb636f2923f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.954886 Jul 28 11:40:28.773648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1761/3452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:27 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:28.778858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:28.784119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:28.792700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:28.797243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:28.810079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.814949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.817139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.817678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.818517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.819518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:28.822246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:28.827514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.235127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:29.243415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:29.246957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:29.248274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09fe408e-c9ec-4158-833b-c6a8fa1c4614 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.480644 Jul 28 11:40:29.249127 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1692/3453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:28 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:29.254764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:29.256210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:29.264204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.264749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.265737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.266442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.266754 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4090f8f-2e0c-423c-b0c8-749126b25677 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1507 microversion: 2.1 time: 0.491812 Jul 28 11:40:29.267516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1762/3454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:28 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:29.298216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:29.300885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:29.318229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.318696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.321214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.322019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.565361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:29.577761 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a0ae559-a870-4e05-9fc2-250d78b412f6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1272 microversion: 2.1 time: 0.327294 Jul 28 11:40:29.580546 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1693/3455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:29 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:29.586068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:29.588312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:29.597489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.598289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:29.599461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:29.600418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.025181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:30.036901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-084945c7-8b1c-4c66-8cba-f732ff18536f tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1507 microversion: 2.1 time: 0.749829 Jul 28 11:40:30.044809 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1763/3456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:29 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1507 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:30.063887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2e904d23-ae60-4c85-82df-8dd9ccdba51a req-5a871de5-38c2-4c05-8da8-73d5f9538394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6c3c3c-8b1f-47db-bdd0-d7fed551897c", "tag": "c30f7b07-a56c-46b3-abfa-3f812b5db62f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:30.080366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2e904d23-ae60-4c85-82df-8dd9ccdba51a req-5a871de5-38c2-4c05-8da8-73d5f9538394 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.080831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2e904d23-ae60-4c85-82df-8dd9ccdba51a req-5a871de5-38c2-4c05-8da8-73d5f9538394 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.094357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:30.103737 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b099caa9-c23c-4cdd-a349-7764fc9e1751 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.521604 Jul 28 11:40:30.103880 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2e904d23-ae60-4c85-82df-8dd9ccdba51a req-5a871de5-38c2-4c05-8da8-73d5f9538394 service nova] Creating event network-changed:c30f7b07-a56c-46b3-abfa-3f812b5db62f for instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c on n-h1-851368-1 Jul 28 11:40:30.104335 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1694/3457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:29 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:30.112209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2e904d23-ae60-4c85-82df-8dd9ccdba51a req-5a871de5-38c2-4c05-8da8-73d5f9538394 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066143 Jul 28 11:40:30.113025 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1764/3458] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:30.118516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.119362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.122109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.122721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.127572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.128238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.134082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.134768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.136506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.136974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.139493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.141230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.169238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:40:30.326713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8d0187bc-a5de-442b-95c8-cc61505b3339 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 204 len: 0 microversion: 2.1 time: 0.212106 Jul 28 11:40:30.327819 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1765/3459] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:30 2022] DELETE /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:40:30.339295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.340001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.359630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.360143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.361752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.363574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.696557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:30.707538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7ee9aafc-2cd8-42ea-b316-fe395afa1174 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.602128 Jul 28 11:40:30.708742 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1695/3460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:30 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:30.726380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.727614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.737735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.738486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.742584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.743456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.781392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:40:30.807121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:30.816935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b840338b-babc-4924-97ff-aae9bd350bde tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.485785 Jul 28 11:40:30.817621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1766/3461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:30 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:30.826007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.826835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.840541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.841555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.843434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.844101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.858142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Instance is already in deleting state, ignoring this request Jul 28 11:40:30.859426 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-253a5940-d10d-4160-92ca-49b6e801f8d5 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 204 len: 0 microversion: 2.1 time: 0.149091 Jul 28 11:40:30.863165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1696/3462] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:30 2022] DELETE /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:40:30.873580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:30.874800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:30.881380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.882137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:30.883594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:30.884193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.222324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:31.262418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:31.263735 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb4ce92e-0cc9-4f92-8796-7e20c02b1d4f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.444987 Jul 28 11:40:31.271219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1767/3463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:30 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:31.281861 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aaa6f672-f0f0-4323-83eb-93222110630b tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1513 microversion: 2.1 time: 0.415111 Jul 28 11:40:31.283592 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1697/3464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:30 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:31.284652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:31.285603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:31.296378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.297766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.299475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.301938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.554333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:31.565799 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8547dfa2-70da-4e08-9450-9ebf123315ae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.293313 Jul 28 11:40:31.567114 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1768/3465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:31 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:31.731237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:31.732655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:31.751873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.757856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.759313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.759962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.840708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:31.841501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:31.856221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.857931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:31.859940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:31.862028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.144826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:32.161809 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3180048f-456f-48a8-b08b-beb9ed040672 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.436292 Jul 28 11:40:32.162413 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1698/3466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:31 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:32.288021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:32.288931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:32.295749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.296208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.297000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.297441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.361690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:32.371363 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b389ad7c-e745-4ffa-8108-3d731e7f5ee7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.537054 Jul 28 11:40:32.372262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1769/3467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:31 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:32.377698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:32.378399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:32.385006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.385525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.386552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.387013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.656550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:32.672340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8612148f-6be9-436a-9a25-775cc87a8b94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.388340 Jul 28 11:40:32.682415 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1699/3468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:32 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:32.691036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:32.692512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:32.693365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:32.699433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.700193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:32.701233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:32.703440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53ea7941-6a5b-4e56-b9c3-60e6dd421d14 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1513 microversion: 2.1 time: 0.330098 Jul 28 11:40:32.704751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1770/3469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:32 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:32.724743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.014047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:33.031195 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7906a781-355c-4b3c-a169-7e615702ee16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.343519 Jul 28 11:40:33.034929 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1700/3470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:32 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:33.183325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:33.184310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:33.191584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.192294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.193269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.193710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.402493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:33.410017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:33.410586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:33.414436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02c2f0ef-0a8d-408d-a1f7-1920e5ff4284 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.234879 Jul 28 11:40:33.420115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:33.425035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.425708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.426944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.427707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.428235 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1771/3471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:33 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:33.623586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:33.625834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:33.636353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7072dbd-a131-43c6-a54a-0b92a365f16f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.242433 Jul 28 11:40:33.639254 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1701/3472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:33 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:33.697929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:33.698979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:33.711343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.715254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.719593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.720752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.725894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:33.726519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:33.737701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.739157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.741555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:33.742418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:33.998572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee97a9f08e1f4bdc84e6811281002555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a71e0861b4540459987082bc918fbdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:34.012163 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-872dde26-99c4-4d70-b77c-1bcdcdd7da39 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 200 len: 1471 microversion: 2.1 time: 0.290206 Jul 28 11:40:34.015179 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1702/3473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:33 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:34.040907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2f98958c-61b2-4133-bbf6-cb6cf114fd95 req-b4b5b074-0b21-4fa3-9ff5-1356a76395d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e", "tag": "8468f9de-e8c5-4eb8-9b93-a3022d3e18b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:34.075623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2f98958c-61b2-4133-bbf6-cb6cf114fd95 req-b4b5b074-0b21-4fa3-9ff5-1356a76395d6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.076270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2f98958c-61b2-4133-bbf6-cb6cf114fd95 req-b4b5b074-0b21-4fa3-9ff5-1356a76395d6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.093353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2f98958c-61b2-4133-bbf6-cb6cf114fd95 req-b4b5b074-0b21-4fa3-9ff5-1356a76395d6 service nova] Creating event network-changed:8468f9de-e8c5-4eb8-9b93-a3022d3e18b4 for instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e on n-h1-851368-1 Jul 28 11:40:34.101707 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2f98958c-61b2-4133-bbf6-cb6cf114fd95 req-b4b5b074-0b21-4fa3-9ff5-1356a76395d6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081806 Jul 28 11:40:34.103016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1703/3474] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:34.109112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:34.110136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:34.119598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.120413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.121661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.129197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.519039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:34.532365 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7da459b-8940-4057-b62a-47df0c0de999 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.839608 Jul 28 11:40:34.551208 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1772/3475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:33 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:34.565475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:34.566483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:34.607204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.612819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.615319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.616824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.620351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:34.635373 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8db87ea5-0bcf-4d8b-ac86-f0b112e3ddea tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.524384 Jul 28 11:40:34.641002 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1704/3476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:34 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:34.660019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:34.663132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:34.687232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.698837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:34.699952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:34.702651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.427961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:35.435468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:35.439161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cbd5d4c0-fce8-4269-93f1-4e6008190c3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.783768 Jul 28 11:40:35.439829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1705/3477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:34 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:35.450812 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e07720c-02a0-434a-b9de-3f9812a1796b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.895995 Jul 28 11:40:35.451728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1773/3478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:34 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:35.457158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.457784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: eadcf824-cdae-453a-85eb-2f8c94bb16c1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:35.476195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.476652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.477452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.477900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.496523 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] HTTP exception thrown: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Request method failure captured: Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 HTTP/1.1 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTwZR73lNc0RjRBVMCnIGRNw47vVh3WUComTC5x31lrRD3qSfJR_IT0SudnxJ1CnWJwqgPKLVKR3menulCodngneIy2UJvMtgfkFu8cvSK3Q7IUsvBuktZp14AkPScy6qJ8syalpaQqKhil_JT5RGJ4N2szsXPJ-nf2wN28H61I0So Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a71e0861b4540459987082bc918fbdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}] Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ee97a9f08e1f4bdc84e6811281002555 Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'eadcf824-cdae-453a-85eb-2f8c94bb16c1'} Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.498701 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Returning 404 to user: Instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae1fdc15-d40e-4f76-874a-179d33b14a6c tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1" status: 404 len: 111 microversion: 2.1 time: 0.047502 Jul 28 11:40:35.504412 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1774/3479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:35 2022] GET /compute/v2.1/servers/eadcf824-cdae-453a-85eb-2f8c94bb16c1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:35.511110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.511929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:35.520930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.521536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.522790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.523381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.544221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] HTTP exception thrown: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Request method failure captured: Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 HTTP/1.1 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTwZR73lNc0RjRBVMCnIGRNw47vVh3WUComTC5x31lrRD3qSfJR_IT0SudnxJ1CnWJwqgPKLVKR3menulCodngneIy2UJvMtgfkFu8cvSK3Q7IUsvBuktZp14AkPScy6qJ8syalpaQqKhil_JT5RGJ4N2szsXPJ-nf2wN28H61I0So Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a71e0861b4540459987082bc918fbdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}] Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ee97a9f08e1f4bdc84e6811281002555 Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'a47e80e3-0309-4e90-8975-92a0a6287584'} Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:35.549063 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.554025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Returning 404 to user: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:35.555721 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f723f17-bb30-4d49-9fa2-438e4472f9c8 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 404 len: 111 microversion: 2.1 time: 0.049958 Jul 28 11:40:35.559286 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1775/3480] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:35 2022] DELETE /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:35.561414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.561831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:35.568684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.569253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.570122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.570657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.677113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8638558-02be-4a24-812a-b7a46c52ebed tempest-ListImageFiltersNegativeTestJSON-1172685130 tempest-ListImageFiltersNegativeTestJSON-1172685130-project] Calling method '.version_select at 0x7f2eb2480ee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.704552 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e8638558-02be-4a24-812a-b7a46c52ebed tempest-ListImageFiltersNegativeTestJSON-1172685130 tempest-ListImageFiltersNegativeTestJSON-1172685130-project] HTTP exception thrown: Image not found. Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8638558-02be-4a24-812a-b7a46c52ebed tempest-ListImageFiltersNegativeTestJSON-1172685130 tempest-ListImageFiltersNegativeTestJSON-1172685130-project] Request method failure captured: Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/images/039bb6be-f652-4a54-919a-4d74e8fad49f HTTP/1.1 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWy2j8mj4rF98jGZHt_Gjcbt63RxTKOrbtSPhxm9wwkJ3OfhzXf2T0YtT2DmVTB1E0bkgjMlc7JLKQQrjHfR11aL0DvCwfKjWMekKniTz2XA02g73WCbEpJ5Teae33NfZQ9PTZDTgGED-QR7HW9UCTTiM_MrRRzvw0E8FHAM2B-P_Y Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: f23c11417d144ef4a94b623aac679d71 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1172685130 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f23c11417d144ef4a94b623aac679d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f23c11417d144ef4a94b623aac679d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f23c11417d144ef4a94b623aac679d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f23c11417d144ef4a94b623aac679d71"}]}] Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1172685130 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: f23c11417d144ef4a94b623aac679d71 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1172685130 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ListImageFiltersNegativeTestJSON-1172685130-project Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 9a662f4145ae4133b3d08927ad685928 Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1172685130-project Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '039bb6be-f652-4a54-919a-4d74e8fad49f'} Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 039bb6be-f652-4a54-919a-4d74e8fad49f Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:40:35.707763 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 039bb6be-f652-4a54-919a-4d74e8fad49f could not be found. Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:40:35.713053 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.717215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8638558-02be-4a24-812a-b7a46c52ebed tempest-ListImageFiltersNegativeTestJSON-1172685130 tempest-ListImageFiltersNegativeTestJSON-1172685130-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:35.718263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8638558-02be-4a24-812a-b7a46c52ebed tempest-ListImageFiltersNegativeTestJSON-1172685130 tempest-ListImageFiltersNegativeTestJSON-1172685130-project] 10.222.0.93 "GET /compute/v2.1/images/039bb6be-f652-4a54-919a-4d74e8fad49f" status: 404 len: 62 microversion: 2.1 time: 0.277288 Jul 28 11:40:35.723145 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1706/3481] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:35 2022] GET /compute/v2.1/images/039bb6be-f652-4a54-919a-4d74e8fad49f => generated 62 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:40:35.728615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.729246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: a47e80e3-0309-4e90-8975-92a0a6287584] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:35.737813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.738557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.739589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.740198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.764214 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] HTTP exception thrown: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Request method failure captured: Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 HTTP/1.1 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nTwZR73lNc0RjRBVMCnIGRNw47vVh3WUComTC5x31lrRD3qSfJR_IT0SudnxJ1CnWJwqgPKLVKR3menulCodngneIy2UJvMtgfkFu8cvSK3Q7IUsvBuktZp14AkPScy6qJ8syalpaQqKhil_JT5RGJ4N2szsXPJ-nf2wN28H61I0So Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a71e0861b4540459987082bc918fbdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}] Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ee97a9f08e1f4bdc84e6811281002555 Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'a47e80e3-0309-4e90-8975-92a0a6287584'} Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:35.766302 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. Jul 28 11:40:35.770510 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:35.773437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Returning 404 to user: Instance a47e80e3-0309-4e90-8975-92a0a6287584 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:35.774882 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-320bba50-f2ab-4b23-949c-a729aec4cda4 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584" status: 404 len: 111 microversion: 2.1 time: 0.050325 Jul 28 11:40:35.779187 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1707/3482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:35 2022] GET /compute/v2.1/servers/a47e80e3-0309-4e90-8975-92a0a6287584 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:35.789524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:35.790408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:35.808519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.808983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.809789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:35.810233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:35.971466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:35.992204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-514208d8-8d1e-4541-b92a-e45ba424cce7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.433232 Jul 28 11:40:35.997940 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1776/3483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:35 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:36.022892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:36.023880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:36.038390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.041811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.043635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.045184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.085283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] HTTP exception thrown: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Request method failure captured: Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a HTTP/1.1 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTwZR73lNc0RjRBVMCnIGRNw47vVh3WUComTC5x31lrRD3qSfJR_IT0SudnxJ1CnWJwqgPKLVKR3menulCodngneIy2UJvMtgfkFu8cvSK3Q7IUsvBuktZp14AkPScy6qJ8syalpaQqKhil_JT5RGJ4N2szsXPJ-nf2wN28H61I0So Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a71e0861b4540459987082bc918fbdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}] Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ee97a9f08e1f4bdc84e6811281002555 Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3a70dc22-0b38-4f37-919a-45cde364058a'} Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:36.089014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.094321 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.103602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Returning 404 to user: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:36.105519 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c24ddfb4-57f6-46e8-bf0c-ce560cb930e2 tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 404 len: 111 microversion: 2.1 time: 0.103773 Jul 28 11:40:36.110071 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1777/3484] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:40:35 2022] DELETE /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:36.132518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:36.138967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] [instance: 3a70dc22-0b38-4f37-919a-45cde364058a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:36.156432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:36.167687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b724570e-c1da-4428-acb0-c7b17725fc63 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.387083 Jul 28 11:40:36.170318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.171156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.173767 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1708/3485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:35 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:36.175140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.175773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.188832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3562dbae-5faa-4c78-a51f-0d8d8c6e4c2c req-76285964-11d3-4e55-8b61-2be1f6f2cdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcf824-cdae-453a-85eb-2f8c94bb16c1", "name": "network-vif-deleted", "tag": "1ea298a8-8b1a-4e22-89c6-848c6568e900"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:36.217845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3562dbae-5faa-4c78-a51f-0d8d8c6e4c2c req-76285964-11d3-4e55-8b61-2be1f6f2cdb7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.218454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3562dbae-5faa-4c78-a51f-0d8d8c6e4c2c req-76285964-11d3-4e55-8b61-2be1f6f2cdb7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.219714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] HTTP exception thrown: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Request method failure captured: Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a HTTP/1.1 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTwZR73lNc0RjRBVMCnIGRNw47vVh3WUComTC5x31lrRD3qSfJR_IT0SudnxJ1CnWJwqgPKLVKR3menulCodngneIy2UJvMtgfkFu8cvSK3Q7IUsvBuktZp14AkPScy6qJ8syalpaQqKhil_JT5RGJ4N2szsXPJ-nf2wN28H61I0So Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a71e0861b4540459987082bc918fbdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a71e0861b4540459987082bc918fbdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a71e0861b4540459987082bc918fbdf"}]}] Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 6a71e0861b4540459987082bc918fbdf Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-491301145 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ee97a9f08e1f4bdc84e6811281002555 Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-491301145-project Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3a70dc22-0b38-4f37-919a-45cde364058a'} Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:36.228164 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] Returning 404 to user: Instance 3a70dc22-0b38-4f37-919a-45cde364058a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:36.234118 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2039b30a-76e7-49e8-b8ae-ca4801eaaf2d tempest-ServerDiskConfigTestJSON-491301145 tempest-ServerDiskConfigTestJSON-491301145-project] 10.222.0.93 "GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a" status: 404 len: 111 microversion: 2.1 time: 0.115959 Jul 28 11:40:36.235089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1778/3486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:36 2022] GET /compute/v2.1/servers/3a70dc22-0b38-4f37-919a-45cde364058a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:36.249861 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3562dbae-5faa-4c78-a51f-0d8d8c6e4c2c req-76285964-11d3-4e55-8b61-2be1f6f2cdb7 service nova] Creating event network-vif-deleted:1ea298a8-8b1a-4e22-89c6-848c6568e900 for instance eadcf824-cdae-453a-85eb-2f8c94bb16c1 on n-h2-851368-1 Jul 28 11:40:36.260802 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3562dbae-5faa-4c78-a51f-0d8d8c6e4c2c req-76285964-11d3-4e55-8b61-2be1f6f2cdb7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084483 Jul 28 11:40:36.264586 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1709/3487] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:36.482476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:36.485253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:36.486525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:36.487401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:36.500526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:36.501824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.504445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.506155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.506818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.509093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.509771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:36.510171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:36.512062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:37.078484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:37.080381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:37.089317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cfaf48b1-ecf0-468e-88bc-6ddc12ae2eb1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.619336 Jul 28 11:40:37.096295 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1806df9-cf03-4fb0-8b40-90c5ba12a661 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.623446 Jul 28 11:40:37.103662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1779/3488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:36 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:37.109749 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1710/3489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:36 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:37.111533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:37.112235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:37.120385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:37.120970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:37.122201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:37.122711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:37.194790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:37.197087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:37.214644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:37.215363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:37.217213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:37.218025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:37.491465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:37.499361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b737f0c3-5c05-41c9-8f42-8f97cd7e4972 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.394444 Jul 28 11:40:37.507323 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1780/3490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:37 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:37.546629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:37.555035 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dc9e08e-513e-4bb4-ae19-f0206602e46c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.369422 Jul 28 11:40:37.555911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1711/3491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:37 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:38.124439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:38.126724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:38.128074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:38.128922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:38.136384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=14 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:38.152595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.154462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.161021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.162033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.162813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.163036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.167024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.168688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.254241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:38.708721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:38.727109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:38.731035 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6d4fba0-f0ef-4045-a457-3541bd750b15 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.616920 Jul 28 11:40:38.733166 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1712/3492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:38 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:38.736146 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d84822a3-3786-4eb8-90ab-16559a8da606 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.626441 Jul 28 11:40:38.736731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1781/3493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:38 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:38.745709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:38.747517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:38.767432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:38.768300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:38.776300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.784643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.785467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.786997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.787389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.787822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:38.789964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:38.792497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:39.261086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:39.272197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b26a56ed-1d63-475d-86f6-75330d3ba61e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.536950 Jul 28 11:40:39.288319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1713/3494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:38 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:39.730766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0fe04130-1f17-43fc-9c82-a6b4ebeb220e req-5c944b6c-ea30-4fd3-8d20-b000c0133166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6c3c3c-8b1f-47db-bdd0-d7fed551897c", "name": "network-vif-plugged", "status": "completed", "tag": "c30f7b07-a56c-46b3-abfa-3f812b5db62f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:39.766346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0fe04130-1f17-43fc-9c82-a6b4ebeb220e req-5c944b6c-ea30-4fd3-8d20-b000c0133166 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:39.768220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0fe04130-1f17-43fc-9c82-a6b4ebeb220e req-5c944b6c-ea30-4fd3-8d20-b000c0133166 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:39.793781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:39.802772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5180ffe0-81ba-4ffd-aade-faa3b7e26c64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 1.064991 Jul 28 11:40:39.805880 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0fe04130-1f17-43fc-9c82-a6b4ebeb220e req-5c944b6c-ea30-4fd3-8d20-b000c0133166 service nova] Creating event network-vif-plugged:c30f7b07-a56c-46b3-abfa-3f812b5db62f for instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c on n-h1-851368-1 Jul 28 11:40:39.814196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0fe04130-1f17-43fc-9c82-a6b4ebeb220e req-5c944b6c-ea30-4fd3-8d20-b000c0133166 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.517653 Jul 28 11:40:39.824058 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1782/3495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:38 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:39.835373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1714/3496] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:39.836822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:39.837647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:39.848209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:39.849280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:39.853575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:39.858459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:39.859708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:39.861639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:39.872846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:39.873545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:39.874516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:39.879837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:40.466819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:40.482459 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b86cec1-7feb-4c28-8fb9-304d7356ad0f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.653139 Jul 28 11:40:40.483686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1783/3497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:39 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:40.501333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:40.502279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:40.511376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:40.512013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:40.513067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:40.513737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:40.599516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:40.615929 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5478c4da-d3b5-42de-9b6f-7d1bc843b9e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1523 microversion: 2.1 time: 0.777170 Jul 28 11:40:40.618460 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1715/3498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:39 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1523 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:40.831157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:40.831835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:40.844981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:40.845465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:40.851900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:40.852574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:41.566023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:41.577154 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5acd8bf-ab74-4e2d-8b29-58eaf6ebc691 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1314 microversion: 2.1 time: 0.749959 Jul 28 11:40:41.593141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1716/3499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:40 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:41.602651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:41.610923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:41.622624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:41.623176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:41.624036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:41.624477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:41.861868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:41.921256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7d4bf8f4-641b-40cb-a8e5-329c025b11d6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 1.422224 Jul 28 11:40:41.924894 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1784/3500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:40 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:41.951491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:41.955969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:41.973264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:41.977729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:41.978833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:41.979417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:42.096289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:42.104721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00fa67e9-9220-4397-a08c-0e7f1a5743d8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1499 microversion: 2.1 time: 0.510102 Jul 28 11:40:42.105302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1717/3501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:41 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1499 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:42.394620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:42.403157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e020c0a-773e-4ee7-b4bd-d83f8092aa48 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1503 microversion: 2.1 time: 0.476364 Jul 28 11:40:42.420868 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1785/3502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:41 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1503 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:42.432898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:42.433523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:42.444908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:42.445751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:42.446723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:42.447372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:42.604063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:42.604684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:42.618200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:42.620203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:42.621476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:42.622006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.037211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:43.048065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b293aa6-9c9f-4f96-8ae1-5e0dea969ace tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1516 microversion: 2.1 time: 0.619152 Jul 28 11:40:43.062942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1718/3503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:42 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1516 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:43.077762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:43.078765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:43.103145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.106473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.107688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.108546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.319056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:43.327944 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10ed03f5-67b1-48e5-9a88-d5eb2eaf6432 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1501 microversion: 2.1 time: 0.727791 Jul 28 11:40:43.329238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1786/3504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:42 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1501 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:43.334337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:43.337820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 1fa19044-b81b-491e-9c94-de168a0a65f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:43.349895 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/1fa19044-b81b-491e-9c94-de168a0a65f7/action HTTP/1.1 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 14 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: {"rescue": {}} Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1fa19044-b81b-491e-9c94-de168a0a65f7', 'body': {'rescue': {}}} Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:43.362845 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. Jul 28 11:40:43.370071 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:40:43.374365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 404 to user: Instance 1fa19044-b81b-491e-9c94-de168a0a65f7 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:43.376587 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82139846-4dee-4abe-8e2f-bdd52576729b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/1fa19044-b81b-491e-9c94-de168a0a65f7/action" status: 404 len: 111 microversion: 2.1 time: 0.045227 Jul 28 11:40:43.377394 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1787/3505] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:43 2022] POST /compute/v2.1/servers/1fa19044-b81b-491e-9c94-de168a0a65f7/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:40:43.382041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:43.384450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:43.385375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:43.398196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b02e4516-f296-4bbc-9106-41499bdbebde tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.333030 Jul 28 11:40:43.405424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.406258 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1719/3506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:43 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:43.420626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.421573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.422036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.430654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-32c83c82-70bd-478c-90ff-600b514e11e8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:43.458263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32c83c82-70bd-478c-90ff-600b514e11e8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.465792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32c83c82-70bd-478c-90ff-600b514e11e8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.517323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-32c83c82-70bd-478c-90ff-600b514e11e8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Going to try to stop instance {{(pid=119236) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:40:43.624241 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-32c83c82-70bd-478c-90ff-600b514e11e8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c/action" status: 202 len: 0 microversion: 2.1 time: 0.214832 Jul 28 11:40:43.626706 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1720/3507] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:43 2022] POST /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:40:43.647046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:43.647863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:43.663224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.663827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.666285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.666743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.679774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:43.795999 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51866ccc-99b4-4864-befd-5badd249ae6e tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action" status: 202 len: 0 microversion: 2.1 time: 0.167523 Jul 28 11:40:43.799300 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1721/3508] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:43 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:40:43.811590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:43.812683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:43.823567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.824974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:43.826171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:43.826834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:44.579593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:44.599127 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ababd9b-6739-4cb5-96b7-cb54f1dc60e8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 200 len: 1476 microversion: 2.1 time: 1.220332 Jul 28 11:40:44.600044 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1788/3509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:43 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 1476 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:44.605838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:44.606792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:44.636687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:44.637158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:44.637981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:44.640532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:45.296505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:45.309378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5e8258d-c025-441d-8d95-2d5d4eb81701 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 1.508593 Jul 28 11:40:45.310335 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1722/3510] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:43 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:45.316092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:45.316913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:45.323517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:45.324177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:45.325627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:45.326355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:45.656114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:45.669208 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e95670c3-2bc9-4bb5-85b9-ba054a9ba2ce tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1501 microversion: 2.1 time: 1.066038 Jul 28 11:40:45.670598 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1789/3511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:44 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1501 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:45.695413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1885269343"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:45.700897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:45.718967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:45.720504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:45.722299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:45.727026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:45.972935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:45.981718 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9cb40380-c750-4938-bfd0-3b9252f605db tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1314 microversion: 2.1 time: 0.670100 Jul 28 11:40:45.986242 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1723/3512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:45 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:45.999347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-69423802-11f9-43e9-bfea-57b4081291c1 req-2ab0e64d-bf34-4a13-93da-a008a7830a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e", "name": "network-vif-plugged", "status": "completed", "tag": "8468f9de-e8c5-4eb8-9b93-a3022d3e18b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:46.024725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-69423802-11f9-43e9-bfea-57b4081291c1 req-2ab0e64d-bf34-4a13-93da-a008a7830a3b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.025178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-69423802-11f9-43e9-bfea-57b4081291c1 req-2ab0e64d-bf34-4a13-93da-a008a7830a3b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.085211 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-69423802-11f9-43e9-bfea-57b4081291c1 req-2ab0e64d-bf34-4a13-93da-a008a7830a3b service nova] Creating event network-vif-plugged:8468f9de-e8c5-4eb8-9b93-a3022d3e18b4 for instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e on n-h1-851368-1 Jul 28 11:40:46.097139 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-69423802-11f9-43e9-bfea-57b4081291c1 req-2ab0e64d-bf34-4a13-93da-a008a7830a3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107925 Jul 28 11:40:46.097753 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1724/3513] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:40:46.106369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:46.160882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:46.170645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.171392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.174235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.177292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.255320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'flavor' on Instance uuid 81709a7c-41ea-4c87-82ac-2e64604a82ea {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:46.286274 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99bcaa7f-a924-48e3-b3fa-2b1101d5e99b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8/action" status: 202 len: 0 microversion: 2.1 time: 0.611326 Jul 28 11:40:46.300327 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1790/3514] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:45 2022] POST /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:40:46.301617 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Cannot 'rescue' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state paused Jul 28 11:40:46.305498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e8b501e-b041-4fbf-8e09-e1f286dd4fdb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb346f280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action HTTP/1.1 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 14 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: {"rescue": {}} Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'rescue' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state paused Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '81709a7c-41ea-4c87-82ac-2e64604a82ea', 'body': {'rescue': {}}} Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea in vm_state paused. Cannot rescue while the instance is in this state. Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state paused Jul 28 11:40:46.308044 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state paused Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 409 to user: Cannot 'rescue' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state paused {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:40:46.313236 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c14cb5c-3d02-4c10-a9ee-b88ad0faabf7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action" status: 409 len: 144 microversion: 2.1 time: 0.207581 Jul 28 11:40:46.317804 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1725/3515] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:46 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action => generated 144 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:40:46.337237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:46.337806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:46.367545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.368059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.368937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.369553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.457892 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e8b501e-b041-4fbf-8e09-e1f286dd4fdb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.156651 Jul 28 11:40:46.474946 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1791/3516] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:46 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:46.487483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:46.488560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:46.527117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.529444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.532685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.533594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.646775 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1349698a-1454-4c23-bfb7-772f6f374508 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action" status: 202 len: 0 microversion: 2.1 time: 0.327189 Jul 28 11:40:46.659890 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1726/3517] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:46 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:40:46.691560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:46.696723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:46.728660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.729137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:46.733027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:46.733536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.044431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:48.060154 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d85fe0ef-93c3-4126-9d10-74c883c9b2ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 1.582963 Jul 28 11:40:48.061290 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1792/3518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:46 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:48.077404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:48.080052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:48.108871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.112672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.113992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.115649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.123669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:48.133072 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1912a6ce-abcf-4abe-8370-b0d77a871205 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1508 microversion: 2.1 time: 1.470994 Jul 28 11:40:48.149170 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1727/3519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:46 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1508 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:48.159377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6dec1e8c-8735-49cf-9011-51f4084fa266 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbed0b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:48.240774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6dec1e8c-8735-49cf-9011-51f4084fa266 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.088841 Jul 28 11:40:48.248642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1728/3520] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:48 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:48.561665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:48.569859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e56fb9fa-1fae-402e-b2aa-4be945e4533f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1501 microversion: 2.1 time: 0.505084 Jul 28 11:40:48.590927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1793/3521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:48 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1501 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:48.613985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:48.623344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:48.631534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.632588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.633612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.634339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.704629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lazy-loading 'flavor' on Instance uuid 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:48.927569 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-78f2726c-feea-43ce-b29a-def88d7e290a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "POST /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e/action" status: 200 len: 32 microversion: 2.1 time: 0.336507 Jul 28 11:40:48.928982 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1729/3522] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:48 2022] POST /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:40:48.938943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:48.940450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:48.956961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.957698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:48.962307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:48.962744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:49.085868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:49.086464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:49.101368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:49.101841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:49.104858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:49.106527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:50.318041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:50.329843 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c2c113b9-2a8a-4b3b-8802-fa4f7da81253 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 1.392865 Jul 28 11:40:50.332607 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1794/3523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:48 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:50.343890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:50.346620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:50.365620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:50.366384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:50.368716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:50.370541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:50.377822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:50.398163 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b0bd971-eba1-483e-aaf3-c1c21aab7755 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 1.310836 Jul 28 11:40:50.401622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1730/3524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:49 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:50.421135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09cbaaa6-8d33-4c71-9e10-944b97aa6333 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1bac310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:50.539853 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09cbaaa6-8d33-4c71-9e10-944b97aa6333 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.136882 Jul 28 11:40:50.541701 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1731/3525] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:50 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:50.937577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:50.952698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d0bd3b6-0b43-48b1-9016-59f1a5fe9af4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1516 microversion: 2.1 time: 0.618767 Jul 28 11:40:50.961154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1795/3526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:50 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1516 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:51.362904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:51.363856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:51.381223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:51.382188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:51.382610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:51.383050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:51.435218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:51.436123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:51.444381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:51.451988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:51.455497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:51.456538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:51.457148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:52.936808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:52.962738 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-957d55d8-cbdb-4aaf-976c-3de2dac72306 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 1.606776 Jul 28 11:40:52.971952 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1732/3527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:51 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:52.977029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6e57c166-dd17-4035-aaf7-b20068f8a6b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1bb4940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:53.086549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6e57c166-dd17-4035-aaf7-b20068f8a6b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.113077 Jul 28 11:40:53.088217 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1733/3528] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:52 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:53.644253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:53.657874 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02ec3f38-d90b-43d7-a107-5752af27ca48 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 2.236161 Jul 28 11:40:53.661188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1796/3529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:51 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:53.912239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:53.914979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:53.961152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:53.961820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:53.963330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:53.963858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:53.993470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:53.994089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:54.012612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.013344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.020140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.022529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.056351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'flavor' on Instance uuid 81709a7c-41ea-4c87-82ac-2e64604a82ea {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:40:54.313783 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9412f143-9f1d-4f6c-becf-35b25096714d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action" status: 200 len: 32 microversion: 2.1 time: 0.412091 Jul 28 11:40:54.318948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1734/3530] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:40:53 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action => generated 32 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:40:54.339039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8a4b3ac-2e0e-4438-9b94-179e2cd78084 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1becdc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:54.457312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8a4b3ac-2e0e-4438-9b94-179e2cd78084 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.134596 Jul 28 11:40:54.466547 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1735/3531] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:54 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:54.495794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:54.497252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:54.513204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.514046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.515736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.516498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.543187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:54.798597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:54.806836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8000aed-0d69-477c-903a-7aeadf9c5052 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.818234 Jul 28 11:40:54.823100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1797/3532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:53 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:40:54.823504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:54.824598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:54.836812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.841117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.842315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:54.843135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:54.896440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:40:55.214382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:55.226803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e807568-4b4d-4803-b370-5cf22524fa1d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.412580 Jul 28 11:40:55.245601 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1798/3533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:54 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:55.394161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:55.406951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-524e580b-4804-4954-8d73-ea329e593557 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.938675 Jul 28 11:40:55.407580 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1736/3534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:54 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:55.473705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79fee05b-2b11-4def-a986-817869ff8b26 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb244fe50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:55.566653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79fee05b-2b11-4def-a986-817869ff8b26 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.097624 Jul 28 11:40:55.567432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1799/3535] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:55 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:55.848780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:55.853458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:55.865361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:55.866241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:55.867631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:55.870797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:56.094714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d33ecd83-7bc5-4eb4-9fb1-db6270873389 req-13cb2c9e-a575-46bd-9b66-626323965f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30be6610-ed09-4773-9b5b-4a176e0a3ba8", "name": "network-vif-plugged", "status": "completed", "tag": "5d3d7e60-2622-4a14-8863-ab772c85aaa8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:56.154167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d33ecd83-7bc5-4eb4-9fb1-db6270873389 req-13cb2c9e-a575-46bd-9b66-626323965f3b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:56.161689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d33ecd83-7bc5-4eb4-9fb1-db6270873389 req-13cb2c9e-a575-46bd-9b66-626323965f3b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:56.181743 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d33ecd83-7bc5-4eb4-9fb1-db6270873389 req-13cb2c9e-a575-46bd-9b66-626323965f3b service nova] Creating event network-vif-plugged:5d3d7e60-2622-4a14-8863-ab772c85aaa8 for instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 on n-h2-851368-1 Jul 28 11:40:56.215616 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d33ecd83-7bc5-4eb4-9fb1-db6270873389 req-13cb2c9e-a575-46bd-9b66-626323965f3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127150 Jul 28 11:40:56.216992 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1800/3536] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:40:56.275627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:56.280237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:56.306156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:56.306608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:56.337808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:56.343374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:57.199037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:57.212246 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-787d437f-5d49-4377-9271-e5e972bb776a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 1.380022 Jul 28 11:40:57.214989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1737/3537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:55 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:57.245150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:57.245821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:57.270755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:57.273178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:57.276644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:57.277353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:58.383890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:58.393847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f37ca631-33a4-45b1-a488-9af06804ae28 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 2.127588 Jul 28 11:40:58.407516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1801/3538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:56 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:58.423612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6af20f04-c63e-41ea-8ba2-d92f0d4ea2e7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb266f790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:58.534409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6af20f04-c63e-41ea-8ba2-d92f0d4ea2e7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.125487 Jul 28 11:40:58.536205 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1802/3539] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:40:58 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:58.683444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:58.696329 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf477a84-52d9-42be-83d2-ca5518676a77 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 1.479605 Jul 28 11:40:58.697031 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1738/3540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:57 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:58.707005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:58.710316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:58.721099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:58.721553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:58.732574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:58.736964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:58.866616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-442361121", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "813e3b31-f1d0-468e-9c8f-3a7e06f086da"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:40:58.974044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] validate_networks() for [('813e3b31-f1d0-468e-9c8f-3a7e06f086da', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:40:59.556763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:40:59.576804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9eebf54f-34da-4650-b48a-71c7b147ac5f tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.877602 Jul 28 11:40:59.579899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1739/3541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:58 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:40:59.598104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:40:59.600330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:40:59.615186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:59.615641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:40:59.620208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:40:59.620678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:00.386006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:00.393826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85554ff7-f2fa-4170-a945-589bb2263985 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.811124 Jul 28 11:41:00.409830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1740/3542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:40:59 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:00.417953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb7578a2-67cb-46dc-90e3-4f35a0ea9d54 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b69ee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:00.499413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb7578a2-67cb-46dc-90e3-4f35a0ea9d54 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.088346 Jul 28 11:41:00.505951 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1741/3543] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:00 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:00.513492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:00.514384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:00.521947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:00.522699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:00.524399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:00.525018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:00.812942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:00.838006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6fa3f67-e015-4758-9940-f1ebc21244b5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.318479 Jul 28 11:41:00.842077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1742/3544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:00 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:00.863822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:00.864405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:00.880791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:00.881242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:00.888900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:00.891548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:01.603531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:01.616649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e90ec549-ee66-4308-8e42-3b4453d8b2de tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.772539 Jul 28 11:41:01.618967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1743/3545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:00 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:01.629507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:01.634119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:01.661702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:01.662629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:01.665826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:01.666650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:01.707163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:01.707649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:01.708008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:01.708487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:01.708968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:01.768606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:01.779257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:01.782973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:01.789016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:01.866765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Getting quotas for project 593df873c42445f3bd88594c24e9789c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:01.879364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Getting quotas for user 2dcba44b8d1048ef9f8d8b6995d67c7c and project 593df873c42445f3bd88594c24e9789c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:01.937823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:01.941004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:02.095374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0acb84a8-5c46-45d7-83bb-0e3ec4f622b3 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.555011 Jul 28 11:41:02.096847 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1803/3546] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:02.101889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0e07b7b-3088-4613-8b6a-d640d26d6c8c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb243cc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:02.194857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0e07b7b-3088-4613-8b6a-d640d26d6c8c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.096641 Jul 28 11:41:02.199185 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1804/3547] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:02 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:02.234830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:02.235638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:02.272216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:02.272687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:02.273500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:02.273949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:02.717494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:02.744899 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a3d1d2a-5917-446b-8ae7-7255be24eb16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 1.123784 Jul 28 11:41:02.747676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1744/3548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:01 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:02.763029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87136813-129b-45e3-9d19-24a31a00dd1f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:02.767854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87136813-129b-45e3-9d19-24a31a00dd1f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:03.327959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87136813-129b-45e3-9d19-24a31a00dd1f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:03.335350 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87136813-129b-45e3-9d19-24a31a00dd1f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1227 microversion: 2.1 time: 0.586548 Jul 28 11:41:03.338804 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1745/3549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:02 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1227 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:03.346708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:03.351431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:03.374173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:03.374637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:03.376085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:03.376524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:03.679989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:03.689544 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1590c85e-313a-41d4-9613-5dba9173b151 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 1.488960 Jul 28 11:41:03.690426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1805/3550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:02 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:03.739436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21289cf7-b573-4ae6-a7d8-d8b4355f00ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb23ef550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:03.774078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:03.786329 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aec877e1-4dac-4a1a-a976-56e188a1a576 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.446273 Jul 28 11:41:03.790994 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1746/3551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:03 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:03.852354 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21289cf7-b573-4ae6-a7d8-d8b4355f00ee tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.134677 Jul 28 11:41:03.852953 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1806/3552] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:03 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:03.880753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-626ae36a-e35f-4381-8968-bf75451c4912 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb1b0b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1876384382", "description": "tempest-description-2120490213"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:03.890377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:03.893207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:03.901093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:03.902037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:03.903177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:03.904097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:04.552136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:04.566089 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-264a855e-c730-4989-9675-82d0346146b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.705520 Jul 28 11:41:04.571485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1807/3553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:03 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:04.583799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:04.584981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:04.601800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:04.605160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:04.608022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:04.608750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:04.956103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:04.964764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-30175e00-24a4-4e8a-8a61-b44cd4370256 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1285 microversion: 2.1 time: 0.391600 Jul 28 11:41:04.990735 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1808/3554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:04 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1285 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:04.998413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:05.019782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:05.042696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:05.049723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:05.049723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:05.049723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:05.169741 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-626ae36a-e35f-4381-8968-bf75451c4912 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.377194 Jul 28 11:41:05.170400 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1747/3555] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:05.178930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:05.179733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:05.207633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=82 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:05.217550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:05.218020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:05.219379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:05.232649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:06.248473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:06.258545 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a068585-b7b1-4aa1-b527-eda0c3953f88 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 1.266340 Jul 28 11:41:06.264223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1809/3556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:04 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:06.273822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5319a0c8-6bcd-478e-9e61-e72b57d6dfa2 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb243b5e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:06.387660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5319a0c8-6bcd-478e-9e61-e72b57d6dfa2 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.117700 Jul 28 11:41:06.388503 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1810/3557] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:06 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:06.394961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5fc05229-b182-4f4f-b29d-78cf3082dbc2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb2344820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-36181577", "description": "tempest-description-1458638014"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:06.532975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:06.545833 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33ca18a6-4ed2-4b8c-8ee4-15566cbefaa1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 1.373810 Jul 28 11:41:06.546455 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1748/3558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:05 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:06.575260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:06.575959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:06.604602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:06.605063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:06.605858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:06.606296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:07.408684 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5fc05229-b182-4f4f-b29d-78cf3082dbc2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.018987 Jul 28 11:41:07.422014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:07.422728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1811/3559] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:07.425422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:07.426054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:07.442229 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e24f542-08a0-45f6-a8ec-e39d8c57c9fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.881618 Jul 28 11:41:07.455579 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1749/3560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:06 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:07.471662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:07.473366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:07.474270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:07.475140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:07.475888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:07.476356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:07.497325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:07.499694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:07.501382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:07.502892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:08.742042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:08.769773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c00905bb-79ed-46c3-840b-0b9379b7e410 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 1.321073 Jul 28 11:41:08.770380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1750/3561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:07 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:08.805488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:08.815321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7abd61f-bf87-458d-b944-d803b5c11f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2488a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:08.824624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc0d08d3-53da-4a1d-bdaa-28c8456584f2 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 1.405558 Jul 28 11:41:08.832873 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1812/3562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:07 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:08.849079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-898812955", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "a23a7084-16d8-43cd-8612-92204a86f6eb"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:08.967898 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7abd61f-bf87-458d-b944-d803b5c11f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.176335 Jul 28 11:41:08.977725 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1751/3563] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:08 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:09.001684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:09.006640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:09.024800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:09.028135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:09.029819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:09.030450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:09.088702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] validate_networks() for [('a23a7084-16d8-43cd-8612-92204a86f6eb', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:10.294091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:10.301935 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6966921c-0401-405f-aba7-1466478baed4 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 1.320487 Jul 28 11:41:10.306858 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1752/3564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:08 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:10.328080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:10.339998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:10.359104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:10.360602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:10.361403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:10.361842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.096234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:11.179823 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1ec55a75-979c-4616-8b79-e173fdef1c44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.848585 Jul 28 11:41:11.182587 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1753/3565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:10 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:11.228846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d223ef17-2106-4d35-9686-2cc505d0f7f1 req-ffaa914c-e88f-4b1d-9cda-2434b23108d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292f23b9-b305-4ff6-b40b-ec7b10ecaf60", "tag": "290022bd-2266-4698-b5e5-6c8f35e27771"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:11.266421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:11.266973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:11.278500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:11.279295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:11.279889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:11.294921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d223ef17-2106-4d35-9686-2cc505d0f7f1 req-ffaa914c-e88f-4b1d-9cda-2434b23108d6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.301331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d223ef17-2106-4d35-9686-2cc505d0f7f1 req-ffaa914c-e88f-4b1d-9cda-2434b23108d6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.304778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.307735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.309079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.309713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.351957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d223ef17-2106-4d35-9686-2cc505d0f7f1 req-ffaa914c-e88f-4b1d-9cda-2434b23108d6 service nova] Creating event network-changed:290022bd-2266-4698-b5e5-6c8f35e27771 for instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 on n-h2-851368-1 Jul 28 11:41:11.372188 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d223ef17-2106-4d35-9686-2cc505d0f7f1 req-ffaa914c-e88f-4b1d-9cda-2434b23108d6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187316 Jul 28 11:41:11.376448 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1754/3566] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:11.390067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Getting quotas for project ad0ebfd3e32749b383a21607debabb13. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:11.396990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:11.398248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:11.410298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Getting quotas for user 37df19b8b5c54532aef17359de7b03ca and project ad0ebfd3e32749b383a21607debabb13. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:11.440121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.445333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:11.447985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.448556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:11.451199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.451974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.599189 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff1902a8-af2d-44e2-af76-4bbc1b003715 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.764894 Jul 28 11:41:11.606431 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1813/3567] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:11.628388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:11.632506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:11.653124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.654405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:11.657690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:11.658357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.010847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:12.019830 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a2f9278-363c-4c0e-a8c6-c516f32c04d6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1502 microversion: 2.1 time: 0.636661 Jul 28 11:41:12.026318 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1755/3568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:11 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:12.072191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23501115-5d77-4164-8339-24bbbafc1731 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b5b8b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:12.228563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-23501115-5d77-4164-8339-24bbbafc1731 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.201182 Jul 28 11:41:12.229903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1756/3569] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:12 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:12.236453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:12.237337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:12.241272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:12.252400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.254226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.255250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.256045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.261690 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f4b54cc6-98a3-4c21-954e-d46b672ce876 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 0.653624 Jul 28 11:41:12.262298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1814/3570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:11 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:12.278764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97674941-20ba-4964-8fa7-5a03ee2abee8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:12.283298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-97674941-20ba-4964-8fa7-5a03ee2abee8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:12.504630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-97674941-20ba-4964-8fa7-5a03ee2abee8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:12.514375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-97674941-20ba-4964-8fa7-5a03ee2abee8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1215 microversion: 2.1 time: 0.247297 Jul 28 11:41:12.518523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1815/3571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:12 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:12.595534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:12.613393 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d71a8dfb-3beb-4655-9d79-3a3808cf8850 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.381679 Jul 28 11:41:12.620723 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1757/3572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:12 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:12.668278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef895d3b-91b6-43c1-b568-56adab02860d"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:12.681470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:12.684003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Action: 'create', calling method: .version_select at 0x7f2eb243c820>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:12.706889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.709098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.714479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.714946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.745602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Getting quotas for project 5a81f3201b0d42e4a0e436e9e7b80f2e. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:12.758913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Getting quotas for user e80119c6cdff4012ba135868f5234583 and project 5a81f3201b0d42e4a0e436e9e7b80f2e. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:12.784600 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Cannot 'attach_volume' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state rescued Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/os-volume_attachments HTTP/1.1 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 74 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: {"volumeAttachment": {"volumeId": "ef895d3b-91b6-43c1-b568-56adab02860d"}} Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'attach_volume' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state rescued Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '81709a7c-41ea-4c87-82ac-2e64604a82ea', 'body': {'volumeAttachment': {'volumeId': 'ef895d3b-91b6-43c1-b568-56adab02860d'}}} Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 11:41:12.787870 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state rescued Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state rescued Jul 28 11:41:12.793325 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:12.806124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 409 to user: Cannot 'attach_volume' instance 81709a7c-41ea-4c87-82ac-2e64604a82ea while it is in vm_state rescued {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:12.809540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c86fbc97-eb8d-44e2-8312-a6d6dcf08918 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.165430 Jul 28 11:41:12.810304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1758/3573] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:41:12 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/os-volume_attachments => generated 152 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:41:12.817535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:12.820472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:12.829686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.832342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.833314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:12.833937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:12.867340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:12.914794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Getting quotas for project 5a81f3201b0d42e4a0e436e9e7b80f2e. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:12.930344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Getting quotas for user e80119c6cdff4012ba135868f5234583 and project 5a81f3201b0d42e4a0e436e9e7b80f2e. Resources: {'server_groups'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:12.980463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69661115-6b3e-41b3-8887-e4039e74b3c2 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.459795 Jul 28 11:41:12.981370 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1816/3574] 10.222.0.93 () {62 vars in 1214 bytes} [Thu Jul 28 11:41:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:41:12.998481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:13.010130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:13.031058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.032674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:13.041592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.042347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:13.114794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:13.125192 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb31cb89-aecb-4603-903d-6263c345dcda tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1511 microversion: 2.1 time: 0.312921 Jul 28 11:41:13.144148 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1759/3575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:12 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:13.150557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f0d47f2-e916-45c3-b482-2233d6d3f141 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.169935 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f0d47f2-e916-45c3-b482-2233d6d3f141 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.023119 Jul 28 11:41:13.173068 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1760/3576] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 28 11:41:13 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:41:13.187046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a5ed4f0-fcc4-486f-bd78-588132f5f4b9 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.198201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a5ed4f0-fcc4-486f-bd78-588132f5f4b9 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f" status: 200 len: 235 microversion: 2.64 time: 0.018330 Jul 28 11:41:13.199599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1761/3577] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Jul 28 11:41:13 2022] GET /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f => generated 235 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:41:13.216367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c51065b8-0b1d-4516-aa84-65c597c3f4bf tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.227445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d60e37db-86ef-4f8f-a53f-552d6df2d421 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action" status: 202 len: 0 microversion: 2.1 time: 0.241684 Jul 28 11:41:13.228501 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1817/3578] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:12 2022] POST /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:13.243751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.245299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:13.262210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.264084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:13.265103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.267641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:13.269642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c51065b8-0b1d-4516-aa84-65c597c3f4bf tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f" status: 204 len: 0 microversion: 2.64 time: 0.060323 Jul 28 11:41:13.272357 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1762/3579] 10.222.0.93 () {60 vars in 1307 bytes} [Thu Jul 28 11:41:13 2022] DELETE /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:41:13.282512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19812a4e-7b97-446a-a7e0-cc934924041f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1bd3b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.336077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:13.395423 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19812a4e-7b97-446a-a7e0-cc934924041f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.117476 Jul 28 11:41:13.400025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1763/3580] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:13 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:13.421571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13e9b2f6-1fc8-47a6-a7a4-7dca13678695 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.455240 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-13e9b2f6-1fc8-47a6-a7a4-7dca13678695 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] HTTP exception thrown: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13e9b2f6-1fc8-47a6-a7a4-7dca13678695 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Request method failure captured: Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f HTTP/1.1 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXXh5AS-Iz_mW8eEKF1cdyy2m53bbAAqdr5psZT3wX_9GxuOI2jLvtZxLPaVRxuUcy3TrrzQxuVNHU_8zvHIVWOHwm9IgOcebOAfUUsl2MSMXJbZU74L2vLkk9b9KKcGuwyszdxEJQlZguqkp6Qr6_eR_l2efAgyDc-Oh-0RKU5pjU Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.64 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 5a81f3201b0d42e4a0e436e9e7b80f2e Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerGroup264TestJSON-917925646 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a81f3201b0d42e4a0e436e9e7b80f2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a81f3201b0d42e4a0e436e9e7b80f2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a81f3201b0d42e4a0e436e9e7b80f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a81f3201b0d42e4a0e436e9e7b80f2e"}]}] Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerGroup264TestJSON-917925646 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 5a81f3201b0d42e4a0e436e9e7b80f2e Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerGroup264TestJSON-917925646 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerGroup264TestJSON-917925646-project Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e80119c6cdff4012ba135868f5234583 Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerGroup264TestJSON-917925646-project Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '96d3b31a-2cb1-4360-8a07-74463668279f'} Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:13.463907 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. Jul 28 11:41:13.469460 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:13.471878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13e9b2f6-1fc8-47a6-a7a4-7dca13678695 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] Returning 404 to user: Instance group 96d3b31a-2cb1-4360-8a07-74463668279f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:13.476640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13e9b2f6-1fc8-47a6-a7a4-7dca13678695 tempest-ServerGroup264TestJSON-917925646 tempest-ServerGroup264TestJSON-917925646-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f" status: 404 len: 117 microversion: 2.64 time: 0.074590 Jul 28 11:41:13.477853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1764/3581] 10.222.0.93 () {60 vars in 1307 bytes} [Thu Jul 28 11:41:13 2022] DELETE /compute/v2.1/os-server-groups/96d3b31a-2cb1-4360-8a07-74463668279f => generated 117 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:41:13.485571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:13.487853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:13.544463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.550487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:13.556218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:13.565406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.553356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:14.562000 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae949cd9-0407-4e7d-9e34-fd910c9400f9 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 1.082592 Jul 28 11:41:14.574026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1765/3582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:13 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:14.579044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:14.579874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:14.593177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.598161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.601729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.604926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.659308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:14.672854 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5815e4d-9544-4dd5-a1c0-5b0d7f6c17ee tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1510 microversion: 2.1 time: 1.434675 Jul 28 11:41:14.678479 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1818/3583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:13 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1510 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:14.687008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:14.688272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:14.718296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.731521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.732508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.732973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.744084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:14.752280 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d3fc6de-05c6-468d-a5f0-ae3bf7060498 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1273 microversion: 2.1 time: 0.184335 Jul 28 11:41:14.767155 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1766/3584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:14 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:14.776228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:14.777127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:14.790246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.791229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:14.793674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:14.795365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.153915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:15.165946 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-feec87f5-15cd-4422-9a65-99b55ded2f5c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1488 microversion: 2.1 time: 0.397401 Jul 28 11:41:15.180988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1767/3585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:14 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:15.180988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a89a9a09-b0f2-4181-832a-055f1c4f424e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1becdc0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:15.273763 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a89a9a09-b0f2-4181-832a-055f1c4f424e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.105965 Jul 28 11:41:15.274478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1768/3586] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:15 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:15.300451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:15.305351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:15.308866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:15.311935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20a4919e-d6e8-40a2-9dbb-84fcd408a639 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.631804 Jul 28 11:41:15.316387 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1819/3587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:14 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:15.323631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.325572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.329616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.330196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.433122 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3bd4a975-4045-42e7-911e-ea27c872c498 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 200 len: 176 microversion: 2.1 time: 0.137946 Jul 28 11:41:15.434299 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1769/3588] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:15 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 176 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:15.444550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:15.445534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:15.455599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.456928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.462134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.462823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.586489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:15.587237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:15.602495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.602947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.607867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.608321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.903283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:15.925042 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-239112d6-392c-4b37-b42f-39f94a72e65d tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 0.344090 Jul 28 11:41:15.927903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1770/3589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:15 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:41:15.938590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:15.939260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:15.957600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.961552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:15.962481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:15.962865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.540872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:16.556333 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-28c6b297-27b2-4ffd-ad65-fefaa44dc807 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 1.115269 Jul 28 11:41:16.571480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1820/3590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:15 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:16.581729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:16.582602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:16.590253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.591056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.592113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.592908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.755391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:16.763039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac3378c4-d593-4083-8c43-25f0894bcda9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1273 microversion: 2.1 time: 0.190084 Jul 28 11:41:16.763572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1821/3591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:16 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:16.795667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-790c1dfa-a3c9-4509-92b9-efadcf095363 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2628160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:16.847776 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-790c1dfa-a3c9-4509-92b9-efadcf095363 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1412 microversion: 2.1 time: 0.059374 Jul 28 11:41:16.849204 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1822/3592] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:16 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:16.859017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:16.859806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:16.866486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.867225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.868674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.868674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.896278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:16.904539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b679fef-87df-4678-8367-9a08fa1ac860 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1510 microversion: 2.1 time: 0.975563 Jul 28 11:41:16.905365 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1771/3593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:15 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1510 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:16.910714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:16.911880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:16.919431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.920346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:16.921175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:16.922073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.385071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:17.396625 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f52f072c-ca78-4239-a60d-2bd19b97216a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.545396 Jul 28 11:41:17.411117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1823/3594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:16 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:17.416819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:17.417818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:17.425887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:17.433985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.434315 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-68457c93-0cb6-4202-81b0-43438b377d4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.527137 Jul 28 11:41:17.436483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.438585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.439607 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1772/3595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:17.441154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.465140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:17.465763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:17.481300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.481756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.487400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.487856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.924610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:17.943381 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bafe2879-da63-4c81-a8ad-a517e909e4b4 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 0.538559 Jul 28 11:41:17.950314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:17.961060 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1824/3596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:17 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:17.961464 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-438b84a9-4c68-45ab-8c6e-54b9a0c6aecd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.501353 Jul 28 11:41:17.962038 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1773/3597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:17 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:41:17.975344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:17.975344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:17.976692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:17.991131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.991131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.991131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:17.991131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:17.991131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:18.019105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6d4caf7-1caa-40fb-b27c-73767cd8e2fe tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b5bd30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:18.168155 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6d4caf7-1caa-40fb-b27c-73767cd8e2fe tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1421 microversion: 2.1 time: 0.190065 Jul 28 11:41:18.170424 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1774/3598] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:17 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1421 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:18.196640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:18.199245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:18.207630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.208370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:18.209777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.212571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:18.650401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:18.664997 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb33ae12-b9a6-49b7-b2fa-d8eef39cd1e1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.702717 Jul 28 11:41:18.675289 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1825/3599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:17 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:18.691769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:18.694094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:18.707327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.708042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:18.709063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.709661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:18.715130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:18.731582 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-141195e3-cbbf-4a22-a417-afcebd77ce66 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1510 microversion: 2.1 time: 0.557813 Jul 28 11:41:18.741708 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1775/3600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:18 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:18.760782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-205fe247-36b4-4c90-87e0-c4fb02d9133f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1bacf70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:18.872764 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-205fe247-36b4-4c90-87e0-c4fb02d9133f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 200 len: 1421 microversion: 2.1 time: 0.121759 Jul 28 11:41:18.873355 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1776/3601] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:18 2022] GET /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 1421 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:18.888968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:18.889616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:18.905330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.905758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:18.907438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:18.908114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:19.293453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:19.303541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d8c9502-f8db-485f-8a13-c6339edb28ef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.626848 Jul 28 11:41:19.306150 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1826/3602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:18 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:19.329794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5c445395-8df7-48b3-8369-dcbe5078b5d9 req-d61be50d-a70a-42fa-8f20-aa0c404bcc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292f23b9-b305-4ff6-b40b-ec7b10ecaf60", "name": "network-vif-plugged", "status": "completed", "tag": "290022bd-2266-4698-b5e5-6c8f35e27771"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:19.345587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5c445395-8df7-48b3-8369-dcbe5078b5d9 req-d61be50d-a70a-42fa-8f20-aa0c404bcc07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:19.350977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5c445395-8df7-48b3-8369-dcbe5078b5d9 req-d61be50d-a70a-42fa-8f20-aa0c404bcc07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:19.378197 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5c445395-8df7-48b3-8369-dcbe5078b5d9 req-d61be50d-a70a-42fa-8f20-aa0c404bcc07 service nova] Creating event network-vif-plugged:290022bd-2266-4698-b5e5-6c8f35e27771 for instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 on n-h2-851368-1 Jul 28 11:41:19.384957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5c445395-8df7-48b3-8369-dcbe5078b5d9 req-d61be50d-a70a-42fa-8f20-aa0c404bcc07 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077131 Jul 28 11:41:19.391469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1827/3603] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:19.402051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f72800e-c5dd-4f00-ae75-3908b9987270 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2661af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:19.805662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:19.821483 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-993b0756-7f81-476b-8828-23d2c7fb6ee8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.936645 Jul 28 11:41:19.834783 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1777/3604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:18 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:19.834783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:19.834783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:19.836555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:19.837048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:19.837848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:19.838545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:20.111919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f72800e-c5dd-4f00-ae75-3908b9987270 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 204 len: 0 microversion: 2.1 time: 0.718738 Jul 28 11:41:20.113029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1828/3605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:19 2022] DELETE /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 0 bytes in 721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:41:20.119062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1955832194", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fe6b5fcd-50fa-4151-8267-beaa12b03a0e"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:20.195822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] validate_networks() for [('fe6b5fcd-50fa-4151-8267-beaa12b03a0e', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:20.323015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:20.331447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd1f1f94-8a19-4b11-b30f-ba3a50175be5 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1327 microversion: 2.1 time: 0.507651 Jul 28 11:41:20.332864 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1778/3606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:19 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1327 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:20.338649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:20.346143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:20.360198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:20.366030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:20.369114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:20.369376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:20.829943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:20.841767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3096dc12-3c73-4df9-80e0-d77132d28663 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.507643 Jul 28 11:41:20.845661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1779/3607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:20 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:20.858154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:20.859007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:20.872222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:20.872957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:20.877067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:20.877754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.351956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:21.411520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:21.422817 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9040052b-4421-4f2f-8d28-c8bd18633283 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1516 microversion: 2.1 time: 0.575708 Jul 28 11:41:21.423453 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1780/3608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:20 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1516 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:21.440966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:21.445133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:21.462695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.469739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.470837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.471486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.521180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:41:21.530326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:21.531951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:21.533203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:21.533724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:21.534244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:21.553509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.554222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.555198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.555744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.602312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:21.622169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:21.655335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:21.662393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:21.705282 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2a61ce5-0836-4d6a-80e2-2077c92ea2eb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 204 len: 0 microversion: 2.1 time: 0.274432 Jul 28 11:41:21.706610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1781/3609] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:41:21 2022] DELETE /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:41:21.713509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:21.714431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:21.728746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.731544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.732680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:21.737475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:21.771961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:21.825654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f34fb2d-dd7a-4dcb-bfa2-66193a0b2dd7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705093 Jul 28 11:41:21.826710 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1829/3610] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:21.982418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c6794dfa-a8ad-464b-b17d-2412f96ae366 req-d0ca7af4-4e5b-4e7c-88cd-467bb241e303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b40c76-6acb-43a9-8492-66d1a009b285", "tag": "030f05a3-d34a-405a-88ba-0506fb903a26"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:22.008833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c6794dfa-a8ad-464b-b17d-2412f96ae366 req-d0ca7af4-4e5b-4e7c-88cd-467bb241e303 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:22.009558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c6794dfa-a8ad-464b-b17d-2412f96ae366 req-d0ca7af4-4e5b-4e7c-88cd-467bb241e303 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:22.062383 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c6794dfa-a8ad-464b-b17d-2412f96ae366 req-d0ca7af4-4e5b-4e7c-88cd-467bb241e303 service nova] Creating event network-changed:030f05a3-d34a-405a-88ba-0506fb903a26 for instance c2b40c76-6acb-43a9-8492-66d1a009b285 on n-h2-851368-1 Jul 28 11:41:22.073256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c6794dfa-a8ad-464b-b17d-2412f96ae366 req-d0ca7af4-4e5b-4e7c-88cd-467bb241e303 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243649 Jul 28 11:41:22.076442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1830/3611] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:22.087578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:22.088954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:22.094933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:22.099423 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a7e13c0-c249-49aa-a9be-be5cebfa3c65 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1507 microversion: 2.1 time: 0.391205 Jul 28 11:41:22.100892 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1782/3612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:21 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:22.104656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:22.105827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:22.106497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fa707b3-6cf1-4b3f-8afd-ddb3b31894d6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:22.107116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fa707b3-6cf1-4b3f-8afd-ddb3b31894d6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:22.107455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:22.108296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:22.348221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fa707b3-6cf1-4b3f-8afd-ddb3b31894d6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:22.358158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fa707b3-6cf1-4b3f-8afd-ddb3b31894d6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1215 microversion: 2.1 time: 0.255713 Jul 28 11:41:22.358784 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1783/3613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:22 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:22.377035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:22.386848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:22.405123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:22.405768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:22.406790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:22.411199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:23.068508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:23.110848 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c32f39a-276c-4e6f-bd65-0dd50f98ce11 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1528 microversion: 2.1 time: 1.026139 Jul 28 11:41:23.137609 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1831/3614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:22 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1528 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:23.170017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-664052141", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "961a9b15-0870-4716-afa2-9403d248bf26"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:23.290021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] validate_networks() for [('961a9b15-0870-4716-afa2-9403d248bf26', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:23.636656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:23.645800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7885f69-9f16-4f7e-90eb-7c51c39bf107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 1.277603 Jul 28 11:41:23.650990 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1784/3615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:22 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:23.673399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:23.674024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:23.689906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:23.690372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:23.691196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:23.691645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.225040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:24.238729 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf58cc05-0c15-4684-9c66-7e0d2ac9fc63 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1487 microversion: 2.1 time: 0.573180 Jul 28 11:41:24.258696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1785/3616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:23 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1487 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:24.265397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:24.266600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:24.282560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.283286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.292245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.295500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.660767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:24.670124 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-579907f3-df8a-45c5-93f1-fdee6ab527c1 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1528 microversion: 2.1 time: 0.409212 Jul 28 11:41:24.670998 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1786/3617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:24 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1528 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:24.680736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:24.681907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:24.691728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.692516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.693404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.694092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.843949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:24.851305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:24.851871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:24.852775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:24.852911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:24.853430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:24.858185 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16bb53fb-8f81-449c-a537-3342665a9518 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1273 microversion: 2.1 time: 0.185529 Jul 28 11:41:24.859856 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1787/3618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:24 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:24.866623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b286a56d-f7bc-4c48-b2c4-9a9c8e78b55b req-3df2ecbe-acea-4d58-8e78-1c4632c3f0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30be6610-ed09-4773-9b5b-4a176e0a3ba8", "name": "network-vif-unplugged", "status": "completed", "tag": "5d3d7e60-2622-4a14-8863-ab772c85aaa8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:24.869676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.870135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.870945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.871419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.881380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b286a56d-f7bc-4c48-b2c4-9a9c8e78b55b req-3df2ecbe-acea-4d58-8e78-1c4632c3f0b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:24.882237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b286a56d-f7bc-4c48-b2c4-9a9c8e78b55b req-3df2ecbe-acea-4d58-8e78-1c4632c3f0b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:24.910640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b286a56d-f7bc-4c48-b2c4-9a9c8e78b55b req-3df2ecbe-acea-4d58-8e78-1c4632c3f0b4 service nova] Creating event network-vif-unplugged:5d3d7e60-2622-4a14-8863-ab772c85aaa8 for instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 on n-h2-851368-1 Jul 28 11:41:24.919005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b286a56d-f7bc-4c48-b2c4-9a9c8e78b55b req-3df2ecbe-acea-4d58-8e78-1c4632c3f0b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057501 Jul 28 11:41:24.920182 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1788/3619] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:24.927361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-167e652a-6642-46da-b0af-65e105bff2fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: .version_select at 0x7f2eb1b15820>, body: {"keypair": {"name": "tempest-keypair-1121217442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7yc0gvqorcvbHU7Rbn2y6x+woxU7qlxoQJxnlaWK+YVCNH14FIDR+f4vBSsFR56W2iP9UCvtqsEB6EbtP3VKu4GP/IOS0HORgisceCex3Kht1lye+SlDIJmMV3PM3+yg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:24.945336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:24.945987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-167e652a-6642-46da-b0af-65e105bff2fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for project 1ca9223e0d984405b7343af9fb32a118. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:24.952040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for user 5b9d61f656eb49ae95e22e56412c55fd and project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:24.956370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-167e652a-6642-46da-b0af-65e105bff2fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for user dc8e6648280a4851ac6428027a0414fe and project 1ca9223e0d984405b7343af9fb32a118. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:24.973493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:24.976100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:24.986301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-167e652a-6642-46da-b0af-65e105bff2fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064713 Jul 28 11:41:24.989223 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1789/3620] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:41:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:25.011222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1822810640", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:25.052147 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8080b890-af82-429f-82f6-09fef34a5a90 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908977 Jul 28 11:41:25.053526 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1832/3621] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:25.058496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:25.087769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:25.117441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:25.146190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] validate_networks() for [('dfd82bc3-3a82-4137-89dc-f46871c8bc57', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:25.149577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:25.150397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:25.154995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:25.994208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:26.005983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c64648ab-8861-495b-a341-3e1502f47edd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.951169 Jul 28 11:41:26.006686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1833/3622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:25 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:26.072423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:26.073582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:26.090632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.091450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.092409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.093017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.115977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] HTTP exception thrown: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Request method failure captured: Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 HTTP/1.1 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXJuQowKumPMvp-G5RTOZNoldWg_rHE4EYvfQnn9sHYfdvrIDSXVU1v4dnkC7-oWNhdb0jObmkcnVO6tHZVqDBvjVe7kT4h8kEId8oGMHASKtkEbSpOVqwGwpX3ZdQmhPeB7XMG8XeZtyAhecOpmiUZCjmWI65ym0jzDdcIA5tgsiA Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 36933aa4ef85421fad2d66c7f5a0252f Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/36933aa4ef85421fad2d66c7f5a0252f"}]}] Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 36933aa4ef85421fad2d66c7f5a0252f Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestMultiTenantJSON-506293580-project Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9b5c22bde7a74a4dab8fc0d5a4a88bcc Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580-project Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '292f23b9-b305-4ff6-b40b-ec7b10ecaf60'} Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:41:26.119713 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:26.126769 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:26.131251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Returning 404 to user: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:26.132389 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fbbe0b8b-a6f0-43c8-bd73-484297001756 tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] 10.222.0.93 "DELETE /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 404 len: 111 microversion: 2.1 time: 0.119227 Jul 28 11:41:26.133281 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1834/3623] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:41:26 2022] DELETE /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:26.138536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:26.139582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:26.146236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.147003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.148547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.149247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.279996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:26.290376 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92595010-48a5-48d2-b942-14d8ce854739 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1211 microversion: 2.1 time: 0.155732 Jul 28 11:41:26.290980 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1835/3624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:26 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:26.297556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-44b0afa1-9c3e-439b-9014-c726e943bf89 req-4a454384-1a15-476e-804f-69b08523d8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30be6610-ed09-4773-9b5b-4a176e0a3ba8", "name": "network-vif-deleted", "tag": "5d3d7e60-2622-4a14-8863-ab772c85aaa8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:26.309220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-44b0afa1-9c3e-439b-9014-c726e943bf89 req-4a454384-1a15-476e-804f-69b08523d8e5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.309983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-44b0afa1-9c3e-439b-9014-c726e943bf89 req-4a454384-1a15-476e-804f-69b08523d8e5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.326640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-44b0afa1-9c3e-439b-9014-c726e943bf89 req-4a454384-1a15-476e-804f-69b08523d8e5 service nova] Creating event network-vif-deleted:5d3d7e60-2622-4a14-8863-ab772c85aaa8 for instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 on n-h2-851368-1 Jul 28 11:41:26.337967 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-44b0afa1-9c3e-439b-9014-c726e943bf89 req-4a454384-1a15-476e-804f-69b08523d8e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044749 Jul 28 11:41:26.339717 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1836/3625] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:26.356996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:26.358523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:26.368133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.368897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.369843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.370810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.432396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:26.433929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:26.434914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:26.436508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:26.436985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:26.457194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.457997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.459980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.461637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.491560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:26.539840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Getting quotas for project 619a89b0148340b4a9e79785f3021233. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:26.557639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Getting quotas for user d5941defd0a44f07a644a9777c1842ea and project 619a89b0148340b4a9e79785f3021233. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:26.575503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:26.579206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:26.674026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:26.674230 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a137eeb4-9d1d-4a79-9285-40d25ac91c02 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.675575 Jul 28 11:41:26.674773 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1790/3626] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:26.688670 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bb5194a-4cea-4bdf-bd37-bfd86fc9bae2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1273 microversion: 2.1 time: 0.344079 Jul 28 11:41:26.691143 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1837/3627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:26 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:26.701227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:26.716500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:26.730235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.730897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.732306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:26.732919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:26.735324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb78fae6-7955-4165-9fca-585d40cf3352 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:26.736047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb78fae6-7955-4165-9fca-585d40cf3352 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:27.300923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb78fae6-7955-4165-9fca-585d40cf3352 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:27.314298 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb78fae6-7955-4165-9fca-585d40cf3352 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1214 microversion: 2.1 time: 0.619262 Jul 28 11:41:27.315280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1838/3628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:26 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1214 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:27.324165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:27.332149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:27.351912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:27.353489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:27.354494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:27.357328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.057857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:28.068442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86e41a39-22db-4178-a0db-3d6926b27f4b tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1528 microversion: 2.1 time: 1.385118 Jul 28 11:41:28.069411 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1791/3629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:26 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1528 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:28.074622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:28.075655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.078319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:28.084357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.085145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.086481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.087144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.089821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dad9061e-7d8c-411a-ba92-29b33b190a0b tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.773466 Jul 28 11:41:28.103465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1839/3630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:27 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:28.108583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:28.110047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.116698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.117630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.118682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.119370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.242945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:28.256944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b5aa934-dd47-45db-b3c4-e2d1132848cb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1265 microversion: 2.1 time: 0.185949 Jul 28 11:41:28.260553 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1792/3631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:28 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:28.267844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Action: 'update', calling method: >, body: {"server": {"name": "292f23b9-b305-4ff6-b40b-ec7b10ecaf60_new"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:28.271912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.281480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.282716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.284915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.285808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.304170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] HTTP exception thrown: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Request method failure captured: Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: request: PUT /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 HTTP/1.1 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 64 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXJuQowKumPMvp-G5RTOZNoldWg_rHE4EYvfQnn9sHYfdvrIDSXVU1v4dnkC7-oWNhdb0jObmkcnVO6tHZVqDBvjVe7kT4h8kEId8oGMHASKtkEbSpOVqwGwpX3ZdQmhPeB7XMG8XeZtyAhecOpmiUZCjmWI65ym0jzDdcIA5tgsiA Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 36933aa4ef85421fad2d66c7f5a0252f Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_36933aa4ef85421fad2d66c7f5a0252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/36933aa4ef85421fad2d66c7f5a0252f"}]}] Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 36933aa4ef85421fad2d66c7f5a0252f Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580 Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestMultiTenantJSON-506293580-project Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 9b5c22bde7a74a4dab8fc0d5a4a88bcc Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-506293580-project Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "292f23b9-b305-4ff6-b40b-ec7b10ecaf60_new"}} Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '292f23b9-b305-4ff6-b40b-ec7b10ecaf60', 'body': {'server': {'name': '292f23b9-b305-4ff6-b40b-ec7b10ecaf60_new'}}} Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:41:28.307617 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:28.314627 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:28.318342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] Returning 404 to user: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:28.319647 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9065940-853b-4a9f-afef-90c765e1917b tempest-ServersNegativeTestMultiTenantJSON-506293580 tempest-ServersNegativeTestMultiTenantJSON-506293580-project] 10.222.0.93 "PUT /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 404 len: 111 microversion: 2.1 time: 0.057463 Jul 28 11:41:28.322533 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1793/3632] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:41:28 2022] PUT /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:28.334622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:28.335543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.344595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.345351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.346439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.347128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.410217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:41:28.529410 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4bb7768-10f5-4344-b8ba-e0345b356cc8 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "DELETE /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 204 len: 0 microversion: 2.1 time: 0.197345 Jul 28 11:41:28.531679 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1794/3633] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:41:28 2022] DELETE /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:41:28.540108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:28.541134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.554350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.555110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.556355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.557007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.616289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:28.635404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe3e537a-2cc3-49c0-81f2-681be75fced3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.530717 Jul 28 11:41:28.643730 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1840/3634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:28 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:28.656420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:28.657377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:28.672879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.673343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.674135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:28.674578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:28.760661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:28.771624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2742ed7-1376-4457-9184-964efe100d56 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1284 microversion: 2.1 time: 0.237671 Jul 28 11:41:28.775667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1795/3635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:28 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:29.115881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:29.117594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:29.129032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.129505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.135221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.135691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.159004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:29.176019 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-07f8ec20-f531-4502-ad56-f8121645332f tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1534 microversion: 2.1 time: 0.530615 Jul 28 11:41:29.176342 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1841/3636] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:28 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1534 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:29.280775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:29.281696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:29.296567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.297029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.297825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.298280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.866618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:29.878002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fba8731-bac1-4b2a-8708-f27faed4cc65 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.766571 Jul 28 11:41:29.880428 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1796/3637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:29 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:29.888780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:29.889725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:29.900366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.901236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.902604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.903800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.913735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:29.923966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffcdec6f-2b66-4928-8a99-f9a1e1a01c1b tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.647736 Jul 28 11:41:29.924558 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1842/3638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:29 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:29.939772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:29.940316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:29.951662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.952857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:29.953833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:29.963878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.142054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:30.151505 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90ce03ad-0b34-4181-a5ae-a30fdc5a1520 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1272 microversion: 2.1 time: 0.225856 Jul 28 11:41:30.165862 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1843/3639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:29 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:30.171040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f77c6137-e81b-4df4-812b-5e92641e903b req-63dded96-6fa4-486f-8f94-106d53b3241c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b40c76-6acb-43a9-8492-66d1a009b285", "name": "network-vif-plugged", "status": "completed", "tag": "030f05a3-d34a-405a-88ba-0506fb903a26"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:30.188845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f77c6137-e81b-4df4-812b-5e92641e903b req-63dded96-6fa4-486f-8f94-106d53b3241c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.191791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f77c6137-e81b-4df4-812b-5e92641e903b req-63dded96-6fa4-486f-8f94-106d53b3241c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.208169 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f77c6137-e81b-4df4-812b-5e92641e903b req-63dded96-6fa4-486f-8f94-106d53b3241c service nova] Creating event network-vif-plugged:030f05a3-d34a-405a-88ba-0506fb903a26 for instance c2b40c76-6acb-43a9-8492-66d1a009b285 on n-h2-851368-1 Jul 28 11:41:30.215751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f77c6137-e81b-4df4-812b-5e92641e903b req-63dded96-6fa4-486f-8f94-106d53b3241c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048288 Jul 28 11:41:30.222391 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1844/3640] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:30.232710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-415e5ea7-71ba-47de-816a-37823e1c2ba2 req-5a2a1958-c8e9-45c1-b4f1-32e27be1589d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ff646a-0e04-4fa6-aa38-550b5680889e", "tag": "6298740e-c160-434c-9dc7-56024962f725"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:30.258058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-415e5ea7-71ba-47de-816a-37823e1c2ba2 req-5a2a1958-c8e9-45c1-b4f1-32e27be1589d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.258884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-415e5ea7-71ba-47de-816a-37823e1c2ba2 req-5a2a1958-c8e9-45c1-b4f1-32e27be1589d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.285901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-415e5ea7-71ba-47de-816a-37823e1c2ba2 req-5a2a1958-c8e9-45c1-b4f1-32e27be1589d service nova] Creating event network-changed:6298740e-c160-434c-9dc7-56024962f725 for instance c2ff646a-0e04-4fa6-aa38-550b5680889e on n-h1-851368-1 Jul 28 11:41:30.292452 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-415e5ea7-71ba-47de-816a-37823e1c2ba2 req-5a2a1958-c8e9-45c1-b4f1-32e27be1589d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068068 Jul 28 11:41:30.293822 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1845/3641] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:30.311064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:30.312237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:30.320709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.321420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.322511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.323258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.557108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:30.567634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73c7e4bb-80f4-4616-a423-6936e6c89647 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.684403 Jul 28 11:41:30.581634 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1797/3642] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:29 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:30.902513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:30.903535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:30.911333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.912048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:30.912989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:30.913435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.223794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcba44b8d1048ef9f8d8b6995d67c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593df873c42445f3bd88594c24e9789c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:31.234403 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78637368-5227-4378-b0db-e1cbc70f2c6a tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 200 len: 1534 microversion: 2.1 time: 0.939148 Jul 28 11:41:31.235572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1846/3643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:30 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 1534 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:31.244012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:31.244924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:31.267004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.267748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.269299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.270241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.534518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:31.542190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5bd3944b-42e9-4015-afdf-efb39c1c106f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1315 microversion: 2.1 time: 0.644040 Jul 28 11:41:31.548490 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1798/3644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:30 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:31.566911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:31.568931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:31.578407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.578954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.580638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.581276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.764320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:31.782430 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74b0819d-5ee0-4a1e-932c-05d76764ee6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.545521 Jul 28 11:41:31.783372 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1847/3645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:31 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:31.795350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:31.795350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:31.813038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.817287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:31.823914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:31.824545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:32.082030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:32.098369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a7974f7-ecf1-45cb-94b2-253c5834da34 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.548549 Jul 28 11:41:32.099190 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1799/3646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:31 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:32.105971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1710511876", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b82a6bf-cc91-456c-82fe-865a1ae14648"}], "security_groups": [{"name": "tempest-securitygroup--778106360"}], "key_name": "tempest-keypair-1121217442", "user_data": "}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:32.413016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:32.421641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f6437e8-17fe-45b8-b92a-7a0d829f0386 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.636539 Jul 28 11:41:32.428056 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1848/3647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:31 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:32.477746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] validate_networks() for [('4b82a6bf-cc91-456c-82fe-865a1ae14648', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:32.723884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71f748db-a151-4ac0-ac2b-ae6e9fdaf89e tempest-ComputeTenantNetworksTest-1368299114 tempest-ComputeTenantNetworksTest-1368299114-project] Calling method '.version_select at 0x7f2eb23ece50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:33.040209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71f748db-a151-4ac0-ac2b-ae6e9fdaf89e tempest-ComputeTenantNetworksTest-1368299114 tempest-ComputeTenantNetworksTest-1368299114-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.609542 Jul 28 11:41:33.041085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1849/3648] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:41:32 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:33.048079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:33.065373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] [instance: 292f23b9-b305-4ff6-b40b-ec7b10ecaf60] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:33.080506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.080961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.081802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.082240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.108035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:33.109569 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] HTTP exception thrown: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Request method failure captured: Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 HTTP/1.1 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nW9hSNDpQpxA8WBlWI13I72T7a-TpE3uEKFwzyY6pbrBoig9TeX49KfUa5WktPDQNAzDGp0nqxr9o23xyMGUQOsTRwBrI-dmyNjzzc3vcbBvbvm8wvVz-_5jpM6ShIb-O-gx-1pprXSDqZ0kvLk5BvWLg84ot3FgarsnDDVLU5sxCM Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 593df873c42445f3bd88594c24e9789c Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1709748944 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/593df873c42445f3bd88594c24e9789c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/593df873c42445f3bd88594c24e9789c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_593df873c42445f3bd88594c24e9789c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/593df873c42445f3bd88594c24e9789c"}]}] Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1709748944 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 593df873c42445f3bd88594c24e9789c Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1709748944 Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1709748944-project Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2dcba44b8d1048ef9f8d8b6995d67c7c Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1709748944-project Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '292f23b9-b305-4ff6-b40b-ec7b10ecaf60'} Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:33.117296 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. Jul 28 11:41:33.123748 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:33.130763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] Returning 404 to user: Instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:33.131980 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab6fb22e-bd62-4772-95dc-2017266d7352 tempest-ServersNegativeTestMultiTenantJSON-1709748944 tempest-ServersNegativeTestMultiTenantJSON-1709748944-project] 10.222.0.93 "GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60" status: 404 len: 111 microversion: 2.1 time: 0.089663 Jul 28 11:41:33.134045 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1850/3649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:33 2022] GET /compute/v2.1/servers/292f23b9-b305-4ff6-b40b-ec7b10ecaf60 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:33.145113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b85a9d2f-21a1-4d60-b001-45fe76e1e9fd req-17550c5e-c484-4552-b3c3-e531de6867a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a4cdde0-93d5-43e3-a652-35c69539929a", "tag": "9312f597-97ae-421b-ab6f-b439e842fc10"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:33.162284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b85a9d2f-21a1-4d60-b001-45fe76e1e9fd req-17550c5e-c484-4552-b3c3-e531de6867a0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.163044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b85a9d2f-21a1-4d60-b001-45fe76e1e9fd req-17550c5e-c484-4552-b3c3-e531de6867a0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.177046 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b85a9d2f-21a1-4d60-b001-45fe76e1e9fd req-17550c5e-c484-4552-b3c3-e531de6867a0 service nova] Creating event network-changed:9312f597-97ae-421b-ab6f-b439e842fc10 for instance 0a4cdde0-93d5-43e3-a652-35c69539929a on n-h2-851368-1 Jul 28 11:41:33.184216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b85a9d2f-21a1-4d60-b001-45fe76e1e9fd req-17550c5e-c484-4552-b3c3-e531de6867a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047306 Jul 28 11:41:33.185200 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1851/3650] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:33.197602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f15f9508-e44e-42c2-af13-d77785d6cdbc req-3a9fa93f-f626-49ea-8fdb-b9e892349f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292f23b9-b305-4ff6-b40b-ec7b10ecaf60", "name": "network-vif-deleted", "tag": "290022bd-2266-4698-b5e5-6c8f35e27771"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:33.209873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f15f9508-e44e-42c2-af13-d77785d6cdbc req-3a9fa93f-f626-49ea-8fdb-b9e892349f61 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.210578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f15f9508-e44e-42c2-af13-d77785d6cdbc req-3a9fa93f-f626-49ea-8fdb-b9e892349f61 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.224434 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f15f9508-e44e-42c2-af13-d77785d6cdbc req-3a9fa93f-f626-49ea-8fdb-b9e892349f61 service nova] Creating event network-vif-deleted:290022bd-2266-4698-b5e5-6c8f35e27771 for instance 292f23b9-b305-4ff6-b40b-ec7b10ecaf60 on n-h2-851368-1 Jul 28 11:41:33.231757 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f15f9508-e44e-42c2-af13-d77785d6cdbc req-3a9fa93f-f626-49ea-8fdb-b9e892349f61 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044727 Jul 28 11:41:33.233144 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1852/3651] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:33.238918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:33.240232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:33.247659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.248108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.249182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:33.249863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:33.977955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:33.995841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac574dbd-84ff-4f64-afaf-c8b932ecfb42 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1503 microversion: 2.1 time: 0.760982 Jul 28 11:41:33.996616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1853/3652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:33 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1503 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:34.002033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:34.002729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:34.015353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.015809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.016596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.017035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.104454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:34.105554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:34.106376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:34.107194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:34.108161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:34.119214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.119773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.120695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.121206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.141615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:34.147826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Getting quotas for user dc8e6648280a4851ac6428027a0414fe and project 1ca9223e0d984405b7343af9fb32a118. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:34.167986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:34.170966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:34.229666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2eac0b79-c093-4e08-829f-7754d97c1d1c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.127878 Jul 28 11:41:34.231175 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1800/3653] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:34.237663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1116028-0120-4f8d-b9ea-c978cb3ccb0e tempest-ComputeTenantNetworksTest-1368299114 tempest-ComputeTenantNetworksTest-1368299114-project] Calling method '.version_select at 0x7f2eb1b38b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:34.437049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:34.452834 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45242830-1b63-4d86-a937-0917ef1923fb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.455035 Jul 28 11:41:34.466596 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1854/3654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:33 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:34.472248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:34.472885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:34.494987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.495475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.496288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.496759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.580020 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1116028-0120-4f8d-b9ea-c978cb3ccb0e tempest-ComputeTenantNetworksTest-1368299114 tempest-ComputeTenantNetworksTest-1368299114-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks/f480709d-53f9-4f3f-b98d-0fe63d2d28cb" status: 200 len: 140 microversion: 2.1 time: 0.347404 Jul 28 11:41:34.581159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1801/3655] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:34 2022] GET /compute/v2.1/os-tenant-networks/f480709d-53f9-4f3f-b98d-0fe63d2d28cb => generated 140 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:34.591265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:34.591885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:34.604913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.605390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.607676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:34.609779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:34.902460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:35.056952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:35.082652 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c2cd50bc-4035-4875-839c-4dbbb39b7544 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.613991 Jul 28 11:41:35.084484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1855/3656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:34 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:35.096148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1876384382"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:35.098212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:35.117386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.123422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.127737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.128204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.135243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:35.146220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bbfde7f4-ec03-4bf9-be11-801233ab5bca tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.564387 Jul 28 11:41:35.150666 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1802/3657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:34 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:35.170313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:35.175904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:35.192095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.192975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.194001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.194666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.224279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:35.347398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:35.357721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97416bd6-c09f-46f2-a551-9eec0e68fffb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1298 microversion: 2.1 time: 0.197358 Jul 28 11:41:35.359145 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1803/3658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:35 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:35.365787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9cc39913-f565-49a1-a67e-cc089b35430f req-5e7db8be-eb42-4ca5-9f7d-d2566b493382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f", "tag": "a8dd089c-68ac-4753-bd5e-0ab17932cb2a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:35.378720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9cc39913-f565-49a1-a67e-cc089b35430f req-5e7db8be-eb42-4ca5-9f7d-d2566b493382 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.380850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9cc39913-f565-49a1-a67e-cc089b35430f req-5e7db8be-eb42-4ca5-9f7d-d2566b493382 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.403220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9cc39913-f565-49a1-a67e-cc089b35430f req-5e7db8be-eb42-4ca5-9f7d-d2566b493382 service nova] Creating event network-changed:a8dd089c-68ac-4753-bd5e-0ab17932cb2a for instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f on n-h1-851368-1 Jul 28 11:41:35.410461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9cc39913-f565-49a1-a67e-cc089b35430f req-5e7db8be-eb42-4ca5-9f7d-d2566b493382 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049817 Jul 28 11:41:35.411825 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1804/3659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:35.476428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:35.478197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:35.497932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.498580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.500190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:35.500869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:35.613693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.network.security_group_api [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Adding security group abe07de5-2806-4a50-a6e3-9727cc3d305c to port 030f05a3-d34a-405a-88ba-0506fb903a26 Jul 28 11:41:36.083817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:36.092678 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd6aef37-f5ac-4d14-ae55-cfebe3c5da88 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.622210 Jul 28 11:41:36.094466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1805/3660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:35 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:41:36.111245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:36.112186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:36.120078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:36.120792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:36.121755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:36.122359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:36.911372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:36.930267 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-655be6ff-79c7-45a6-a8b3-94e62285d9a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.823392 Jul 28 11:41:36.931661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1806/3661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:36 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:36.938049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:36.938906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:36.945950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:36.946632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:36.947713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:36.949009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.306337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=36 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:37.532285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:37.540390 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8350ab88-a628-4975-a718-fde3be249527 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.607396 Jul 28 11:41:37.559232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1807/3662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:36 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:37.565337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:37.566160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:37.573120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.573931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.574969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.575895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.675631 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8e2183d-e51a-4f5f-86f3-0dcffcca59a8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/action" status: 202 len: 0 microversion: 2.1 time: 2.588545 Jul 28 11:41:37.676877 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1856/3663] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:35 2022] POST /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/action => generated 0 bytes in 2591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:37.683672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:37.684656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:37.700697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.701604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.705401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.706263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.742670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:37.750313 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9f1c3060-59fc-433e-b19e-7b666832e035 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1304 microversion: 2.1 time: 0.189549 Jul 28 11:41:37.754148 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1808/3664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:37 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:37.769115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c99922ce-5c9e-444b-85eb-a1972f074362 req-eae507a3-0863-4671-9cc4-04bd12cc9942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ff646a-0e04-4fa6-aa38-550b5680889e", "name": "network-vif-plugged", "status": "completed", "tag": "6298740e-c160-434c-9dc7-56024962f725"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:37.789871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c99922ce-5c9e-444b-85eb-a1972f074362 req-eae507a3-0863-4671-9cc4-04bd12cc9942 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.790322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c99922ce-5c9e-444b-85eb-a1972f074362 req-eae507a3-0863-4671-9cc4-04bd12cc9942 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.813118 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c99922ce-5c9e-444b-85eb-a1972f074362 req-eae507a3-0863-4671-9cc4-04bd12cc9942 service nova] Creating event network-vif-plugged:6298740e-c160-434c-9dc7-56024962f725 for instance c2ff646a-0e04-4fa6-aa38-550b5680889e on n-h1-851368-1 Jul 28 11:41:37.834088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c99922ce-5c9e-444b-85eb-a1972f074362 req-eae507a3-0863-4671-9cc4-04bd12cc9942 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078476 Jul 28 11:41:37.835019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1809/3665] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:37.841020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-36181577"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:37.841183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:37.874966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.875572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:37.876411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:37.877742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:38.392833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:38.399113 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Adding security group aba05089-1f6c-48c4-af18-05853b5db296 to port 030f05a3-d34a-405a-88ba-0506fb903a26 Jul 28 11:41:38.406875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f747d099-c834-49e0-991a-7d5a3c70403a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.727322 Jul 28 11:41:38.410063 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1857/3666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:37 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:38.425868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-54e9e436-53f8-4e0c-9761-0250934f5737 req-52b689f4-a110-43c1-b0a2-0020db1c90fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b40c76-6acb-43a9-8492-66d1a009b285", "tag": "030f05a3-d34a-405a-88ba-0506fb903a26"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:38.437201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-54e9e436-53f8-4e0c-9761-0250934f5737 req-52b689f4-a110-43c1-b0a2-0020db1c90fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:38.437793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-54e9e436-53f8-4e0c-9761-0250934f5737 req-52b689f4-a110-43c1-b0a2-0020db1c90fa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:38.454140 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-54e9e436-53f8-4e0c-9761-0250934f5737 req-52b689f4-a110-43c1-b0a2-0020db1c90fa service nova] Creating event network-changed:030f05a3-d34a-405a-88ba-0506fb903a26 for instance c2b40c76-6acb-43a9-8492-66d1a009b285 on n-h2-851368-1 Jul 28 11:41:38.464483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-54e9e436-53f8-4e0c-9761-0250934f5737 req-52b689f4-a110-43c1-b0a2-0020db1c90fa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051661 Jul 28 11:41:38.465880 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1858/3667] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:38.473022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:38.474091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:38.510776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:38.515971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:38.525043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:38.527567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:39.375943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:39.404714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af9467f2-b089-4d42-8efb-9f1c54c554fb tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.931582 Jul 28 11:41:39.408259 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1859/3668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:38 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:39.417746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:39.419035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:39.431660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:39.432796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:39.434567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:39.435389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:40.292873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:40.306703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da6e7193-a27b-4520-b143-463026b6cdde tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1315 microversion: 2.1 time: 0.895991 Jul 28 11:41:40.322643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1860/3669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:39 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:40.339214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:40.339859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:40.359974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:40.360666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:40.361576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:40.362137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:41.102893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b6dc0d8-abfe-4884-9ee6-f97e5eb877b2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/action" status: 202 len: 0 microversion: 2.1 time: 3.266540 Jul 28 11:41:41.107098 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1810/3670] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:37 2022] POST /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/action => generated 0 bytes in 3268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:41.113389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:41.114284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:41.134623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:41.136466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:41.142884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:41.143708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:41.209480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:41.262642 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af45f4d7-ef26-46a1-b7e6-399c753589eb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.934345 Jul 28 11:41:41.270426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1861/3671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:40 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:41.291985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:41.293470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:41.307930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:41.324953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:41.329661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:41.336570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:41.337042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:41.993497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:42.013332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:42.049040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ee6f789-40a4-4f4d-b331-d5d08c8b207c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.940218 Jul 28 11:41:42.050243 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1811/3672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:41 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:42.060911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:42.061453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:42.063427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f0e4f30-333d-4a73-97a0-3b4c7d3e83a5 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.790731 Jul 28 11:41:42.076358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1862/3673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:41 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:42.076358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ee248fae-7236-4161-8533-cc91193c7fdd req-c8c28c44-a111-4071-b4ff-a40024095b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b40c76-6acb-43a9-8492-66d1a009b285", "tag": "030f05a3-d34a-405a-88ba-0506fb903a26"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:42.076923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.076923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.076923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.076923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.097440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ee248fae-7236-4161-8533-cc91193c7fdd req-c8c28c44-a111-4071-b4ff-a40024095b18 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.099046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ee248fae-7236-4161-8533-cc91193c7fdd req-c8c28c44-a111-4071-b4ff-a40024095b18 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.140534 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ee248fae-7236-4161-8533-cc91193c7fdd req-c8c28c44-a111-4071-b4ff-a40024095b18 service nova] Creating event network-changed:030f05a3-d34a-405a-88ba-0506fb903a26 for instance c2b40c76-6acb-43a9-8492-66d1a009b285 on n-h2-851368-1 Jul 28 11:41:42.169873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ee248fae-7236-4161-8533-cc91193c7fdd req-c8c28c44-a111-4071-b4ff-a40024095b18 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104185 Jul 28 11:41:42.170725 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1863/3674] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:42.178765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:42.180295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:42.220759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.221350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.222201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.222652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.819110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:42.825836 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-74dc9f25-1223-4802-b8cd-f8b4fbcf3e75 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.771021 Jul 28 11:41:42.827016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1812/3675] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Jul 28 11:41:42 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285/os-security-groups => generated 1157 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:42.832194 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9340a3f0-7966-4d82-af00-2cdc143d5073 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1501 microversion: 2.1 time: 0.659800 Jul 28 11:41:42.833153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:42.833766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:42.845505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.854748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.855632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:42.855893 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1864/3676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:42 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1501 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:42.856137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:42.865101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5583f47e-0280-4db0-9cb9-9338976936cc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb2626700>, body: {"security_group": {"name": " tempest-securitygroup -1147693054 ", "description": "tempest-description-1722949155"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:43.856018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:43.884196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7f7b4e6-4b4a-49f5-aa04-17a20b70a6e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 1.055608 Jul 28 11:41:43.886975 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1813/3677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:42 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:43.895237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:43.899191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:43.909981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:43.912988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:43.916695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:43.917342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.028338 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-712dfdb6-2c78-4fd4-95d4-25e3e6fb0ca0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.139153 Jul 28 11:41:44.030468 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1814/3678] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:43 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:44.037359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:44.043226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:44.062550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.063037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.066630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.067124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.137823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:44.163644 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5583f47e-0280-4db0-9cb9-9338976936cc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.306496 Jul 28 11:41:44.164239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1865/3679] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:42 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:44.205237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:44.205879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:44.209276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:44.238108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.238793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.240758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.241408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.852631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:44.861779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c078a4b-f345-4265-b6a8-8f70cb72eaca tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.829803 Jul 28 11:41:44.863584 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1815/3680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:44 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:44.868625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b9c14a2d-6656-4662-a516-1928c2246a1b req-a7f71951-fdad-430d-ad30-5545896d5dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4cdde0-93d5-43e3-a652-35c69539929a", "name": "network-vif-plugged", "status": "completed", "tag": "9312f597-97ae-421b-ab6f-b439e842fc10"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:44.888536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b9c14a2d-6656-4662-a516-1928c2246a1b req-a7f71951-fdad-430d-ad30-5545896d5dac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.891768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b9c14a2d-6656-4662-a516-1928c2246a1b req-a7f71951-fdad-430d-ad30-5545896d5dac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.904983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:44.909723 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b9c14a2d-6656-4662-a516-1928c2246a1b req-a7f71951-fdad-430d-ad30-5545896d5dac service nova] Creating event network-vif-plugged:9312f597-97ae-421b-ab6f-b439e842fc10 for instance 0a4cdde0-93d5-43e3-a652-35c69539929a on n-h2-851368-1 Jul 28 11:41:44.915391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b9c14a2d-6656-4662-a516-1928c2246a1b req-a7f71951-fdad-430d-ad30-5545896d5dac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050053 Jul 28 11:41:44.916311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1816/3681] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:44.917590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-956003f5-31ec-4a09-b131-24f1228c3aac tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.733857 Jul 28 11:41:44.922385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a1ea83f8-ca20-4a68-869c-b45373108ab7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b78790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:44.928397 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1866/3682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:44 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:44.937969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-362f1db9-1708-4e98-89df-69b5c0ddf300 req-6442b16c-4b1b-45bd-af5f-8bca55fef594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:44.949416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-362f1db9-1708-4e98-89df-69b5c0ddf300 req-6442b16c-4b1b-45bd-af5f-8bca55fef594 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:44.950374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-362f1db9-1708-4e98-89df-69b5c0ddf300 req-6442b16c-4b1b-45bd-af5f-8bca55fef594 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:44.975975 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-362f1db9-1708-4e98-89df-69b5c0ddf300 req-6442b16c-4b1b-45bd-af5f-8bca55fef594 service nova] Creating event network-changed:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:41:44.997877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-362f1db9-1708-4e98-89df-69b5c0ddf300 req-6442b16c-4b1b-45bd-af5f-8bca55fef594 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064562 Jul 28 11:41:45.000179 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1867/3683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:45.007373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:45.009043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:45.017873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.018674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:45.019890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.020683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:45.163574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a1ea83f8-ca20-4a68-869c-b45373108ab7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff" status: 200 len: 224 microversion: 2.1 time: 0.245707 Jul 28 11:41:45.166029 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1817/3684] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:44 2022] GET /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff => generated 224 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:45.185674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:45.190279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:45.199830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.201452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:45.203689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.204359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:45.319740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84492ac5-47b6-4189-a093-7fe2403d75b6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.149887 Jul 28 11:41:45.320496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1818/3685] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:45 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:45.330831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d170a81a-5950-4008-9cc7-8514461330e6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1bd3310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:45.406656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:45.442817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d457dd38-5d7a-4af2-91eb-26a75b4fa037 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.437597 Jul 28 11:41:45.443777 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1868/3686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:45 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:45.888632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:45.889259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:45.915949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.916784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:45.918120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:45.918733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.520275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d170a81a-5950-4008-9cc7-8514461330e6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff" status: 202 len: 0 microversion: 2.1 time: 1.197383 Jul 28 11:41:46.521862 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1819/3687] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:41:45 2022] DELETE /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:46.532334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:46.533869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:46.556818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.558299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.579170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.581545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.602156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:46.611742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f093564-0dd4-45b4-b66b-4d907294ab96 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1307 microversion: 2.1 time: 0.727214 Jul 28 11:41:46.615420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1869/3688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:45 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1307 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:46.627522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:46.631782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:46.654932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.655737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.656895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.658012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.741272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-42c6d353-c08d-476e-aa38-b6d172aabc12 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.124526 Jul 28 11:41:46.742789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1870/3689] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:46 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:46.750042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:46.759175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:46.785246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.786108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:46.788180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:46.789236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:47.443490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:47.457094 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ebdb1268-07d8-412d-a18a-0a2baf4bf058 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.931753 Jul 28 11:41:47.478129 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1820/3690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:46 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:47.487092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1ad49d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:47.533738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:47.549374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b90fd6d7-777c-48da-8d5e-c2d25222c9a5 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.804619 Jul 28 11:41:47.550289 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1871/3691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:46 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:47.556920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-811ad6ca-779a-4ed4-9f4a-94c363149da0 req-079f6414-8939-4826-91dd-203e1eb889a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f", "name": "network-vif-plugged", "status": "completed", "tag": "a8dd089c-68ac-4753-bd5e-0ab17932cb2a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:47.590629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-811ad6ca-779a-4ed4-9f4a-94c363149da0 req-079f6414-8939-4826-91dd-203e1eb889a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:47.591186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-811ad6ca-779a-4ed4-9f4a-94c363149da0 req-079f6414-8939-4826-91dd-203e1eb889a3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:47.638104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:41:47.639614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-811ad6ca-779a-4ed4-9f4a-94c363149da0 req-079f6414-8939-4826-91dd-203e1eb889a3 service nova] Creating event network-vif-plugged:a8dd089c-68ac-4753-bd5e-0ab17932cb2a for instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f on n-h1-851368-1 Jul 28 11:41:47.640281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 90869fe2-2d31-407f-820a-d220ab8dd0ff not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:41:47.640830 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.640830 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff HTTP/1.1 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '90869fe2-2d31-407f-820a-d220ab8dd0ff'} Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:41:47.642821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5971a4c5-86f0-4694-b1b9-d9e201d82d25'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db14aa6c-46d8-46c9-8610-95ffd2b9a171 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff" status: 404 len: 194 microversion: 2.1 time: 0.163831 Jul 28 11:41:47.647368 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1821/3692] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:47 2022] GET /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:47.656005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:47.656639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:47.667770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-811ad6ca-779a-4ed4-9f4a-94c363149da0 req-079f6414-8939-4826-91dd-203e1eb889a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115660 Jul 28 11:41:47.668469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1872/3693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:47.680480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:47.681046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:47.681740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:47.682180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:47.688496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90462921-2548-4197-a726-1fc9e0e95d07 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb23ec3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-806062153", "description": "tempest-description-1380519963"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:48.176127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:48.184765 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-90f80755-e360-4ae1-a351-481552fe1268 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1487 microversion: 2.1 time: 0.537439 Jul 28 11:41:48.185629 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1822/3694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:47 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1487 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:48.192398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:48.194930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:48.203598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.204299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.205496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.206443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.222369 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90462921-2548-4197-a726-1fc9e0e95d07 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.552399 Jul 28 11:41:48.222994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1873/3695] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:48.227691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:48.228348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:48.244280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.244733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.245518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.246135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.250697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:48.301952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lazy-loading 'flavor' on Instance uuid 0a4cdde0-93d5-43e3-a652-35c69539929a {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:41:48.394317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-944ddd78-094b-41c4-a71c-0c96e4a4e738 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a/action" status: 202 len: 0 microversion: 2.1 time: 0.169908 Jul 28 11:41:48.400575 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1874/3696] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:48 2022] POST /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:48.407552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e33190f-44a6-4dc3-90c7-be892125b465 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb23ec430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-954064980", "description": "tempest-description-1040232935"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:48.465043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-57e24375-3b84-42b6-8383-73d3647814fa tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.277329 Jul 28 11:41:48.466331 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1823/3697] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:48 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:48.472234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:48.472982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:48.489761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.490214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.496175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.496881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.711362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e33190f-44a6-4dc3-90c7-be892125b465 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.308483 Jul 28 11:41:48.714426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1875/3698] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:48.725588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:48.728007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:48.739684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.740337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.741218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.741752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.791240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:48.809809 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5932220a-01ca-42a0-a98d-8a104a97feeb tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1495 microversion: 2.1 time: 0.342232 Jul 28 11:41:48.810655 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1824/3699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:48 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1495 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:48.816017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:48.816631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:48.837891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.838573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:48.847492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:48.848023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:49.080312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:49.095205 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5fc69b86-4444-4635-9c53-075fbcf54d94 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1314 microversion: 2.1 time: 0.379146 Jul 28 11:41:49.095796 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1876/3700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:48 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:49.100706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22bdc61d-a71d-4722-bda1-aa37573b87dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb22aa9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-277356433", "description": "tempest-description-132019811"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:49.140542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:49.151457 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-49b9b8de-fe6e-436f-a6d4-28789e05e291 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.339709 Jul 28 11:41:49.157316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1825/3701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:48 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:49.356793 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22bdc61d-a71d-4722-bda1-aa37573b87dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.259623 Jul 28 11:41:49.357590 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1877/3702] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:49 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:49.370584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-964cc42c-3139-43ae-8641-0b1c065c2324 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1ad4310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:49.477298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:49.480188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:49.501430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:49.501945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:49.502663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:49.503123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:49.721623 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1a80a85-eaee-470a-953c-115e01e9aed9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.248080 Jul 28 11:41:49.731398 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1878/3703] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:49 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:41:49.792958 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-964cc42c-3139-43ae-8641-0b1c065c2324 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.426229 Jul 28 11:41:49.793546 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1826/3704] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:41:49 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:49.810131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bd63f7d-814d-4244-8b81-bd9dc6092f46 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb21e0700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:49.837169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:49.837805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:49.859030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:49.859916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:49.861113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:49.861715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:49.914303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:50.200509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:50.210172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db1669e4-1d8c-4dc1-8646-38db627ec4dc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 200 len: 1478 microversion: 2.1 time: 0.378977 Jul 28 11:41:50.210794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1827/3705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:49 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 1478 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:50.310166 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bd63f7d-814d-4244-8b81-bd9dc6092f46 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2" status: 202 len: 0 microversion: 2.1 time: 0.506745 Jul 28 11:41:50.311691 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1879/3706] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:41:49 2022] DELETE /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:50.317785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:50.318544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:50.334556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.335388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:50.336694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.337777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:50.422209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4197d45e-7169-4c9a-86d8-35916874f287 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: .version_select at 0x7f2eb1bd3b80>, body: {"keypair": {"name": "tempest-keypair-1993161568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqTuTNCbavqQFC36klzUYrw9ZHgbbWA+7EiIrL/uPJH9h4Piri6pfIy4T6eUBkGDiBYkt0uKNPNH/ybrUtzJTvoA1ObQsFnlv7V2JJf94xEl2hlyOwoGC22HdOaq8Q1SQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:50.463043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:41:50.482267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-4197d45e-7169-4c9a-86d8-35916874f287 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for project a4f889574d214453a98946a8548d3f54. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:50.501193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-4197d45e-7169-4c9a-86d8-35916874f287 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for user 7e1c75be51e843a8a9555b396bbc5163 and project a4f889574d214453a98946a8548d3f54. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:50.526537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:50.535005 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e74e397-a62d-4c47-8734-8b9309851b68 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1500 microversion: 2.1 time: 0.222191 Jul 28 11:41:50.535639 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1880/3707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:50 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:50.542991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:50.543838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:50.567995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.569002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:50.569141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4197d45e-7169-4c9a-86d8-35916874f287 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.351125 Jul 28 11:41:50.570331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.570780 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1828/3708] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:41:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:50.571052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:50.579616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-70914631"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:50.582710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:50.595930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.596678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:50.598198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:50.599364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.043553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d00d86a-3bbf-48f0-b446-607e92c1eb91 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a/action" status: 202 len: 0 microversion: 2.1 time: 0.470162 Jul 28 11:41:51.045217 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1829/3709] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:50 2022] POST /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:41:51.052718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b22310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:51.066212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:51.074480 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05cc502a-3efa-4306-b820-a28a07c5e4f7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.537248 Jul 28 11:41:51.075699 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1881/3710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:50 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:51.085143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:51.092826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:41:51.093586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:51.094219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 54048da0-7fda-476b-9331-6efd07cdc0c2 not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:41:51.094988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.094988 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2 HTTP/1.1 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '54048da0-7fda-476b-9331-6efd07cdc0c2'} Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:41:51.097361 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] Jul 28 11:41:51.101697 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.108696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:41:51.108696 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-5f4fbcda-9389-4eb5-89ba-4a1488f785da'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:51.109931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-140a0d6c-be56-4c05-9ece-89b31eacfee1 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2" status: 404 len: 194 microversion: 2.1 time: 0.063016 Jul 28 11:41:51.114397 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1830/3711] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:51 2022] GET /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:51.119526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.119927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.120317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:51.120769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.121212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.123421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:51.137283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.138099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.141146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.141935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.185370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lazy-loading 'flavor' on Instance uuid 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:41:51.232207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2092d90c-0e89-4c95-a2c9-5893d4ff8293 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.116112 Jul 28 11:41:51.239794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1831/3712] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:51 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:51.245680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e153a38a-62ab-408b-b7db-1c1581991b23 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b220d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:51.317204 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-289e6c47-445c-4199-9f30-456d2b9e543e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "POST /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f/action" status: 200 len: 32 microversion: 2.1 time: 0.239450 Jul 28 11:41:51.318126 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1882/3713] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:51 2022] POST /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:51.323221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddbee3f8-da5b-4e24-b72d-0984439fd70a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbea9a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:51.340754 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e153a38a-62ab-408b-b7db-1c1581991b23 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.099478 Jul 28 11:41:51.342479 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1832/3714] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:51 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:51.353817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:51.354587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:51.366456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.366933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.370513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:51.370963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:51.646387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:51.657615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b81d89b5-39e4-4e80-9fca-6e1718a8dc81 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.315062 Jul 28 11:41:51.673036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1833/3715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:51 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:51.726392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddbee3f8-da5b-4e24-b72d-0984439fd70a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90" status: 202 len: 0 microversion: 2.1 time: 0.407026 Jul 28 11:41:51.726988 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1883/3716] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:41:51 2022] DELETE /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:51.736274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b383a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:51.789736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:41:51.790964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 640552e0-4141-47fb-8c32-73bc14c44f90 not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:41:51.791639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.791639 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90 HTTP/1.1 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '640552e0-4141-47fb-8c32-73bc14c44f90'} Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:41:51.793874 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:41:51.799455 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-acf3c9be-0671-404f-beaa-8cd1b636f1a9'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:51.806187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-933f5f05-1b69-471f-b4f5-e48f4f5032b6 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90" status: 404 len: 194 microversion: 2.1 time: 0.069166 Jul 28 11:41:51.808228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1834/3717] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:51 2022] GET /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:51.818986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9585fa95-4a85-42f1-a1f0-6621a738d1be tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe4e5e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.099741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.102433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:52.112637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.114715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.116664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.117773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.126558 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9585fa95-4a85-42f1-a1f0-6621a738d1be tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3" status: 202 len: 0 microversion: 2.1 time: 0.313496 Jul 28 11:41:52.130917 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1884/3718] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:41:51 2022] DELETE /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:41:52.138041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe32a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.211340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:41:52.212097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:41:52.215164 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.215164 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3 HTTP/1.1 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '620cf132-1d29-4f19-9573-3f3a70eb38d3'} Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:41:52.225783 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] Jul 28 11:41:52.230228 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:41:52.238558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:41:52.238558 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-49036352-1209-433c-ae44-109f33dc1783'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:41:52.239804 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66287a34-87aa-4e5c-9c97-d54963031abc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3" status: 404 len: 194 microversion: 2.1 time: 0.107758 Jul 28 11:41:52.240762 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1885/3719] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:41:52 2022] GET /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3 => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:41:52.253869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:52.259223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:52.276972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.278193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.279060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.279714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.343915 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d8065bd-778b-4a47-b00f-3472cefa8d99 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.099166 Jul 28 11:41:52.347150 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1886/3720] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:52 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:52.356230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ec735f8-5420-4bc9-acbf-89782be39440 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb24850d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.383592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:52.401944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6033cf27-5693-457c-acf4-9949e00ff0c6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.305042 Jul 28 11:41:52.405294 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1835/3721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:52 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:41:52.416611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d8a3db62-3786-4403-9855-c036e87acd51 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b030d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.511605 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d8a3db62-3786-4403-9855-c036e87acd51 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.103410 Jul 28 11:41:52.523553 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1836/3722] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:52 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:52.536717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b2182376-612e-42fa-872f-e470e1e358fc req-cc0b4491-9a12-4b53-99af-499318ae1cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "name": "network-vif-plugged", "status": "completed", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:52.554349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b2182376-612e-42fa-872f-e470e1e358fc req-cc0b4491-9a12-4b53-99af-499318ae1cda service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.554805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b2182376-612e-42fa-872f-e470e1e358fc req-cc0b4491-9a12-4b53-99af-499318ae1cda service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.584663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b2182376-612e-42fa-872f-e470e1e358fc req-cc0b4491-9a12-4b53-99af-499318ae1cda service nova] Creating event network-vif-plugged:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:41:52.590426 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b2182376-612e-42fa-872f-e470e1e358fc req-cc0b4491-9a12-4b53-99af-499318ae1cda service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065049 Jul 28 11:41:52.591321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1837/3723] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:52.684337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:52.685551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:52.696567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.697288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.698974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:52.700251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:52.851568 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ec735f8-5420-4bc9-acbf-89782be39440 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.502255 Jul 28 11:41:52.852158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1887/3724] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 11:41:52 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:52.868262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bd3e137-c3e5-47bd-993b-e63ef690b2c5 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2ebbe4e040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-605189206", "description": "tempest-description-856939722"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:53.033314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:53.046256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46bcac87-ffe5-4962-ac92-de6abde68b27 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.367077 Jul 28 11:41:53.052739 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1838/3725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:52 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:41:53.187991 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bd3e137-c3e5-47bd-993b-e63ef690b2c5 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.324076 Jul 28 11:41:53.188847 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1888/3726] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:53.207056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d94790c2-adff-484e-9f40-42f7d849141d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb1b78790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2111437270", "description": "tempest-description-1871893090"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:53.357460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:53.361018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:53.378607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:53.378975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:53.379795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:53.383406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:53.497214 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6a4ce7e-0b15-425b-8b4d-4fdd3b587a94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 14 microversion: 2.1 time: 0.145194 Jul 28 11:41:53.498545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1889/3727] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:53 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:41:53.505081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:53.506196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:53.514131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:53.515522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:53.516619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:53.517340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:53.813933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d94790c2-adff-484e-9f40-42f7d849141d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.615824 Jul 28 11:41:53.815978 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1839/3728] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:41:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:53.821451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6c622b6-cf31-4648-849f-09f9df4ff039 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1ad1af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:53.900851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6c622b6-cf31-4648-849f-09f9df4ff039 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.081985 Jul 28 11:41:53.913359 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1840/3729] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:53 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:54.025245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1197312453", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "a23a7084-16d8-43cd-8612-92204a86f6eb"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:54.123176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:54.138517 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a90535b6-613e-4c59-9290-69238b3c215f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1371 microversion: 2.1 time: 0.633141 Jul 28 11:41:54.142271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1890/3730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:53 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1371 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:54.161507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] validate_networks() for [('a23a7084-16d8-43cd-8612-92204a86f6eb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:54.166305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:54.166945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:54.194344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:54.196203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:54.198117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:54.198590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:54.999455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:55.009157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ef8961d-aec1-422d-9487-81e5c21085e8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.864919 Jul 28 11:41:55.012822 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1891/3731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:54 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:55.037533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:55.042455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:55.063029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.063520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:55.066985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.067683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:55.173251 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f237dc1-0812-427e-9577-d509df7cd8a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action" status: 200 len: 8206 microversion: 2.1 time: 0.137250 Jul 28 11:41:55.178325 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1892/3732] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:41:55 2022] POST /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e/action => generated 8206 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:55.193110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03e96891-aed1-4e96-8106-286fd64af1fc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb23971f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:55.272057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-03e96891-aed1-4e96-8106-286fd64af1fc tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.091460 Jul 28 11:41:55.272710 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1893/3733] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:55 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:55.292160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:55.293199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:55.302558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.303423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:55.304879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.306045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:55.917839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:55.932779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e55cd050-d9d9-4bd2-9691-88a1ff9aa82a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1565 microversion: 2.1 time: 0.654839 Jul 28 11:41:55.933731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1894/3734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:55 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1565 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:55.945707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:55.952551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:55.986362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.986833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:55.987682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:55.988124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:56.592483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:41:56.593017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:41:56.593695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:41:56.594327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:41:56.594850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:41:56.611216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:56.615570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:56.616724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:56.617224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:56.662601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Getting quotas for project ad0ebfd3e32749b383a21607debabb13. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:41:56.676549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Getting quotas for user 37df19b8b5c54532aef17359de7b03ca and project ad0ebfd3e32749b383a21607debabb13. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:41:56.712812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:41:56.715266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:41:56.825624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d749c4c1-76f1-4bcd-8a61-bc2f2a536f1d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.804849 Jul 28 11:41:56.825844 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1841/3735] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:41:56.838714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:56.841328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:56.857394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:56.858267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:56.859303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:56.859916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:57.066274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19218043-ed2b-453a-ab2d-285f706bd9c9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.237678 Jul 28 11:41:57.066878 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1842/3736] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:41:56 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:57.072124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:57.072750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:57.081353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:57.089690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:57.089690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:57.090178 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c51db393-4b73-420d-bcd4-de183451da44 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 1.155226 Jul 28 11:41:57.090449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:57.090953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:57.093536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1895/3737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:55 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:57.098600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06b8a3f8-db92-4847-976b-59649267adf0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbea9a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:57.192853 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06b8a3f8-db92-4847-976b-59649267adf0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.097982 Jul 28 11:41:57.203558 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1896/3738] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:57 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:57.210870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a3a484a6-ab06-4e43-9533-89566163bfd9 req-022dc7d7-a72b-4d6d-8653-dcc01ce8d405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4cdde0-93d5-43e3-a652-35c69539929a", "name": "network-vif-plugged", "status": "completed", "tag": "9312f597-97ae-421b-ab6f-b439e842fc10"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:57.224674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a3a484a6-ab06-4e43-9533-89566163bfd9 req-022dc7d7-a72b-4d6d-8653-dcc01ce8d405 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:57.225434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a3a484a6-ab06-4e43-9533-89566163bfd9 req-022dc7d7-a72b-4d6d-8653-dcc01ce8d405 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:57.265008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a3a484a6-ab06-4e43-9533-89566163bfd9 req-022dc7d7-a72b-4d6d-8653-dcc01ce8d405 service nova] Creating event network-vif-plugged:9312f597-97ae-421b-ab6f-b439e842fc10 for instance 0a4cdde0-93d5-43e3-a652-35c69539929a on n-h2-851368-1 Jul 28 11:41:57.270719 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a3a484a6-ab06-4e43-9533-89566163bfd9 req-022dc7d7-a72b-4d6d-8653-dcc01ce8d405 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065001 Jul 28 11:41:57.272964 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1897/3739] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:41:57.280812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b461344-1d24-4d54-a526-e7f9aeff4542 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:57.282559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b461344-1d24-4d54-a526-e7f9aeff4542 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:57.851381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b461344-1d24-4d54-a526-e7f9aeff4542 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:57.867941 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b461344-1d24-4d54-a526-e7f9aeff4542 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1216 microversion: 2.1 time: 0.593354 Jul 28 11:41:57.881170 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1898/3740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:57 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1216 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:57.900317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-111851484", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "943a17d0-217a-43f4-abe4-3c73bf004c2d"}], "security_groups": [{"name": "tempest-securitygroup--236548364"}], "key_name": "tempest-keypair-1993161568", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:41:57.956452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:57.994816 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6d0bec25-d307-45b5-99c9-61c7b958ec95 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.926627 Jul 28 11:41:57.995460 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1843/3741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:57 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:58.019964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:58.020738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:58.036424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:58.037017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:58.037912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:58.041034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:58.333139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] validate_networks() for [('943a17d0-217a-43f4-abe4-3c73bf004c2d', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:41:58.479580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:58.498332 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0d3dd5d-53fa-4f35-bf8b-fd06ee66d712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.482012 Jul 28 11:41:58.499498 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1844/3742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:57 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:58.527376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aff1ba96-c25c-4e76-90d4-fbc8d209c2d0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbed0a60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:58.619091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aff1ba96-c25c-4e76-90d4-fbc8d209c2d0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.101798 Jul 28 11:41:58.621366 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1845/3743] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:41:58 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:58.634387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:58.640427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:58.661858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:58.671796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:58.677374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:58.678851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:59.205413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:59.215106 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5bb5795-9d93-48bf-bf9f-60e9e58b77a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.589120 Jul 28 11:41:59.218474 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1846/3744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:58 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:59.244584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:59.247943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:59.268829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:59.271240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:59.274788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:59.275538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:59.526935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:59.548047 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2afa310-ea78-49d8-a513-d7e43297101d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1274 microversion: 2.1 time: 0.319205 Jul 28 11:41:59.549000 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1847/3745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:59 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:41:59.553855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:41:59.554473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:41:59.569218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:59.569663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:59.580769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:41:59.581504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:41:59.978166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:41:59.995618 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37550ba0-947e-41d8-89e9-5b567743ad52 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.445411 Jul 28 11:41:59.996214 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1848/3746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:59 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:00.017186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:00.017846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:00.038141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:00.042324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:00.044243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:00.048123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:00.999832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:42:01.000357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:42:01.000735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:42:01.001235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:42:01.001723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:42:01.034877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:01.035690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:01.036691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:01.038901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:01.086720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for project a4f889574d214453a98946a8548d3f54. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:42:01.096791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for user 7e1c75be51e843a8a9555b396bbc5163 and project a4f889574d214453a98946a8548d3f54. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:42:01.143041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:42:01.154300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:42:01.304527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea7e9a12-9c32-4870-ad33-1a528eca4442 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.432259 Jul 28 11:42:01.305641 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1899/3747] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:41:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:42:01.310610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58a553c4-b5e2-4724-9fe0-33e29a767624 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbea9ee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:01.389100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58a553c4-b5e2-4724-9fe0-33e29a767624 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.082085 Jul 28 11:42:01.389950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1900/3748] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:01 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:01.395473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-27e47164-3dd3-4b04-805d-3e6378436e73 req-0c984a5c-31ee-4bff-b579-f3b49b741272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:01.410222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-27e47164-3dd3-4b04-805d-3e6378436e73 req-0c984a5c-31ee-4bff-b579-f3b49b741272 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:01.410928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-27e47164-3dd3-4b04-805d-3e6378436e73 req-0c984a5c-31ee-4bff-b579-f3b49b741272 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:01.439246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-27e47164-3dd3-4b04-805d-3e6378436e73 req-0c984a5c-31ee-4bff-b579-f3b49b741272 service nova] Creating event network-changed:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:42:01.451853 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-27e47164-3dd3-4b04-805d-3e6378436e73 req-0c984a5c-31ee-4bff-b579-f3b49b741272 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058509 Jul 28 11:42:01.454798 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1901/3749] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:01.462792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:01.477343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:01.493184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:01.495857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:01.496688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:01.497135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:01.557724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:02.055881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:02.065833 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-194d3c6e-1b19-4d1f-a9f2-b2ce16a76538 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 2.068563 Jul 28 11:42:02.066419 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1849/3750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:41:59 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:02.106125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:02.113975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:02.149149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:02.149611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:02.150414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:02.150838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.059445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:03.082443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d73e3818-a527-46c4-bebc-e13512b7cbb8 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 1.617491 Jul 28 11:42:03.083348 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1902/3751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:01 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:03.111569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:03.113082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:03.138398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.161897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.163417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.166523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.581553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:03.613680 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96e74c5e-7b17-4b70-b0c0-d90e0bb4b1df tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1289 microversion: 2.1 time: 0.528714 Jul 28 11:42:03.618089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1903/3752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:03 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1289 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:03.631151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:03.633356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:03.658935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.660350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.661425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.662090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.727442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:03.741901 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e7a28319-cac4-40e4-bd52-b6be9eee9622 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 1.663064 Jul 28 11:42:03.761942 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1850/3753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:02 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:03.781983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-abed22d7-9ebc-420f-bca3-fcbbf8b7241d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbed0b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:03.782482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Locking {{(pid=119235) lock /opt/stack/nova/nova/compute/api.py:4782}} Jul 28 11:42:03.893635 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d5e4b42-5b45-41cd-bc65-15d05e13b2f3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.273527 Jul 28 11:42:03.897621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1904/3754] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:03 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:03.902279 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-abed22d7-9ebc-420f-bca3-fcbbf8b7241d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.139099 Jul 28 11:42:03.903829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1851/3755] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:03 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:03.904584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:03.907416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:03.942503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.942892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:03.946892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:03.950208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.112002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:04.112002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:04.125065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.125589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.127560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.128059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.421263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:04.433042 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c31ae2c-ea7d-4354-b5f1-a1e7ff3574a2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.534053 Jul 28 11:42:04.436163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1905/3756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:03 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:04.460453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:04.471793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.474798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.523141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action HTTP/1.1 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 15 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: {"os-stop": {}} Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5', 'body': {'os-stop': {}}} Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked Jul 28 11:42:04.527674 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:04.534652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 409 to user: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 is locked {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:04.535809 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c53ca066-1725-4066-a85e-edf9c783cef1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 409 len: 107 microversion: 2.1 time: 0.080245 Jul 28 11:42:04.536973 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1906/3757] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:04 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 107 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:42:04.546568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:04.550740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:04.565826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.567769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.571532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.572415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.658738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Unlocking {{(pid=119235) unlock /opt/stack/nova/nova/compute/api.py:4811}} Jul 28 11:42:04.741656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77fe0c1e-ab2c-4cdb-9bf9-0b5e9dc0ab9c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.198987 Jul 28 11:42:04.745403 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1907/3758] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:04 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:04.754434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:04.757727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:04.778847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.779448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.780367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.780878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.869703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:04.883477 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4885b270-abdf-4aa8-ac3a-220784a80e77 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.783192 Jul 28 11:42:04.884649 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1852/3759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:04 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:04.890257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9766b61-017e-4c2a-abc7-8bea1dad0dcc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:04.911306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9766b61-017e-4c2a-abc7-8bea1dad0dcc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:04.912227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9766b61-017e-4c2a-abc7-8bea1dad0dcc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:04.976148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9766b61-017e-4c2a-abc7-8bea1dad0dcc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Going to try to stop instance {{(pid=119236) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:42:04.992314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:05.032234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:05.050698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31050dbe-80d6-41c0-a2a6-2942d63ca9d2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1295 microversion: 2.1 time: 0.306136 Jul 28 11:42:05.052363 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1908/3760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:04 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1295 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:05.057156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:05.057950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:05.076795 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9766b61-017e-4c2a-abc7-8bea1dad0dcc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.190456 Jul 28 11:42:05.093141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1853/3761] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:04 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:05.096720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:05.097243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:05.098201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:05.098727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:05.131854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a3b4ad0-823e-4f46-80ed-eaebe49d9ff0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2931ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:05.268744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a3b4ad0-823e-4f46-80ed-eaebe49d9ff0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.156147 Jul 28 11:42:05.269329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1854/3762] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:05 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:05.280042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:05.281997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:05.296377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:05.297980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:05.299617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:05.302595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.075083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:06.085293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd67c41b-012d-4692-93d4-c1223b614d35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.812264 Jul 28 11:42:06.091221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1855/3763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:05 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:06.102669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-33fd05ac-9286-4810-a25a-87b4ef3a586d req-2bfcf089-fee2-4fd8-b89f-33338435d946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134c96d2-8940-46fa-96fb-b8ad7bc63928", "tag": "04be67eb-25dd-4d92-901e-14540ce2a58f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:06.132157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-33fd05ac-9286-4810-a25a-87b4ef3a586d req-2bfcf089-fee2-4fd8-b89f-33338435d946 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:06.132940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-33fd05ac-9286-4810-a25a-87b4ef3a586d req-2bfcf089-fee2-4fd8-b89f-33338435d946 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.152850 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-33fd05ac-9286-4810-a25a-87b4ef3a586d req-2bfcf089-fee2-4fd8-b89f-33338435d946 service nova] Creating event network-changed:04be67eb-25dd-4d92-901e-14540ce2a58f for instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 on n-h2-851368-1 Jul 28 11:42:06.160213 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-33fd05ac-9286-4810-a25a-87b4ef3a586d req-2bfcf089-fee2-4fd8-b89f-33338435d946 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067103 Jul 28 11:42:06.183925 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1856/3764] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:06.198688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:06.200741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:06.202838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:06.210622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6f908e93-920c-47c2-baf1-2aa9d77d64d1 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 1.157159 Jul 28 11:42:06.211492 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1909/3765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:05 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:06.218110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:06.218826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.223684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:06.228596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.229003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:06.231359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:06.251446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:06.253598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.254592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:06.256117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:06.388666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:06.400155 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e2465c0-aa52-4a3c-9524-0ced1e1a2157 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1295 microversion: 2.1 time: 0.183361 Jul 28 11:42:06.410486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1910/3766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:06 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:06.417722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-581f9c50-65ae-4ab6-80af-295c849c52e7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbe4e9d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:06.526170 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-581f9c50-65ae-4ab6-80af-295c849c52e7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.114393 Jul 28 11:42:06.536895 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1911/3767] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:06 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:06.615392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:06.624276 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d102010-b1d7-4712-8b92-60f950d39e6e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.437848 Jul 28 11:42:06.636333 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1857/3768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:06 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:07.112289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:07.113424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:07.123029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.124568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.125599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.126254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.232342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:07.233548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:07.235844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:07.237240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:07.264900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.266773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.273631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.274428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.329033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:07.343884 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-30a35cce-35a7-4703-952d-a4afceca1323 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.235939 Jul 28 11:42:07.346589 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1912/3769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:07 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:07.434608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:07.436052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:07.451240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.452098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.453264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.453877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.489139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:07.499008 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-545606f0-23c5-4d28-9005-7c6e7ee92982 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.270721 Jul 28 11:42:07.512698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1858/3770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:07 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:07.561585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a215125-7b10-47ee-885f-47de719ab19c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1af18b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:07.643326 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a215125-7b10-47ee-885f-47de719ab19c tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.105728 Jul 28 11:42:07.644442 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1859/3771] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:07 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:07.649623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:07.650778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:07.665740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.666778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.667850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:07.668557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:07.715814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:07.735578 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e05f617f-7b08-4df5-bc85-f7a86a84e2fd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.307233 Jul 28 11:42:07.736203 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1913/3772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:07 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:08.372266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:08.372948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:08.380783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:08.381244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:08.382020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:08.393475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:08.858435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:08.866175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9720c8f-59f5-43a2-a3b3-48e26321f10e tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 1.220376 Jul 28 11:42:08.875485 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1860/3773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:07 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:08.881763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:08.882489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:08.900422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:08.900875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:08.901868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:08.902478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:09.262643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:09.284347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68309023-f98e-4b9d-a845-78f6b3819af0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.915574 Jul 28 11:42:09.288370 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1914/3774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:08 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:09.299312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf7287a3-c633-47fe-ac08-ed40d711ecd9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbe36700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:09.366398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:09.381951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfa5147b-867f-4fce-b062-a8340f0a49a6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.505081 Jul 28 11:42:09.382560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1861/3775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:08 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:09.391843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:09.395133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:09.405309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf7287a3-c633-47fe-ac08-ed40d711ecd9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.115222 Jul 28 11:42:09.407137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1915/3776] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:09 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:09.414624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:09.415106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:09.415918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:09.416359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:09.892313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:09.893046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:09.911122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:09.914339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:09.917532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:09.919683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:09.984859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:10.148167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:10.161073 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db62f52b-d437-40f7-b202-cae46a3b8a43 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.777052 Jul 28 11:42:10.161845 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1862/3777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:09 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:10.314065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:10.314683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:10.330337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:10.331145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:10.332209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:10.333519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:10.408853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:10.419156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f7cb709-1e37-4559-a021-0f5380433d47 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.531852 Jul 28 11:42:10.423719 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1916/3778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:09 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:10.429040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:10.433918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:10.448547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:10.454806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:10.458095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:10.462287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.059849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:11.064414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:11.082203 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a03791fa-1d49-4f39-b809-e884c2e0d9c9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.656898 Jul 28 11:42:11.097274 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1917/3779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:10 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:11.097274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f8e174a-6813-4c80-b7f2-9ddd3062ea8e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbdfcb80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:11.129329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:11.193932 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f8e174a-6813-4c80-b7f2-9ddd3062ea8e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.107525 Jul 28 11:42:11.196528 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1918/3780] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:11 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:11.208085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5329264f-4736-4818-86d2-3be3df69d74c req-94bf1873-4fca-4e1a-bba2-44c657fd7d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be83408-f030-40e8-b48b-6b36c90449f3", "tag": "6fd36397-9386-4b92-bb1e-ecf102352fe9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:11.232256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:11.241725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5329264f-4736-4818-86d2-3be3df69d74c req-94bf1873-4fca-4e1a-bba2-44c657fd7d05 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:11.243630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5329264f-4736-4818-86d2-3be3df69d74c req-94bf1873-4fca-4e1a-bba2-44c657fd7d05 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.261364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5329264f-4736-4818-86d2-3be3df69d74c req-94bf1873-4fca-4e1a-bba2-44c657fd7d05 service nova] Creating event network-changed:6fd36397-9386-4b92-bb1e-ecf102352fe9 for instance 2be83408-f030-40e8-b48b-6b36c90449f3 on n-h1-851368-1 Jul 28 11:42:11.272730 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5329264f-4736-4818-86d2-3be3df69d74c req-94bf1873-4fca-4e1a-bba2-44c657fd7d05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072629 Jul 28 11:42:11.274173 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1919/3781] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:11.282203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:11.283306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:11.292226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:11.293863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.295719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:11.296337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.345969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:11.358309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8fa78805-fcca-420a-a2c9-97dddee64aec tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 1.047129 Jul 28 11:42:11.371340 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1863/3782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:10 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:11.448965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:11.449947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:11.466234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:11.467707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.472288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:11.473080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:11.629104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:11.641958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7972d29f-4cf3-4bd2-9642-ba1734f2c1f0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.362842 Jul 28 11:42:11.644095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1920/3783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:11 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:11.763282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:11.777666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a7e6881-d9f3-4c0a-8764-11a4d4174e28 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.333114 Jul 28 11:42:11.793485 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1864/3784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:11 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:12.105052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:12.105679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:12.116534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.116964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.120092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.121070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.216974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cad03eb0-3b73-4003-904e-c454e96c5a6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb22e8280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:12.329644 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cad03eb0-3b73-4003-904e-c454e96c5a6e tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.119391 Jul 28 11:42:12.330694 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1865/3785] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:12 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:12.382272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:12.382904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:12.406831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.413965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.417233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.417945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.562364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:12.587146 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc50b873-5f37-4945-9d0b-59204b10143c tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.485815 Jul 28 11:42:12.588694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1921/3786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:12 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:12.674475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:12.675472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:12.693294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.694054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.695616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.702977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.743308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:12.751809 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-58042ef2-f636-49d2-853c-39692a64b09f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.374788 Jul 28 11:42:12.755240 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1866/3787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:12 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:12.853718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:12.854395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:12.871921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.872380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:12.873222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:12.873665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:13.153540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:13.167959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-994a88c2-67cb-48fc-856e-5516a7a82ea8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.506034 Jul 28 11:42:13.169287 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1922/3788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:12 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:13.262124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:13.277164 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-785b686d-05e3-4336-a9d4-4c645b873e90 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.473187 Jul 28 11:42:13.278142 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1867/3789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:12 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:13.350357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4227509-a884-40bd-a819-68e2aea2208f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbdfcb80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:13.419690 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4227509-a884-40bd-a819-68e2aea2208f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.078384 Jul 28 11:42:13.421118 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1923/3790] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:13 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:13.608879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:13.609519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:13.625054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:13.625797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:13.626773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:13.627408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:13.780086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:13.780706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:13.799722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:13.800477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:13.801500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:13.812012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.010270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:14.019161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc368328-f49b-42af-aa75-08e821aab648 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.414189 Jul 28 11:42:14.023202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1868/3791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:13 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:14.157747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:14.184182 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b69675f8-c4d7-4031-9777-578e6f8ed7cb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.406921 Jul 28 11:42:14.185034 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1924/3792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:13 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:14.194033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:14.194652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:14.207344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:14.207816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.209087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:14.209533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.299373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:14.300571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:14.317575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:14.319409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.320457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:14.321895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.621041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:14.645414 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2293c211-069c-4aa3-9d8a-71009555ef5b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.444720 Jul 28 11:42:14.648064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1869/3793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:14 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:14.660355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79064a00-9d69-4ad1-a691-eadce5a8e1e0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb22fb790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:14.761598 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79064a00-9d69-4ad1-a691-eadce5a8e1e0 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.111746 Jul 28 11:42:14.762430 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1870/3794] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:14 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:14.771822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:14.775239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c823ab99-212c-4048-8092-c62805641f77 req-28dca9a1-7134-48f0-a9fe-3291097e3e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134c96d2-8940-46fa-96fb-b8ad7bc63928", "name": "network-vif-plugged", "status": "completed", "tag": "04be67eb-25dd-4d92-901e-14540ce2a58f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:14.781029 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f00242bd-f9f6-4321-ac61-a174dfd127dd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.486639 Jul 28 11:42:14.782117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1925/3795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:14 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:14.804598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c823ab99-212c-4048-8092-c62805641f77 req-28dca9a1-7134-48f0-a9fe-3291097e3e14 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:14.805515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c823ab99-212c-4048-8092-c62805641f77 req-28dca9a1-7134-48f0-a9fe-3291097e3e14 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:14.833536 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c823ab99-212c-4048-8092-c62805641f77 req-28dca9a1-7134-48f0-a9fe-3291097e3e14 service nova] Creating event network-vif-plugged:04be67eb-25dd-4d92-901e-14540ce2a58f for instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 on n-h2-851368-1 Jul 28 11:42:14.841511 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c823ab99-212c-4048-8092-c62805641f77 req-28dca9a1-7134-48f0-a9fe-3291097e3e14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077199 Jul 28 11:42:14.843567 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1871/3796] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:15.044384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:15.045045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:15.059731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.060257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.069862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.070335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.207726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:15.208438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:15.219016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.219513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.230873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.231909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.441114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:15.449196 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddf20ab3-f172-448b-99dc-abeb7f99d61d tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.409362 Jul 28 11:42:15.453994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1926/3797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:15 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:15.606103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:15.615770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e6bb342-feaf-4fc7-98c6-d56feb476ef2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.412267 Jul 28 11:42:15.622030 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1872/3798] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:15 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:15.679007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:15.682420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:15.706021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.708638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.712299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.716462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.780035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89422db4-72e4-4a2e-9861-093bfa4e8bb6 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2479820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:15.853684 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89422db4-72e4-4a2e-9861-093bfa4e8bb6 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.080045 Jul 28 11:42:15.854989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1873/3799] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:15 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:15.861877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:15.862819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:15.870925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.871854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:15.872957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:15.873622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:16.222526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:16.235790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b3c726e-4a9c-433a-b321-fa2aa44eddda tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1316 microversion: 2.1 time: 0.379144 Jul 28 11:42:16.247417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1874/3800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:15 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:16.273786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:16.283440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72eb35d5-6717-4007-8676-5edf0cd31c96 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.613257 Jul 28 11:42:16.285082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1927/3801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:15 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:16.474861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:16.475606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:16.483091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:16.483838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:16.485471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:16.486148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:16.637220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:16.638342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:16.654254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:16.655453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:16.658702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:16.659189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:16.780072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:16.787928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:16.793957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a13feea9-720c-4579-83e4-34eff94fe66e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.325796 Jul 28 11:42:16.798812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1875/3802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:16 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:16.871261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12699e0b-9685-4735-b0c7-82822a998c3a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b5bca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:16.937518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:16.949689 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-48b9aafe-6abf-41ea-8c98-00a8684b09e7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1657 microversion: 2.1 time: 0.316372 Jul 28 11:42:16.962262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1928/3803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1657 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:16.962867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12699e0b-9685-4735-b0c7-82822a998c3a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.080881 Jul 28 11:42:16.962867 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1876/3804] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:16 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:16.977003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74fe80a3-6b11-4392-a91f-b0ef2712a184 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:16.988791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74fe80a3-6b11-4392-a91f-b0ef2712a184 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:16.994356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74fe80a3-6b11-4392-a91f-b0ef2712a184 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.029016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74fe80a3-6b11-4392-a91f-b0ef2712a184 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Going to try to start instance {{(pid=119235) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 11:42:17.096866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74fe80a3-6b11-4392-a91f-b0ef2712a184 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.127333 Jul 28 11:42:17.097937 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1929/3805] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:16 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:17.109136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:17.109773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:17.125703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.126207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.127224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.127689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.262071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:17.262797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:17.291979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.293914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.295850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.297371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.601237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:17.618800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-096e4329-a0a4-400f-9708-20ccf8a9697a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1666 microversion: 2.1 time: 0.515853 Jul 28 11:42:17.620362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1877/3806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:17 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1666 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:17.626970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:17.628139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:17.637618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.638953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.640767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.642229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.898976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:17.918687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afe2f5fc-9287-4d64-8579-2a2cb0749ed4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1505 microversion: 2.1 time: 0.656830 Jul 28 11:42:17.919809 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1930/3807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:17 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:17.934989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:17.939499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:17.960232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.974178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:17.975551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:17.978149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:18.106094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:18.116101 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c5e49a3-f71d-406a-9afb-9063c48cde46 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.493975 Jul 28 11:42:18.119884 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1878/3808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:17 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:18.128789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-605189206"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:18.132850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:18.148521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:18.150739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:18.152323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:18.157816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:18.623820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:18.636528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-970f115f-33c9-4a4a-a7cd-c241f3f80e99 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.714786 Jul 28 11:42:18.642977 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1931/3809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:17 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:18.653502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14612450-91b4-453b-9d4b-6bf31da50962 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1c7bd30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:18.732840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14612450-91b4-453b-9d4b-6bf31da50962 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1436 microversion: 2.1 time: 0.088042 Jul 28 11:42:18.742084 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1932/3810] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:18 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:18.750808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:18.752244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:18.765916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:18.766652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:18.773153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:18.774742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:18.799501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Adding security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d to port 04be67eb-25dd-4d92-901e-14540ce2a58f Jul 28 11:42:19.283013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:19.299276 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d54ac292-a7bd-4e24-be2e-31e5582d7f64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1666 microversion: 2.1 time: 0.555612 Jul 28 11:42:19.300643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1933/3811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:18 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1666 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:19.312045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:19.313077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:19.325715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:19.326216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:19.327009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:19.331047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:19.635301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:19.645101 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4a184067-8e48-4e45-b922-6c40177486af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.343138 Jul 28 11:42:19.659114 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1934/3812] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:19 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:19.666509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:19.667051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:19.681632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:19.682249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:19.683319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:19.684310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:19.832730 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2430fb2d-9f9c-4c80-a242-5c8681fef1e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action" status: 202 len: 0 microversion: 2.1 time: 1.711342 Jul 28 11:42:19.837652 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1879/3813] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:18 2022] POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:19.843408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97dcb5ec-d0bd-48a2-9cd3-97ca6471fc69 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b38af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:19.928161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97dcb5ec-d0bd-48a2-9cd3-97ca6471fc69 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1445 microversion: 2.1 time: 0.089022 Jul 28 11:42:19.928760 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1880/3814] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:19 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:19.954672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e575cc26-1823-4638-8e71-168c0f8728c3 req-709fc872-a9b2-40d7-8413-2e2224f15ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134c96d2-8940-46fa-96fb-b8ad7bc63928", "tag": "04be67eb-25dd-4d92-901e-14540ce2a58f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:20.000093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e575cc26-1823-4638-8e71-168c0f8728c3 req-709fc872-a9b2-40d7-8413-2e2224f15ad5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:20.000549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e575cc26-1823-4638-8e71-168c0f8728c3 req-709fc872-a9b2-40d7-8413-2e2224f15ad5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:20.056796 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e575cc26-1823-4638-8e71-168c0f8728c3 req-709fc872-a9b2-40d7-8413-2e2224f15ad5 service nova] Creating event network-changed:04be67eb-25dd-4d92-901e-14540ce2a58f for instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 on n-h2-851368-1 Jul 28 11:42:20.083151 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e575cc26-1823-4638-8e71-168c0f8728c3 req-709fc872-a9b2-40d7-8413-2e2224f15ad5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136556 Jul 28 11:42:20.084510 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1881/3815] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:20.097575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb22fb040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:20.162480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:20.166216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:20.175756 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c8a7104-e3d0-4ca5-8e92-7ceb03affbf7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.514991 Jul 28 11:42:20.176668 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1935/3816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:19 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:20.190655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61ce3200-d325-466c-8791-d07de7879887 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbe36430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:20.251772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61ce3200-d325-466c-8791-d07de7879887 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 200 len: 1445 microversion: 2.1 time: 0.073810 Jul 28 11:42:20.252727 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1936/3817] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:20 2022] GET /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 1445 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:20.267668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98818063-b0de-4fdb-8a24-d6fecd8ea126 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1c6daf0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:20.409525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use.", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:20.410229 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.410229 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d HTTP/1.1 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: exception: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'a5f85a4a-2d3b-4b30-89e7-504ea98afa5d'} Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:20.412590 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 400 to user: Security Group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d in use. Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-33991dea-da40-424f-bddf-d90a75e6e735'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9083ee7d-c6b9-4448-9614-023c6e3f97d2 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d" status: 400 len: 185 microversion: 2.1 time: 0.328414 Jul 28 11:42:20.417768 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1882/3818] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:20 2022] DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d => generated 185 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:42:20.425823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:20.425823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:20.436539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:20.439785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:20.445501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:20.449524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:20.451809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:20.959452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:20.985096 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6d58b8b0-4cc2-4f45-a964-188905332525 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.566170 Jul 28 11:42:20.987796 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1883/3819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:20 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:20.999807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:21.004837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:21.026156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.027595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:21.031340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.032004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:21.258482 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fdb4855-dff8-4c1b-b4d2-534440126107 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action" status: 202 len: 0 microversion: 2.1 time: 0.269092 Jul 28 11:42:21.259448 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1884/3820] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:20 2022] POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:21.272250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:21.276914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:21.296485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.298034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:21.305663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.306312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:21.410407 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98818063-b0de-4fdb-8a24-d6fecd8ea126 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 204 len: 0 microversion: 2.1 time: 1.145948 Jul 28 11:42:21.411568 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1937/3821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:20 2022] DELETE /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:21.417440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:21.418387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:21.446596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.447297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:21.451835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:21.454404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.054174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:22.062649 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-beb0b19f-a5e0-44e7-b80a-7f141cc37d16 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.649496 Jul 28 11:42:22.063408 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1938/3822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:21 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:22.085537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:22.088889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:22.089733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:22.096328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.097109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.098102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.098993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.101462 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1ffebaf-575d-4894-84f9-695fcab3cd89 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.839255 Jul 28 11:42:22.102080 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1885/3823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:21 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:22.116487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-24021b5e-3777-4943-a812-48b05e5014b5 req-1a4dcd78-d3eb-45f7-ae14-454bb979d636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be83408-f030-40e8-b48b-6b36c90449f3", "name": "network-vif-plugged", "status": "completed", "tag": "6fd36397-9386-4b92-bb1e-ecf102352fe9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:22.129604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-24021b5e-3777-4943-a812-48b05e5014b5 req-1a4dcd78-d3eb-45f7-ae14-454bb979d636 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.130084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-24021b5e-3777-4943-a812-48b05e5014b5 req-1a4dcd78-d3eb-45f7-ae14-454bb979d636 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.151740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-24021b5e-3777-4943-a812-48b05e5014b5 req-1a4dcd78-d3eb-45f7-ae14-454bb979d636 service nova] Creating event network-vif-plugged:6fd36397-9386-4b92-bb1e-ecf102352fe9 for instance 2be83408-f030-40e8-b48b-6b36c90449f3 on n-h1-851368-1 Jul 28 11:42:22.164452 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-24021b5e-3777-4943-a812-48b05e5014b5 req-1a4dcd78-d3eb-45f7-ae14-454bb979d636 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059360 Jul 28 11:42:22.165408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1886/3824] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:22.172023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:22.173129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:22.183221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.184021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.186693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.187418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.517862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:22.528795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1d9d1ee-19c8-431d-8662-da1e69339df6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.451572 Jul 28 11:42:22.530424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1939/3825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:22 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:22.539603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:22.540424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:22.549520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.550313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.551369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.552040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.594421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:22.666795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:22.682385 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-96aa48cd-7b28-489c-bdee-04dc85f51a39 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1575 microversion: 2.1 time: 0.515791 Jul 28 11:42:22.683379 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1887/3826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:22 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1575 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:22.707064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:22.707686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:22.716497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.716872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.717650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.718278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.774707 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6cb2a171-8440-4aec-a521-6377959f9e32 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 204 len: 0 microversion: 2.1 time: 0.242519 Jul 28 11:42:22.783185 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1940/3827] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:22 2022] DELETE /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:22.790602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Unlocking {{(pid=119236) unlock /opt/stack/nova/nova/compute/api.py:4811}} Jul 28 11:42:22.865613 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2c28dcb-7e2b-42e7-b603-2e9f0cb3c686 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.165628 Jul 28 11:42:22.866317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1888/3828] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:22 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:22.880063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:22.881074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:22.887380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.888078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.889695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:22.890517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:22.926010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-300421725", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "961a9b15-0870-4716-afa2-9403d248bf26"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:22.990459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] validate_networks() for [('961a9b15-0870-4716-afa2-9403d248bf26', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:42:23.210967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:23.225417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04b320df-60dc-4f86-a04d-3c670357cdff tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.349873 Jul 28 11:42:23.226010 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1941/3829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:22 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:23.233522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:23.233522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:23.239107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.239549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.240318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.240756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.489923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:23.498370 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-457c4b06-6fd4-4b57-915a-35524103ed19 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.271088 Jul 28 11:42:23.498969 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1942/3830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:23 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:23.520588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:23.522000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:23.529847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.530657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.531786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.532467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.775244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:23.786046 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f119455-6728-40c7-9474-cbcf93be4c69 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.273355 Jul 28 11:42:23.786956 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1943/3831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:23 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:23.791564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:23.792172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:23.802472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.803027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.803898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.804346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.829512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:42:23.830313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:42:23.830524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:42:23.830827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:42:23.831284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:42:23.841512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.842205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.843201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:23.843838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:23.887493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:42:23.899517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Getting quotas for user 5b9d61f656eb49ae95e22e56412c55fd and project e4c0984c481948a3b06410470d8c3035. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:42:23.913502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:42:23.916520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:42:23.980369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6a6658d-0831-46f3-8dc1-dc1c326e0bf5 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058370 Jul 28 11:42:23.986442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:23.988715 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1889/3832] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:42:23.995818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:23.996968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:23.999941 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d5ff1af2-4cc5-45f0-8f91-ba6ce20595f2 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.211344 Jul 28 11:42:24.003712 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1944/3833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:23 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:24.005859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.006481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.007509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.008097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.036206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:24.037334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:24.052929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.054221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.056379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.057570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.531535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:24.541686 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea1bd511-b0e1-441c-b476-8292b20ad616 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1575 microversion: 2.1 time: 0.551405 Jul 28 11:42:24.555871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1890/3834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:23 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1575 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:24.562746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:24.563782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:24.569541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:24.572231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.573150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.573970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.574687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.588864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ea3f3db8-6cba-44f1-8f8b-724e81fc4588 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.583971 Jul 28 11:42:24.589507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1945/3835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:24 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:24.600377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f31bd3b7-9b46-4acb-b709-59ec202e4441 req-1b659e3d-5662-4f7c-b3f1-d3259eb922de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4cdde0-93d5-43e3-a652-35c69539929a", "name": "network-vif-unplugged", "status": "completed", "tag": "9312f597-97ae-421b-ab6f-b439e842fc10"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:24.614914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f31bd3b7-9b46-4acb-b709-59ec202e4441 req-1b659e3d-5662-4f7c-b3f1-d3259eb922de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.615391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f31bd3b7-9b46-4acb-b709-59ec202e4441 req-1b659e3d-5662-4f7c-b3f1-d3259eb922de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.627983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f31bd3b7-9b46-4acb-b709-59ec202e4441 req-1b659e3d-5662-4f7c-b3f1-d3259eb922de service nova] Creating event network-vif-unplugged:9312f597-97ae-421b-ab6f-b439e842fc10 for instance 0a4cdde0-93d5-43e3-a652-35c69539929a on n-h2-851368-1 Jul 28 11:42:24.633081 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f31bd3b7-9b46-4acb-b709-59ec202e4441 req-1b659e3d-5662-4f7c-b3f1-d3259eb922de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042366 Jul 28 11:42:24.635994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1946/3836] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:24.640987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:24.641705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:24.649653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.650129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.650926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.651399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.657427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:24.665167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bce6a433-bc27-47a3-bac6-dbd08d053fc9 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1211 microversion: 2.1 time: 0.107820 Jul 28 11:42:24.671243 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1891/3837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:24 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:24.671870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:24.672623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:24.678769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.679466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.680434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.681043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.789052 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d88a215c-9f5f-4f1a-85d7-234758fb0ec3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.120793 Jul 28 11:42:24.790098 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1892/3838] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:24 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:24.799216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:24.799893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:24.807097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.807569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.808345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:24.810989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:24.817996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:24.818995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:24.832029 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1a93893a-bcd3-462a-90b4-d7a99c621330 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1362 microversion: 2.1 time: 0.195554 Jul 28 11:42:24.834169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1947/3839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:24 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:25.023577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:25.024204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:25.034793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.035268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:25.036088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.036552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:25.043149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:25.052260 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9199ceec-63f5-4b5d-ac6f-6b48cd677177 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1675 microversion: 2.1 time: 0.257729 Jul 28 11:42:25.052820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1893/3840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:24 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:25.352179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:25.362485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd7df459-55ec-4601-8f17-119db0dae243 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.343193 Jul 28 11:42:25.363416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1948/3841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:25 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:25.572544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:25.573790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:25.611399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.612348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:25.616785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.617900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:25.689279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:25.690039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:25.709779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.715330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:25.719220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:25.719932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.058456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:26.068284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f9b315a-b0b8-4f13-90f1-4ec714fffa95 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1267 microversion: 2.1 time: 0.385230 Jul 28 11:42:26.072448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1949/3842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:25 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:26.080443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:26.081359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:26.121266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.122147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.123831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.127058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.444650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:26.459187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e6ac405-48ef-45d7-9c8a-73566e8d2c32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1580 microversion: 2.1 time: 0.894772 Jul 28 11:42:26.460034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1894/3843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:25 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1580 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:26.478663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:26.479716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:26.480375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:26.499395 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c724d719-24db-46e8-9abd-972460bc8de3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1548 microversion: 2.1 time: 0.425482 Jul 28 11:42:26.505044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.505770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.506764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.507225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1950/3844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:26 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1548 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:26.509236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.521269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-692b9627-380e-45f0-af20-01ff2b897e8e req-91615d92-b01c-41ca-9fd1-d0a373db9798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4cdde0-93d5-43e3-a652-35c69539929a", "name": "network-vif-deleted", "tag": "9312f597-97ae-421b-ab6f-b439e842fc10"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:26.539402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-692b9627-380e-45f0-af20-01ff2b897e8e req-91615d92-b01c-41ca-9fd1-d0a373db9798 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.540331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-692b9627-380e-45f0-af20-01ff2b897e8e req-91615d92-b01c-41ca-9fd1-d0a373db9798 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.556447 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-692b9627-380e-45f0-af20-01ff2b897e8e req-91615d92-b01c-41ca-9fd1-d0a373db9798 service nova] Creating event network-vif-deleted:9312f597-97ae-421b-ab6f-b439e842fc10 for instance 0a4cdde0-93d5-43e3-a652-35c69539929a on n-h2-851368-1 Jul 28 11:42:26.563633 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-692b9627-380e-45f0-af20-01ff2b897e8e req-91615d92-b01c-41ca-9fd1-d0a373db9798 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054749 Jul 28 11:42:26.565408 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1951/3845] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:26.573587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:26.574368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:26.583644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.584271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:26.585346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:26.586445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.093584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:27.109295 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d543809-61eb-4254-9154-3cc6a9050474 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1655 microversion: 2.1 time: 0.647909 Jul 28 11:42:27.110003 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1895/3846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:26 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1655 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:27.131783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:27.132642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.141429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.142193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.143200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.143814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.278181 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfc263cf-56ab-4705-8ac5-05c69dfb8f10 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154003 Jul 28 11:42:27.278989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1896/3847] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:42:27 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:27.285127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:27.285623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:27.286599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.303475 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95a86e75-8c0d-4860-8ecc-5929c247b1b6 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1486 microversion: 2.1 time: 0.735111 Jul 28 11:42:27.303475 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1952/3848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:26 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1486 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:27.307799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.308499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.314252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.314898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:27.315579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.316523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.331611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.332068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.333004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.333440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.396858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:27.442002 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5b6bf548-7966-4fdb-b889-3f40fd2d8b79 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.137815 Jul 28 11:42:27.443934 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1953/3849] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:27 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:27.452597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:27.453307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:27.454270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.462864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.463607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.464505 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6c84aff-8919-4d96-b374-20c55f74e358 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1265 microversion: 2.1 time: 0.183106 Jul 28 11:42:27.464938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.465545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.467229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1897/3850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:27 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:27.481842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:27.482941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.500269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.500603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.501331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.501774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.589404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99a65522-c7a3-4cb3-a951-9f66dc8a0036 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "POST /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f/action" status: 202 len: 0 microversion: 2.1 time: 0.143833 Jul 28 11:42:27.590138 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1954/3851] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:27 2022] POST /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:27.599507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:27.600224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:27.618047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.619809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:27.622300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:27.626060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.053134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:28.068785 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88b91607-1fc6-43ca-8742-79085b1e2cd8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1662 microversion: 2.1 time: 0.600496 Jul 28 11:42:28.090090 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1898/3852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:27 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1662 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:28.105018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:28.106002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:28.120536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.121278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.124987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.125976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.154594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:28.166577 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a8b5047-31e8-4b05-b324-b573bb83da9d tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1573 microversion: 2.1 time: 0.574609 Jul 28 11:42:28.170770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1955/3853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:27 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1573 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:28.192105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2111437270"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:28.193154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:28.201413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.202098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.205299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.206773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.492992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:28.508223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f552ee90-f22a-4f4a-bff8-d3177b39dd12 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1494 microversion: 2.1 time: 0.416720 Jul 28 11:42:28.514730 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1899/3854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:28 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1494 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:28.525515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:28.526143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:28.541718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.542165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.542955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:28.549557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:28.634352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.network.security_group_api [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Adding security group cf9e2294-22d3-452a-a166-d145866ebc9a to port 04be67eb-25dd-4d92-901e-14540ce2a58f Jul 28 11:42:29.095617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:29.105525 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51482436-2a7d-4465-9a11-cf798cd9538f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.588943 Jul 28 11:42:29.106299 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1900/3855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:28 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:29.111622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:29.112616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:29.119569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.121238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:29.122330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.123566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:29.533280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:29.543052 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6767d14a-af3c-4416-bf17-02e08239272c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.435345 Jul 28 11:42:29.548540 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1901/3856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:29 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:29.553807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:29.554624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:29.562958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.563724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:29.564524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.564966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:29.855510 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2f8f83b-4f75-40b4-ab96-bfb85f8da5c7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action" status: 202 len: 0 microversion: 2.1 time: 1.666168 Jul 28 11:42:29.856570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1956/3857] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:28 2022] POST /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928/action => generated 0 bytes in 1669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:42:29.864161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:29.864869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:29.879766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.884642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:29.887733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:29.889729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:30.309606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:30.330241 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0bccc1e8-6f0d-435e-bf00-894851d02d85 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1494 microversion: 2.1 time: 0.776448 Jul 28 11:42:30.335954 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1902/3858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:29 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1494 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:30.352541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c929598b-d47a-4508-adaa-9a10c2a029f5 req-87a66afc-8537-4121-b0db-f76203a3b422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be83408-f030-40e8-b48b-6b36c90449f3", "tag": "6fd36397-9386-4b92-bb1e-ecf102352fe9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:30.399964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c929598b-d47a-4508-adaa-9a10c2a029f5 req-87a66afc-8537-4121-b0db-f76203a3b422 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:30.400517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c929598b-d47a-4508-adaa-9a10c2a029f5 req-87a66afc-8537-4121-b0db-f76203a3b422 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:30.441736 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c929598b-d47a-4508-adaa-9a10c2a029f5 req-87a66afc-8537-4121-b0db-f76203a3b422 service nova] Creating event network-changed:6fd36397-9386-4b92-bb1e-ecf102352fe9 for instance 2be83408-f030-40e8-b48b-6b36c90449f3 on n-h1-851368-1 Jul 28 11:42:30.458190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c929598b-d47a-4508-adaa-9a10c2a029f5 req-87a66afc-8537-4121-b0db-f76203a3b422 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115048 Jul 28 11:42:30.459112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1903/3859] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:30.459704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:30.470494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b5ba60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:30.470914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3c69ec0-4b23-4ba9-91b8-cb52933ebf32 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.611384 Jul 28 11:42:30.471536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1957/3860] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:29 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:30.485013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7cf2b2ee-324f-4a45-8078-f4c57d6dcd57 req-36322fd6-890d-4219-b0b7-1393bfa6ad35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134c96d2-8940-46fa-96fb-b8ad7bc63928", "tag": "04be67eb-25dd-4d92-901e-14540ce2a58f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:30.515337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7cf2b2ee-324f-4a45-8078-f4c57d6dcd57 req-36322fd6-890d-4219-b0b7-1393bfa6ad35 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:30.515811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7cf2b2ee-324f-4a45-8078-f4c57d6dcd57 req-36322fd6-890d-4219-b0b7-1393bfa6ad35 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:30.540901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7cf2b2ee-324f-4a45-8078-f4c57d6dcd57 req-36322fd6-890d-4219-b0b7-1393bfa6ad35 service nova] Creating event network-changed:04be67eb-25dd-4d92-901e-14540ce2a58f for instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 on n-h2-851368-1 Jul 28 11:42:30.564358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7cf2b2ee-324f-4a45-8078-f4c57d6dcd57 req-36322fd6-890d-4219-b0b7-1393bfa6ad35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087961 Jul 28 11:42:30.565264 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1958/3861] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:30.582456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:30.583648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:30.595998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:30.596468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:30.597278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:30.597719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:31.420296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use.", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:31.421064 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.421064 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a HTTP/1.1 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: exception: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'cf9e2294-22d3-452a-a166-d145866ebc9a'} Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:31.424173 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] Jul 28 11:42:31.429646 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:31.434807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 400 to user: Security Group cf9e2294-22d3-452a-a166-d145866ebc9a in use. Jul 28 11:42:31.434807 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-986d7557-fb03-430c-8b96-718347ffbefc'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:31.436268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7747875-8107-4f85-8d09-4f7736ac91fc tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a" status: 400 len: 185 microversion: 2.1 time: 0.975459 Jul 28 11:42:31.437032 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1904/3862] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:30 2022] DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a => generated 185 bytes in 977 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:42:31.445790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:31.446540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:31.462897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:31.463866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:31.465227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:31.465904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:31.615445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:31.624034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-614a48a0-3b33-41bd-afdb-29ade8367846 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 1.057330 Jul 28 11:42:31.624968 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1959/3863] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:30 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:31.629860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:31.630747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:31.642370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:31.643646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:31.644662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:31.645876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.100298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.112603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a2b3241-9f2a-4956-9dc2-04d458f43608 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.674326 Jul 28 11:42:32.116344 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1905/3864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:31 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.131561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.132368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.139381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.140192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.141219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.141906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.171525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:32.270008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.286630 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79e26dd0-652f-4837-b21f-5dab540ca95a tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1494 microversion: 2.1 time: 0.660068 Jul 28 11:42:32.291480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1960/3865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:31 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1494 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.294049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51a630a9-2453-4ea7-b2c6-16f7a379f947 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 204 len: 0 microversion: 2.1 time: 0.175656 Jul 28 11:42:32.294811 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1906/3866] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:32 2022] DELETE /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:32.303514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.304568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.312611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.317470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.320835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.321430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.323533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.324233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.334435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.340011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.340864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.341864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.636808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.639082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.646836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a611731-68d0-4cf5-9c32-cee467e116af tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.354091 Jul 28 11:42:32.656518 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1961/3867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.656518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-df7fe611-32a9-4205-8a0a-de2a0799ad92 req-6c90c81e-4147-4371-a9a8-3cfc6b686083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3e3a78-7485-4922-9f5b-2ddac1c17d24", "tag": "fc4105ad-32dd-4816-8bb8-7dea087f5db2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:32.662787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16a0fdbc-6b0b-4da3-b9b1-0e60e8ed5848 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1648 microversion: 2.1 time: 0.348929 Jul 28 11:42:32.663108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-df7fe611-32a9-4205-8a0a-de2a0799ad92 req-6c90c81e-4147-4371-a9a8-3cfc6b686083 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.663849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-df7fe611-32a9-4205-8a0a-de2a0799ad92 req-6c90c81e-4147-4371-a9a8-3cfc6b686083 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.666252 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1907/3868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:32 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1648 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.676526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-df7fe611-32a9-4205-8a0a-de2a0799ad92 req-6c90c81e-4147-4371-a9a8-3cfc6b686083 service nova] Creating event network-changed:fc4105ad-32dd-4816-8bb8-7dea087f5db2 for instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 on n-h2-851368-1 Jul 28 11:42:32.681154 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-df7fe611-32a9-4205-8a0a-de2a0799ad92 req-6c90c81e-4147-4371-a9a8-3cfc6b686083 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031501 Jul 28 11:42:32.681815 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1962/3869] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:32.683505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.684329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.690447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.691142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.696973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.698111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.698368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.698368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.698844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.699111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.699320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.699668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.915786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.918620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:32.927881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7b42c92-53b5-43d6-9dfd-1f8a06cb7326 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.258248 Jul 28 11:42:32.929118 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1908/3870] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:32 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.939386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d63d207-1a95-4736-aadd-865ce090c7f8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.242092 Jul 28 11:42:32.940112 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1963/3871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:32.960159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:32.960782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:32.968623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.969316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:32.970593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:32.971281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.117744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:33.126112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d440624-33fc-4822-be96-e07022eb66d3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.169667 Jul 28 11:42:33.126696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1909/3872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:33.312106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:33.312717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:33.319423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.320071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.320928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.321530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.470170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:33.478774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e68a506f-de5e-4a86-baa2-21454b226445 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1500 microversion: 2.1 time: 0.170668 Jul 28 11:42:33.480307 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1964/3873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:33 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:33.512196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:33.512708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:33.521031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.521671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.522574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.523256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.527820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:33.554815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:33.647047 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f313b52-311a-4799-a242-db675ec2d565 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "DELETE /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 204 len: 0 microversion: 2.1 time: 0.137222 Jul 28 11:42:33.649169 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1910/3874] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:33 2022] DELETE /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:33.657469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:33.658146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:33.673123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.673790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.674751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.675950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.714261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:33.715126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:33.725694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.726156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.726945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:33.727472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:33.856041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:33.907694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:34.174547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:34.182817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cebaed37-9a60-407a-b0eb-a363f46f91aa tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.529485 Jul 28 11:42:34.193713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:34.198137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1965/3875] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:33 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:34.202378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4002028c-66cc-48e1-a2a8-9732ab8cb8e9 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1648 microversion: 2.1 time: 0.509007 Jul 28 11:42:34.203268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1911/3876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:33 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1648 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:34.204548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:34.205173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:34.211688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:34.212780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:34.213755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:34.214362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:34.473196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:34.482901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1828fc1f-033a-41b3-bde4-81808f1d684d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.282781 Jul 28 11:42:34.483421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1966/3877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:34 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:35.056386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:35.063159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:35.086024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.088817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.089653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.090097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.206337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:35.207135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:35.240543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.242718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.252008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.253156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.615938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:35.634303 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bee47835-42c8-414b-a7c8-591e8dd33c64 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.432482 Jul 28 11:42:35.635218 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1967/3878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:35 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:35.640652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:35.641267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:35.649793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.650507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.654400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.655094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.672896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afd453ed-c8cb-4151-a846-1d80f129ec0f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629228 Jul 28 11:42:35.676211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1912/3879] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:42:35 2022] POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:35.690942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:35.694502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:35.712503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.712989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:35.717795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:35.719921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:36.052870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:36.064666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e334383-e1fa-4f0b-ac2a-82b8d1854c58 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.386797 Jul 28 11:42:36.065988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1913/3880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:35 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:36.074385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:36.085752 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53b118ff-ebbd-4ad5-90e3-4e2ae351670f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1648 microversion: 2.1 time: 0.448705 Jul 28 11:42:36.087213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1968/3881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:35 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1648 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:36.356397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fd9019cc-49c9-45a8-b4fb-99b6fb041432 req-9b484b57-cc02-4655-8c6e-05b8cbdb57cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134c96d2-8940-46fa-96fb-b8ad7bc63928", "name": "network-vif-deleted", "tag": "04be67eb-25dd-4d92-901e-14540ce2a58f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:36.389000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd9019cc-49c9-45a8-b4fb-99b6fb041432 req-9b484b57-cc02-4655-8c6e-05b8cbdb57cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:36.389638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd9019cc-49c9-45a8-b4fb-99b6fb041432 req-9b484b57-cc02-4655-8c6e-05b8cbdb57cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:36.436496 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fd9019cc-49c9-45a8-b4fb-99b6fb041432 req-9b484b57-cc02-4655-8c6e-05b8cbdb57cf service nova] Creating event network-vif-deleted:04be67eb-25dd-4d92-901e-14540ce2a58f for instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 on n-h2-851368-1 Jul 28 11:42:36.447931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fd9019cc-49c9-45a8-b4fb-99b6fb041432 req-9b484b57-cc02-4655-8c6e-05b8cbdb57cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095221 Jul 28 11:42:36.449769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1914/3882] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:36.675566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:36.676601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:36.693323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:36.696096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:36.699332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:36.701599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:36.926027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:36.935830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d5145ec-c16d-46cf-a4a4-64ddcb182239 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.284130 Jul 28 11:42:36.938403 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1969/3883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:36 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:37.089552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:37.090404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:37.108367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:37.109212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:37.113852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:37.118176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.120410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.124772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.125836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.128367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.131936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.135456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.136971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.241505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:37.290486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.290981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.291491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lazy-loading 'fault' on Instance uuid 134c96d2-8940-46fa-96fb-b8ad7bc63928 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:42:37.389094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:37.397091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69aa4eb7-1284-4df8-a0cf-b7b3ae50c102 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 200 len: 1306 microversion: 2.1 time: 0.293144 Jul 28 11:42:37.398337 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1970/3884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:37 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 1306 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:37.518883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:37.531611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4dbb964-abc1-47f3-8b97-a4f708ebeb66 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.448138 Jul 28 11:42:37.532092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1915/3885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:37 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:37.960797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:37.961678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:37.977993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.978464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:37.979298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:37.979866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:38.423192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:38.423806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:38.440449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:38.440912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:38.441704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:38.442153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:38.465622 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 HTTP/1.1 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '134c96d2-8940-46fa-96fb-b8ad7bc63928'} Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:38.482756 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:38.490082 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:38.493152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:38.493152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c7f98c0-04ff-4332-9b5d-f2e84d4f6811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 404 len: 111 microversion: 2.1 time: 0.074594 Jul 28 11:42:38.493152 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1916/3886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:38 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:38.506323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b249ebdf-a64f-4a3b-848c-a990a7245e36 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb2488940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:38.668138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:38.680094 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9417035-b481-4f11-929a-cb9fbe41dfc9 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 200 len: 1506 microversion: 2.1 time: 0.723142 Jul 28 11:42:38.696621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1971/3887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:37 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:38.709151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1aa40b37-1169-48e0-9d12-efffb60cc770 req-9b660519-ba0e-4f79-89a1-e6d8ed9f1f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f", "name": "network-vif-deleted", "tag": "a8dd089c-68ac-4753-bd5e-0ab17932cb2a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:38.749595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1aa40b37-1169-48e0-9d12-efffb60cc770 req-9b660519-ba0e-4f79-89a1-e6d8ed9f1f08 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:38.751283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1aa40b37-1169-48e0-9d12-efffb60cc770 req-9b660519-ba0e-4f79-89a1-e6d8ed9f1f08 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:38.784631 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1aa40b37-1169-48e0-9d12-efffb60cc770 req-9b660519-ba0e-4f79-89a1-e6d8ed9f1f08 service nova] Creating event network-vif-deleted:a8dd089c-68ac-4753-bd5e-0ab17932cb2a for instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f on n-h1-851368-1 Jul 28 11:42:38.796602 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1aa40b37-1169-48e0-9d12-efffb60cc770 req-9b660519-ba0e-4f79-89a1-e6d8ed9f1f08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096635 Jul 28 11:42:38.803441 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1972/3888] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:38.819434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:38.822193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:38.837282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:38.839664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:38.843562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:38.845301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.101554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b249ebdf-a64f-4a3b-848c-a990a7245e36 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d" status: 202 len: 0 microversion: 2.1 time: 0.601747 Jul 28 11:42:39.102797 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1917/3889] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:38 2022] DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:39.117307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-314d1a03-f20b-4808-b6f7-b97c8f521160 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb2488f70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:39.130137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:39.143816 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6d02fde-b1bb-43bf-81e0-c20860e0d6f7 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.335652 Jul 28 11:42:39.157158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1973/3890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:38 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:39.691083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-314d1a03-f20b-4808-b6f7-b97c8f521160 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a" status: 202 len: 0 microversion: 2.1 time: 0.584163 Jul 28 11:42:39.692070 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1918/3891] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:39 2022] DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:42:39.707918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:39.708774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:39.715283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-134668bf-154f-415c-82da-3f7391ee2e0f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'create', calling method: .version_select at 0x7f2eb1bc91f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-856033169", "description": "tempest-description-465682775"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:39.724331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.726989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.728175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.728855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.746780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] HTTP exception thrown: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Request method failure captured: Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f HTTP/1.1 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWn0Chgi-3tCfyBTtJhxxnwS9g11nucqfB88lCoFG6ikxF3v_MH4hVdCOpWtOyirsmZJmrV_DuPh_4z46YU_AUhvSv-FgygRTi-gkE0zJZXJd4o9l0P_XCAd7q8W_iiB2bQwzZrWL8Ta8ZLcUumIpz2EyCgrS68y4l3BYgNhDizpp4 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 619a89b0148340b4a9e79785f3021233 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/619a89b0148340b4a9e79785f3021233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/619a89b0148340b4a9e79785f3021233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_619a89b0148340b4a9e79785f3021233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/619a89b0148340b4a9e79785f3021233"}]}] Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 619a89b0148340b4a9e79785f3021233 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueTestJSON-402644562-project Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d5941defd0a44f07a644a9777c1842ea Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueTestJSON-402644562-project Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f'} Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:39.749410 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. Jul 28 11:42:39.755042 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:39.757113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Returning 404 to user: Instance 78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:39.758183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-152ff32c-c728-4977-bb19-0a6745aef4f8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f" status: 404 len: 111 microversion: 2.1 time: 0.054436 Jul 28 11:42:39.759384 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1919/3892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:39 2022] GET /compute/v2.1/servers/78c9e9e8-b6f8-4e8b-8d09-9dbe725a261f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:39.770123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:39.771170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:39.778157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.778925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.779960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.780598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.816118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:39.913185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:39.917389 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6963df06-b1fe-4abe-9e80-8fad6f89634e tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 204 len: 0 microversion: 2.1 time: 0.152315 Jul 28 11:42:39.918287 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1920/3893] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:39 2022] DELETE /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:39.927369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:39.928089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:39.937862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.938303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:39.939663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:39.940590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:40.165694 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-134668bf-154f-415c-82da-3f7391ee2e0f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.466605 Jul 28 11:42:40.165694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1974/3894] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:42:39 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:40.178761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:40.180369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:40.187420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:40.188215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:40.189228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:40.189926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:40.383676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:40.403024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce4b50f1-da24-4eaf-9abf-6e51996a51e7 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1493 microversion: 2.1 time: 0.480136 Jul 28 11:42:40.404339 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1921/3895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:39 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1493 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:40.423912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac0bf24b-bab5-4b18-8830-769cf6afd830 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Action: 'update', calling method: .version_select at 0x7f2eb25bf1f0>, body: {"security_group": {"name": "tempest-sg-hth-1160431349", "description": "tempest-description-hth-1271767830"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:40.551191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:40.559084 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b2b684a-3368-4389-9f10-26648151848d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.384180 Jul 28 11:42:40.572669 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1975/3896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:40 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:40.581636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-41db87b8-cad1-44e1-a0b2-376df19e4305 req-1d517688-4e4f-4f19-bf55-934dc00e227a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3e3a78-7485-4922-9f5b-2ddac1c17d24", "name": "network-vif-plugged", "status": "completed", "tag": "fc4105ad-32dd-4816-8bb8-7dea087f5db2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:40.603715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-41db87b8-cad1-44e1-a0b2-376df19e4305 req-1d517688-4e4f-4f19-bf55-934dc00e227a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:40.604227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-41db87b8-cad1-44e1-a0b2-376df19e4305 req-1d517688-4e4f-4f19-bf55-934dc00e227a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:40.628564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-41db87b8-cad1-44e1-a0b2-376df19e4305 req-1d517688-4e4f-4f19-bf55-934dc00e227a service nova] Creating event network-vif-plugged:fc4105ad-32dd-4816-8bb8-7dea087f5db2 for instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 on n-h2-851368-1 Jul 28 11:42:40.636760 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-41db87b8-cad1-44e1-a0b2-376df19e4305 req-1d517688-4e4f-4f19-bf55-934dc00e227a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071816 Jul 28 11:42:40.638379 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1976/3897] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:40.774026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac0bf24b-bab5-4b18-8830-769cf6afd830 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36" status: 200 len: 218 microversion: 2.1 time: 0.368564 Jul 28 11:42:40.783276 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1922/3898] 10.222.0.93 () {60 vars in 1290 bytes} [Thu Jul 28 11:42:40 2022] PUT /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36 => generated 218 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:40.791850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-caa9c351-39c9-4dff-bb50-0ba0b18a618f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe32a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:40.874845 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-caa9c351-39c9-4dff-bb50-0ba0b18a618f tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36" status: 200 len: 218 microversion: 2.1 time: 0.088521 Jul 28 11:42:40.875466 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1977/3899] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:42:40 2022] GET /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36 => generated 218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:40.891376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a96bcf98-d537-4095-af1c-0b58770b3064 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b5b8b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.146713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a96bcf98-d537-4095-af1c-0b58770b3064 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36" status: 202 len: 0 microversion: 2.1 time: 0.260507 Jul 28 11:42:41.147598 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1923/3900] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:40 2022] DELETE /compute/v2.1/os-security-groups/049e1632-62e3-428a-8dbd-d0d57b487a36 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:41.156441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.157075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:41.165332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.165795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.177542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.178107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.198061 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 HTTP/1.1 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '134c96d2-8940-46fa-96fb-b8ad7bc63928'} Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:41.201379 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.206219 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.208612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.209939 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2edab97c-d612-40b1-a6ca-12b1df5fa077 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 404 len: 111 microversion: 2.1 time: 0.057983 Jul 28 11:42:41.214149 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1978/3901] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:41.220550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.221184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: 134c96d2-8940-46fa-96fb-b8ad7bc63928] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:41.235730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.236221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.237019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.237462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.279794 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 HTTP/1.1 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '134c96d2-8940-46fa-96fb-b8ad7bc63928'} Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.285661 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. Jul 28 11:42:41.290274 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.294430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Instance 134c96d2-8940-46fa-96fb-b8ad7bc63928 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.295814 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bbcd706a-63d3-4051-96fd-470e22f93be7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928" status: 404 len: 111 microversion: 2.1 time: 0.079255 Jul 28 11:42:41.297012 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1924/3902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:41 2022] GET /compute/v2.1/servers/134c96d2-8940-46fa-96fb-b8ad7bc63928 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:41.306603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe4ef70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.355197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:41.355857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group cf9e2294-22d3-452a-a166-d145866ebc9a not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:41.356386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.356386 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a HTTP/1.1 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cf9e2294-22d3-452a-a166-d145866ebc9a'} Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:41.358234 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] Jul 28 11:42:41.363475 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.370725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group cf9e2294-22d3-452a-a166-d145866ebc9a does not exist Jul 28 11:42:41.370725 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-9ae9aacb-99fc-4c28-9546-c467c7146fa9'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.370725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93e1147e-00d8-48c5-a2b9-81047eafa459 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a" status: 404 len: 194 microversion: 2.1 time: 0.068344 Jul 28 11:42:41.370725 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1979/3903] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/cf9e2294-22d3-452a-a166-d145866ebc9a => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:41.380759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb25bf1f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.430636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.432609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:41.440703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:41.441329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:41.441904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.441904 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d HTTP/1.1 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'a5f85a4a-2d3b-4b30-89e7-504ea98afa5d'} Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:41.444379 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group a5f85a4a-2d3b-4b30-89e7-504ea98afa5d does not exist Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-f9ed2b7a-62b7-4d58-892a-c63947575c1f'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3083a5c5-4c07-4e24-9905-1acc49476811 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d" status: 404 len: 194 microversion: 2.1 time: 0.068717 Jul 28 11:42:41.448933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1925/3904] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/a5f85a4a-2d3b-4b30-89e7-504ea98afa5d => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:41.456336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb24e0280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.465267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.467538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.468512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.469265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.505878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:41.507308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:41.508021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.508021 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3 HTTP/1.1 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '620cf132-1d29-4f19-9573-3f3a70eb38d3'} Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:41.511127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 620cf132-1d29-4f19-9573-3f3a70eb38d3 does not exist Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-c0c5ecd3-4e54-47e3-8ee2-5b757a5632a3'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-738bc41c-6ed3-441e-afc7-416da7ef5397 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3" status: 404 len: 194 microversion: 2.1 time: 0.062436 Jul 28 11:42:41.516323 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1926/3905] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/620cf132-1d29-4f19-9573-3f3a70eb38d3 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:41.528484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1b5b8b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.638149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG neutronclient.v2_0.client [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist", "detail": ""}} {{(pid=119236) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:41.638763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.security_group_api [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 640552e0-4141-47fb-8c32-73bc14c44f90 not found {{(pid=119236) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:41.639347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.639347 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90 HTTP/1.1 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: exception: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '640552e0-4141-47fb-8c32-73bc14c44f90'} Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:41.642471 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 640552e0-4141-47fb-8c32-73bc14c44f90 does not exist Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: Neutron server returns request_ids: ['req-80a63131-f777-4180-8fe0-b952b06179bc'] {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a3a5e08-1cc8-41bd-8e84-30d4de57a460 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90" status: 404 len: 194 microversion: 2.1 time: 0.124260 Jul 28 11:42:41.647875 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1927/3906] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/640552e0-4141-47fb-8c32-73bc14c44f90 => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:41.655769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.655769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:41.666855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.667342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.668133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:41.668583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:41.828941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:41.843759 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9e3fd9a8-ac08-4db0-bdf3-8b20e5906695 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1493 microversion: 2.1 time: 0.422412 Jul 28 11:42:41.844954 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1980/3907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:41 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1493 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:41.867712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb1c0ad30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:41.943425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:41.946945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 54048da0-7fda-476b-9331-6efd07cdc0c2 not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:41.951714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.951714 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2 HTTP/1.1 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '54048da0-7fda-476b-9331-6efd07cdc0c2'} Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:41.955466 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] Jul 28 11:42:41.962670 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:41.970337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 54048da0-7fda-476b-9331-6efd07cdc0c2 does not exist Jul 28 11:42:41.970337 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-7c8fd466-7d29-4200-a08d-29ffa556917c'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:41.970337 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-213c09e0-209e-49a7-bb32-c59a3fcc8bbf tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2" status: 404 len: 194 microversion: 2.1 time: 0.106578 Jul 28 11:42:41.970337 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1981/3908] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/54048da0-7fda-476b-9331-6efd07cdc0c2 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:41.980004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe36550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:42.037564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG neutronclient.v2_0.client [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist", "detail": ""}} {{(pid=119235) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 11:42:42.038152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.security_group_api [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Neutron security group 90869fe2-2d31-407f-820a-d220ab8dd0ff not found {{(pid=119235) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 11:42:42.038986 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.038986 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff HTTP/1.1 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: exception: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '90869fe2-2d31-407f-820a-d220ab8dd0ff'} Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 11:42:42.041126 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] Jul 28 11:42:42.046572 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:42.052335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Security group 90869fe2-2d31-407f-820a-d220ab8dd0ff does not exist Jul 28 11:42:42.052335 n-d-851368-1 devstack@n-api.service[119235]: Neutron server returns request_ids: ['req-e2d8e820-5f4e-49e3-82bb-761b11d36734'] {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:42.052335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-718f49bf-d0d0-4ccb-8aa0-7bc3af370ca7 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff" status: 404 len: 194 microversion: 2.1 time: 0.077474 Jul 28 11:42:42.052335 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1982/3909] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:41 2022] DELETE /compute/v2.1/os-security-groups/90869fe2-2d31-407f-820a-d220ab8dd0ff => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:42.065423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:42.067327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:42.068057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:42.081622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.082424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:42.083937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.085989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:42.112252 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9076764-3084-4d7c-9dcf-127fb3316481 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1307 microversion: 2.1 time: 0.465364 Jul 28 11:42:42.114304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1928/3910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:41 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:42.148583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:42.335840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ed90a7e-bb04-440a-a67e-887e165711a4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 204 len: 0 microversion: 2.1 time: 0.278700 Jul 28 11:42:42.336820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1983/3911] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:42 2022] DELETE /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:42.349096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:42.350428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:42.359819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.360801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:42.361708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.364197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:42.741269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:42.749333 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b28185b7-8387-44aa-9537-325ee9ab7b32 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1645 microversion: 2.1 time: 0.408176 Jul 28 11:42:42.762854 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1929/3912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:42 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1645 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:42.869746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:42.870472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:42.882505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.882965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:42.896487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:42.896957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.133826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:43.134542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:43.142606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.144633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.145661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.147278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.180294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5941defd0a44f07a644a9777c1842ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '619a89b0148340b4a9e79785f3021233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:43.207786 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1018bf50-8605-4aaf-99de-57168a4d1e87 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 200 len: 1493 microversion: 2.1 time: 0.341934 Jul 28 11:42:43.210069 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1984/3913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:42 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 1493 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:43.378433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:43.398964 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-598badc3-bc9e-412b-900a-d0335c188d10 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1488 microversion: 2.1 time: 0.269389 Jul 28 11:42:43.400567 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1930/3914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:43 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1488 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:43.423477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1256647865"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:43.428810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:43.437429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.438605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.440062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.440509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.450909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a147ddb8-8e2d-49df-8e5b-b68f6d7d422a req-051d393a-5715-48ed-99b2-5b81875ecb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e", "name": "network-vif-deleted", "tag": "8468f9de-e8c5-4eb8-9b93-a3022d3e18b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:43.466604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a147ddb8-8e2d-49df-8e5b-b68f6d7d422a req-051d393a-5715-48ed-99b2-5b81875ecb84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.467052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a147ddb8-8e2d-49df-8e5b-b68f6d7d422a req-051d393a-5715-48ed-99b2-5b81875ecb84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.514014 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a147ddb8-8e2d-49df-8e5b-b68f6d7d422a req-051d393a-5715-48ed-99b2-5b81875ecb84 service nova] Creating event network-vif-deleted:8468f9de-e8c5-4eb8-9b93-a3022d3e18b4 for instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e on n-h1-851368-1 Jul 28 11:42:43.530808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a147ddb8-8e2d-49df-8e5b-b68f6d7d422a req-051d393a-5715-48ed-99b2-5b81875ecb84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083140 Jul 28 11:42:43.531454 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1931/3915] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:42:43.734423 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2a8ea55-3ad6-4a6a-a261-028ae753f7b4 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "POST /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24/action" status: 202 len: 0 microversion: 2.1 time: 0.314903 Jul 28 11:42:43.735318 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1985/3916] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:43 2022] POST /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:42:43.746071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b901b1f-9b54-4e98-bd45-4b24250eaa3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb238ea60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:43.771506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:43.772609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:43.786043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.786797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.787936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:43.788683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:43.803450 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b901b1f-9b54-4e98-bd45-4b24250eaa3d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06" status: 200 len: 1412 microversion: 2.1 time: 0.061433 Jul 28 11:42:43.812690 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1932/3917] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:43 2022] GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:43.818640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6d8aa4ab-4081-4145-988a-3dbcc27e5d4f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2352940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:43.866016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6d8aa4ab-4081-4145-988a-3dbcc27e5d4f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06" status: 200 len: 1412 microversion: 2.1 time: 0.051590 Jul 28 11:42:43.866778 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1933/3918] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:43 2022] GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:43.881938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dfbe9b7-be94-43f8-8751-96e55dacb850 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb1b38ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:44.083650 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dfbe9b7-be94-43f8-8751-96e55dacb850 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06" status: 204 len: 0 microversion: 2.1 time: 0.207903 Jul 28 11:42:44.084667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1934/3919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:43 2022] DELETE /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:44.100517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ffc5a3b-0d93-48e9-90db-d59aa9b4f62a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb23b63a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:44.107454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:44.120166 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3757bf9b-f7b9-4789-bb12-ca4023da4dfd tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1645 microversion: 2.1 time: 0.353895 Jul 28 11:42:44.121615 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1986/3920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:43 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1645 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:44.134142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0ffc5a3b-0d93-48e9-90db-d59aa9b4f62a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Image not found. Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ffc5a3b-0d93-48e9-90db-d59aa9b4f62a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 HTTP/1.1 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2e0df032-763a-49fd-9a64-d3540679dc06'} Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e0df032-763a-49fd-9a64-d3540679dc06 Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:42:44.136292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e0df032-763a-49fd-9a64-d3540679dc06 could not be found. Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ffc5a3b-0d93-48e9-90db-d59aa9b4f62a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ffc5a3b-0d93-48e9-90db-d59aa9b4f62a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06" status: 404 len: 62 microversion: 2.1 time: 0.047876 Jul 28 11:42:44.141703 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1935/3921] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:42:44 2022] GET /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:42:44.151750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:44.151750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:44.159663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:44.160123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:44.160917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:44.161364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:44.230980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:44.232399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] [instance: 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:44.239742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:44.240870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:44.245022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:44.245022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:44.267781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] HTTP exception thrown: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Request method failure captured: Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e HTTP/1.1 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nWn0Chgi-3tCfyBTtJhxxnwS9g11nucqfB88lCoFG6ikxF3v_MH4hVdCOpWtOyirsmZJmrV_DuPh_4z46YU_AUhvSv-FgygRTi-gkE0zJZXJd4o9l0P_XCAd7q8W_iiB2bQwzZrWL8Ta8ZLcUumIpz2EyCgrS68y4l3BYgNhDizpp4 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 619a89b0148340b4a9e79785f3021233 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/619a89b0148340b4a9e79785f3021233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/619a89b0148340b4a9e79785f3021233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_619a89b0148340b4a9e79785f3021233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/619a89b0148340b4a9e79785f3021233"}]}] Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 619a89b0148340b4a9e79785f3021233 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueTestJSON-402644562 Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueTestJSON-402644562-project Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d5941defd0a44f07a644a9777c1842ea Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueTestJSON-402644562-project Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e'} Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:44.269367 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. Jul 28 11:42:44.273951 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:44.276426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] Returning 404 to user: Instance 6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:44.277561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4188c81d-e72b-42dc-b646-c8eb38fd14b8 tempest-ServerRescueTestJSON-402644562 tempest-ServerRescueTestJSON-402644562-project] 10.222.0.93 "GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e" status: 404 len: 111 microversion: 2.1 time: 0.051755 Jul 28 11:42:44.278971 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1936/3922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:44 2022] GET /compute/v2.1/servers/6d13e5fe-31b7-473f-8b5a-e76a1fc80d3e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:44.464291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:44.480787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2b9c8b3-8612-4b63-bcfb-c72826c391ce tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1500 microversion: 2.1 time: 0.336566 Jul 28 11:42:44.483052 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1987/3923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:44 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1500 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:45.155976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:45.158072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:45.173954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:45.176215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:45.180000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:45.189755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:45.195286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:45.304571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df19b8b5c54532aef17359de7b03ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ebfd3e32749b383a21607debabb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:45.313238 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf0e7fbf-8ea2-4c6e-8e98-23cf31e56729 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 200 len: 1300 microversion: 2.1 time: 0.172161 Jul 28 11:42:45.329509 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1937/3924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:45 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:45.503998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:45.506417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:45.525543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:45.526374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:45.527406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:45.528708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:45.548392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-08ca8ff4-50f5-4c9f-92dd-c891ed1573dd req-45139bed-632c-4b07-aea7-fe147a656b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b40c76-6acb-43a9-8492-66d1a009b285", "name": "network-vif-deleted", "tag": "030f05a3-d34a-405a-88ba-0506fb903a26"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:45.586859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-08ca8ff4-50f5-4c9f-92dd-c891ed1573dd req-45139bed-632c-4b07-aea7-fe147a656b16 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:45.587355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-08ca8ff4-50f5-4c9f-92dd-c891ed1573dd req-45139bed-632c-4b07-aea7-fe147a656b16 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:45.642314 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-08ca8ff4-50f5-4c9f-92dd-c891ed1573dd req-45139bed-632c-4b07-aea7-fe147a656b16 service nova] Creating event network-vif-deleted:030f05a3-d34a-405a-88ba-0506fb903a26 for instance c2b40c76-6acb-43a9-8492-66d1a009b285 on n-h2-851368-1 Jul 28 11:42:45.658737 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-08ca8ff4-50f5-4c9f-92dd-c891ed1573dd req-45139bed-632c-4b07-aea7-fe147a656b16 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113753 Jul 28 11:42:45.661593 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1938/3925] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:46.245714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:46.261282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55ab00c5-67be-468b-b047-afff0d4a0238 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1506 microversion: 2.1 time: 0.762600 Jul 28 11:42:46.275261 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1988/3926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:45 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:46.351495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:46.352085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] [instance: c2b40c76-6acb-43a9-8492-66d1a009b285] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:46.367362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:46.367991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:46.373369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:46.376731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:46.401604 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] HTTP exception thrown: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Request method failure captured: Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 HTTP/1.1 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nXP1bOli2T3ZszBDpotDnSeh218h4TiYJhM0xXZXD0Y-i2cdygJJW0R52SruL7kUl9Wf5-9tcNspBllr2iwRUcFOfgdkTjahPwDqZSwRxpBAkhuy_2h95eg3YgqS8KBzqqbsCeNftLRNrkXsIQJgJJLacvjfvNgdE-vY5nkRl1bUuc Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad0ebfd3e32749b383a21607debabb13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad0ebfd3e32749b383a21607debabb13"}]}] Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ad0ebfd3e32749b383a21607debabb13 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-146622330 Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 37df19b8b5c54532aef17359de7b03ca Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-SecurityGroupsTestJSON-146622330-project Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c2b40c76-6acb-43a9-8492-66d1a009b285'} Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:46.408442 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Returning 404 to user: Instance c2b40c76-6acb-43a9-8492-66d1a009b285 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bed96683-f7f5-4bab-9368-9ff1542f900a tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285" status: 404 len: 111 microversion: 2.1 time: 0.064837 Jul 28 11:42:46.413148 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1939/3927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:46 2022] GET /compute/v2.1/servers/c2b40c76-6acb-43a9-8492-66d1a009b285 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:46.419626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e625e99-e0d9-4326-b702-0b3fac088178 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2ebbe82f70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:46.850004 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e625e99-e0d9-4326-b702-0b3fac088178 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/aba05089-1f6c-48c4-af18-05853b5db296" status: 202 len: 0 microversion: 2.1 time: 0.433939 Jul 28 11:42:46.855418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1989/3928] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:46 2022] DELETE /compute/v2.1/os-security-groups/aba05089-1f6c-48c4-af18-05853b5db296 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:46.860044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87fe2b4d-214f-4a76-9aef-e32198bd12f4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] Calling method '.version_select at 0x7f2eb2518940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:47.284640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:47.285556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:47.300650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:47.301370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:47.302401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:47.303549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:47.318620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87fe2b4d-214f-4a76-9aef-e32198bd12f4 tempest-SecurityGroupsTestJSON-146622330 tempest-SecurityGroupsTestJSON-146622330-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/abe07de5-2806-4a50-a6e3-9727cc3d305c" status: 202 len: 0 microversion: 2.1 time: 0.463727 Jul 28 11:42:47.319507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1940/3929] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:42:46 2022] DELETE /compute/v2.1/os-security-groups/abe07de5-2806-4a50-a6e3-9727cc3d305c => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:42:47.659873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:47.669321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8c071ad-9a4c-4ee3-b4d4-fd5868a973f8 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1501 microversion: 2.1 time: 0.389428 Jul 28 11:42:47.673558 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1990/3930] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:47 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1501 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:48.694680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:48.695261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:48.734793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:48.735363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:48.737751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:48.738218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.221570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:49.235926 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-031f0922-6626-409a-be0e-e7373bac9276 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1488 microversion: 2.1 time: 0.545479 Jul 28 11:42:49.240349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1941/3931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:48 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1488 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:49.259649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:49.260553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:49.277240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.277709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.278532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.281372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.337384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:49.340930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:42:49.441397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba52dcb5-3134-42b6-9939-68e34db97689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 204 len: 0 microversion: 2.1 time: 0.187410 Jul 28 11:42:49.442351 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1991/3932] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:49 2022] DELETE /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:42:49.455288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f87fc348-40b5-467c-99ea-ced270422689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb233c700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:49.482281 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f87fc348-40b5-467c-99ea-ced270422689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Image not found. Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f87fc348-40b5-467c-99ea-ced270422689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 HTTP/1.1 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2e0df032-763a-49fd-9a64-d3540679dc06'} Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e0df032-763a-49fd-9a64-d3540679dc06 to delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e0df032-763a-49fd-9a64-d3540679dc06 could not be found. Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.483965 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f87fc348-40b5-467c-99ea-ced270422689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f87fc348-40b5-467c-99ea-ced270422689 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06" status: 404 len: 62 microversion: 2.1 time: 0.036317 Jul 28 11:42:49.490260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1942/3933] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:49 2022] DELETE /compute/v2.1/images/2e0df032-763a-49fd-9a64-d3540679dc06 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:42:49.496695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:49.497951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:49.504615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.505074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.505860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.511453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.564126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:42:49.681868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Instance is already in deleting state, ignoring this request Jul 28 11:42:49.686045 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e070d038-6d24-4778-a6e8-29290f77f582 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 204 len: 0 microversion: 2.1 time: 0.194270 Jul 28 11:42:49.689538 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1992/3934] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:49 2022] DELETE /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:42:49.696953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:49.698239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:49.712050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.712664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:49.713767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:49.714552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:50.296861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:50.301865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:50.314499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:50.316024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:50.316205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:50.317344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:50.318212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:50.330218 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-67053fe4-3ce3-41e1-9bb1-ae5661b494ac tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1494 microversion: 2.1 time: 0.632102 Jul 28 11:42:50.330866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1943/3935] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:49 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1494 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:50.362959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'flavor' on Instance uuid 973487fe-da17-4f60-bf87-e899efe54f37 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:42:50.685537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7ff0277-8224-4796-9757-0de8aadf91d3 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/action" status: 200 len: 32 microversion: 2.1 time: 0.395638 Jul 28 11:42:50.688949 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1993/3936] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:50 2022] POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:42:50.698378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:50.699000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:50.710945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:50.711740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:50.720851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:50.721348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:50.937536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cc891eeb-cb82-48ff-b48d-6b81295247e4 req-023e790e-a5d7-4c48-88cb-773b7f8623e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3e3a78-7485-4922-9f5b-2ddac1c17d24", "name": "network-vif-plugged", "status": "completed", "tag": "fc4105ad-32dd-4816-8bb8-7dea087f5db2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:50.962871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cc891eeb-cb82-48ff-b48d-6b81295247e4 req-023e790e-a5d7-4c48-88cb-773b7f8623e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:50.964520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cc891eeb-cb82-48ff-b48d-6b81295247e4 req-023e790e-a5d7-4c48-88cb-773b7f8623e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:51.008899 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cc891eeb-cb82-48ff-b48d-6b81295247e4 req-023e790e-a5d7-4c48-88cb-773b7f8623e0 service nova] Creating event network-vif-plugged:fc4105ad-32dd-4816-8bb8-7dea087f5db2 for instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 on n-h2-851368-1 Jul 28 11:42:51.022603 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cc891eeb-cb82-48ff-b48d-6b81295247e4 req-023e790e-a5d7-4c48-88cb-773b7f8623e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090713 Jul 28 11:42:51.028117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1994/3937] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:51.034206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:51.052120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.357630 Jul 28 11:42:51.052715 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1944/3938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:50 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:51.359461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:51.361007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:51.370480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:51.372756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:51.373973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:51.375184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:51.446545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:51.447798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf183c80-d627-4f65-8a53-0b7d11a1edef tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001607 Jul 28 11:42:51.448605 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1945/3939] 10.222.0.93 () {56 vars in 886 bytes} [Thu Jul 28 11:42:51 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 28 11:42:51.752792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:51.766627 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2773aa8b-c64b-49c2-99bd-4fc9162e25cf tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1494 microversion: 2.1 time: 0.415458 Jul 28 11:42:51.768382 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1995/3940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:51 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1494 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:52.078265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:52.079045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:52.094284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.095358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.098081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.099578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.513790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:52.525663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6f643e2d-168a-4fdb-bdb1-a7cae1b30cd8 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.452178 Jul 28 11:42:52.526799 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1946/3941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:52 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:52.633671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d7ce1ec1-78ad-430a-941d-a163d4b17c13 req-fcdbf754-4781-409f-915b-58bfbe04c03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3e3a78-7485-4922-9f5b-2ddac1c17d24", "name": "network-vif-deleted", "tag": "fc4105ad-32dd-4816-8bb8-7dea087f5db2"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:52.652155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d7ce1ec1-78ad-430a-941d-a163d4b17c13 req-fcdbf754-4781-409f-915b-58bfbe04c03c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.659920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d7ce1ec1-78ad-430a-941d-a163d4b17c13 req-fcdbf754-4781-409f-915b-58bfbe04c03c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.684742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d7ce1ec1-78ad-430a-941d-a163d4b17c13 req-fcdbf754-4781-409f-915b-58bfbe04c03c service nova] Creating event network-vif-deleted:fc4105ad-32dd-4816-8bb8-7dea087f5db2 for instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 on n-h2-851368-1 Jul 28 11:42:52.700658 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d7ce1ec1-78ad-430a-941d-a163d4b17c13 req-fcdbf754-4781-409f-915b-58bfbe04c03c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069986 Jul 28 11:42:52.701356 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1996/3942] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:52.796045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:52.796916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:52.810814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.812252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.813574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.814946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.929224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:52.929386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:52.929806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lazy-loading 'fault' on Instance uuid 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:42:53.015121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9d61f656eb49ae95e22e56412c55fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c0984c481948a3b06410470d8c3035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:53.022748 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87a8b02a-6959-4421-a792-f4f2959a2109 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 200 len: 1297 microversion: 2.1 time: 0.234046 Jul 28 11:42:53.023379 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1947/3943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:52 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 1297 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:53.552687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:53.553589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:53.565994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:53.569730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:53.570700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:53.574214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:53.820100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:53.829858 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6be85853-6f99-497f-9cc4-301586edad14 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.284472 Jul 28 11:42:53.830753 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1997/3944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:53 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:54.046832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.049704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0f3e3a78-7485-4922-9f5b-2ddac1c17d24] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.060658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.061852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.062859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.063690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.080308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 HTTP/1.1 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0f3e3a78-7485-4922-9f5b-2ddac1c17d24'} Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.082345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance 0f3e3a78-7485-4922-9f5b-2ddac1c17d24 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d7f434d-1941-4bc6-9574-dc2a6f87920d tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24" status: 404 len: 111 microversion: 2.1 time: 0.047754 Jul 28 11:42:54.132087 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1948/3945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/servers/0f3e3a78-7485-4922-9f5b-2ddac1c17d24 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:54.133436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c06e065-20cb-44f2-aa12-22a436daa1a3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2ebbe04550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.147748 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2c06e065-20cb-44f2-aa12-22a436daa1a3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Image not found. Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c06e065-20cb-44f2-aa12-22a436daa1a3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 HTTP/1.1 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '64ad3708-b697-497a-8314-986d87b355a8'} Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 64ad3708-b697-497a-8314-986d87b355a8 to delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64ad3708-b697-497a-8314-986d87b355a8 could not be found. Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.151992 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:42:54.156811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.159368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c06e065-20cb-44f2-aa12-22a436daa1a3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.160216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c06e065-20cb-44f2-aa12-22a436daa1a3 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8" status: 404 len: 62 microversion: 2.1 time: 0.065740 Jul 28 11:42:54.161229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1998/3946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/images/64ad3708-b697-497a-8314-986d87b355a8 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:42:54.172308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.173575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.185673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.186153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.188704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.189162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.213002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a HTTP/1.1 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0a4cdde0-93d5-43e3-a652-35c69539929a'} Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.214586 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.218649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.219706 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4c197cba-0888-4f34-858e-1398b5e02938 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 404 len: 111 microversion: 2.1 time: 0.052403 Jul 28 11:42:54.223399 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1949/3947] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:54.227961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.228564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 0a4cdde0-93d5-43e3-a652-35c69539929a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.238155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.238614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.239451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.239901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.271426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a HTTP/1.1 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0a4cdde0-93d5-43e3-a652-35c69539929a'} Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.273193 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. Jul 28 11:42:54.276047 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.282705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance 0a4cdde0-93d5-43e3-a652-35c69539929a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.284715 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e4b25ef-b1c9-4e79-83f0-b140fa35ee09 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a" status: 404 len: 111 microversion: 2.1 time: 0.060648 Jul 28 11:42:54.285829 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 1999/3948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/servers/0a4cdde0-93d5-43e3-a652-35c69539929a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:54.294709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc2b723b-941e-4435-aeed-440d1c6e0421 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb2488e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.335734 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-bc2b723b-941e-4435-aeed-440d1c6e0421 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Image not found. Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc2b723b-941e-4435-aeed-440d1c6e0421 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab HTTP/1.1 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '28b3829d-7ea0-406d-8657-00eb1d221dab'} Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28b3829d-7ea0-406d-8657-00eb1d221dab to delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28b3829d-7ea0-406d-8657-00eb1d221dab could not be found. Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.337875 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc2b723b-941e-4435-aeed-440d1c6e0421 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc2b723b-941e-4435-aeed-440d1c6e0421 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab" status: 404 len: 62 microversion: 2.1 time: 0.049537 Jul 28 11:42:54.341636 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1950/3949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/images/28b3829d-7ea0-406d-8657-00eb1d221dab => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:42:54.354906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.357140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.378212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.379327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.380164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.380913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.408150 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 HTTP/1.1 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '30be6610-ed09-4773-9b5b-4a176e0a3ba8'} Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.410839 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.413795 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.416322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.418451 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76db161b-ce77-48c8-b13e-ed12704f1f46 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 404 len: 111 microversion: 2.1 time: 0.073174 Jul 28 11:42:54.420207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1951/3950] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:54.432523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.433615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: 30be6610-ed09-4773-9b5b-4a176e0a3ba8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.443482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.444151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.446071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.446439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.467283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 HTTP/1.1 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '30be6610-ed09-4773-9b5b-4a176e0a3ba8'} Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.469161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance 30be6610-ed09-4773-9b5b-4a176e0a3ba8 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a524d64-7354-415e-8a07-ccf0b6c3e79a tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8" status: 404 len: 111 microversion: 2.1 time: 0.046694 Jul 28 11:42:54.472695 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1952/3951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/servers/30be6610-ed09-4773-9b5b-4a176e0a3ba8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:42:54.478851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2186ba1-b0e6-49b2-9588-b91e6183847f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '.version_select at 0x7f2eb24e0790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.511934 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e2186ba1-b0e6-49b2-9588-b91e6183847f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Image not found. Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2186ba1-b0e6-49b2-9588-b91e6183847f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d HTTP/1.1 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '0f037cc6-c99c-4d88-b709-0ce0a79a603d'} Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f037cc6-c99c-4d88-b709-0ce0a79a603d to delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f037cc6-c99c-4d88-b709-0ce0a79a603d could not be found. Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.513889 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:42:54.517037 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.519781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2186ba1-b0e6-49b2-9588-b91e6183847f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.520830 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2186ba1-b0e6-49b2-9588-b91e6183847f tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d" status: 404 len: 62 microversion: 2.1 time: 0.045779 Jul 28 11:42:54.520929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f0ff187-c5b0-4bd3-836e-10a1e08cb82d tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] Calling method '.version_select at 0x7f2eb1c3a280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.521932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1953/3952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/images/0f037cc6-c99c-4d88-b709-0ce0a79a603d => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:42:54.531234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.532283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.541673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.542384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.543621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.544859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.567265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d HTTP/1.1 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd738d032-8063-4a65-b8bf-ef5d59ddd66d'} Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.569668 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.573520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.575181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.576203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0bbfd0e3-544e-46ef-886d-db44777d0e92 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 404 len: 111 microversion: 2.1 time: 0.050353 Jul 28 11:42:54.577787 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1954/3953] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:42:54 2022] DELETE /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:54.591472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.592347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] [instance: d738d032-8063-4a65-b8bf-ef5d59ddd66d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.602330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.603780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.604773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.605399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.628012 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] HTTP exception thrown: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Request method failure captured: Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d HTTP/1.1 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nUuFqdqBlaVmpwtApstt6JfuMlnuBFExasQiTg0k83-2JBw7pPwc3bjZdpuUqHjmTSsDQrnTgrXwKi2gbIRe7uOJ_pFHuwOtpvpDz7pgtqaDb70OVrYdGYyArTFheuCxybeyHKYPPz-O2qKcxP-kL3Qd9byf2FXiYSto5b9fDF6U-8 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e4c0984c481948a3b06410470d8c3035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e4c0984c481948a3b06410470d8c3035"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e4c0984c481948a3b06410470d8c3035"}]}] Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e4c0984c481948a3b06410470d8c3035 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesTestJSON-681462411 Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 5b9d61f656eb49ae95e22e56412c55fd Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesTestJSON-681462411-project Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd738d032-8063-4a65-b8bf-ef5d59ddd66d'} Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.631558 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. Jul 28 11:42:54.635373 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:42:54.639268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] Returning 404 to user: Instance d738d032-8063-4a65-b8bf-ef5d59ddd66d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:42:54.640370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ad8d5db-de19-4c84-8980-b783861d04f1 tempest-ImagesTestJSON-681462411 tempest-ImagesTestJSON-681462411-project] 10.222.0.93 "GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d" status: 404 len: 111 microversion: 2.1 time: 0.058111 Jul 28 11:42:54.641399 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1955/3954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/servers/d738d032-8063-4a65-b8bf-ef5d59ddd66d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:42:54.855311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:54.856739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:54.872216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.872930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:54.875875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:54.877082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:55.043651 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f0ff187-c5b0-4bd3-836e-10a1e08cb82d tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.718651 Jul 28 11:42:55.045213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2000/3955] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf/defaults => generated 371 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:55.057252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-779e7256-09e3-4220-9758-27bb2ee9421a tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] Calling method '.version_select at 0x7f2eb1bdbc10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:55.178974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:55.190112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-440ce79d-5ad7-4af7-ae1f-3c472cdce829 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.340090 Jul 28 11:42:55.204220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-779e7256-09e3-4220-9758-27bb2ee9421a tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf" status: 200 len: 371 microversion: 2.1 time: 0.143776 Jul 28 11:42:55.204220 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2001/3956] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:42:55 2022] GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:42:55.205219 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1956/3957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:54 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:55.220811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4867a366-3157-4895-bcac-bd422777095e tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] Calling method '.version_select at 0x7f2eb1bd1040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:55.592031 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4867a366-3157-4895-bcac-bd422777095e tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.375517 Jul 28 11:42:55.592619 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2002/3958] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 11:42:55 2022] GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf/defaults => generated 371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:55.605762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-499a639a-da25-4e51-a25b-90a03d81abde tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] Calling method '.version_select at 0x7f2eb1b5ba60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:56.125004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-499a639a-da25-4e51-a25b-90a03d81abde tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf" status: 200 len: 371 microversion: 2.1 time: 0.523008 Jul 28 11:42:56.126075 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1957/3959] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 11:42:55 2022] GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf => generated 371 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:56.139252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a478bf6-b1c0-4fb9-836b-47538ac585e2 tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] Calling method '.version_select at 0x7f2eb1bc9940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:56.227112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:56.227754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:56.245351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:56.245808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:56.246595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:56.255330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:56.483439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:56.492130 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06dae989-4f64-48c8-89fe-c40f53e9c49b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.269412 Jul 28 11:42:56.510675 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1958/3960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:56 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:42:56.678167 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a478bf6-b1c0-4fb9-836b-47538ac585e2 tempest-QuotasTestJSON-1523211773 tempest-QuotasTestJSON-1523211773-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf?user_id=7dc8babfe07c49779cccc2e32a7a84f4" status: 200 len: 371 microversion: 2.1 time: 0.544188 Jul 28 11:42:56.678762 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2003/3961] 10.222.0.93 () {58 vars in 1323 bytes} [Thu Jul 28 11:42:56 2022] GET /compute/v2.1/os-quota-sets/c75df7c2100847b3a46847e2313e8dcf?user_id=7dc8babfe07c49779cccc2e32a7a84f4 => generated 371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:42:56.748572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:56.751703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:56.752172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:56.753039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:56.753479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:56.806561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ff2deb3-2ff2-4f6d-9e82-b044067846d1 tempest-AZV2TestJSON-584648556 tempest-AZV2TestJSON-584648556-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.141443 Jul 28 11:42:56.807179 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1959/3962] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Jul 28 11:42:56 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:42:57.544212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:57.545997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:57.562830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:57.563955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:57.565806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:57.566635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:57.914121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:57.927990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-01680292-b279-4ca9-84bc-43bb998936c0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.412008 Jul 28 11:42:57.928902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2004/3963] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:57 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:58.954417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:58.955690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:58.971864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:58.974918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:58.975983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:58.976937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:59.523097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:42:59.531515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:42:59.534209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:59.545053 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e875aebd-d6cb-4341-bd97-0fdd72d08a38 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.597250 Jul 28 11:42:59.546575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1960/3964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:58 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:42:59.562787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:59.564295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:59.567618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:59.568631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:59.714551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78186b24-2c72-4596-9ce0-520324682940 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.186664 Jul 28 11:42:59.722360 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2005/3965] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:42:59 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:42:59.727981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:42:59.728609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:42:59.743146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:59.743607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:42:59.748463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:42:59.749135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:00.254551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:00.284170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2044d50a-e814-4ff8-8f52-2458294d4863 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1672 microversion: 2.1 time: 0.559863 Jul 28 11:43:00.300826 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1961/3966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:42:59 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1672 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:00.577879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:00.579174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:00.587597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:00.592247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:00.593410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:00.594175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:01.311687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:01.316968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:01.345675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:01.346353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:01.347320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:01.349194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:01.657626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:01.699841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8398e916-d9ce-4c98-ab5a-257a2eb6a92b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 1.126299 Jul 28 11:43:01.701306 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2006/3967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:00 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:02.064293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:02.072308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71ba8bb8-605d-4d36-bebc-b33784e1ea11 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1672 microversion: 2.1 time: 0.768779 Jul 28 11:43:02.073582 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1962/3968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:01 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1672 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:02.740996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:02.744524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:02.772045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:02.774618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:02.777191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:02.779933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:03.065579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:03.082171 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85e77784-6c02-4d2d-884a-5c52b5023a31 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.357946 Jul 28 11:43:03.084740 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2007/3969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:02 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:03.113466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:03.114914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:03.128258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:03.133109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:03.134705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:03.136732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:03.749350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:03.763739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-17ea9f96-a93a-40bc-baab-deb55a2fc9ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1677 microversion: 2.1 time: 0.665617 Jul 28 11:43:03.764695 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1963/3970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:03 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1677 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:04.108218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:04.109738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:04.128284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:04.130220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:04.132333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:04.133318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:04.727423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:04.735977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f67f64d4-8929-4866-95b3-8d2a1199741d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 0.635211 Jul 28 11:43:04.736562 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2008/3971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:04 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:04.785169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:04.786012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:04.794947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:04.800092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:04.801089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:04.801784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:04.839012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1374433215", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:04.857787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:04.979875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] validate_networks() for None {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:43:05.573418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:05.592175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c211444b-c223-4efa-b77e-bbfa45d29f01 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.810781 Jul 28 11:43:05.592900 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2009/3972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:04 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:05.637637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:43:05.639278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:43:05.640221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:43:05.640825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:43:05.641395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:43:05.677905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:05.678444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:05.679735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:05.680202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:05.742898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Getting quotas for project 549d2e4844204083816889d0c08cf6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:43:05.753137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Getting quotas for user e9c8592d2d464a4890d000151507738d and project 549d2e4844204083816889d0c08cf6a8. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:43:05.759945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:05.760561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:05.773675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:05.773814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:05.774520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:05.776227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:43:05.778704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:05.780908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:43:05.858401 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-70c87b52-1086-48f8-9b4e-6a378c28cfdf tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.429556 Jul 28 11:43:05.866499 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1964/3973] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:43:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:43:05.875617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-704ef95a-4130-4139-a8ef-4f7c5c0ca226 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:05.876686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-704ef95a-4130-4139-a8ef-4f7c5c0ca226 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:06.262137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-704ef95a-4130-4139-a8ef-4f7c5c0ca226 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:06.283255 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-704ef95a-4130-4139-a8ef-4f7c5c0ca226 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1217 microversion: 2.1 time: 0.412009 Jul 28 11:43:06.284322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1965/3974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:05 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1217 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:06.673879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:07.213955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:07.242401 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-820cbdc3-a601-4ca5-84cd-830c00e09288 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1736 microversion: 2.1 time: 1.488523 Jul 28 11:43:07.255350 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2010/3975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:05 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1736 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:07.305453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:07.306601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:07.330070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:07.330640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:07.331756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:07.332521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:07.440216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:07.450587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4298379-808e-4a47-b449-0a8fc5e35aa8 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1269 microversion: 2.1 time: 0.148608 Jul 28 11:43:07.451912 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1966/3976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:07 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:08.267687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:08.268280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:08.284896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:08.286725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:08.287176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:08.288134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:08.288825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:08.473917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:08.474459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:08.502276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:08.503109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:08.504415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:08.505795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:08.522481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:08.823699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:08.833400 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd16d2ee-ef33-41b9-9148-3a0309ea20c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1275 microversion: 2.1 time: 0.364466 Jul 28 11:43:08.848171 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1967/3977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:08 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1275 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:08.975238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:08.992123 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6822154-4b0e-41f1-9fea-b5595fdd9ed0 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1716 microversion: 2.1 time: 0.724650 Jul 28 11:43:08.993480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2011/3978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:08 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1716 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:09.286752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:09.287481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:09.296677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.297341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.307991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.308682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.488119 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Cannot 'detach_volume' instance 973487fe-da17-4f60-bf87-e899efe54f37 while it is in vm_state rescued Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments/04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6 HTTP/1.1 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'detach_volume' instance 973487fe-da17-4f60-bf87-e899efe54f37 while it is in vm_state rescued Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '973487fe-da17-4f60-bf87-e899efe54f37', 'id': '04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6'} Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 973487fe-da17-4f60-bf87-e899efe54f37 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 973487fe-da17-4f60-bf87-e899efe54f37 while it is in vm_state rescued Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:09.511861 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 973487fe-da17-4f60-bf87-e899efe54f37 while it is in vm_state rescued Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:09.515498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 409 to user: Cannot 'detach_volume' instance 973487fe-da17-4f60-bf87-e899efe54f37 while it is in vm_state rescued {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:43:09.516323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-396181d0-02f6-485f-b317-a3c3a8c35897 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments/04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6" status: 409 len: 152 microversion: 2.1 time: 0.235307 Jul 28 11:43:09.522573 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1968/3979] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:43:09 2022] DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments/04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6 => generated 152 bytes in 244 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:43:09.526637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:09.527210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:09.537449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.537968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.538762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.541411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.678221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88f32b4d-f1d5-43ec-9824-1a2adfb4245c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/action" status: 202 len: 0 microversion: 2.1 time: 0.154031 Jul 28 11:43:09.679201 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2012/3980] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:43:09 2022] POST /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:43:09.698307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:09.701762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:09.722279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.723838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.725304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.746198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.857489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:09.858191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:09.867162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.869808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:09.870682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:09.871905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:10.171683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:10.188171 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2dd475a-0fe3-42c2-9ac8-b40260345649 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1275 microversion: 2.1 time: 0.334724 Jul 28 11:43:10.188762 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2013/3981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:09 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1275 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:11.209650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:11.211156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:11.224662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:11.226806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:11.228399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:11.231803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:11.244036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:11.255871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b38174f-aa3f-4351-a296-6a12aa92b750 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1724 microversion: 2.1 time: 1.567549 Jul 28 11:43:11.256651 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1969/3982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:09 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1724 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:11.773372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6dcd0451-8ac7-4fdd-8425-542e2721bc92 req-41fd1137-303c-4bfd-9605-f42da8629c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:11.790116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:11.796458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6dcd0451-8ac7-4fdd-8425-542e2721bc92 req-41fd1137-303c-4bfd-9605-f42da8629c97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:11.796917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6dcd0451-8ac7-4fdd-8425-542e2721bc92 req-41fd1137-303c-4bfd-9605-f42da8629c97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:11.821553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6dcd0451-8ac7-4fdd-8425-542e2721bc92 req-41fd1137-303c-4bfd-9605-f42da8629c97 service nova] Creating event network-changed:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:43:11.841535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6dcd0451-8ac7-4fdd-8425-542e2721bc92 req-41fd1137-303c-4bfd-9605-f42da8629c97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071723 Jul 28 11:43:11.849384 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1970/3983] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:12.198402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:12.225852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-636f65bd-5a7d-4983-bd0a-31bbf83d43bc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 1.019910 Jul 28 11:43:12.234484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2014/3984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:11 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:12.284329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:12.285039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:12.297886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:12.298523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:12.299523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:12.300121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:12.850696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:12.863601 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3274264f-4d08-4201-a1d3-2c762fc0d4fb tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1724 microversion: 2.1 time: 0.582110 Jul 28 11:43:12.866963 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1971/3985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:12 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1724 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:13.255474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:13.263552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:13.275499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:13.276121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:13.278226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:13.279509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:13.736753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:13.752581 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-650c5b6c-b9fc-4ddd-bbba-56367be90e83 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.501911 Jul 28 11:43:13.753846 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2015/3986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:13 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:13.887016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:13.887661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:13.896351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:13.896793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:13.904157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:13.908666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:14.253995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:14.268566 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d344b60-a93b-491b-bda0-708ab4d1b276 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1724 microversion: 2.1 time: 0.385179 Jul 28 11:43:14.270613 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1972/3987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:13 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:14.773784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:14.774405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:14.786217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:14.786709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:14.787541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:14.789426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:15.032775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:15.040887 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7ebe37a-6289-4411-b340-d53c983e7741 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.270827 Jul 28 11:43:15.041480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2016/3988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:14 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:15.289024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-764187473", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "53665c12-83de-457c-87fa-254b1dbcbe7f"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:15.292101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:15.292800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:15.301992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:15.303672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:15.304492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:15.304941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:15.380686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] validate_networks() for [('53665c12-83de-457c-87fa-254b1dbcbe7f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:43:15.723388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:16.024342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:16.033125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-951d29d8-0686-4a15-a1ae-bf8e4059b9fd tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1730 microversion: 2.1 time: 0.745383 Jul 28 11:43:16.038340 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2017/3989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:15 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1730 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:16.061177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:16.061848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:16.075161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:16.089756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:16.096429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:16.096892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:16.266964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:16.284289 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61dcf2e9-27df-435f-bc88-da45550191e9 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.228429 Jul 28 11:43:16.285818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2018/3990] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:43:16 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:43:16.291802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:16.294149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:16.304199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:16.305092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:16.306224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:16.307282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:17.305742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:17.317742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66a0b146-cd58-49c8-964b-790784c193f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 1.030367 Jul 28 11:43:17.339223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2019/3991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:16 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:17.377029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:43:17.377510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:43:17.377906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:43:17.378319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:43:17.378905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:43:17.396860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:17.397328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:17.398130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:17.398765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:17.446360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Getting quotas for project d371845cfd7342e0bc305ac07561a81a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:43:17.456636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Getting quotas for user 66d7651505924cdca3478e71a23d068c and project d371845cfd7342e0bc305ac07561a81a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:43:17.477809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:43:17.480360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:43:17.640577 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0320ffeb-a3f1-459e-8ca2-43e9f2fd8bde tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.558317 Jul 28 11:43:17.641898 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1973/3992] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:43:17.653010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac2a86f0-ed69-4fac-a02d-cb715adf2cfa tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:17.654006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac2a86f0-ed69-4fac-a02d-cb715adf2cfa tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:17.835645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac2a86f0-ed69-4fac-a02d-cb715adf2cfa tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:17.858337 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac2a86f0-ed69-4fac-a02d-cb715adf2cfa tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1224 microversion: 2.1 time: 0.203763 Jul 28 11:43:17.859705 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2020/3993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:17 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:18.339383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:18.341370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:18.372023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:18.375569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:18.377873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:18.380688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:18.858632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-91275533-f5a5-49ba-a7b8-741de77ab33e req-21fa8639-cf19-431b-8b52-ba7447fa8446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:18.860378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:18.885172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1bd39b13-70e9-478f-a575-8b61b6d80b7f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.547342 Jul 28 11:43:18.892795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-91275533-f5a5-49ba-a7b8-741de77ab33e req-21fa8639-cf19-431b-8b52-ba7447fa8446 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:18.893907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-91275533-f5a5-49ba-a7b8-741de77ab33e req-21fa8639-cf19-431b-8b52-ba7447fa8446 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:18.901036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1974/3994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:18 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:18.936510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:18.938390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-91275533-f5a5-49ba-a7b8-741de77ab33e req-21fa8639-cf19-431b-8b52-ba7447fa8446 service nova] Creating event network-changed:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:43:18.941042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:18.961843 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-91275533-f5a5-49ba-a7b8-741de77ab33e req-21fa8639-cf19-431b-8b52-ba7447fa8446 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102623 Jul 28 11:43:18.962498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2021/3995] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:43:18.977525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:18.979168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:19.001462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:19.002977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:19.244170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:19.260318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae36415a-f00a-4d92-90d9-3df22ce6969a tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1220 microversion: 2.1 time: 0.356051 Jul 28 11:43:19.261466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1975/3996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:18 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1220 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:19.912775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:19.915646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:19.928718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:19.929537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:19.930853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:19.931631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:20.286297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:20.287619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:20.308156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:20.310053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:20.310882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:20.313940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:20.527107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:20.537501 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62748777-b865-42c0-b333-8f15c0a20d78 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.630257 Jul 28 11:43:20.539413 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2022/3997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:19 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:20.587178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:20.597181 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09f7d9fb-3669-410e-9a10-a226b286ccd8 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1282 microversion: 2.1 time: 0.315550 Jul 28 11:43:20.616526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1976/3998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:20 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1282 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:21.004318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4bfe9157-2418-4b55-8659-d893045cb3ac req-ed8e0695-c4b4-4453-82dd-6779804c3f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:21.014661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4bfe9157-2418-4b55-8659-d893045cb3ac req-ed8e0695-c4b4-4453-82dd-6779804c3f91 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:21.015473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4bfe9157-2418-4b55-8659-d893045cb3ac req-ed8e0695-c4b4-4453-82dd-6779804c3f91 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:21.029028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4bfe9157-2418-4b55-8659-d893045cb3ac req-ed8e0695-c4b4-4453-82dd-6779804c3f91 service nova] Creating event network-changed:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:43:21.051742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4bfe9157-2418-4b55-8659-d893045cb3ac req-ed8e0695-c4b4-4453-82dd-6779804c3f91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050926 Jul 28 11:43:21.063883 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2023/3999] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:21.560927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:21.562926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:21.575065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:21.576739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:21.578213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:21.579414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:21.619598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:21.620303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:21.630408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:21.630783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:21.641938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:21.642564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:22.033550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:22.045374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb640919-bc93-4a0e-a3b3-ad46fc34824c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.429790 Jul 28 11:43:22.046047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2024/4000] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:21 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:22.068593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:22.080632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39886f55-c967-442f-bcf4-b70b4afc1f82 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.523116 Jul 28 11:43:22.095793 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1977/4001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:21 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:22.611062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fb4b51b9-1f81-406d-891d-0f648f572de7 req-890818cf-7dfe-473b-b2a9-8908cc51269f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-plugged", "status": "completed", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:22.633049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fb4b51b9-1f81-406d-891d-0f648f572de7 req-890818cf-7dfe-473b-b2a9-8908cc51269f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:22.633500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fb4b51b9-1f81-406d-891d-0f648f572de7 req-890818cf-7dfe-473b-b2a9-8908cc51269f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:22.657997 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fb4b51b9-1f81-406d-891d-0f648f572de7 req-890818cf-7dfe-473b-b2a9-8908cc51269f service nova] Creating event network-vif-plugged:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:43:22.684179 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fb4b51b9-1f81-406d-891d-0f648f572de7 req-890818cf-7dfe-473b-b2a9-8908cc51269f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076612 Jul 28 11:43:22.685266 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2025/4002] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:23.082331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9f296d3d-7d09-4154-87fd-975d810d5e78 req-db2c6740-4037-4246-b763-ffd869325157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8f32c5-f758-469a-b38f-a0ac7d54a379", "tag": "c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:23.085899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:23.087411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:23.106540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:23.108559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:23.110956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9f296d3d-7d09-4154-87fd-975d810d5e78 req-db2c6740-4037-4246-b763-ffd869325157 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:23.112060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:23.112685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:23.116084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9f296d3d-7d09-4154-87fd-975d810d5e78 req-db2c6740-4037-4246-b763-ffd869325157 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:23.151484 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9f296d3d-7d09-4154-87fd-975d810d5e78 req-db2c6740-4037-4246-b763-ffd869325157 service nova] Creating event network-changed:c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00 for instance af8f32c5-f758-469a-b38f-a0ac7d54a379 on n-h2-851368-1 Jul 28 11:43:23.160261 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9f296d3d-7d09-4154-87fd-975d810d5e78 req-db2c6740-4037-4246-b763-ffd869325157 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083843 Jul 28 11:43:23.166210 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2026/4003] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:23.172234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:23.176116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:23.201027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:23.201543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:23.202328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:23.202918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:23.540381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:23.549216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d43b03ae-6ea8-44bc-a854-8f74c183540c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.380960 Jul 28 11:43:23.550770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2027/4004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:23 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:23.580006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:23.590088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3cb5be8-edd6-4de9-ac56-5c1a5d4c38ae tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.526656 Jul 28 11:43:23.594959 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1978/4005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:23 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:24.574095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:24.575230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:24.593587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:24.595373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:24.599608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:24.602882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:24.618783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:24.619738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:24.636312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:24.637232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:24.638172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:24.644715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:25.034916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:25.040077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:25.046160 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4327a617-88c3-4776-8ca0-d21a79d23eed tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.432087 Jul 28 11:43:25.049137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1979/4006] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:24 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:25.051888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43364fe8-3b6d-45ab-b57f-8539fcca9432 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1317 microversion: 2.1 time: 0.481914 Jul 28 11:43:25.052485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2028/4007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:24 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:26.075691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:26.076312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:26.076894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:26.077526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:26.088661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.091997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.092771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.093954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.094568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.095302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.096653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.098634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.145778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:26.717343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:26.732163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-812855cc-75aa-446a-a40f-78fb9a62c2c0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1466 microversion: 2.1 time: 0.659590 Jul 28 11:43:26.733310 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2029/4008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:26 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1466 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:26.762727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1487553711", "metadata": {"image_type": "test"}}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:26.765610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:26.769435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:26.779671 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f94d2077-b318-4482-837c-5c4f1bd80818 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.703793 Jul 28 11:43:26.780342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1980/4009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:26 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:26.788585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.788937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.789894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:26.791584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:26.870024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Getting quotas for project 549d2e4844204083816889d0c08cf6a8. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:43:26.877062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Getting quotas for user e9c8592d2d464a4890d000151507738d and project 549d2e4844204083816889d0c08cf6a8. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:43:27.287491 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c85902e-a67d-4c98-919c-24f034bf2204 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "POST /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e/action" status: 202 len: 0 microversion: 2.1 time: 0.533587 Jul 28 11:43:27.288089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2030/4010] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:43:26 2022] POST /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:43:27.299219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5eadb001-acb5-442b-9c9a-8fec833def85 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb3389820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:27.393927 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5eadb001-acb5-442b-9c9a-8fec833def85 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.099240 Jul 28 11:43:27.395204 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1981/4011] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:27 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:27.801707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:27.802444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:27.814619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:27.815174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:27.815961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:27.816389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:27.864744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:28.123654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:28.132369 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f65f1d4-45b0-4b8f-a515-a4c856f6dfe0 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.334726 Jul 28 11:43:28.132965 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2031/4012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:27 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:28.411710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0319822e-3035-4c10-a162-70669cdbefbc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2344af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:28.422937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:28.425296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:28.503735 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0319822e-3035-4c10-a162-70669cdbefbc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.098247 Jul 28 11:43:28.504640 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1982/4013] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:28 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:29.154252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:29.156424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:29.169980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:29.172394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:29.176654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:29.177547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:29.519753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-283d0338-4289-4abb-8f75-07c28cf415bb tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2ec4790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:29.578116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-283d0338-4289-4abb-8f75-07c28cf415bb tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.063989 Jul 28 11:43:29.578795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1983/4014] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:29 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:29.621403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:29.632087 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce564186-8b3c-40e2-ae02-d3b83fac9a21 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.481635 Jul 28 11:43:29.634377 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2032/4015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:29 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:30.603132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1163cb73-e803-416e-88ce-0b5e3596093c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b381f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:30.658881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:30.661409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:30.677903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:30.678455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:30.683743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:30.684324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:30.726716 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1163cb73-e803-416e-88ce-0b5e3596093c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.133699 Jul 28 11:43:30.728105 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1984/4016] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:30 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:30.739857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a8315516-5e50-4c3c-8623-a7449899f149 req-20b56a32-6170-41f7-b999-6ea2b2e3df81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8f32c5-f758-469a-b38f-a0ac7d54a379", "name": "network-vif-plugged", "status": "completed", "tag": "c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:30.756962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a8315516-5e50-4c3c-8623-a7449899f149 req-20b56a32-6170-41f7-b999-6ea2b2e3df81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:30.757808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a8315516-5e50-4c3c-8623-a7449899f149 req-20b56a32-6170-41f7-b999-6ea2b2e3df81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:30.772757 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a8315516-5e50-4c3c-8623-a7449899f149 req-20b56a32-6170-41f7-b999-6ea2b2e3df81 service nova] Creating event network-vif-plugged:c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00 for instance af8f32c5-f758-469a-b38f-a0ac7d54a379 on n-h2-851368-1 Jul 28 11:43:30.779388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a8315516-5e50-4c3c-8623-a7449899f149 req-20b56a32-6170-41f7-b999-6ea2b2e3df81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047484 Jul 28 11:43:30.780666 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1985/4017] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:30.936560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:30.944814 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c97baaa-cb61-4d31-a877-136776f2e35d tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.294522 Jul 28 11:43:30.946240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2033/4018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:30 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:31.743852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05dfa7ac-36e7-4b0b-ba0b-4141f4952f64 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2ec4790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:31.814730 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05dfa7ac-36e7-4b0b-ba0b-4141f4952f64 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.075988 Jul 28 11:43:31.815602 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1986/4019] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:31 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:31.978641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:31.980296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:31.996380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:32.004299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:32.005503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:32.006169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:32.292390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:32.304930 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3463cb24-c1b6-4603-8adc-abd135bc8f91 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1324 microversion: 2.1 time: 0.340958 Jul 28 11:43:32.306136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2034/4020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:31 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:32.840097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d7eb793-cc15-40d1-9e76-7a8140acf371 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb298cc10>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:32.905687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d7eb793-cc15-40d1-9e76-7a8140acf371 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.071192 Jul 28 11:43:32.906271 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1987/4021] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:32 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:33.331868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:33.332537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:33.348394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:33.349881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:33.351434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:33.352117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:33.823355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:33.833897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab4f1a65-5ea6-408a-8dd3-06e7b939c012 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1520 microversion: 2.1 time: 0.508125 Jul 28 11:43:33.837671 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2035/4022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:33 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:33.865093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:33.865758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:33.877986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:33.878449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:33.879275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:33.879726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:33.922404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69b9af27-164c-4d33-9a6f-a5a03587fe87 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb44c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:33.960849 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] HTTP exception thrown: Action 999 not found Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Request method failure captured: Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379/os-instance-actions/999 HTTP/1.1 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nZSmTepbhCK-EE8aDd4rMQNl68YrAcwVw2bdNWpZ9pErqTcKsre0Bl_U4QTdgK7uMIxjZFooZ6HEBOulpMhYILSc2bw1ggwtS4TlUVwbAUhS9m9ih7eqUh5hbm4isgl8mKm6D_0Ma8_eNChGHosFjyVePHj2nyxZ9CwGYNc-kXCKHU Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}] Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 66d7651505924cdca3478e71a23d068c Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: exception: Action 999 not found Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': 'af8f32c5-f758-469a-b38f-a0ac7d54a379', 'id': '999'} Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 28 11:43:33.973946 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:33.978942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Returning 404 to user: Action 999 not found {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:43:33.980515 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ed4075c-76b5-462c-949b-13b98c9f31fe tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.120945 Jul 28 11:43:33.981830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1988/4023] 10.222.0.93 () {58 vars in 1308 bytes} [Thu Jul 28 11:43:33 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379/os-instance-actions/999 => generated 66 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:43:33.986224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69b9af27-164c-4d33-9a6f-a5a03587fe87 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.068211 Jul 28 11:43:33.987413 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2036/4024] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:33 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:33.999090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '.version_select at 0x7f2eb24a45e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:33.999789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: 50197fc6-29cb-4e0f-874a-65e51b50a91d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:34.006738 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] HTTP exception thrown: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Request method failure captured: Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/50197fc6-29cb-4e0f-874a-65e51b50a91d/os-instance-actions HTTP/1.1 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nZSmTepbhCK-EE8aDd4rMQNl68YrAcwVw2bdNWpZ9pErqTcKsre0Bl_U4QTdgK7uMIxjZFooZ6HEBOulpMhYILSc2bw1ggwtS4TlUVwbAUhS9m9ih7eqUh5hbm4isgl8mKm6D_0Ma8_eNChGHosFjyVePHj2nyxZ9CwGYNc-kXCKHU Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}] Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 66d7651505924cdca3478e71a23d068c Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '50197fc6-29cb-4e0f-874a-65e51b50a91d'} Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:43:34.008903 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. Jul 28 11:43:34.012772 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:43:34.014773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Returning 404 to user: Instance 50197fc6-29cb-4e0f-874a-65e51b50a91d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:43:34.020747 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95e46ac8-0f71-42bd-8f4f-8d40bc529f14 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/50197fc6-29cb-4e0f-874a-65e51b50a91d/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.028388 Jul 28 11:43:34.021368 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1989/4025] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Jul 28 11:43:33 2022] GET /compute/v2.1/servers/50197fc6-29cb-4e0f-874a-65e51b50a91d/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:43:34.029243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:34.030364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:34.048512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:34.048976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:34.049777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:34.050222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:34.146307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:43:34.277768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f92802c9-d39d-4031-bf14-d54ecb007418 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "DELETE /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 204 len: 0 microversion: 2.1 time: 0.254463 Jul 28 11:43:34.279819 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2037/4026] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:43:34 2022] DELETE /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:43:34.288556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:34.289312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:34.300483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:34.308939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:34.311963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:34.312773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:34.796036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f5fdea02-1d7c-4650-bce7-319e40ed9ec0 req-2747b5e4-02f0-46db-9d0a-3fa154f3f141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-plugged", "status": "completed", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:34.828537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5fdea02-1d7c-4650-bce7-319e40ed9ec0 req-2747b5e4-02f0-46db-9d0a-3fa154f3f141 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:34.834761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5fdea02-1d7c-4650-bce7-319e40ed9ec0 req-2747b5e4-02f0-46db-9d0a-3fa154f3f141 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:34.866036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f5fdea02-1d7c-4650-bce7-319e40ed9ec0 req-2747b5e4-02f0-46db-9d0a-3fa154f3f141 service nova] Creating event network-vif-plugged:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:43:34.872878 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f5fdea02-1d7c-4650-bce7-319e40ed9ec0 req-2747b5e4-02f0-46db-9d0a-3fa154f3f141 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080410 Jul 28 11:43:34.873905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2038/4027] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:43:34.965897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:34.988692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c73e4a9-25cb-4a65-a1c3-d7b7e9955415 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1526 microversion: 2.1 time: 0.703769 Jul 28 11:43:35.005570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b377250-6d09-4c6b-ae62-e1693508bfb6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb4ca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:35.010424 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1990/4028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:34 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1526 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:35.077567 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b377250-6d09-4c6b-ae62-e1693508bfb6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.077869 Jul 28 11:43:35.084854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2039/4029] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:34 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:36.017263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:36.018053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:36.035370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:36.036676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:36.039145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:36.045544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:36.094696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52005d4d-837f-4773-ad84-8f4ded0ff6be tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b80a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:36.174364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52005d4d-837f-4773-ad84-8f4ded0ff6be tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.085352 Jul 28 11:43:36.182733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2040/4030] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:36 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:36.489525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:36.503433 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0293e21a-9596-4fdf-bb9c-d6bdf537ec5c tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1526 microversion: 2.1 time: 0.490297 Jul 28 11:43:36.505305 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1991/4031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:36 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1526 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:37.200188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-971cd662-3541-4faf-8971-7e06f2da6bd4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b80790>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:37.303180 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-971cd662-3541-4faf-8971-7e06f2da6bd4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.110119 Jul 28 11:43:37.303771 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2041/4032] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:37 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:37.536117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:37.541547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:37.586140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:37.587271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:37.588670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:37.589402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:38.127441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:38.143127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:38.156429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:38.164908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:38.179194 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2f1975be-1295-4789-b9e6-1a7ff1798a05 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1484 microversion: 2.1 time: 0.647802 Jul 28 11:43:38.184293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:38.195943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:38.199278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:38.199514 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1992/4033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:37 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1484 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:38.204092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:38.328627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-538333cd-59f5-4535-8745-99691ade8616 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb33e3280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:38.445476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-538333cd-59f5-4535-8745-99691ade8616 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.128619 Jul 28 11:43:38.455593 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1993/4034] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:38 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:38.472720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bddd341f-4f9c-41e8-9bcc-d92d7814eed2 req-53f5eef6-ed49-4dfb-88dc-143b3a7bc980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8f32c5-f758-469a-b38f-a0ac7d54a379", "name": "network-vif-deleted", "tag": "c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:38.509176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bddd341f-4f9c-41e8-9bcc-d92d7814eed2 req-53f5eef6-ed49-4dfb-88dc-143b3a7bc980 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:38.510226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bddd341f-4f9c-41e8-9bcc-d92d7814eed2 req-53f5eef6-ed49-4dfb-88dc-143b3a7bc980 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:38.571514 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bddd341f-4f9c-41e8-9bcc-d92d7814eed2 req-53f5eef6-ed49-4dfb-88dc-143b3a7bc980 service nova] Creating event network-vif-deleted:c39a83b5-15ab-4e8f-a4dd-b2f3e00dff00 for instance af8f32c5-f758-469a-b38f-a0ac7d54a379 on n-h2-851368-1 Jul 28 11:43:38.599044 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bddd341f-4f9c-41e8-9bcc-d92d7814eed2 req-53f5eef6-ed49-4dfb-88dc-143b3a7bc980 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141757 Jul 28 11:43:38.599696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1994/4035] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:38.757496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:38.766302 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0683649a-b0dc-4ed3-a971-cfbf281ad217 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.615823 Jul 28 11:43:38.776162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2042/4036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:38 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:38.812308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:38.813391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:38.839616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:38.840437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:38.842303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:38.845199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.161964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:39.171480 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15550817-497b-49bf-b099-b7b3a2b5b2d5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.366942 Jul 28 11:43:39.172925 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1995/4037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:38 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:39.197019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:39.197688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:39.204215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:39.221612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.223460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.227107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.227538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:39.229247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:39.229623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.262987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.266424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.268034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.273317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.436747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.456993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.462949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lazy-loading 'fault' on Instance uuid af8f32c5-f758-469a-b38f-a0ac7d54a379 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:43:39.590562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66d7651505924cdca3478e71a23d068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd371845cfd7342e0bc305ac07561a81a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:39.599805 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71977706-a40d-432c-9e7b-0c259035b289 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 200 len: 1314 microversion: 2.1 time: 0.376883 Jul 28 11:43:39.606580 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1996/4038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:39 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:39.616875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:39.622946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd8252ca-f952-4235-9600-e4e911502e68 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2627af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:39.626020 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-275dbea7-a123-4fb3-ab98-148b89729cb3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.434882 Jul 28 11:43:39.630729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2043/4039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:39 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:39.658098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:39.658702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:39.680197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.681039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.684152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:39.684583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:39.712569 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd8252ca-f952-4235-9600-e4e911502e68 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.104513 Jul 28 11:43:39.713449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1997/4040] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:39 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:39.986078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:40.001320 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56049fd5-efc8-48d2-bcc2-b301b6fe431b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.350707 Jul 28 11:43:40.009836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2044/4041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:39 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:40.272714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-430345496", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fe6b5fcd-50fa-4151-8267-beaa12b03a0e"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:40.363841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] validate_networks() for [('fe6b5fcd-50fa-4151-8267-beaa12b03a0e', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:43:40.626588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:40.627240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] [instance: af8f32c5-f758-469a-b38f-a0ac7d54a379] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:40.642015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:40.642480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:40.643308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:40.643760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:40.692822 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] HTTP exception thrown: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Request method failure captured: Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 HTTP/1.1 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nZSmTepbhCK-EE8aDd4rMQNl68YrAcwVw2bdNWpZ9pErqTcKsre0Bl_U4QTdgK7uMIxjZFooZ6HEBOulpMhYILSc2bw1ggwtS4TlUVwbAUhS9m9ih7eqUh5hbm4isgl8mKm6D_0Ma8_eNChGHosFjyVePHj2nyxZ9CwGYNc-kXCKHU Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d371845cfd7342e0bc305ac07561a81a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d371845cfd7342e0bc305ac07561a81a"}]}] Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d371845cfd7342e0bc305ac07561a81a Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-838448670 Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 66d7651505924cdca3478e71a23d068c Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-838448670-project Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'af8f32c5-f758-469a-b38f-a0ac7d54a379'} Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:43:40.694544 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] Returning 404 to user: Instance af8f32c5-f758-469a-b38f-a0ac7d54a379 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-797e9b21-a813-4c02-85f0-0cd35592f823 tempest-InstanceActionsNegativeTestJSON-838448670 tempest-InstanceActionsNegativeTestJSON-838448670-project] 10.222.0.93 "GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379" status: 404 len: 111 microversion: 2.1 time: 0.074614 Jul 28 11:43:40.697973 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2045/4042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:40 2022] GET /compute/v2.1/servers/af8f32c5-f758-469a-b38f-a0ac7d54a379 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:43:40.727639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-125450c5-caaa-4663-80e9-1c2ddebff008 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1ba4dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:40.797947 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-125450c5-caaa-4663-80e9-1c2ddebff008 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.074066 Jul 28 11:43:40.806053 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2046/4043] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:40 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:41.060147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:43:41.060651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:43:41.061197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:43:41.061619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:43:41.062038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:43:41.088870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:41.101994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:41.104330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:41.110764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:41.155123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:43:41.161924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:43:41.183477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:43:41.190802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:43:41.298580 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8daaf76d-880c-4351-baa2-a5ab8cb9a366 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029941 Jul 28 11:43:41.299193 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1998/4044] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:43:41.320107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-337647f7-3fab-490c-bab3-a3e6c5edd7ab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:41.322935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-337647f7-3fab-490c-bab3-a3e6c5edd7ab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:41.541201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-337647f7-3fab-490c-bab3-a3e6c5edd7ab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:41.557077 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-337647f7-3fab-490c-bab3-a3e6c5edd7ab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1214 microversion: 2.1 time: 0.250357 Jul 28 11:43:41.560925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2047/4045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:41 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:41.814621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b9cbca2-2f50-45f0-b799-f05c6ae8999d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2627e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:41.891052 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b9cbca2-2f50-45f0-b799-f05c6ae8999d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.082276 Jul 28 11:43:41.891902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 1999/4046] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:41 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:42.581639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:42.583785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:42.611147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:42.612256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:42.615461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:42.618438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:42.835814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:42.852795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39d7b11a-03c2-40ab-add7-b45da727edeb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1218 microversion: 2.1 time: 0.274824 Jul 28 11:43:42.858103 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2048/4047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:42 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1218 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:42.906534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-11db5995-c247-420f-a3bf-3c587b03d9c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb249f8b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:43.001826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-11db5995-c247-420f-a3bf-3c587b03d9c3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.099587 Jul 28 11:43:43.009719 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2000/4048] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:42 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:43.880644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:43.882836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:43.903513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:43.904179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:43.905672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:43.907734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:43.948899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:44.017357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-259f685a-b699-4ba1-a92a-62fc85e5848f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2488310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:44.034031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:44.044392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60d962b8-2d4e-4daa-b4b4-f2f58f723475 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1272 microversion: 2.1 time: 0.168744 Jul 28 11:43:44.047134 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2049/4049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:43 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:44.108095 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-259f685a-b699-4ba1-a92a-62fc85e5848f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.094507 Jul 28 11:43:44.117900 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2001/4050] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:44 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:45.067266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:45.068008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:45.081226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:45.083277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:45.086924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:45.089427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:45.125983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc522655-3cd5-4d4b-8f32-8fd6f142e071 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb347f5e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:45.228396 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc522655-3cd5-4d4b-8f32-8fd6f142e071 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.108155 Jul 28 11:43:45.229207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2002/4051] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:45 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:45.329767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:45.338074 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-07b5c103-a54d-4728-99a6-99be2628dbef tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1272 microversion: 2.1 time: 0.275126 Jul 28 11:43:45.347199 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2050/4052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:45 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:45.782370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:45.782906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:45.786341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:45.812450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:45.814481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:45.822328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:45.823175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:45.884500 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7542d380-844c-462b-b1e7-350d53e80bbd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/ips" status: 200 len: 145 microversion: 2.1 time: 0.106465 Jul 28 11:43:45.892383 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2003/4053] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:43:45 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/ips => generated 145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:46.245867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d317addf-c31c-4137-ab50-58934b0c20c2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb8700>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:46.330013 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d317addf-c31c-4137-ab50-58934b0c20c2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.088639 Jul 28 11:43:46.339144 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2051/4054] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:46 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:46.369522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:46.371317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:46.387332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:46.388607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:46.389621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:46.390220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:47.349299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aab854c4-42c9-4619-85ef-0798d60a9af0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb5c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:47.437441 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aab854c4-42c9-4619-85ef-0798d60a9af0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.093848 Jul 28 11:43:47.453793 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2052/4055] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:47 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:47.819681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:47.828918 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-792800ec-6e86-4010-85d7-01d52c248b74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 1.463195 Jul 28 11:43:47.834839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2004/4056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:46 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:48.453453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5b3c3dc-24b7-4719-9f66-b21ece0ce275 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1ba0e50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:48.573996 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5b3c3dc-24b7-4719-9f66-b21ece0ce275 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.121434 Jul 28 11:43:48.574630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2053/4057] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:48 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:48.860326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:48.861575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:48.890375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:48.893009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:48.893976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:48.901185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:49.246710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:49.255438 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-44d504d8-3f56-4974-aff4-7937dedf4489 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.399286 Jul 28 11:43:49.270511 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2005/4058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:48 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:49.590139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca4e762f-1ade-47cf-9927-a99c28b2cf7e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb5d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:49.597290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762a0ffa-dd70-464d-ac58-04b16ae66615"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:49.603640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:49.613159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:49.614220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:49.615357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:49.616002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:49.640261 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca4e762f-1ade-47cf-9927-a99c28b2cf7e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.054556 Jul 28 11:43:49.642076 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2054/4059] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:49 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:50.086452 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27bcba83-fd4a-43b3-a1dc-0113b55e1940 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493340 Jul 28 11:43:50.088520 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2006/4060] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:43:49 2022] POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:50.278039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:50.278651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:50.297126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:50.297603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:50.298389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:50.298827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:50.568570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:50.582390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af52b1cb-f391-494b-a630-62f667c728c0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.308328 Jul 28 11:43:50.587506 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2055/4061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:50 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:50.660543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d746021-46b9-455b-afc2-3a328dcd3df2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2518d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:50.731420 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d746021-46b9-455b-afc2-3a328dcd3df2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.077796 Jul 28 11:43:50.733275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2007/4062] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:50 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:51.226472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:51.227567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:51.251930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.255226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.257736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.258356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.556266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:51.609868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:51.609868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:43:51.609868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:51.610882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:51.619002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'services' on Instance uuid 973487fe-da17-4f60-bf87-e899efe54f37 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:43:51.649852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.649852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.649852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.649852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.729167 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88121eef-bb2c-4095-ae5c-6e24b5921f13 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments/04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6" status: 202 len: 0 microversion: 2.1 time: 0.504720 Jul 28 11:43:51.747967 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2056/4063] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:43:51 2022] DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments/04fd3dc9-68ab-4b8a-9a0f-d0ce76dd78b6 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:43:51.761925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3929b645-324a-4ff8-965b-419c40815be9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1ba4dc0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:51.875061 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3929b645-324a-4ff8-965b-419c40815be9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.125155 Jul 28 11:43:51.882448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2057/4064] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:51 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:51.892950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:51.896110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:51.925283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.927635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.928625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:51.929227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:51.995714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7baacc41-25e7-46c5-8cbd-b616c5457230 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118412 Jul 28 11:43:51.998371 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2058/4065] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:51 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:52.012886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-47b3f51a-d120-4db4-a383-a07c96b2f339 req-ac2edf09-6728-402d-b36b-9b20ddf2e1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38e9a34-3c26-4168-a8bc-a478b2cb2f23", "tag": "7bbb7cff-c36b-4db6-b94a-90d15a06d4ce"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:43:52.044796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-47b3f51a-d120-4db4-a383-a07c96b2f339 req-ac2edf09-6728-402d-b36b-9b20ddf2e1c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:52.045398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-47b3f51a-d120-4db4-a383-a07c96b2f339 req-ac2edf09-6728-402d-b36b-9b20ddf2e1c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:52.067738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-47b3f51a-d120-4db4-a383-a07c96b2f339 req-ac2edf09-6728-402d-b36b-9b20ddf2e1c9 service nova] Creating event network-changed:7bbb7cff-c36b-4db6-b94a-90d15a06d4ce for instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 on n-h2-851368-1 Jul 28 11:43:52.083427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-47b3f51a-d120-4db4-a383-a07c96b2f339 req-ac2edf09-6728-402d-b36b-9b20ddf2e1c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081076 Jul 28 11:43:52.084730 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2059/4066] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:52.212675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:52.233864 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ddb75ef9-51db-44ac-ad91-6da5841672cf tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.627419 Jul 28 11:43:52.234696 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2008/4067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:51 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:52.898780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55dc7e43-90d2-470f-bce9-662f0f94473c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b41b80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:53.003474 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55dc7e43-90d2-470f-bce9-662f0f94473c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.116285 Jul 28 11:43:53.013124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:53.016159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:53.031874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2060/4068] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:52 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:53.043381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:53.050917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:53.052847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:53.057369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:53.191360 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-617e3580-438f-477b-88f9-f8f1ce19abff tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185396 Jul 28 11:43:53.202526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2009/4069] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:53 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:43:53.257612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:53.258364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:53.274002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:53.274986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:53.277466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:53.278203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:54.041586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6c2fd5f-6230-4433-b415-d73ebb00ac89 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb3389820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:54.107452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:54.123288 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6c2fd5f-6230-4433-b415-d73ebb00ac89 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.085476 Jul 28 11:43:54.128453 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2010/4070] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:54 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:54.133673 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ccb7685-d37c-4dae-bf4a-82d0546ccee6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.880069 Jul 28 11:43:54.137836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2061/4071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:53 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:54.221462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:54.225653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:54.252507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:54.256378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:54.264276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:54.266455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:54.364898 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3012b6f-145f-444f-bd27-5cfcdfdb36e1 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155300 Jul 28 11:43:54.366070 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2011/4072] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:54 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:55.139195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1d79d07-3236-45cc-964c-bc18f5aff540 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb4160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:55.157856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:55.159022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:55.175314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:55.178893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:55.180075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:55.183885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:55.250082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1d79d07-3236-45cc-964c-bc18f5aff540 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.115887 Jul 28 11:43:55.256703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2062/4073] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:55 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:55.379370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:55.387325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:55.401202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:55.402038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:55.408185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:55.409280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:55.475877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd36688b-6bcf-40e0-8af8-2ae3c7cbdaa6 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102582 Jul 28 11:43:55.491449 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2063/4074] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:55 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:55.655376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:55.669739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26cf0b72-ffc8-40f5-98c2-f5d5264bace8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.512987 Jul 28 11:43:55.672864 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2012/4075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:55 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:56.271866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc37c373-982d-43b3-94fa-eacc9bbd99cb tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b80550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:56.337232 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc37c373-982d-43b3-94fa-eacc9bbd99cb tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.067306 Jul 28 11:43:56.338085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2064/4076] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:56 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:56.492843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:56.496283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:56.505362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:56.519848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:56.523056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:56.523906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:56.618744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be6ee9b5-8467-4ee1-b6ff-c6e9597a2579 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130334 Jul 28 11:43:56.623690 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2013/4077] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:56 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:56.697190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:56.697877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:56.710232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:56.710694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:56.714450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:56.714911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:57.352001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-244d5cc5-0d8f-4eb4-a59f-34d84174dd5b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2518af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:57.436391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-244d5cc5-0d8f-4eb4-a59f-34d84174dd5b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.088430 Jul 28 11:43:57.437445 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2014/4078] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:57 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:43:57.631948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:57.634995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:57.650255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:57.650984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:57.656230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:57.656983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:57.764060 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26a332f5-4e4f-47ee-9968-fc579b93ef3f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137150 Jul 28 11:43:57.767820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2015/4079] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:57 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:43:58.308757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:58.316683 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22115f86-8428-4eaf-8a1c-d476df2f26d7 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 1.625033 Jul 28 11:43:58.317260 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2065/4080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:56 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:58.453853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a610cdb7-ffdf-41b5-8fd0-036a2902c43d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb347faf0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:58.556023 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a610cdb7-ffdf-41b5-8fd0-036a2902c43d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.107732 Jul 28 11:43:58.565830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2016/4081] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:58 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:58.780324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:58.783282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:58.820129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:58.820781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:58.829009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:58.829774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:58.896476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62aff2e4-7ebe-48ed-9ea4-b45ba81437ec tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120588 Jul 28 11:43:58.897764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2066/4082] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:58 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:43:59.341955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:59.342588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:59.368695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:59.369588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:59.372627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:59.375462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:59.574710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9aef4968-9d0c-47f5-b3c7-29c3f46a5001 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b5d4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:59.648919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9aef4968-9d0c-47f5-b3c7-29c3f46a5001 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.081362 Jul 28 11:43:59.658831 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2067/4083] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:43:59 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:59.734837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:43:59.751862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19da3a23-66f1-46b0-94a0-e174c6391738 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.417508 Jul 28 11:43:59.752720 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2017/4084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:43:59 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:43:59.912657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:43:59.916039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:43:59.931426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:59.949180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:43:59.952622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:43:59.955046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:00.045122 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9d74fe1-db90-4277-bb0d-78dbdfe25bd7 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134444 Jul 28 11:44:00.046096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2068/4085] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:43:59 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:00.665788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a08cb450-d6f5-4ae0-a5ce-57d26c800a3f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb34ce280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:00.739061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a08cb450-d6f5-4ae0-a5ce-57d26c800a3f tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.076165 Jul 28 11:44:00.748695 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2018/4086] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:00 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:00.777433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:00.780679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:00.799643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:00.809577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:00.818866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:00.819844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:01.050635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5310dc28-601d-446f-be38-23ccf743fc49 req-363dd88b-f5ad-41a9-b862-798e71886de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38e9a34-3c26-4168-a8bc-a478b2cb2f23", "name": "network-vif-plugged", "status": "completed", "tag": "7bbb7cff-c36b-4db6-b94a-90d15a06d4ce"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:01.075202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5310dc28-601d-446f-be38-23ccf743fc49 req-363dd88b-f5ad-41a9-b862-798e71886de2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:01.082075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5310dc28-601d-446f-be38-23ccf743fc49 req-363dd88b-f5ad-41a9-b862-798e71886de2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:01.114685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5310dc28-601d-446f-be38-23ccf743fc49 req-363dd88b-f5ad-41a9-b862-798e71886de2 service nova] Creating event network-vif-plugged:7bbb7cff-c36b-4db6-b94a-90d15a06d4ce for instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 on n-h2-851368-1 Jul 28 11:44:01.137889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5310dc28-601d-446f-be38-23ccf743fc49 req-363dd88b-f5ad-41a9-b862-798e71886de2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090866 Jul 28 11:44:01.141953 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2019/4087] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:01.148214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:01.172054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:01.209141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:01.220070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:01.220945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:01.221567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:01.345611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2109295e-d4bd-461c-a397-84ef8c1b24b4 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201658 Jul 28 11:44:01.346211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2020/4088] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:44:01 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:01.511292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:01.522888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d5f8e179-9f23-4d48-8bb0-be2d88bd1c35 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.752875 Jul 28 11:44:01.528965 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2069/4089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:00 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:01.753690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2118684a-c031-43cc-ad6e-3a78338408b5 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2fc7ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:01.850489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2118684a-c031-43cc-ad6e-3a78338408b5 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1422 microversion: 2.1 time: 0.100288 Jul 28 11:44:01.858222 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2021/4090] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:01 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:02.358854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:02.362920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:02.387631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:02.392897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:02.396108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:02.397827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:02.491959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba885518-f68a-4fa1-8eb8-abc6010bde6b tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136439 Jul 28 11:44:02.497270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2070/4091] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:44:02 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:02.559177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:02.563618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:02.574528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:02.575339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:02.576291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:02.577279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:02.590426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:02.865680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cfd457b6-ef57-4fac-b5cf-c02ffb643be2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb325e0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.000390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cfd457b6-ef57-4fac-b5cf-c02ffb643be2 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1431 microversion: 2.1 time: 0.138483 Jul 28 11:44:03.011168 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2071/4092] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:02 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1431 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:03.016896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-946df6ea-186f-40a8-8925-955b990ad729 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bdb280>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.056225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:03.068779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dffed50d-d0e3-4ec1-9cf0-32cc2c0fdce2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1314 microversion: 2.1 time: 0.521128 Jul 28 11:44:03.069384 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2022/4093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:02 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:03.110424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-946df6ea-186f-40a8-8925-955b990ad729 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 200 len: 1431 microversion: 2.1 time: 0.096566 Jul 28 11:44:03.111432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2072/4094] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:03 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 1431 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:03.127248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.127884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:03.140122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:03.142354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:03.146927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:03.147862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:03.507211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.516590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:03.520302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:03.525475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c4aa765-5056-4c19-b189-8a4ad1c26fc9 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1466 microversion: 2.1 time: 0.404234 Jul 28 11:44:03.531335 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2023/4095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:03 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1466 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:03.533809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:03.537031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:03.537918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:03.539559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:03.554260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4178edd5-cac1-4615-9285-571aebfcbd7a tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb33e3550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.621026 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3cc05ac5-b88f-43a8-936f-f5475e260140 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119658 Jul 28 11:44:03.624094 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2073/4096] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:44:03 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:03.705015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4178edd5-cac1-4615-9285-571aebfcbd7a tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e" status: 200 len: 784 microversion: 2.1 time: 0.154187 Jul 28 11:44:03.707413 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2024/4097] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:03 2022] GET /compute/v2.1/images/d754ca4d-54f2-4b37-ac95-af6564180b9e => generated 784 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:03.728892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-36912035-ebec-40bb-8fd6-dd2711dda11d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:03.743201 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-36912035-ebec-40bb-8fd6-dd2711dda11d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018078 Jul 28 11:44:03.744028 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2074/4098] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:44:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:03.765485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b4217c6-02a5-4ef3-9097-8b478b967208 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2be68b0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:04.095457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:04.096521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:04.124544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:04.125306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:04.126660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:04.127425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.011650 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b4217c6-02a5-4ef3-9097-8b478b967208 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "DELETE /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 204 len: 0 microversion: 2.1 time: 1.254627 Jul 28 11:44:05.015445 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2025/4099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:03 2022] DELETE /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:05.018958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:05.034021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:05.041405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.042062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.043168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.043722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.100069 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-364979ab-6c5b-4b95-81e2-2b6c3cb30234 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085421 Jul 28 11:44:05.100608 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2026/4100] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:44:05 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:05.110180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b11b8f-b3eb-432c-a3dc-913b93b84a29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb25bf550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:05.143977 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-28b11b8f-b3eb-432c-a3dc-913b93b84a29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] HTTP exception thrown: Image not found. Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b11b8f-b3eb-432c-a3dc-913b93b84a29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Request method failure captured: Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 HTTP/1.1 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nZICOtc7fco0H7TtYQBEeFmtySsvrluGpp4IUjfqI1dOc3o-pJdoWHTgYRJhGXGXHuU9hwre6bTdpoicM1FSwdv3jpqWIlj8dp5XH4MG3ofitwaODOE0ApaEzBqW8u9ehnlaqllyaaaVOaPVyH44qbUQlCk-NC2KRX2LNJjS6zmAv8 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_549d2e4844204083816889d0c08cf6a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}] Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e9c8592d2d464a4890d000151507738d Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: exception: Image not found. Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7e077367-ca30-437e-9b91-114cf0110455'} Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7e077367-ca30-437e-9b91-114cf0110455 Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 11:44:05.150960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e077367-ca30-437e-9b91-114cf0110455 could not be found. Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:05.154505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b11b8f-b3eb-432c-a3dc-913b93b84a29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Returning 404 to user: Image not found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:05.167280 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28b11b8f-b3eb-432c-a3dc-913b93b84a29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 404 len: 62 microversion: 2.1 time: 0.048838 Jul 28 11:44:05.167280 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2027/4101] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:05 2022] GET /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:44:05.178823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2075922154"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:05.181826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:05.194611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.195064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.196030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.196480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.560996 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-866ddd96-b2cd-4275-8292-e687b797cffa tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "POST /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e/action" status: 202 len: 0 microversion: 2.1 time: 0.394269 Jul 28 11:44:05.568406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2028/4102] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:05 2022] POST /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 11:44:05.575337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fefa8baa-3008-446c-8eeb-a264ef1e8b4b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2898af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:05.592427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:05.607047 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eea8e3d1-572b-4e4a-9cba-803588b8f618 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1500 microversion: 2.1 time: 1.516170 Jul 28 11:44:05.620435 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2075/4103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:04 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1500 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:05.641560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:05.642214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:05.651804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.652745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.653861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:05.654919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:05.695992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fefa8baa-3008-446c-8eeb-a264ef1e8b4b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.125597 Jul 28 11:44:05.701245 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2029/4104] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:05 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:05.976891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.network.security_group_api [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Removing security group bf255086-c4ea-416d-be74-aef58bb759ef from port 7bbb7cff-c36b-4db6-b94a-90d15a06d4ce Jul 28 11:44:06.113338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:06.123294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:06.144405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.144774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.157101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.157572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.242859 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6195b209-eaef-4770-9fe0-23eef470871a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134341 Jul 28 11:44:06.243504 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2030/4105] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:44:06 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:44:06.385490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:06.387844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:06.397600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.399105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.400204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.400974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.442923 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Cannot 'reboot' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action HTTP/1.1 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 28 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: {"reboot": {"type": "HARD"}} Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'reboot' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7713992f-bcca-49f0-ab20-ce960564cd34', 'body': {'reboot': {'type': 'HARD'}}} Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3500, in reboot Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:44:06.445859 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.449921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 409 to user: Cannot 'reboot' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:06.450641 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85ad515a-a67b-4fc5-89d6-b07fac000207 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action" status: 409 len: 145 microversion: 2.1 time: 0.066099 Jul 28 11:44:06.458857 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2031/4106] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:06 2022] POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:44:06.464378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:06.467282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:06.475515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.476156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.477131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.477895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.511509 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Cannot 'rebuild' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action HTTP/1.1 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 65 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: exception: Cannot 'rebuild' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7713992f-bcca-49f0-ab20-ce960564cd34', 'body': {'rebuild': {'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e'}}} Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:06.513466 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued Jul 28 11:44:06.517740 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:06.519655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 409 to user: Cannot 'rebuild' instance 7713992f-bcca-49f0-ab20-ce960564cd34 while it is in vm_state rescued {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:06.520737 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36b3ef18-2915-42be-96d9-7b6cc06f4921 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action" status: 409 len: 146 microversion: 2.1 time: 0.060619 Jul 28 11:44:06.521485 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2032/4107] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:06 2022] POST /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34/action => generated 146 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:44:06.534963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:06.535574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:06.545051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.550298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.551758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.552222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.581671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:06.735161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a4ac9ef-0da7-4a25-b310-9753c1b1c119 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 204 len: 0 microversion: 2.1 time: 0.206288 Jul 28 11:44:06.740993 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2033/4108] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:06 2022] DELETE /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:06.761793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ddc0eb4c-2f04-4edc-83ed-f915600cd821 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb3187ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:06.839992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ddc0eb4c-2f04-4edc-83ed-f915600cd821 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.097447 Jul 28 11:44:06.840929 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2034/4109] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:06 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:06.848716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:06.849468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:06.859173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.859632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:06.860554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:06.861002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.143035 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f4616ae-b415-4ee3-824a-0a3f053827c2 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23/action" status: 202 len: 0 microversion: 2.1 time: 1.515155 Jul 28 11:44:07.145481 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2076/4110] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:05 2022] POST /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23/action => generated 0 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:07.153105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1ec13259-45c3-47e5-943d-e77e8abd1b58 req-fd4eca68-4ef7-45bd-bca3-9d7364e1c446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38e9a34-3c26-4168-a8bc-a478b2cb2f23", "tag": "7bbb7cff-c36b-4db6-b94a-90d15a06d4ce"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:07.174579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1ec13259-45c3-47e5-943d-e77e8abd1b58 req-fd4eca68-4ef7-45bd-bca3-9d7364e1c446 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.177386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1ec13259-45c3-47e5-943d-e77e8abd1b58 req-fd4eca68-4ef7-45bd-bca3-9d7364e1c446 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.234478 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1ec13259-45c3-47e5-943d-e77e8abd1b58 req-fd4eca68-4ef7-45bd-bca3-9d7364e1c446 service nova] Creating event network-changed:7bbb7cff-c36b-4db6-b94a-90d15a06d4ce for instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 on n-h2-851368-1 Jul 28 11:44:07.260485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1ec13259-45c3-47e5-943d-e77e8abd1b58 req-fd4eca68-4ef7-45bd-bca3-9d7364e1c446 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111394 Jul 28 11:44:07.267485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2077/4111] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:07.286087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:07.286974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:07.313320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.314081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.316079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.321362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.338987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:07.359428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c39cf40-6a61-4eda-8151-48a4208ef79d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1690 microversion: 2.1 time: 0.510315 Jul 28 11:44:07.374091 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2035/4112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:06 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1690 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:07.576165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a5156eee-b6a1-41ed-8ff4-8adc5cf8ca4a req-ca2e9cdd-832b-424f-bd8b-e902c4bae43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-unplugged", "status": "completed", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:07.591760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a5156eee-b6a1-41ed-8ff4-8adc5cf8ca4a req-ca2e9cdd-832b-424f-bd8b-e902c4bae43d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.592543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a5156eee-b6a1-41ed-8ff4-8adc5cf8ca4a req-ca2e9cdd-832b-424f-bd8b-e902c4bae43d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.637136 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a5156eee-b6a1-41ed-8ff4-8adc5cf8ca4a req-ca2e9cdd-832b-424f-bd8b-e902c4bae43d service nova] Creating event network-vif-unplugged:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:44:07.648365 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a5156eee-b6a1-41ed-8ff4-8adc5cf8ca4a req-ca2e9cdd-832b-424f-bd8b-e902c4bae43d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076497 Jul 28 11:44:07.649211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2036/4113] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:07.691389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:07.702470 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7876d74-b143-44f0-841f-1531591a64e5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1458 microversion: 2.1 time: 0.431842 Jul 28 11:44:07.717869 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2078/4114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:07 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1458 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:07.732846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:07.733972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:07.749461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.750459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.752556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:07.754235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:07.857287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5a6e869a-77c5-4871-9970-f34f8184c80e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb8c10>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:07.941792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5a6e869a-77c5-4871-9970-f34f8184c80e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.088308 Jul 28 11:44:07.949630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2079/4115] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:07 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:08.059720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:08.069929 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d830f214-e9fe-4005-89f3-e9ce9ed3338d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.342862 Jul 28 11:44:08.078551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2037/4116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:07 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:08.100445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:08.101127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:08.110308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.115053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.116001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.116463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.129732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:08.387659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:08.388522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:08.427438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.427980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.428841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.429284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.798825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:08.807852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98680ead-6ec6-4724-9732-9cbde4996336 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.710720 Jul 28 11:44:08.812077 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2080/4117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:08 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:08.834173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:08.835116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:08.845422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.846876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.849099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:08.849749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:08.972628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:08.984405 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-93cf866d-d97d-4abd-a2fe-b2b246fb1edc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1690 microversion: 2.1 time: 0.601947 Jul 28 11:44:08.988134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2038/4118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:08 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1690 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:08.996792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-18171ade-12a7-4938-b278-f0f2e42975d5 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb3389550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:09.070407 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-18171ade-12a7-4938-b278-f0f2e42975d5 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.079854 Jul 28 11:44:09.082983 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2039/4119] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:08 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:09.457476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:09.477426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3020f3f5-ff7d-408f-8ac4-0ed1e45b7f81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.647489 Jul 28 11:44:09.478349 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2081/4120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:08 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:09.500846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:09.502064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:09.511166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:09.511910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:09.513254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:09.513894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:09.887858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:09.902790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf71dfec-a2d5-4890-b358-bf3e9b2c5ea0 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.407262 Jul 28 11:44:09.903412 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2040/4121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:09 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:09.995716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1648790607", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7a381c82-e764-4cdf-9d5b-da14b0afeea7"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:10.007922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:10.008863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:10.008998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=54 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:10.024072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:10.024679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:10.030324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:10.032435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:10.133456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] validate_networks() for [('7a381c82-e764-4cdf-9d5b-da14b0afeea7', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:44:10.547887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:10.586709 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7544dc9e-3669-4f06-9368-957ead4a207a tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1690 microversion: 2.1 time: 0.582950 Jul 28 11:44:10.587898 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2041/4122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:10 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1690 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:10.605475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9792cf5e-cc35-44bd-8a4c-f9830fb0a925 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2352040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:10.722064 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9792cf5e-cc35-44bd-8a4c-f9830fb0a925 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.131837 Jul 28 11:44:10.724587 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2042/4123] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:10 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:10.740436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1775063102", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fe6b5fcd-50fa-4151-8267-beaa12b03a0e"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:10.851788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] validate_networks() for [('fe6b5fcd-50fa-4151-8267-beaa12b03a0e', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:44:12.143284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:44:12.145535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:44:12.146505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:44:12.147813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:44:12.148857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:44:12.175250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.176300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.177380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.178217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.209361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Getting quotas for project c90ec29b5cd34e56898bf4f5bbf630fb. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:12.217176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Getting quotas for user 0747e8fe4f9f4ae3aba6c8206af87921 and project c90ec29b5cd34e56898bf4f5bbf630fb. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:12.238765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Going to run 3 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:44:12.242456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:44:12.286551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=0addb529-a482-40df-9266-03fed40edeb5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:44:12.357530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=5207346b-c70f-4b27-a8da-c4613c4e66c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:44:12.469319 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-424749d5-10d1-4e8b-90b6-e49d5d9a3c74 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.706221 Jul 28 11:44:12.487721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2082/4124] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:44:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:44:12.514808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:12.524061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:12.540107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.540882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.546704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.547345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.679106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:44:12.679680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:44:12.680022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:44:12.680445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:44:12.680861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:44:12.703641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.704107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.704929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:12.705384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:12.740877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:12.751010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Getting quotas for user 3489992bab7b4f57a6544f31ba18f621 and project eb229519f2fb4be4a84cc037285a03d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:12.765803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:12.808357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:44:12.810022 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6dfe2312-3b32-4b46-a730-ea0fb0f744ba tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1623 microversion: 2.1 time: 0.314934 Jul 28 11:44:12.810705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:44:12.811476 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2083/4125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:12 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1623 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:12.819892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17993a44-8aa2-4714-9948-ee12fd432250 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bdb940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:12.954467 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-17993a44-8aa2-4714-9948-ee12fd432250 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.129335 Jul 28 11:44:12.955390 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2084/4126] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:12 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:12.960080 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da9b2628-f958-466e-8db7-8e0f600231e6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233602 Jul 28 11:44:12.960736 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2043/4127] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:44:12.977637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:12.985217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b4302453-b09b-4863-beb9-19a4f7a18037 req-0ddd66db-29bf-45ac-8a6f-e4527c3e2fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-plugged", "status": "completed", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:12.998366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:12.999204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:13.053898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b4302453-b09b-4863-beb9-19a4f7a18037 req-0ddd66db-29bf-45ac-8a6f-e4527c3e2fec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.054353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b4302453-b09b-4863-beb9-19a4f7a18037 req-0ddd66db-29bf-45ac-8a6f-e4527c3e2fec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.110869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.113207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.115086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.116295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.125323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b4302453-b09b-4863-beb9-19a4f7a18037 req-0ddd66db-29bf-45ac-8a6f-e4527c3e2fec service nova] Creating event network-vif-plugged:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:44:13.138891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b4302453-b09b-4863-beb9-19a4f7a18037 req-0ddd66db-29bf-45ac-8a6f-e4527c3e2fec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166734 Jul 28 11:44:13.144229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2044/4128] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:13.160477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1973e6ee-0881-44f2-b7fe-9465626435dd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:13.170754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1973e6ee-0881-44f2-b7fe-9465626435dd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:13.215158 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1960383-064c-4f21-b63b-7925f34db5eb tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.257022 Jul 28 11:44:13.223245 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2085/4129] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:44:12 2022] GET /compute/v2.1/servers => generated 1018 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:13.245942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43daa8aa-13ac-4d54-b48b-a4672cf2432f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:13.246768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43daa8aa-13ac-4d54-b48b-a4672cf2432f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:13.397745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1973e6ee-0881-44f2-b7fe-9465626435dd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:13.411622 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1973e6ee-0881-44f2-b7fe-9465626435dd tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1215 microversion: 2.1 time: 0.263027 Jul 28 11:44:13.413713 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2045/4130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:13 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:13.509462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0f998f81-8321-4872-b1d1-bdd8da87cf02 req-7e9becdb-f99e-4c0e-890c-da0cdf5dde15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973487fe-da17-4f60-bf87-e899efe54f37", "name": "network-vif-deleted", "tag": "707771e2-b2e9-48f0-b577-96a41c1edd38"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:13.537517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0f998f81-8321-4872-b1d1-bdd8da87cf02 req-7e9becdb-f99e-4c0e-890c-da0cdf5dde15 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.543344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0f998f81-8321-4872-b1d1-bdd8da87cf02 req-7e9becdb-f99e-4c0e-890c-da0cdf5dde15 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.581049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0f998f81-8321-4872-b1d1-bdd8da87cf02 req-7e9becdb-f99e-4c0e-890c-da0cdf5dde15 service nova] Creating event network-vif-deleted:707771e2-b2e9-48f0-b577-96a41c1edd38 for instance 973487fe-da17-4f60-bf87-e899efe54f37 on n-h2-851368-1 Jul 28 11:44:13.587493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43daa8aa-13ac-4d54-b48b-a4672cf2432f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:13.599012 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43daa8aa-13ac-4d54-b48b-a4672cf2432f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1223 microversion: 2.1 time: 0.367130 Jul 28 11:44:13.621078 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2086/4131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:13 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1223 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:13.625901 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0f998f81-8321-4872-b1d1-bdd8da87cf02 req-7e9becdb-f99e-4c0e-890c-da0cdf5dde15 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123792 Jul 28 11:44:13.636939 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2046/4132] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:13.837585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:13.838282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:13.860163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.862924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.866677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:13.868377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:13.975971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-58834287-de34-409a-b7a9-374b189a759c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b385e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:14.034688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:14.039201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:14.039913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'fault' on Instance uuid 973487fe-da17-4f60-bf87-e899efe54f37 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:44:14.090144 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-58834287-de34-409a-b7a9-374b189a759c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.123262 Jul 28 11:44:14.093168 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2047/4133] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:13 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:14.317769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:14.335742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3bf42f66-3467-4510-a8c0-891672d5a335 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 200 len: 1336 microversion: 2.1 time: 0.501459 Jul 28 11:44:14.340355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2087/4134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:13 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 1336 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:14.441572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:14.442501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:14.455896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:14.456366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:14.457627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:14.460292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:14.485828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:14.629187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0dbc236-4aea-48f5-99b9-e212a47b60ad tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:14.630022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0dbc236-4aea-48f5-99b9-e212a47b60ad tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:14.632282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:14.642561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84605613-b54b-4acb-8162-23db7d1563fc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1219 microversion: 2.1 time: 0.207674 Jul 28 11:44:14.643707 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2048/4135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:14 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:14.736483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0dbc236-4aea-48f5-99b9-e212a47b60ad tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:14.743809 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0dbc236-4aea-48f5-99b9-e212a47b60ad tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1223 microversion: 2.1 time: 0.120325 Jul 28 11:44:14.746252 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2088/4136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:14 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:15.111871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-444f660d-b26d-4a3a-979a-1c4b92685175 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb33e3550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:15.252065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-444f660d-b26d-4a3a-979a-1c4b92685175 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.148127 Jul 28 11:44:15.265029 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2049/4137] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:15 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:15.363692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:15.364433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 973487fe-da17-4f60-bf87-e899efe54f37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:15.387141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.387141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.387141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.387716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.454346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 HTTP/1.1 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '973487fe-da17-4f60-bf87-e899efe54f37'} Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:15.482133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. Jul 28 11:44:15.486295 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:15.491822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 404 to user: Instance 973487fe-da17-4f60-bf87-e899efe54f37 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:15.499528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e97d6327-09cd-4351-8f28-bc8d9a7b6ecc tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37" status: 404 len: 111 microversion: 2.1 time: 0.139472 Jul 28 11:44:15.512524 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2089/4138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:15 2022] GET /compute/v2.1/servers/973487fe-da17-4f60-bf87-e899efe54f37 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:15.517874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6bc2ddd4-681c-4c94-aeae-26582ef83428 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '.version_select at 0x7f2eb2c08c10>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:15.556339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5344022-90ae-46c7-af13-a9f01d00373a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:15.564844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5344022-90ae-46c7-af13-a9f01d00373a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.565298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5344022-90ae-46c7-af13-a9f01d00373a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.592748 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6bc2ddd4-681c-4c94-aeae-26582ef83428 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121217442" status: 202 len: 0 microversion: 2.1 time: 0.078777 Jul 28 11:44:15.596691 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2050/4139] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121217442 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:15.616780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5344022-90ae-46c7-af13-a9f01d00373a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:44:15.663819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:15.665460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:15.679212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.679994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.681551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.683610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.736921 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5344022-90ae-46c7-af13-a9f01d00373a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action" status: 202 len: 0 microversion: 2.1 time: 0.185478 Jul 28 11:44:15.750126 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2090/4140] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:15 2022] POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:44:15.757845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:15.759266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:15.767325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.768012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:15.769129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:15.769713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:16.089428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:16.111696 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe710d0e-d7ae-447c-9495-97511af9a51f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1275 microversion: 2.1 time: 0.451662 Jul 28 11:44:16.122626 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2051/4141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:15 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1275 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:16.140925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:16.141897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:16.153842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:16.190265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:16.190967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:16.197173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:16.199859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:16.326100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:16.358782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:16.366068 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-466081c7-0bbe-4be9-bd8d-88eeb551b22a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1275 microversion: 2.1 time: 0.241380 Jul 28 11:44:16.373517 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2052/4142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:16 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:16.374494 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d036263d-b266-4e06-bf70-677634f860c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.621225 Jul 28 11:44:16.379439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f33b6b66-4c5e-40fe-8bba-e95f558bbe4d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb29b4af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:16.380523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2091/4143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:15 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:16.484306 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f33b6b66-4c5e-40fe-8bba-e95f558bbe4d tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.108534 Jul 28 11:44:16.490672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2053/4144] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:16 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:17.140793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:17.141568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:17.157378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.159947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.161269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.168146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.397195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:17.398442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:17.409173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.418169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.419304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.422737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.654324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:17.662481 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f86ddec-8274-4c65-a252-4a364e2df734 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1273 microversion: 2.1 time: 0.526464 Jul 28 11:44:17.663064 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2092/4145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:17 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1273 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:17.707344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:17.710914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:17.728421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.737733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.739040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:17.739713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:17.911898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:17.920692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c6b6ca3-054d-42be-8fea-31c7f6814093 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1293 microversion: 2.1 time: 0.530468 Jul 28 11:44:17.936678 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2054/4146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:17 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1293 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:17.957808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf3175ae-133c-4c95-a4e1-43f41c086255 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2b98ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:18.073581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf3175ae-133c-4c95-a4e1-43f41c086255 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.135402 Jul 28 11:44:18.074721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2055/4147] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:17 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:18.693141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:18.694521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:18.709218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:18.710476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:18.713648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:18.714296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:18.935711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:18.953356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e95a3387-8d43-4822-91f9-709dfe4d7885 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1273 microversion: 2.1 time: 0.258617 Jul 28 11:44:18.953997 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2056/4148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:18 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:18.974453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:18.975118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:18.996700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:18.997165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:18.997965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:18.998410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:19.057758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:19.070397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52dcf47a-4e66-40bb-bc64-34bf3f201f8b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.380427 Jul 28 11:44:19.070993 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2093/4149] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:17 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:19.097918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2e7c8a7-f371-4334-8be2-7eb5f102c714 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b623a0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:19.156148 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2e7c8a7-f371-4334-8be2-7eb5f102c714 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.070260 Jul 28 11:44:19.157551 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2094/4150] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:19 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:19.981522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:19.982425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:19.995025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:19.999876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:20.001230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:20.001830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:20.037421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:20.046387 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a876ac2-5663-47a1-a07e-c1f984514579 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 1.090167 Jul 28 11:44:20.074112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2057/4151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:18 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:20.091852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:20.092479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:20.112538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:20.113675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:20.116229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:20.118002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:20.877089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:20.885032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a16572c2-3d55-4ba0-82a6-3df53e56e78e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 0.907699 Jul 28 11:44:20.891801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2095/4152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:19 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:20.913153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d5683f7-28f4-4af6-95f1-dfa5cad7740e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b41af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:20.988446 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d5683f7-28f4-4af6-95f1-dfa5cad7740e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.095127 Jul 28 11:44:21.008669 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2096/4153] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:20 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:21.078843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:21.079857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:21.088313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:21.107009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:21.108400 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5fcf916-caca-453d-b55a-53e81d8acafe tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.020364 Jul 28 11:44:21.110018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2058/4154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:20 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:21.110759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:21.114388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:21.115112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:21.662330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:21.672819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8987e4bc-3465-4e23-ad17-5b04786f8241 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.598648 Jul 28 11:44:21.676426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2097/4155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:21 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:21.917039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:21.917965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:21.940868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:21.941546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:21.945014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:21.945472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:22.023056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e97ad897-4cc9-476c-a76d-83810e36a6fe tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1bb8310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:22.123521 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e97ad897-4cc9-476c-a76d-83810e36a6fe tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.104316 Jul 28 11:44:22.124291 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2098/4156] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:22 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:22.146790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:22.147594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:22.183144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:22.185281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:22.192938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:22.195810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:22.718172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:23.138745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:23.403319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:23.746644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:23.761358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96615759-f5af-40a1-9539-3eda5ce9b9d7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.625870 Jul 28 11:44:23.762199 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2099/4157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:22 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:23.779143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:23.780525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:23.799149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:23.803012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:23.808762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:23.810010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:23.868247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:23.882518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f855ec40-079f-4c9c-aab6-dd90de3ce4b1 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 1.967353 Jul 28 11:44:23.891633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2059/4158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:21 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:23.916293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dbe8f90f-2d60-4c53-a571-e1812d9fed98 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb2488e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:23.999437 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dbe8f90f-2d60-4c53-a571-e1812d9fed98 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.106579 Jul 28 11:44:24.001470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2060/4159] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:23 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:24.280008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:24.307677 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-63ae0a96-4200-4245-8659-c22e6a2c0169 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.542361 Jul 28 11:44:24.308905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2100/4160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:23 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:24.340689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-918612de-8f65-4c67-a4bc-7fc092a44111 req-c6b0bfca-bfdb-40a5-b7c2-365e41f4a7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ce33a9-ccf5-4fcb-bade-58039ff587b0", "tag": "f7255663-125a-40c1-88ce-14e82c444a95"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:24.363003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-918612de-8f65-4c67-a4bc-7fc092a44111 req-c6b0bfca-bfdb-40a5-b7c2-365e41f4a7ac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:24.373625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-918612de-8f65-4c67-a4bc-7fc092a44111 req-c6b0bfca-bfdb-40a5-b7c2-365e41f4a7ac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:24.419688 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-918612de-8f65-4c67-a4bc-7fc092a44111 req-c6b0bfca-bfdb-40a5-b7c2-365e41f4a7ac service nova] Creating event network-changed:f7255663-125a-40c1-88ce-14e82c444a95 for instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 on n-h2-851368-1 Jul 28 11:44:24.438861 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-918612de-8f65-4c67-a4bc-7fc092a44111 req-c6b0bfca-bfdb-40a5-b7c2-365e41f4a7ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102125 Jul 28 11:44:24.440564 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2061/4161] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:24.785951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:24.787186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:24.813965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:24.825809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:24.829924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:24.840406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:24.842840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:24.911309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:24.912845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:24.937950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:24.938560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:24.944661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:24.945187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:26.015254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:26.026228 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd71c634-0f09-4943-8f7d-0b3ba2fb6875 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 1.121482 Jul 28 11:44:26.032728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:26.042884 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5a026471-b7d4-4192-af78-38824936c7ee tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.263561 Jul 28 11:44:26.043275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2062/4162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:24 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:26.053358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2101/4163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:24 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:26.059324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-20ebb1d4-75c8-4d1a-9405-79f2093bab01 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb249f670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:26.072999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:26.075225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:26.092984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:26.093857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:26.095732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:26.098229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:26.182766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-20ebb1d4-75c8-4d1a-9405-79f2093bab01 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.134319 Jul 28 11:44:26.184234 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2063/4164] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:26 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:26.552455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-70fa895b-d91c-4e8a-ad72-aa186dd14627 req-543cd294-425a-4ece-85a3-9fc21f9e173b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25650d83-6efb-4497-9007-2e6b5df3d4dd", "tag": "f43ff568-d383-43e4-abcf-3205a7556787"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:26.594123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-70fa895b-d91c-4e8a-ad72-aa186dd14627 req-543cd294-425a-4ece-85a3-9fc21f9e173b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:26.594592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-70fa895b-d91c-4e8a-ad72-aa186dd14627 req-543cd294-425a-4ece-85a3-9fc21f9e173b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:26.663167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-70fa895b-d91c-4e8a-ad72-aa186dd14627 req-543cd294-425a-4ece-85a3-9fc21f9e173b service nova] Creating event network-changed:f43ff568-d383-43e4-abcf-3205a7556787 for instance 25650d83-6efb-4497-9007-2e6b5df3d4dd on n-h2-851368-1 Jul 28 11:44:26.676093 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-70fa895b-d91c-4e8a-ad72-aa186dd14627 req-543cd294-425a-4ece-85a3-9fc21f9e173b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128989 Jul 28 11:44:26.680575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2064/4165] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:26.823165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:26.832067 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4344d912-534a-4cba-ad93-19d4f5d64da6 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.776873 Jul 28 11:44:26.840544 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2102/4166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:26 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:27.051672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:27.052390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:27.068235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:27.068847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:27.092385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:27.092953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:27.093517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:27.094368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:27.095339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:27.096177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:27.105289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:27.106063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:27.174954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:28.145566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:28.157380 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-032decd6-d225-4069-8d8b-8603708fc619 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.093007 Jul 28 11:44:28.160982 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2103/4167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:27 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:28.167861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-11a3dd81-59a1-46a4-8ea9-2417281aae03 req-68735eb2-74a0-4a21-a5a6-7539d5b98a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5207346b-c70f-4b27-a8da-c4613c4e66c4", "tag": "f2666c9d-edb9-4a71-b075-dcb62fa6fc41"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:28.226985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-11a3dd81-59a1-46a4-8ea9-2417281aae03 req-68735eb2-74a0-4a21-a5a6-7539d5b98a84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:28.228631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-11a3dd81-59a1-46a4-8ea9-2417281aae03 req-68735eb2-74a0-4a21-a5a6-7539d5b98a84 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:28.283675 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-11a3dd81-59a1-46a4-8ea9-2417281aae03 req-68735eb2-74a0-4a21-a5a6-7539d5b98a84 service nova] Creating event network-changed:f2666c9d-edb9-4a71-b075-dcb62fa6fc41 for instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 on n-h1-851368-1 Jul 28 11:44:28.302882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:28.305009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-11a3dd81-59a1-46a4-8ea9-2417281aae03 req-68735eb2-74a0-4a21-a5a6-7539d5b98a84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134901 Jul 28 11:44:28.308769 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2104/4168] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:28.320558 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a07a9981-2a34-467c-add9-028c13713463 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 1.275120 Jul 28 11:44:28.321221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2065/4169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:27 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:28.328056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d93a6414-69ab-4a3f-93fd-65f9c2628048 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb249d820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:28.339286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:28.340308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:28.387049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:28.391192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:28.392124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:28.408002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:28.440411 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d93a6414-69ab-4a3f-93fd-65f9c2628048 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.129995 Jul 28 11:44:28.448225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2105/4170] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:28 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:28.920962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:28.935084 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3e19bf1d-c398-43a3-9015-41db017dee66 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.610685 Jul 28 11:44:28.938162 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2066/4171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:28 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:29.181430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:29.183356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:29.193885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:29.194673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:29.196207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:29.196848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:29.346846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:29.349747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:29.379240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:29.379698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:29.380496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:29.380933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:30.241841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:30.269582 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f2ae929-f63f-4e10-9306-ea8a5547a2bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.075960 Jul 28 11:44:30.270612 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2106/4172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:29 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:30.275818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7a4e992-69aa-4efd-8b35-efff2781a2e4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b75d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:30.792037 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7a4e992-69aa-4efd-8b35-efff2781a2e4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.520196 Jul 28 11:44:30.792929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2107/4173] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:30 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:30.804044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:30.812819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:30.860044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:30.863546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:30.864405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:30.871733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:31.495093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:31.505241 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0535bc2d-c67e-4dd7-b12c-ed10a22b6ef8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 2.166979 Jul 28 11:44:31.507641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2067/4174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:29 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:31.528507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-debbf375-d8d0-485d-a4f6-2ec9a43b49ab req-c071de82-1987-4c04-a6bd-3c630b024d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0addb529-a482-40df-9266-03fed40edeb5", "tag": "a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:31.553926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-debbf375-d8d0-485d-a4f6-2ec9a43b49ab req-c071de82-1987-4c04-a6bd-3c630b024d1e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:31.554593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-debbf375-d8d0-485d-a4f6-2ec9a43b49ab req-c071de82-1987-4c04-a6bd-3c630b024d1e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:31.589241 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-debbf375-d8d0-485d-a4f6-2ec9a43b49ab req-c071de82-1987-4c04-a6bd-3c630b024d1e service nova] Creating event network-changed:a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42 for instance 0addb529-a482-40df-9266-03fed40edeb5 on n-h2-851368-1 Jul 28 11:44:31.596479 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-debbf375-d8d0-485d-a4f6-2ec9a43b49ab req-c071de82-1987-4c04-a6bd-3c630b024d1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085243 Jul 28 11:44:31.605645 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2068/4175] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:31.621816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:31.622622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:31.643569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:31.644029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:31.644816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:31.645257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.063060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:32.072890 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc83c7b0-d5a7-4953-8799-b809318ee3cf tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 1.277572 Jul 28 11:44:32.077095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2108/4176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:30 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:32.085430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8dbb7b10-6feb-4f78-a1d9-3906ec79136c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b80a60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:32.144070 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8dbb7b10-6feb-4f78-a1d9-3906ec79136c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.063840 Jul 28 11:44:32.152853 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2109/4177] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:32 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:32.406050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:32.406562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:32.423532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.424032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.424863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.425298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.482113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:32.787693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:32.803775 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4607bb2-48e0-4967-9d29-0995744995a7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.192001 Jul 28 11:44:32.808184 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2069/4178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:31 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:32.824121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:32.824997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:32.836589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19892091-7a8b-4447-8cbd-d3d42f0e935d tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 204 len: 0 microversion: 2.1 time: 0.436730 Jul 28 11:44:32.837755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2110/4179] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:32 2022] DELETE /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:32.842661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.843367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.844355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.844954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.851624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:32.852494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:32.871746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.873373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:32.874303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:32.878970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:33.282069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:33.290379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:33.298283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa4c613c-7b91-46d5-8c20-3681718c80ac tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1509 microversion: 2.1 time: 0.455889 Jul 28 11:44:33.298943 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2111/4180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:32 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:33.299765 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4fd8e90c-5cae-418d-b4af-16f1118b7ac8 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 0.488907 Jul 28 11:44:33.304457 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2070/4181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:32 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:33.314404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87c3686a-ee3e-4f01-a60d-36917fd282dc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb289fa60>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:33.319873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:33.320709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:33.330121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:33.330769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:33.331744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:33.332340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:33.403488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87c3686a-ee3e-4f01-a60d-36917fd282dc tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.097664 Jul 28 11:44:33.404384 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2071/4182] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:33 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:33.824572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:33.825340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:33.836941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:33.837764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:33.838539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:33.838966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:34.366947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:34.385124 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1add2b63-7c25-4625-9119-d4dd20e32e21 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 1.063744 Jul 28 11:44:34.389324 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2112/4183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:33 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:34.397383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:34.404231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:34.413118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:34.413786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:34.414736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:34.416230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:34.643476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:34.661810 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a47ca1f-28ed-4cad-be58-7aee0c29be79 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.840200 Jul 28 11:44:34.668275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2072/4184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:33 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:34.680037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:34.688865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:34.710229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:34.714949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:34.716219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:34.720796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.074709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:35.083580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c2591f81-4454-40d3-a935-37025db58a3c tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1509 microversion: 2.1 time: 0.691755 Jul 28 11:44:35.084177 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2113/4185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:34 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:35.092212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5b07008-a127-430f-a001-f19acc76a9f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b80ee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:35.217008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e5b07008-a127-430f-a001-f19acc76a9f1 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.128508 Jul 28 11:44:35.219356 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2114/4186] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:35 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:35.378690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:35.383667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:35.409253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:35.409882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:35.422351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:35.422790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24dad673-85d9-41b4-a4e2-3d29ecab8507 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 0.744918 Jul 28 11:44:35.425756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.426839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2073/4187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:34 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:35.428848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:35.429315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.466298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-abb90c13-0431-4a67-af88-e60c890b6a6c req-f712159f-9caf-4349-9842-5200ea69bec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25650d83-6efb-4497-9007-2e6b5df3d4dd", "name": "network-vif-plugged", "status": "completed", "tag": "f43ff568-d383-43e4-abcf-3205a7556787"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:35.498785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-abb90c13-0431-4a67-af88-e60c890b6a6c req-f712159f-9caf-4349-9842-5200ea69bec3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:35.503768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-abb90c13-0431-4a67-af88-e60c890b6a6c req-f712159f-9caf-4349-9842-5200ea69bec3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.530301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-abb90c13-0431-4a67-af88-e60c890b6a6c req-f712159f-9caf-4349-9842-5200ea69bec3 service nova] Creating event network-vif-plugged:f43ff568-d383-43e4-abcf-3205a7556787 for instance 25650d83-6efb-4497-9007-2e6b5df3d4dd on n-h2-851368-1 Jul 28 11:44:35.541547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-abb90c13-0431-4a67-af88-e60c890b6a6c req-f712159f-9caf-4349-9842-5200ea69bec3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087600 Jul 28 11:44:35.551851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2074/4188] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:35.689094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:35.689817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:35.697354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:35.703028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.704004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:35.704464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:35.904363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:35.913737 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6fa8ead9-d02c-448c-9b0f-1d9432d5953c tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.508483 Jul 28 11:44:35.919657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2115/4189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:35 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:36.106138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:36.110726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:36.124415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.125225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.126277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.128142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.171736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:36.183029 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7192890-7cd6-47a0-ace5-b9736e5ce220 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.498317 Jul 28 11:44:36.196630 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2075/4190] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:35 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:36.234458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bcf1fd8-31f4-470f-99ad-31a796502ae3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb29b4af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:36.339158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0bcf1fd8-31f4-470f-99ad-31a796502ae3 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.109987 Jul 28 11:44:36.351479 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2076/4191] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:36 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:36.447185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:36.448693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:36.468885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.477301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.484726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.486228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.765310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:36.782344 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1aa2ca2d-5c6b-441c-81ed-1ab490680b84 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1509 microversion: 2.1 time: 0.678908 Jul 28 11:44:36.782968 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2116/4192] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:36 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1509 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:36.924288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:36.939758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:36.940384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:36.950517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.953011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.958155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:36.959785 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65f51435-fc29-4a94-aeff-49dc69522b88 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 0.517927 Jul 28 11:44:36.961377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:36.962602 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2077/4193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:36 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:37.220617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:37.221605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:37.244704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:37.245376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:37.250696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:37.251624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:37.776003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:37.784942 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b4c9eae-842a-4c5f-a304-d3507d25a3d3 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1323 microversion: 2.1 time: 0.848898 Jul 28 11:44:37.795803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2117/4194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:36 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1323 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:37.799162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc3421ba-af39-40e9-8eac-c69d85a2df5e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b678b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:37.918981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc3421ba-af39-40e9-8eac-c69d85a2df5e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.125267 Jul 28 11:44:37.920194 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2118/4195] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:37 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:37.934267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ce33a9-ccf5-4fcb-bade-58039ff587b0", "name": "network-vif-plugged", "status": "completed", "tag": "f7255663-125a-40c1-88ce-14e82c444a95"}, {"server_uuid": "5207346b-c70f-4b27-a8da-c4613c4e66c4", "name": "network-vif-plugged", "status": "completed", "tag": "f2666c9d-edb9-4a71-b075-dcb62fa6fc41"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:37.968557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:37.970483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.006149 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] Creating event network-vif-plugged:f7255663-125a-40c1-88ce-14e82c444a95 for instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 on n-h2-851368-1 Jul 28 11:44:38.006981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] Creating event network-vif-plugged:f2666c9d-edb9-4a71-b075-dcb62fa6fc41 for instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 on n-h1-851368-1 Jul 28 11:44:38.026758 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ec2c925e-d735-4e39-8cca-f0b73fcf5356 req-6fe5afb1-8419-437b-8015-91223af8fc14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105158 Jul 28 11:44:38.029108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2119/4196] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:38.046858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:38.048941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:38.072547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.073809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.074921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.076706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.324468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:38.358438 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5a1be68-9742-4863-824e-b2e3e370ce72 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 200 len: 1467 microversion: 2.1 time: 0.326282 Jul 28 11:44:38.362402 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2120/4197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:38 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:38.382259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:38.389350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:38.413283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.413769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.414567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.420887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.427925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:38.462894 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37f0c2de-0de1-43c6-9ee3-fe97c69df9f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 1.248238 Jul 28 11:44:38.468271 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2078/4198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:37 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:38.488615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3663a655-e7f9-4fd1-8e10-8d7e4570018a req-a4a51803-1c34-4788-931b-b6a0451690d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7713992f-bcca-49f0-ab20-ce960564cd34", "name": "network-vif-deleted", "tag": "b624c477-b32a-4fe7-976e-9ab87b211f25"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:38.532330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3663a655-e7f9-4fd1-8e10-8d7e4570018a req-a4a51803-1c34-4788-931b-b6a0451690d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.532800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3663a655-e7f9-4fd1-8e10-8d7e4570018a req-a4a51803-1c34-4788-931b-b6a0451690d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.554367 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3663a655-e7f9-4fd1-8e10-8d7e4570018a req-a4a51803-1c34-4788-931b-b6a0451690d0 service nova] Creating event network-vif-deleted:b624c477-b32a-4fe7-976e-9ab87b211f25 for instance 7713992f-bcca-49f0-ab20-ce960564cd34 on n-h2-851368-1 Jul 28 11:44:38.564148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3663a655-e7f9-4fd1-8e10-8d7e4570018a req-a4a51803-1c34-4788-931b-b6a0451690d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094246 Jul 28 11:44:38.572590 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2079/4199] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:38.812109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:38.812848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:38.821756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.822226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:38.823021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:38.834498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.254279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:39.262614 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-63def077-cf10-4cc6-bcf6-cde1f1312467 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1315 microversion: 2.1 time: 0.896975 Jul 28 11:44:39.267421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2121/4200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:38 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:39.280884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-896b3c83-1594-4d10-a990-b7ff60f0477c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b69af0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.333140 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-896b3c83-1594-4d10-a990-b7ff60f0477c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.064549 Jul 28 11:44:39.334013 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2122/4201] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:39 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:39.348611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:39.357328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45779162-335b-4fc4-8dda-b3054e54db38 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1517 microversion: 2.1 time: 0.551952 Jul 28 11:44:39.383633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2080/4202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:38 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1517 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:39.386566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.387386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 7713992f-bcca-49f0-ab20-ce960564cd34] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:39.399180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.400520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.400902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.401660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:39.405263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.405945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.411009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.413657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.414589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.417822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.442290 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 HTTP/1.1 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7713992f-bcca-49f0-ab20-ce960564cd34'} Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:39.444209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:39.448337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 404 to user: Instance 7713992f-bcca-49f0-ab20-ce960564cd34 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:39.451542 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1346f26e-158c-4e1c-8f36-8809b0a17734 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34" status: 404 len: 111 microversion: 2.1 time: 0.069616 Jul 28 11:44:39.454950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2123/4203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:39 2022] GET /compute/v2.1/servers/7713992f-bcca-49f0-ab20-ce960564cd34 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:44:39.460138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.460646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:39.474751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.475240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.480762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.481384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.545325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:39.632243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:39.650661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:39.670598 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0529d73-ebd4-4061-99a3-525b45143c74 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 204 len: 0 microversion: 2.1 time: 0.213866 Jul 28 11:44:39.674299 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2124/4204] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:39 2022] DELETE /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:39.681792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.682798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:39.691368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.691936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.692906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.693452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.770160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:39.779920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5bb465fa-33cc-4230-b96a-6a13385c9273 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1323 microversion: 2.1 time: 0.383681 Jul 28 11:44:39.795478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2081/4205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:39 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:39.810166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:39.811019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:39.826086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.826530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:39.830526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:39.830989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.025206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:40.035589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49bfb559-b0b1-419c-9013-da8b1276c7a8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.362391 Jul 28 11:44:40.040334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2125/4206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:39 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:40.122677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:40.133250 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e685a1d4-a2a0-41d3-80ff-3a23310f5031 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.336527 Jul 28 11:44:40.145893 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2082/4207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:39 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:40.292473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:40.293009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:40.301414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.302152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.303135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.303729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.349580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89a449ca-222d-4799-85fa-5078e1e15bf0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb314b430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:40.425264 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89a449ca-222d-4799-85fa-5078e1e15bf0 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1427 microversion: 2.1 time: 0.079865 Jul 28 11:44:40.426115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2083/4208] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:40 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:40.596574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:40.612073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-538a805f-57c2-477d-bdda-de6500729845 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1502 microversion: 2.1 time: 0.318302 Jul 28 11:44:40.615922 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2126/4209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:40 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:40.643238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:40.644511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:40.661596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.667045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.671162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.672576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.791233 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9ddd88e-4201-4675-ac0a-d2e15293452a tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0/action" status: 202 len: 0 microversion: 2.1 time: 0.152874 Jul 28 11:44:40.793140 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2084/4210] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:40 2022] POST /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:40.800568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:40.801409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:40.820387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.820886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.824223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.824698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.831021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:40.833207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:40.850935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.851639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:40.854112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:40.854627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:41.320836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:41.343283 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59e0f00e-995e-43c9-853d-b896df1571b8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1323 microversion: 2.1 time: 0.547060 Jul 28 11:44:41.351942 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2127/4211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:40 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:41.355489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:41.356353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:41.357150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:41.366180 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f23611d-053d-43e0-81be-45ca0aa1f5be tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1507 microversion: 2.1 time: 0.553569 Jul 28 11:44:41.366602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:41.366842 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2085/4212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:40 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:41.367891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:41.369404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:41.369967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:41.377099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:41.377704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:41.393607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:41.394282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:41.395287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:41.396158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:42.138875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:42.150615 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3cd3d0cd-663c-4ae0-abd2-3646ac7c787b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.804734 Jul 28 11:44:42.155210 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2128/4213] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:41 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:42.160853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b9a6e4f-a568-4c9b-a9b3-3145f3b6f208 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1b5d8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:42.177067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:42.185955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfc94428-73f6-4a5d-adf9-4a2aabe7c08f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.812614 Jul 28 11:44:42.186536 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2086/4214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:41 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:42.199022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e14f3898-6ab9-4476-862a-7c95dd062c6f req-654edb20-13f9-421c-a0ae-2c8624d12c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0addb529-a482-40df-9266-03fed40edeb5", "name": "network-vif-plugged", "status": "completed", "tag": "a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:42.211916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e14f3898-6ab9-4476-862a-7c95dd062c6f req-654edb20-13f9-421c-a0ae-2c8624d12c5f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:42.212888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e14f3898-6ab9-4476-862a-7c95dd062c6f req-654edb20-13f9-421c-a0ae-2c8624d12c5f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:42.224975 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e14f3898-6ab9-4476-862a-7c95dd062c6f req-654edb20-13f9-421c-a0ae-2c8624d12c5f service nova] Creating event network-vif-plugged:a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42 for instance 0addb529-a482-40df-9266-03fed40edeb5 on n-h2-851368-1 Jul 28 11:44:42.230534 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e14f3898-6ab9-4476-862a-7c95dd062c6f req-654edb20-13f9-421c-a0ae-2c8624d12c5f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039925 Jul 28 11:44:42.231838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2087/4215] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:42.250406 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7b9a6e4f-a568-4c9b-a9b3-3145f3b6f208 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1436 microversion: 2.1 time: 0.093325 Jul 28 11:44:42.260614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2129/4216] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:42 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1436 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:42.266268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12815143-d2d8-439d-befc-059818e0aea6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb289f280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:42.337688 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12815143-d2d8-439d-befc-059818e0aea6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 200 len: 1436 microversion: 2.1 time: 0.075859 Jul 28 11:44:42.338611 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2088/4217] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Jul 28 11:44:42 2022] GET /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 1436 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:42.354015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:42.355504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:42.365593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:42.366395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:42.367452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:42.369223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:42.370719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:42.371555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:42.383274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:42.385818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:42.387876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:42.389166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.019052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:43.033395 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-140403ed-6050-4b44-96bf-af781e76e3bd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1323 microversion: 2.1 time: 0.669271 Jul 28 11:44:43.037632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2089/4218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:42 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:43.057958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:43.058870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:43.078284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.084583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.092128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.092818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.156246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:43.164270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d7bb927-e5a9-41e3-af1d-f5ee63b20dc6 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1479 microversion: 2.1 time: 0.814781 Jul 28 11:44:43.165137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2130/4219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:42 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1479 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:43.185637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:43.186632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:43.192756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.193292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.200901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.201848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.627485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:43.640352 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe70b357-e371-4c33-a335-cf3c05fb15ed tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1487 microversion: 2.1 time: 0.601377 Jul 28 11:44:43.641298 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2090/4220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:43 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1487 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:43.646430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:43.654430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:43.666045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.672969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.674223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.675241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.815548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:43.830451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70bf6df8-7e11-454d-b4e0-37f983243bc7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1722 microversion: 2.1 time: 0.653489 Jul 28 11:44:43.837061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2131/4221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:43 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:43.852558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:43.853567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:43.861032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.861828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.862971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:43.863695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:43.893391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lazy-loading 'flavor' on Instance uuid 52ce33a9-ccf5-4fcb-bade-58039ff587b0 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:44:44.089188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:44.100114 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81efbcf8-e137-4c32-8140-f3337236df81 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.456973 Jul 28 11:44:44.101528 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2091/4222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:43 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:44.109297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.110456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.117613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.118308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.119950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.120550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.167934 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51a2da8c-636b-4c35-bc17-8ee6930e5764 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0/action" status: 202 len: 0 microversion: 2.1 time: 0.327532 Jul 28 11:44:44.171128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2132/4223] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:43 2022] POST /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:44.183922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.184712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.192615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.194056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.194942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.195868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.348051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:44.359521 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7612ba55-77af-4f6c-a0d1-d1a6b8804166 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1516 microversion: 2.1 time: 0.256474 Jul 28 11:44:44.360142 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2092/4224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:44.370977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.372151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.378851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.379113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:44.379743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.380528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.381013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.401712 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bce927b-5dcb-4f5c-8f28-5845a09b3005 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1493 microversion: 2.1 time: 0.225677 Jul 28 11:44:44.402224 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2133/4225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:44.410410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.411032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.425196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.425648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.426437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.426872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.593483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:44.601083 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2721a693-77a2-4850-97a2-427fdf9f985c tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1479 microversion: 2.1 time: 0.235989 Jul 28 11:44:44.615374 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2093/4226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1479 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:44.622448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:44.630052 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-362594b0-cb1c-4bdd-991d-5e3c2da1c774 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 200 len: 1517 microversion: 2.1 time: 0.226568 Jul 28 11:44:44.630834 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2134/4227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:44.650488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.651063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.658216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.658606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.659592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.660090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.683682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:44.693916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:44.798205 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f18add8d-b290-43d2-bfb6-21a5441ea072 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 204 len: 0 microversion: 2.1 time: 0.150718 Jul 28 11:44:44.803551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2094/4228] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:44 2022] DELETE /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:44:44.807590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.807988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.816409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.817590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.818542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.819212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.855458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:44.856626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:44.865568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.866264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:44.867643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:44.868439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.125099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:45.135375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4924c53e-7698-4b84-a973-d9f54cb38036 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 200 len: 1523 microversion: 2.1 time: 0.330890 Jul 28 11:44:45.136636 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2135/4229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:45.148487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:45.149452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:45.161282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.162148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.163800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.164601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.235860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:45.244988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a709c6d-fb05-4092-809e-821c8d1db0e9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1699 microversion: 2.1 time: 0.395414 Jul 28 11:44:45.261643 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2095/4230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:44 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1699 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:45.267207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1a84e12-678a-48af-a3f8-8a102f580184 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:45.282272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a84e12-678a-48af-a3f8-8a102f580184 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.283137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a84e12-678a-48af-a3f8-8a102f580184 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.316380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1a84e12-678a-48af-a3f8-8a102f580184 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Going to try to start instance {{(pid=119236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 11:44:45.397195 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1a84e12-678a-48af-a3f8-8a102f580184 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action" status: 202 len: 0 microversion: 2.1 time: 0.134137 Jul 28 11:44:45.398484 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2096/4231] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:44:45 2022] POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:45.411258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:45.413204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:45.423649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.424439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.425321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.425805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.689544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:45.698229 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2938e97-fe62-44c7-85aa-1d2ad8425046 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1522 microversion: 2.1 time: 0.559863 Jul 28 11:44:45.708950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2136/4232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:45 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:45.717673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:45.718510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:45.729389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:45.731670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.740121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.744544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.747240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.749032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f9e4c55-d85c-4012-81d7-496283de6c0d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1708 microversion: 2.1 time: 0.344889 Jul 28 11:44:45.759702 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2097/4233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:45 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1708 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:45.779109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:45.779774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:45.795437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.796547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:45.798035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:45.798035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.231838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:46.246402 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4f36f20-6e94-45e1-a1ec-d56fd1e9a6e4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1514 microversion: 2.1 time: 0.534555 Jul 28 11:44:46.248893 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2137/4234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:45 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1514 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:46.258493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:46.266308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-db16e6d0-1f48-4eae-91c3-c8f4498f31b6 req-b3fe774a-4650-4005-adfb-5ba3342a171d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81709a7c-41ea-4c87-82ac-2e64604a82ea", "name": "network-vif-deleted", "tag": "9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:46.268221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e4fa5ee-ac6d-41b1-9e83-6ef5931c96d4 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1466 microversion: 2.1 time: 0.507247 Jul 28 11:44:46.269957 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2098/4235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:45 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1466 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:46.275732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:46.277183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:46.280573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:46.282991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-db16e6d0-1f48-4eae-91c3-c8f4498f31b6 req-b3fe774a-4650-4005-adfb-5ba3342a171d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.285886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.286020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-db16e6d0-1f48-4eae-91c3-c8f4498f31b6 req-b3fe774a-4650-4005-adfb-5ba3342a171d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.286695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.287730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.295558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.323812 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-db16e6d0-1f48-4eae-91c3-c8f4498f31b6 req-b3fe774a-4650-4005-adfb-5ba3342a171d service nova] Creating event network-vif-deleted:9f523fec-0c3e-4bc5-8e5c-fca324ae6b9a for instance 81709a7c-41ea-4c87-82ac-2e64604a82ea on n-h1-851368-1 Jul 28 11:44:46.338412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-db16e6d0-1f48-4eae-91c3-c8f4498f31b6 req-b3fe774a-4650-4005-adfb-5ba3342a171d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085493 Jul 28 11:44:46.339657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2138/4236] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:46.348846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d758f91a-449a-4388-908e-17edbe9be41e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2eb1afe4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:46.469347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:46.478708 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c58ff711-06cb-4e39-b562-b82ca40f6e9a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 200 len: 1523 microversion: 2.1 time: 0.207483 Jul 28 11:44:46.480096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2099/4237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:46 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:46.731699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:46.732991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:46.748384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.750800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.751804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.754782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.827104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:46.827532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:46.828183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lazy-loading 'fault' on Instance uuid 81709a7c-41ea-4c87-82ac-2e64604a82ea {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:44:47.023270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6648280a4851ac6428027a0414fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca9223e0d984405b7343af9fb32a118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:47.037277 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f0f5d86-b263-49a6-819e-c1f834aabb5f tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 200 len: 1312 microversion: 2.1 time: 0.311165 Jul 28 11:44:47.055058 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2100/4238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:46 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:47.066329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:47.069316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:47.086236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.087022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.090515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.091322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.189287 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d758f91a-449a-4388-908e-17edbe9be41e tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "DELETE /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77" status: 204 len: 0 microversion: 2.1 time: 0.847198 Jul 28 11:44:47.191603 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2139/4239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:46 2022] DELETE /compute/v2.1/images/b9ab1a12-71a9-48b3-aa14-a4ae1ff46b77 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:47.199435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81b3e4a8-291a-4ffb-bd06-99125ded093b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '.version_select at 0x7f2ebbea9e50>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:47.229585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-81b3e4a8-291a-4ffb-bd06-99125ded093b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] HTTP exception thrown: Image not found. Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81b3e4a8-291a-4ffb-bd06-99125ded093b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Request method failure captured: Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 HTTP/1.1 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nZICOtc7fco0H7TtYQBEeFmtySsvrluGpp4IUjfqI1dOc3o-pJdoWHTgYRJhGXGXHuU9hwre6bTdpoicM1FSwdv3jpqWIlj8dp5XH4MG3ofitwaODOE0ApaEzBqW8u9ehnlaqllyaaaVOaPVyH44qbUQlCk-NC2KRX2LNJjS6zmAv8 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_549d2e4844204083816889d0c08cf6a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}] Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e9c8592d2d464a4890d000151507738d Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: exception: Image not found. Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7e077367-ca30-437e-9b91-114cf0110455'} Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7e077367-ca30-437e-9b91-114cf0110455 to delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e077367-ca30-437e-9b91-114cf0110455 could not be found. Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.231774 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 11:44:47.235855 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:47.240172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81b3e4a8-291a-4ffb-bd06-99125ded093b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Returning 404 to user: Image not found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:47.243051 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81b3e4a8-291a-4ffb-bd06-99125ded093b tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "DELETE /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455" status: 404 len: 62 microversion: 2.1 time: 0.048058 Jul 28 11:44:47.247914 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2140/4240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:47 2022] DELETE /compute/v2.1/images/7e077367-ca30-437e-9b91-114cf0110455 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 11:44:47.256431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:47.257341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:47.266623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.267536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.268534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.269199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.299521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:47.301786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:47.314528 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89010a0f-1dc3-4c67-8343-fb9b697f05e2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1708 microversion: 2.1 time: 0.257628 Jul 28 11:44:47.315598 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2101/4241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:47 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1708 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:47.329804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:47.331760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:47.342768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.343356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.344352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.344799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.372351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:47.442062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05e9d070-f395-456f-99d3-08a9464bc404 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "DELETE /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 204 len: 0 microversion: 2.1 time: 0.192541 Jul 28 11:44:47.442783 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2141/4242] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:47 2022] DELETE /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:47.455447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:47.456889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:47.464985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.465624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.467469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:47.470727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:47.973789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:47.996692 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ccba4faf-8745-451c-abca-3ca00038a222 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1472 microversion: 2.1 time: 0.546111 Jul 28 11:44:47.997352 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2142/4243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:47 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1472 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:44:48.032556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:48.034196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:48.077336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.078141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:48.079575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.080343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:48.186183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:48.205016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-728b33b4-e48d-4c97-9d19-a725b31bbeab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1514 microversion: 2.1 time: 0.888293 Jul 28 11:44:48.205688 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2102/4244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:47 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1514 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:48.210581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:48.211379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] [instance: 81709a7c-41ea-4c87-82ac-2e64604a82ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:48.261130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.261591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:48.263373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.263829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:48.309374 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] HTTP exception thrown: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Request method failure captured: Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea HTTP/1.1 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nVkF07E5wxTCDErnpHKcKkRrNJB9bIhLvCnvPFGlgx493O1r4HIY75NbE1CSSFU9Ae92A80vSDFNOMeao5NewqlVacywjmHIck-V57i4swIeRcJi51w75szds_d164dh7GSi2GbnZFtrPxJsqJ1ViAMPvPlE-l9W9d4DPJvlcEo6Z4 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca9223e0d984405b7343af9fb32a118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca9223e0d984405b7343af9fb32a118"}]}] Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1ca9223e0d984405b7343af9fb32a118 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1084137004 Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: dc8e6648280a4851ac6428027a0414fe Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1084137004-project Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '81709a7c-41ea-4c87-82ac-2e64604a82ea'} Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:48.318752 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:48.323789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] Returning 404 to user: Instance 81709a7c-41ea-4c87-82ac-2e64604a82ea could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:48.332135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c66388e-5971-4855-b01f-66093da8e852 tempest-ServerRescueNegativeTestJSON-1084137004 tempest-ServerRescueNegativeTestJSON-1084137004-project] 10.222.0.93 "GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea" status: 404 len: 111 microversion: 2.1 time: 0.125198 Jul 28 11:44:48.333256 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2103/4245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:48 2022] GET /compute/v2.1/servers/81709a7c-41ea-4c87-82ac-2e64604a82ea => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:48.345473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:48.347201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:48.366162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.367634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:48.368735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:48.381454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.183930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:49.192018 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-083c091d-76ad-4916-98ba-a6bbf5f2fe3f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 200 len: 1481 microversion: 2.1 time: 1.191518 Jul 28 11:44:49.194569 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2143/4246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:47 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 1481 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:49.206586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-bf6ec407-e5bf-4c09-8f7b-d5dc817c0599 req-13e43323-b378-41b4-8b51-dbbc2ea2b3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0addb529-a482-40df-9266-03fed40edeb5", "name": "network-vif-deleted", "tag": "a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:49.227915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bf6ec407-e5bf-4c09-8f7b-d5dc817c0599 req-13e43323-b378-41b4-8b51-dbbc2ea2b3fb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:49.228641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bf6ec407-e5bf-4c09-8f7b-d5dc817c0599 req-13e43323-b378-41b4-8b51-dbbc2ea2b3fb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.254723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-bf6ec407-e5bf-4c09-8f7b-d5dc817c0599 req-13e43323-b378-41b4-8b51-dbbc2ea2b3fb service nova] Creating event network-vif-deleted:a4fd7ce1-b8dc-4dc2-a903-7a3b9d296e42 for instance 0addb529-a482-40df-9266-03fed40edeb5 on n-h2-851368-1 Jul 28 11:44:49.264436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-bf6ec407-e5bf-4c09-8f7b-d5dc817c0599 req-13e43323-b378-41b4-8b51-dbbc2ea2b3fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062243 Jul 28 11:44:49.265360 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2144/4247] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:49.276438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:49.277444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:49.295236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:49.295935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.296879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:49.297509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.595977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:49.616929 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c778c819-5c5e-4a2c-a0bb-ffaa3e6c634f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1708 microversion: 2.1 time: 1.276450 Jul 28 11:44:49.618094 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2104/4248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:48 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1708 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:49.628166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:49.628981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:49.647283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:49.649650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.653510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:49.656233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:49.958020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:49.967568 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7f9d0d9-a96b-4495-9490-892249f7d2ba tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1472 microversion: 2.1 time: 0.700804 Jul 28 11:44:49.972768 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2145/4249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:49 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1472 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:49.977703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-406b5be3-59c5-43c5-a6ac-64619d3b0087 req-5e89fe80-ce1a-4537-9461-73604c77cb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-unplugged", "status": "completed", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:50.021738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-406b5be3-59c5-43c5-a6ac-64619d3b0087 req-5e89fe80-ce1a-4537-9461-73604c77cb42 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.022358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-406b5be3-59c5-43c5-a6ac-64619d3b0087 req-5e89fe80-ce1a-4537-9461-73604c77cb42 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.048551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-406b5be3-59c5-43c5-a6ac-64619d3b0087 req-5e89fe80-ce1a-4537-9461-73604c77cb42 service nova] Creating event network-vif-unplugged:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:44:50.060548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-406b5be3-59c5-43c5-a6ac-64619d3b0087 req-5e89fe80-ce1a-4537-9461-73604c77cb42 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086210 Jul 28 11:44:50.064643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2146/4250] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:50.217792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:50.218506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:50.236003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.244420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.248788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.249249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.297709 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] HTTP exception thrown: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 HTTP/1.1 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0addb529-a482-40df-9266-03fed40edeb5'} Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:50.307107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:50.311419 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.314205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 404 to user: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:50.315784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8df74d44-e21e-4ec1-a25e-67aa1e7812cd tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 404 len: 111 microversion: 2.1 time: 0.103532 Jul 28 11:44:50.319858 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2147/4251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:50 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:44:50.337023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:50.342174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:50.343100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:50.370252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.370703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.371647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.372090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.588375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1933ad2-51da-4e7d-acef-7eb27fc4c94f tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.262333 Jul 28 11:44:50.593418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2148/4252] 10.222.0.93 () {58 vars in 1230 bytes} [Thu Jul 28 11:44:50 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:44:50.613251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffa81dd4-5e28-489e-88bd-28df91283d80 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffa81dd4-5e28-489e-88bd-28df91283d80 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: action_args: {} Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 11:44:50.624801 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 11:44:50.630473 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:50.638510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffa81dd4-5e28-489e-88bd-28df91283d80 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:50.640625 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffa81dd4-5e28-489e-88bd-28df91283d80 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.038010 Jul 28 11:44:50.642829 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2149/4253] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Jul 28 11:44:50 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:44:50.660235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:50.660887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:50.679514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.680139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.681156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:50.681939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:50.949636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:50.966202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a221f81-b367-46eb-a40b-1cd7b9579abb tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 1.345623 Jul 28 11:44:50.988671 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2105/4254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:49 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:51.003963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.010379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.022090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:51.028038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.028490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.029297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.031292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.090840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:44:51.113103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.122332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-117e1729-a8f7-4f83-9c2f-a788ca92fd8a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1712 microversion: 2.1 time: 0.478154 Jul 28 11:44:51.122915 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2150/4255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:50 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1712 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:51.152873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.153507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:51.177012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.177477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.180877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.182708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.190221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37e3a695-c67c-418a-9853-eac20630cd8b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.199846 Jul 28 11:44:51.192400 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2106/4256] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:44:50 2022] GET /compute/v2.1/servers => generated 683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:51.202954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.221179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.225893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.servers [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Removing options 'limit' from query {{(pid=119236) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 11:44:51.231541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:51.260114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.260842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.261851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.262836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.342639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:44:51.390141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc6127d3-c425-41e1-8236-68b1da29b509 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.190943 Jul 28 11:44:51.391351 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2107/4257] 10.222.0.93 () {58 vars in 1144 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:51.407312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247dac91-1226-44ac-9952-6e997a912c4b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247dac91-1226-44ac-9952-6e997a912c4b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '-1' Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 11:44:51.413656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 11:44:51.417530 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.422877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-247dac91-1226-44ac-9952-6e997a912c4b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:51.424519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-247dac91-1226-44ac-9952-6e997a912c4b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024853 Jul 28 11:44:51.425880 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2108/4258] 10.222.0.93 () {58 vars in 1142 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:44:51.444028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-645bb2ac-3a39-4d5d-a0f2-ca12febdb985 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-645bb2ac-3a39-4d5d-a0f2-ca12febdb985 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: action_args: {} Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'testing' Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 11:44:51.450347 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 11:44:51.460974 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:44:51.464301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-645bb2ac-3a39-4d5d-a0f2-ca12febdb985 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:51.465456 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-645bb2ac-3a39-4d5d-a0f2-ca12febdb985 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.032096 Jul 28 11:44:51.466243 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2109/4259] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:44:51.477202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5873f1f2-323a-45e0-998b-33e8c799a281 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.483188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5873f1f2-323a-45e0-998b-33e8c799a281 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.484230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5873f1f2-323a-45e0-998b-33e8c799a281 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:51.491707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.servers [None req-5873f1f2-323a-45e0-998b-33e8c799a281 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Flavor 'non_existing_flavor' could not be found {{(pid=119236) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 28 11:44:51.494652 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5873f1f2-323a-45e0-998b-33e8c799a281 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.022675 Jul 28 11:44:51.496363 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2110/4260] 10.222.0.93 () {58 vars in 1178 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:44:51.513357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:51.529872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.530666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:51.541163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.541613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.542417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.549358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.865738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8592d2d464a4890d000151507738d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549d2e4844204083816889d0c08cf6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:51.871205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:51.885216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1dc4e02-5ffd-4f62-91c0-fa5489974f29 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 200 len: 1472 microversion: 2.1 time: 0.736778 Jul 28 11:44:51.886355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2151/4261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 1472 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:51.911378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3344a857-38e8-4619-b9f9-ee110e3fd5e6 req-320b8d1e-1c65-4599-bc5e-ac1490d3447e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d66e2-facb-45f4-bb76-c7b6808f717e", "name": "network-vif-deleted", "tag": "b93fe000-384e-4986-9635-bf014977e366"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:51.945190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3344a857-38e8-4619-b9f9-ee110e3fd5e6 req-320b8d1e-1c65-4599-bc5e-ac1490d3447e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:51.956925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3344a857-38e8-4619-b9f9-ee110e3fd5e6 req-320b8d1e-1c65-4599-bc5e-ac1490d3447e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:51.969646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1936e8f-8876-478c-8c72-5534916c6022 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.465090 Jul 28 11:44:51.970964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2111/4262] 10.222.0.93 () {58 vars in 1174 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:44:52.007469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:52.022434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:52.031457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3344a857-38e8-4619-b9f9-ee110e3fd5e6 req-320b8d1e-1c65-4599-bc5e-ac1490d3447e service nova] Creating event network-vif-deleted:b93fe000-384e-4986-9635-bf014977e366 for instance 258d66e2-facb-45f4-bb76-c7b6808f717e on n-h1-851368-1 Jul 28 11:44:52.035406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:52.046235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3344a857-38e8-4619-b9f9-ee110e3fd5e6 req-320b8d1e-1c65-4599-bc5e-ac1490d3447e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158139 Jul 28 11:44:52.046873 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2152/4263] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:52.064079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:52.066630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:52.069054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.073586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.075965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.080802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.085535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.088033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.090693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.091588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.488945 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc58a353-66d9-429f-ab45-92d1ebf931f8 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.499532 Jul 28 11:44:52.500636 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2112/4264] 10.222.0.93 () {58 vars in 1184 bytes} [Thu Jul 28 11:44:51 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:44:52.511384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9f4a4392-e263-4275-bb8f-f6b378f199f0 req-3d59522c-c2d5-4663-b41e-52f3d9213a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ce33a9-ccf5-4fcb-bade-58039ff587b0", "name": "network-vif-plugged", "status": "completed", "tag": "f7255663-125a-40c1-88ce-14e82c444a95"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:52.548405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9f4a4392-e263-4275-bb8f-f6b378f199f0 req-3d59522c-c2d5-4663-b41e-52f3d9213a22 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.548864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9f4a4392-e263-4275-bb8f-f6b378f199f0 req-3d59522c-c2d5-4663-b41e-52f3d9213a22 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.594791 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9f4a4392-e263-4275-bb8f-f6b378f199f0 req-3d59522c-c2d5-4663-b41e-52f3d9213a22 service nova] Creating event network-vif-plugged:f7255663-125a-40c1-88ce-14e82c444a95 for instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 on n-h2-851368-1 Jul 28 11:44:52.610663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9f4a4392-e263-4275-bb8f-f6b378f199f0 req-3d59522c-c2d5-4663-b41e-52f3d9213a22 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108660 Jul 28 11:44:52.619489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2113/4265] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:52.643225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:52.659306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:52.661461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:52.677269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.678791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.685123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.685788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.783039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:52.788883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:44:52.832449 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-414921fa-ef50-490e-bcdc-6b265c5a821f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.780025 Jul 28 11:44:52.833334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2153/4266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:52 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:52.884438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:52.899181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.901511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.908337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:52.908971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] [instance: 258d66e2-facb-45f4-bb76-c7b6808f717e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:52.920346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.920812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.929612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:52.930396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:52.980464 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] HTTP exception thrown: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Request method failure captured: Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e HTTP/1.1 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nZICOtc7fco0H7TtYQBEeFmtySsvrluGpp4IUjfqI1dOc3o-pJdoWHTgYRJhGXGXHuU9hwre6bTdpoicM1FSwdv3jpqWIlj8dp5XH4MG3ofitwaODOE0ApaEzBqW8u9ehnlaqllyaaaVOaPVyH44qbUQlCk-NC2KRX2LNJjS6zmAv8 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/549d2e4844204083816889d0c08cf6a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_549d2e4844204083816889d0c08cf6a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/549d2e4844204083816889d0c08cf6a8"}]}] Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 549d2e4844204083816889d0c08cf6a8 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-940971750 Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e9c8592d2d464a4890d000151507738d Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ImagesOneServerTestJSON-940971750-project Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '258d66e2-facb-45f4-bb76-c7b6808f717e'} Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:52.982533 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. Jul 28 11:44:52.986222 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:52.994336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] Returning 404 to user: Instance 258d66e2-facb-45f4-bb76-c7b6808f717e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:52.995740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4e3c3b2-55d9-42fa-93ca-bf4303b28046 tempest-ImagesOneServerTestJSON-940971750 tempest-ImagesOneServerTestJSON-940971750-project] 10.222.0.93 "GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e" status: 404 len: 111 microversion: 2.1 time: 0.092280 Jul 28 11:44:53.008513 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2154/4267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:52 2022] GET /compute/v2.1/servers/258d66e2-facb-45f4-bb76-c7b6808f717e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:53.228061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2db04e32-b69a-4b19-abcf-db5a15589134 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.606565 Jul 28 11:44:53.230225 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2114/4268] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:44:52 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:53.254991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1070d45-ed5d-4793-9781-a6fa8fd5e20d tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.260590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e1070d45-ed5d-4793-9781-a6fa8fd5e20d tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:53.265440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1070d45-ed5d-4793-9781-a6fa8fd5e20d tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.015934 Jul 28 11:44:53.269480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2155/4269] 10.222.0.93 () {58 vars in 1178 bytes} [Thu Jul 28 11:44:53 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:44:53.284724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.289960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:53.294916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Searching by: {'deleted': False, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:44:53.301713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.309993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.311319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.311976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.372652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:44:53.443783 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-402d5b7c-6bdf-4135-8478-e61bcc50c833 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.163117 Jul 28 11:44:53.447427 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2115/4270] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:44:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:53.459245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.459980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:53.475746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.476196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.482677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.483038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.521654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] HTTP exception thrown: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 HTTP/1.1 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0addb529-a482-40df-9266-03fed40edeb5'} Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:53.527906 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:53.531689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:53.535763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 404 to user: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:53.539719 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-910545dc-104a-48d4-ae0a-9e6ee576204b tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 404 len: 111 microversion: 2.1 time: 0.084943 Jul 28 11:44:53.544784 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2156/4271] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:53 2022] DELETE /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:53.549299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.549932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:53.565193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.565667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.567108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.567547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.634449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:53.811279 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d8f4948-41ca-4e28-9d80-92d007570610 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 204 len: 0 microversion: 2.1 time: 0.264491 Jul 28 11:44:53.816216 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2116/4272] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:53 2022] DELETE /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:44:53.822621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.823466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:53.834407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.835251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.836699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.838063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.854363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:53.855379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:53.865505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.867294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.870072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:53.870719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:53.897614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:44:54.092310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5a53225-f9fa-4ded-a9f7-2b7819a3c312 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "DELETE /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 204 len: 0 microversion: 2.1 time: 0.274026 Jul 28 11:44:54.094733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2157/4273] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:44:53 2022] DELETE /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:44:54.116051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:54.116936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 0addb529-a482-40df-9266-03fed40edeb5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:54.129829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:54.130445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:54.131710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:54.132368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:54.183184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] HTTP exception thrown: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 HTTP/1.1 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0addb529-a482-40df-9266-03fed40edeb5'} Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:54.189325 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 404 to user: Instance 0addb529-a482-40df-9266-03fed40edeb5 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:54.192903 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95f43739-4bef-45f2-9344-cac2a5ea88f4 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5" status: 404 len: 111 microversion: 2.1 time: 0.090516 Jul 28 11:44:54.195358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2158/4274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:54 2022] GET /compute/v2.1/servers/0addb529-a482-40df-9266-03fed40edeb5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:54.214421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:54.219009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:54.242900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:54.244336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:54.249226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:54.252945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:55.038902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:55.048266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2564c90b-c0af-4d5a-9395-9aa5afe66095 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 1.198124 Jul 28 11:44:55.052085 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2117/4275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:53 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:55.153037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:55.170925 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3370d1dd-cd2d-4e34-9159-20c99e1473e0 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1522 microversion: 2.1 time: 0.970319 Jul 28 11:44:55.176571 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2159/4276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:54 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1522 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:56.072997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:56.074112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:56.090617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:56.092196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:56.094588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:56.095988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:56.203284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:56.204824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:56.229919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:56.231415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:56.233674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:56.235998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:56.745859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:56.760927 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb2606e9-1bd9-458c-b34b-67a7785939c9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.690504 Jul 28 11:44:56.763180 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2118/4277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:56 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:56.897136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a2e058a4-2fa5-4aff-ab4d-43ee9c9b4fcf tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2ebbeb9f70>, body: {"keypair": {"name": "tempest-keypair-789148794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Oyc5nEoyjS1JwcjGP1lEP3+ygeTaXvphe3HoQyIm1EBG4CvKwHnA70uibhM046klH6U+DtG7qdx6/M/Bqf9am0Mu5u97v4tHB632tuuopmaSwfWtIsQt6t1uvzYiLMw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:56.946192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a2e058a4-2fa5-4aff-ab4d-43ee9c9b4fcf tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:56.958682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a2e058a4-2fa5-4aff-ab4d-43ee9c9b4fcf tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:57.148504 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a2e058a4-2fa5-4aff-ab4d-43ee9c9b4fcf tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.378995 Jul 28 11:44:57.151849 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2119/4278] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:57.175375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a30d81af-ab25-468b-a620-c1e21dd133e8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2ebbe57ca0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:57.195204 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a30d81af-ab25-468b-a620-c1e21dd133e8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-789148794" status: 200 len: 497 microversion: 2.1 time: 0.034260 Jul 28 11:44:57.196483 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2120/4279] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Jul 28 11:44:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-789148794 => generated 497 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:44:57.210114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d26bebf9-f57f-476e-b7e2-fc25fe38cc23 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2ebbe57d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:57.398363 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d26bebf9-f57f-476e-b7e2-fc25fe38cc23 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789148794" status: 202 len: 0 microversion: 2.1 time: 0.194486 Jul 28 11:44:57.400134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2121/4280] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789148794 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:44:57.408606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1a76b372-5aa5-4121-8581-a132289a406f req-9c70aa78-4acd-44ed-8d51-e9faaef89128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5207346b-c70f-4b27-a8da-c4613c4e66c4", "name": "network-vif-deleted", "tag": "f2666c9d-edb9-4a71-b075-dcb62fa6fc41"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:57.430045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:57.437044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1a76b372-5aa5-4121-8581-a132289a406f req-9c70aa78-4acd-44ed-8d51-e9faaef89128 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:57.443004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1a76b372-5aa5-4121-8581-a132289a406f req-9c70aa78-4acd-44ed-8d51-e9faaef89128 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:57.460652 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c8483ef-784c-427e-a439-e2b48ac30211 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 200 len: 1522 microversion: 2.1 time: 1.246394 Jul 28 11:44:57.462893 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2160/4281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:56 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 1522 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:57.488166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee81813f-65b1-47e9-a52b-660c6baadf03 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2eb24d14c0>, body: {"keypair": {"name": "tempest-keypair-649737301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVn3Dkzl+DOf/w3Jy/9c9nFIYAqaE6UP/fe13cOoo1FVLtA+ZYpV2UsDYz2KO8hlDJcE6Qeb0d939fXnmeg3eyQgGjUGoOyzY8B/ndwOfpYDOZxPWikEk7hgzgLRWpDXQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:57.494561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1a76b372-5aa5-4121-8581-a132289a406f req-9c70aa78-4acd-44ed-8d51-e9faaef89128 service nova] Creating event network-vif-deleted:f2666c9d-edb9-4a71-b075-dcb62fa6fc41 for instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 on n-h1-851368-1 Jul 28 11:44:57.520617 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1a76b372-5aa5-4121-8581-a132289a406f req-9c70aa78-4acd-44ed-8d51-e9faaef89128 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113216 Jul 28 11:44:57.523289 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2122/4282] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:57.544672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ee81813f-65b1-47e9-a52b-660c6baadf03 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:57.562252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-ee81813f-65b1-47e9-a52b-660c6baadf03 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:57.616836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee81813f-65b1-47e9-a52b-660c6baadf03 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150600 Jul 28 11:44:57.618884 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2161/4283] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:57.628435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ccca194b-5abc-44c9-bdd5-7e958d6ffe22 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2ebbf011f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:57.683640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ccca194b-5abc-44c9-bdd5-7e958d6ffe22 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649737301" status: 202 len: 0 microversion: 2.1 time: 0.059273 Jul 28 11:44:57.685489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2123/4284] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649737301 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:44:57.697860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-408bea14-51e6-48f3-9c58-3add21be1f8e tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2eb21e08b0>, body: {"keypair": {"name": "tempest-keypair-1548648870", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:57.737448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-408bea14-51e6-48f3-9c58-3add21be1f8e tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:57.750874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-408bea14-51e6-48f3-9c58-3add21be1f8e tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:57.767057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:44:57.783917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:57.784672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:57.798476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:57.799130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:57.802300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:57.803913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:57.804499 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-408bea14-51e6-48f3-9c58-3add21be1f8e tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.112044 Jul 28 11:44:57.811496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2162/4285] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:57 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:57.834358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abcde622-dbb8-4b38-8dcf-da5c9df4fcca tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2eb23a80d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:57.874409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abcde622-dbb8-4b38-8dcf-da5c9df4fcca tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548648870" status: 202 len: 0 microversion: 2.1 time: 0.060432 Jul 28 11:44:57.886132 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2163/4286] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548648870 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:57.896605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f2d39cbf-625e-4449-9356-c19486e258c8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2eb24851f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-887131124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3Q9buI3OkCHiEwkHIP/6c+QBkIMJucVBxIeZqqiPtWCnaf+f7QctBZtHd1fGgsI3CfECj2BVvY/cLxR+9HOcT+BxtKYEjbW70Ndt6GnFFZB+39UlZFFnHTb3MPUtSYlA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:57.942992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f2d39cbf-625e-4449-9356-c19486e258c8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:57.976859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f2d39cbf-625e-4449-9356-c19486e258c8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:58.044529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f2d39cbf-625e-4449-9356-c19486e258c8 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.157208 Jul 28 11:44:58.045152 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2164/4287] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:58.059162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a01bb92-8a02-4ccc-8a82-e3e4bd41ee4d tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2eb23a8a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1898472015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp/NuJu8W+lPhcHKwwWuJidK3KZT5R74GSNzh6n5nGMMGq2H4b2UHcJH1MrmslluH+mIJa1d0MWkJryGYDhL7+LnSnpasNZTlE55N5Os966UfTq5wr2PQo/+RL2PfSOyw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:58.085653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7a01bb92-8a02-4ccc-8a82-e3e4bd41ee4d tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:58.093485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7a01bb92-8a02-4ccc-8a82-e3e4bd41ee4d tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:58.139185 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a01bb92-8a02-4ccc-8a82-e3e4bd41ee4d tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.084867 Jul 28 11:44:58.149104 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2165/4288] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:58.156522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d78864cf-9030-4d13-985b-75298eee3c02 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Action: 'create', calling method: .version_select at 0x7f2eb21e0d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-532510162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoHj0vKM4ITVd3wd0ZwGigYH8iVL0sQUAPK9Rs01Fr9C1TSZFarFvpviz5IdrfHzf44wwwEXVlkpp58nGMeXn1Dp9v4iv4XROTiS0T8pJD5QdtHMKfszIIEXat50lxI0g=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:58.176920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d78864cf-9030-4d13-985b-75298eee3c02 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:44:58.184171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d78864cf-9030-4d13-985b-75298eee3c02 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Getting quotas for user d1206482115845d8beaab91f5021baea and project 526ea0ff80854d1085b16d9b2119498c. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:44:58.218321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d78864cf-9030-4d13-985b-75298eee3c02 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.066561 Jul 28 11:44:58.219685 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2166/4289] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:44:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:58.233197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-408c216f-53a4-4aef-beb6-a4515a83fb3f tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2eb23ecf70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.238847 n-d-851368-1 devstack@n-api.service[119235]: WARNING oslo_db.sqlalchemy.utils [None req-408c216f-53a4-4aef-beb6-a4515a83fb3f tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:44:58.256976 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-408c216f-53a4-4aef-beb6-a4515a83fb3f tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.030680 Jul 28 11:44:58.257832 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2167/4290] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:44:58 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:58.272170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-859203c6-76f7-43c7-94a8-75edde0e2bda tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2eb1afe0d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.326175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-859203c6-76f7-43c7-94a8-75edde0e2bda tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-532510162" status: 202 len: 0 microversion: 2.1 time: 0.057775 Jul 28 11:44:58.326759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2168/4291] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-532510162 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:58.335696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31be250a-a1b1-4174-9430-ff8ba7b33dea tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2eb1c6da60>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.383595 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31be250a-a1b1-4174-9430-ff8ba7b33dea tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1898472015" status: 202 len: 0 microversion: 2.1 time: 0.051197 Jul 28 11:44:58.384966 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2169/4292] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Jul 28 11:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1898472015 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:58.394145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-210a8f63-68f4-4e53-ba92-50c6563873c4 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] Calling method '.version_select at 0x7f2eb2344550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.456789 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-210a8f63-68f4-4e53-ba92-50c6563873c4 tempest-KeyPairsV2TestJSON-367893646 tempest-KeyPairsV2TestJSON-367893646-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-887131124" status: 202 len: 0 microversion: 2.1 time: 0.067670 Jul 28 11:44:58.459334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2170/4293] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-887131124 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:44:58.485641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.486563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 5207346b-c70f-4b27-a8da-c4613c4e66c4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:58.501728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:58.503990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:58.506281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:58.507831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:58.548034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] HTTP exception thrown: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 HTTP/1.1 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5207346b-c70f-4b27-a8da-c4613c4e66c4'} Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:58.550757 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. Jul 28 11:44:58.555187 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:58.562013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 404 to user: Instance 5207346b-c70f-4b27-a8da-c4613c4e66c4 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:58.567984 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb414bbc-cd5b-40ed-a36b-bf64a32c2a51 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4" status: 404 len: 111 microversion: 2.1 time: 0.084663 Jul 28 11:44:58.571869 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2171/4294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:58 2022] GET /compute/v2.1/servers/5207346b-c70f-4b27-a8da-c4613c4e66c4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:44:58.577092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:58.577964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:58.588842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:58.589616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:58.590753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:58.592537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:58.642776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:58.643461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:58.644336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lazy-loading 'fault' on Instance uuid 25650d83-6efb-4497-9007-2e6b5df3d4dd {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:44:58.648387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:58.678738 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-857f6b82-f745-46c5-9a1a-2c61e5724fab tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.897297 Jul 28 11:44:58.681850 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2124/4295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:57 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:58.801029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747e8fe4f9f4ae3aba6c8206af87921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90ec29b5cd34e56898bf4f5bbf630fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:44:58.810260 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffce3e6d-357b-4113-91c1-5b7711f9161a tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 200 len: 1313 microversion: 2.1 time: 0.235803 Jul 28 11:44:58.813274 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2172/4296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:58 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:44:59.709901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:59.711276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:59.765972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:59.767553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:59.772903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:59.775524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:59.789161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f557c920-936a-4259-b3b3-d0a5404d1633 req-17eb5bc7-1edb-4064-9319-7fdc6d42dc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25650d83-6efb-4497-9007-2e6b5df3d4dd", "name": "network-vif-deleted", "tag": "f43ff568-d383-43e4-abcf-3205a7556787"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:44:59.811113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f557c920-936a-4259-b3b3-d0a5404d1633 req-17eb5bc7-1edb-4064-9319-7fdc6d42dc07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:59.811629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f557c920-936a-4259-b3b3-d0a5404d1633 req-17eb5bc7-1edb-4064-9319-7fdc6d42dc07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:59.835912 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f557c920-936a-4259-b3b3-d0a5404d1633 req-17eb5bc7-1edb-4064-9319-7fdc6d42dc07 service nova] Creating event network-vif-deleted:f43ff568-d383-43e4-abcf-3205a7556787 for instance 25650d83-6efb-4497-9007-2e6b5df3d4dd on n-h2-851368-1 Jul 28 11:44:59.850247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f557c920-936a-4259-b3b3-d0a5404d1633 req-17eb5bc7-1edb-4064-9319-7fdc6d42dc07 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064860 Jul 28 11:44:59.852010 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2173/4297] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:44:59.860007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:44:59.860723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] [instance: 25650d83-6efb-4497-9007-2e6b5df3d4dd] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:44:59.885092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:59.885595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:59.886423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:44:59.886879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:44:59.920282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] HTTP exception thrown: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Request method failure captured: Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd HTTP/1.1 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4naJqBPbICnp6OEnZtC8lJiggwXCeVNVT-MRoVPY5LdktbSFHFD-gHNBm22J63ASCsgLtJh0tgdp24phHORWUxwkgtYbo0txShAmFjWCw2rdbwBoK8dwnr5oqJvJV-FacjWJ1_XwrZX3ZXt8BURJunTPfoH_TiM6hjMWJ1VacFIuJvs Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c90ec29b5cd34e56898bf4f5bbf630fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c90ec29b5cd34e56898bf4f5bbf630fb"}]}] Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: c90ec29b5cd34e56898bf4f5bbf630fb Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-50940542 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 0747e8fe4f9f4ae3aba6c8206af87921 Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ListServersNegativeTestJSON-50940542-project Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '25650d83-6efb-4497-9007-2e6b5df3d4dd'} Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:44:59.931110 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] Returning 404 to user: Instance 25650d83-6efb-4497-9007-2e6b5df3d4dd could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:44:59.936034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cee63863-ed68-4de9-a498-6644bcf40897 tempest-ListServersNegativeTestJSON-50940542 tempest-ListServersNegativeTestJSON-50940542-project] 10.222.0.93 "GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd" status: 404 len: 111 microversion: 2.1 time: 0.076804 Jul 28 11:44:59.945190 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2174/4298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:59 2022] GET /compute/v2.1/servers/25650d83-6efb-4497-9007-2e6b5df3d4dd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:45:00.247723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:00.256752 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6be4fb37-aa0e-442d-bd81-97c9e1090165 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.557591 Jul 28 11:45:00.261033 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2125/4299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:44:59 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:01.284415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:01.286066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:01.291679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:01.310660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:01.311600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:01.314758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:01.315485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:01.393269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:02.055436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:02.071655 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3241beff-978b-4960-848a-c1d486593928 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.790322 Jul 28 11:45:02.074095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2175/4300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:01 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:03.097522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:03.098853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:03.123746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:03.124471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:03.125438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:03.128585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:03.319182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:03.794380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:03.813279 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0c880ca-4d44-4ab2-a0c0-2c1df6376443 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.718730 Jul 28 11:45:03.824649 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2126/4301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:03 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:04.719940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1227387183", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:04.817722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:45:04.818163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:45:04.824593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:45:04.825116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:45:04.828167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:45:04.848042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:04.849865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:04.872391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:04.872528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:04.874032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:04.876113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:04.877751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:04.880958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:04.882021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:04.882499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:04.928323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Getting quotas for project ee878bdb457a4708bfdaa673ba26e94c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:45:04.941007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Getting quotas for user 7fde932d3c094630a9295dc3d72e55be and project ee878bdb457a4708bfdaa673ba26e94c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:45:04.960041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:45:04.974833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:45:05.089803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1bcea93-50a9-4e1a-b3c6-671a82d781ba tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.043292 Jul 28 11:45:05.101946 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2176/4302] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:45:05.112089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:05.117508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:05.273691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:05.273691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:05.273691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:05.273691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62a7e781-3674-4bf4-a100-18ea3ba89403 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1278 microversion: 2.57 time: 0.168466 Jul 28 11:45:05.275695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2177/4303] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:05 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:05.325694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:05.360620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4e679bb-257d-40ad-ab5e-9c91825eb919 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.516450 Jul 28 11:45:05.361348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2127/4304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:04 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:06.327957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:06.328508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:06.354476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:06.354982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:06.360784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:06.363904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:06.382980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:06.384396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:06.403519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:06.403990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:06.422420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:06.426476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:06.671372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:06.688045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:06.692880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:06.697132 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b42c5995-1110-4835-80fd-f5ca46645776 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1282 microversion: 2.57 time: 0.372818 Jul 28 11:45:06.698449 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2178/4305] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:06 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:06.986918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:07.216366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:07.229092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c93e92a-0d8b-45bf-86ae-5a6585a33b9b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.846809 Jul 28 11:45:07.231866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2128/4306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:06 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:07.722376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:07.723540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:07.742200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:07.742646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:07.744141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:07.744731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:08.253009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:08.253627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:08.261776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:08.262230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:08.263012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:08.263536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:08.314260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:08.333294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:08.348766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:08.361360 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd8b68d5-9992-4c15-a1e9-d142b5b00e54 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1336 microversion: 2.57 time: 0.639389 Jul 28 11:45:08.362658 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2179/4307] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:07 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1336 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:08.960366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:08.976678 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b073bf60-0c7b-4e34-8f35-ac4ae7380460 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.727472 Jul 28 11:45:08.978009 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2129/4308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:08 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:09.389959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:09.390579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:09.398263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:09.399522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:09.400501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:09.401702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:09.798161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:09.807675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:09.815232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:09.816615 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd65a441-13aa-4cca-96dc-486d89b95f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1336 microversion: 2.57 time: 0.430754 Jul 28 11:45:09.820038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2180/4309] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:09 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1336 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:09.999970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:10.000675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:10.013895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:10.023884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:10.025749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:10.027743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:10.642145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:10.653249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-357d6e9f-8c5c-467a-bac8-9e1f1d322ae6 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.658428 Jul 28 11:45:10.656525 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2130/4310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:09 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:10.842998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:10.844302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:10.859265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:10.859970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:10.860958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:10.864541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.033079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:11.050187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:11.054247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:11.060691 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4a94abb5-3916-42f6-9332-f07d14666f8c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1357 microversion: 2.57 time: 0.217462 Jul 28 11:45:11.062049 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2181/4311] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:10 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:11.091469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:11.097886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:11.130493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.131329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.132512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.133101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.292516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:11.310968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:45:11.311787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:45:11.312472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:45:11.313105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:45:11.313733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:45:11.424839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:11.449764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.450842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.452780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.454015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.525022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d2e1733-70b9-40b2-9bed-d5e8b22ed95d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "POST /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a/action" status: 202 len: 1138 microversion: 2.57 time: 0.440035 Jul 28 11:45:11.526611 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2131/4312] 10.222.0.93 () {62 vars in 1320 bytes} [Thu Jul 28 11:45:11 2022] POST /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a/action => generated 1138 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 11:45:11.547832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:11.548465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:11.558579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.558706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.563337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.564043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.677222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:11.678172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:11.693170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.693736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:11.694639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:11.695245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:12.024606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:12.037008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:12.042231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:12.043918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f4c2466-09f0-43e1-924f-d4535e1d2a80 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.500019 Jul 28 11:45:12.045679 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2182/4313] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:11 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:12.470507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:12.494952 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c22481d-a53f-4b50-8947-af10b149ca94 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.821553 Jul 28 11:45:12.505431 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2132/4314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:11 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:13.081588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:13.082758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:13.101224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:13.106569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:13.107940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:13.115460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:13.118957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:13.373763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:13.386391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:13.387909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:13.402426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f87faf1-1e18-4460-8d2d-29317375f770 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.318969 Jul 28 11:45:13.416154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2183/4315] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:13 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:13.530884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:13.532176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:13.552352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:13.553070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:13.558974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:13.560541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:14.132979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:14.144654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b966bf93-713d-4eb6-a3a3-59084ce16590 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1509 microversion: 2.1 time: 0.618020 Jul 28 11:45:14.145733 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2133/4316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:13 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1509 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:14.429969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:14.431766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:14.447392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:14.449054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:14.452042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:14.453315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:14.750085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:14.767245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:14.772700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:14.777189 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee86ec8f-c33b-4761-8355-a9c9455311f1 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.351356 Jul 28 11:45:14.780106 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2184/4317] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:14 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:15.172136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:15.172826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:15.189050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:15.189578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:15.190420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:15.190860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:15.802017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:15.802659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:15.805511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:15.806238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=28 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:15.827185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:15.827811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:15.831491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:15.832124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:16.241216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:16.254041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:16.256604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:16.258988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d658c42-b391-46d7-aeae-a96bccca9286 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.460652 Jul 28 11:45:16.261451 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2185/4318] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:15 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:16.528646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:16.541534 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fb4c011-e70c-48aa-b951-a967a69dd119 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1506 microversion: 2.1 time: 1.373026 Jul 28 11:45:16.542175 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2134/4319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:15 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1506 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:17.290607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:17.292010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:17.301958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:17.302716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:17.304218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:17.304808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:17.448457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:17.458688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:17.464847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:17.466079 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6a93954-68b4-4242-b2ae-0ef1f068cd7a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.182369 Jul 28 11:45:17.466648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2186/4320] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:17 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:17.565394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:17.568013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:17.588591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:17.593883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:17.596383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:17.598968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:17.602424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:17.711232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6752896b-a813-4bca-ac8b-9137132f70bb req-ac6d0eca-b80a-4d7e-b18c-b5a52b00b4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ce33a9-ccf5-4fcb-bade-58039ff587b0", "name": "network-vif-unplugged", "status": "completed", "tag": "f7255663-125a-40c1-88ce-14e82c444a95"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:17.730211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6752896b-a813-4bca-ac8b-9137132f70bb req-ac6d0eca-b80a-4d7e-b18c-b5a52b00b4fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:17.731120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6752896b-a813-4bca-ac8b-9137132f70bb req-ac6d0eca-b80a-4d7e-b18c-b5a52b00b4fd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:17.763564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6752896b-a813-4bca-ac8b-9137132f70bb req-ac6d0eca-b80a-4d7e-b18c-b5a52b00b4fd service nova] Creating event network-vif-unplugged:f7255663-125a-40c1-88ce-14e82c444a95 for instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 on n-h2-851368-1 Jul 28 11:45:17.777172 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6752896b-a813-4bca-ac8b-9137132f70bb req-ac6d0eca-b80a-4d7e-b18c-b5a52b00b4fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069741 Jul 28 11:45:17.782616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2187/4321] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:18.445137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:18.467452 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-367af269-4535-46ad-9598-da9365a2bb1c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1506 microversion: 2.1 time: 0.907041 Jul 28 11:45:18.495063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:18.496428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:18.498447 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2135/4322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:17 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1506 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:18.512588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:18.513372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:18.514388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:18.517540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:18.720690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:18.730821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:18.736821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:18.738393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54ae6a1e-1a4e-4c56-8a8d-fc500271ec5d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.247779 Jul 28 11:45:18.741667 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2188/4323] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:18 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:19.353461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-11c74636-ab16-4013-b186-791017b0aded tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Action: 'create', calling method: .version_select at 0x7f2ebbe84c10>, body: {"keypair": {"name": "tempest-keypair-635533220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjr2u6P2drJq70RWw7zSVWoHP54LXSUw+BHCoFtO9LsyeA/d2LvfKTRmFlQRhpsjzMUpL+VbXxrc0Z0SSZgjBH9+AtgIEbu+3IBPUyJMcwYOd6A4vHG/S5NQTE+A/h41A=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:19.392068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-11c74636-ab16-4013-b186-791017b0aded tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for project 696b282e6af143e085f825332724e8c9. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:45:19.408793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-11c74636-ab16-4013-b186-791017b0aded tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for user 2bf539bb83cc42c6bf522e6ca582c2c2 and project 696b282e6af143e085f825332724e8c9. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:45:19.478384 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-11c74636-ab16-4013-b186-791017b0aded tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.353854 Jul 28 11:45:19.479380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2136/4324] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:45:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:19.491554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:19.492178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:19.502841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:19.503533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:19.504111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:19.504548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:19.766168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:19.766796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:19.775015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:19.784583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:19.785721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:19.786315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:19.971899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:19.981987 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a167e487-2b21-4ee7-a0ac-830b9838490e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 200 len: 1449 microversion: 2.1 time: 0.495884 Jul 28 11:45:19.987055 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2189/4325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:19 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 1449 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:19.998285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:20.011254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:20.013600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:20.014744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:20.016217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:20.020174 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65bbcb43-47bf-4e51-bc2c-cec681190751 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.256568 Jul 28 11:45:20.023406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2137/4326] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:19 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:20.052556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.053459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:20.057165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.058849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:20.390558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:20.438001 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc0a3db3-c490-4259-816e-6423eb07d0bc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.428417 Jul 28 11:45:20.458829 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2190/4327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:20 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:20.468250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:20.468857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:20.482958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.483666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:20.484767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.485355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:20.899229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:20.908537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f585a6b-f382-4eb3-b90a-919de7331915 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.444113 Jul 28 11:45:20.910903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2138/4328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:20 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:20.953298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:20.953937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:20.975924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.976548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:20.978235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:20.980211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.051329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:21.052199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:21.061801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:21.070996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.072208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:21.072823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.220635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:21.236113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:21.240503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:21.243620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f625481f-47b3-4a5f-9d4d-95026a049f61 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.197543 Jul 28 11:45:21.244961 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2139/4329] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:21 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:21.394164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:21.414778 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f4c290df-8483-4222-a386-84fa8781a8a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.475840 Jul 28 11:45:21.416019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2191/4330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:20 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:21.438764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:21.439622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:21.447545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:21.449088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.450166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:21.450840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.840626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:21.858605 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a333bc68-5155-4cb4-9fa6-054f2b86a712 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.423946 Jul 28 11:45:21.862274 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2140/4331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:21 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:21.884876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98d761d4-fe39-430d-9588-3d866aa6524e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:21.896639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98d761d4-fe39-430d-9588-3d866aa6524e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:21.897087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98d761d4-fe39-430d-9588-3d866aa6524e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:21.949832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-98d761d4-fe39-430d-9588-3d866aa6524e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:45:22.048293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98d761d4-fe39-430d-9588-3d866aa6524e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.168591 Jul 28 11:45:22.052273 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2192/4332] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:45:21 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:45:22.058618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:22.059690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:22.073774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:22.074704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:22.080199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:22.080931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:22.273598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:22.275382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:22.286632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:22.291616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:22.292724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:22.295840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:22.353342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:22.632068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:22.645002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:22.648569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:22.654526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3c58405-bd56-4987-94a8-762333be584d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.387195 Jul 28 11:45:22.667244 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2193/4333] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:22 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:22.759641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:22.777692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b67af69d-1266-4d8c-98ef-b6de2dc3f504 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.723266 Jul 28 11:45:22.778514 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2141/4334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:22 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:23.683016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:23.684988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:23.699336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:23.703342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:23.705048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:23.707001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:23.801861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:23.803059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:23.817646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:23.818725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:23.819788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:23.821911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:23.876758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:23.892069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:23.894798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:23.896854 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-757956ec-d873-4dff-b259-e174f432dc68 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.219093 Jul 28 11:45:23.898048 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2194/4335] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:23 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:24.449141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:24.458885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5e052c9-56f7-49cd-8287-3ad74b216231 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.662153 Jul 28 11:45:24.479988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2142/4336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:23 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:24.941778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:24.955114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:24.988308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:24.989115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:24.998715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:24.999811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:25.186630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:25.200815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:25.202656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:25.204279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e8d61b4-afbf-4861-8e92-097db9e1770c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.279186 Jul 28 11:45:25.205527 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2195/4337] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:24 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:25.493841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:25.496486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:25.505312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:25.506591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:25.507989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:25.509936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:25.978632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:25.988897 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dae5b6ed-9c1a-4a8b-ba49-d82eff93d2e9 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.503072 Jul 28 11:45:25.990960 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2143/4338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:25 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:26.230856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:26.231715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:26.246815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:26.247415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:26.248792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:26.249482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:26.678683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:26.696183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:26.700191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:26.707460 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6caadea4-5899-494b-9af6-087175e3c410 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.482388 Jul 28 11:45:26.716074 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2196/4339] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:26 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:27.016055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:27.017871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:27.054313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:27.057222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:27.058293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:27.059595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:27.386095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:27.400065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1d36e67-aaca-4f72-8eb2-7e3d9090454e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.389669 Jul 28 11:45:27.401173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2144/4340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:27 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:27.743048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:27.744081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:27.755998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:27.756578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:27.757277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:27.758585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:27.864063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:27.880935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:27.885290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:27.891441 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cafdc126-4584-4d53-89ae-49c238d2bcde tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.151040 Jul 28 11:45:27.905041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2197/4341] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:27 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:28.421909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:28.422527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:28.440296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:28.440753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:28.441537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:28.453495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:28.919002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:28.919659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:28.935854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:28.936939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:28.941412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:28.942084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:29.306645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:29.321183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:29.323353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:29.325225 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9e26c87-b1eb-48cf-89b0-88ea81590dec tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.411264 Jul 28 11:45:29.327456 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2198/4342] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:28 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:29.392896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:29.403179 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08f63542-8ec4-4897-936c-a1ff8f0ba5b3 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 0.985053 Jul 28 11:45:29.403767 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2145/4343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:28 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:30.356027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:30.356655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:30.379513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:30.381793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:30.396052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:30.398152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:30.424907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:30.425533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:30.428975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:30.441526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:30.441891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:30.447745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:30.448485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:31.396425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:31.422052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:31.426841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:31.428168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e44808de-1abd-4098-86ec-99ec5715f482 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 1.078920 Jul 28 11:45:31.450628 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2199/4344] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:30 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:31.678012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:31.691390 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f736d67-d44e-41f6-9054-94d4611ea038 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1680 microversion: 2.1 time: 1.270163 Jul 28 11:45:31.709676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2146/4345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:30 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1680 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:31.750738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1891111266", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "182a03d8-908b-463f-8daa-cd0f8d95294c"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:31.865831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] validate_networks() for [('182a03d8-908b-463f-8daa-cd0f8d95294c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:45:32.454141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:32.454769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:32.471659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:32.484248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:32.485116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:32.485604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:32.529560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:32.730924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:32.749102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:32.761733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:32.766557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0ed402d-4e9e-4d4f-8856-0df21dda7e77 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.313815 Jul 28 11:45:32.783466 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2147/4346] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:32 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:32.796772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:32.800907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:32.827602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:32.828323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:32.829294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:32.830096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.593071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:33.609746 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-61e503a9-779a-4124-aff1-d374ea62381d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1657 microversion: 2.1 time: 0.823636 Jul 28 11:45:33.610363 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2148/4347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:32 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1657 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:33.639231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ffb6e25-517d-47a3-bdcc-a7fde98c8058 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:33.659202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ffb6e25-517d-47a3-bdcc-a7fde98c8058 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.659668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ffb6e25-517d-47a3-bdcc-a7fde98c8058 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.668839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:45:33.669315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:45:33.669732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:45:33.670142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:45:33.670738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:45:33.686510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.687277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.689571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.698115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.701344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ffb6e25-517d-47a3-bdcc-a7fde98c8058 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Going to try to start instance {{(pid=119236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 11:45:33.727668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Getting quotas for project 3365b56930b94dcc917dec4a16bbd190. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:45:33.734811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Getting quotas for user 833646315f904e32ab77a18777182dba and project 3365b56930b94dcc917dec4a16bbd190. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:45:33.754786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Going to run 2 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:45:33.757449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:45:33.799282 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ffb6e25-517d-47a3-bdcc-a7fde98c8058 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.167031 Jul 28 11:45:33.802349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2149/4348] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:45:33 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:45:33.820849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:33.822106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:33.836491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=4864b898-f3d0-45e8-ab78-0f1ce5ee7f66,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:45:33.854696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.857680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.861443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.864021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.915181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-63e20719-2e3a-48e0-9b18-4738d857b179 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462160 Jul 28 11:45:33.917156 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2200/4349] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:45:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:45:33.935021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:33.940890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:33.984329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.987346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:33.992942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:33.995478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:34.231816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.244260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.245784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.246999 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4711aab7-470a-4161-8d8e-58e301bf95a8 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.442273 Jul 28 11:45:34.257364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2150/4350] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:33 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:34.274164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:34.290007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.295982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Searching by: {'deleted': False, 'project_id': '3365b56930b94dcc917dec4a16bbd190'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:45:34.353155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:34.353893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:34.359065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:34.362135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:34.426850 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ade27cbc-e2bb-4f29-9ca8-5335adf43349 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.159788 Jul 28 11:45:34.429257 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2151/4351] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:45:34 2022] GET /compute/v2.1/servers => generated 677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:34.447609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a542424-9bf3-40cc-84af-37097754491b tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:34.448474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a542424-9bf3-40cc-84af-37097754491b tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:34.601994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a542424-9bf3-40cc-84af-37097754491b tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.616048 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a542424-9bf3-40cc-84af-37097754491b tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1220 microversion: 2.1 time: 0.178488 Jul 28 11:45:34.652766 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2152/4352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:34 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1220 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:34.746292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:34.755384 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe6979a6-ff79-4cc7-b1a7-5be4e3b3fd34 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1666 microversion: 2.1 time: 0.836348 Jul 28 11:45:34.755977 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2201/4353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:33 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1666 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:35.285458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:35.286961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:35.299150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.302382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.303453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.306244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.470796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:35.495339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:35.498630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:35.508255 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d936968e-c17c-47fa-9713-0fc14470e51a tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.227399 Jul 28 11:45:35.525573 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2153/4354] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:35 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:35.640377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:35.641144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:35.662234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.663236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.667656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.668389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.785168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:35.785788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:35.805947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.807455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.808716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:35.812009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:35.846036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:35.860087 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d64b6fc-7669-4363-a87f-703b9ba75af3 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1224 microversion: 2.1 time: 0.224691 Jul 28 11:45:35.896754 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2202/4355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:35 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1224 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:36.223490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:36.236636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0c1d385-4c95-4e58-a3a8-52d3d2bcc574 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1666 microversion: 2.1 time: 0.460022 Jul 28 11:45:36.240228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2154/4356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:35 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1666 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:36.545100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:36.545721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:36.553786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:36.554238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:36.555614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:36.566683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:36.785184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:36.802715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:36.807011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:36.811136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ab49f24-82e5-401d-94ad-2f7cbf78cdd7 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.273605 Jul 28 11:45:36.830599 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2203/4357] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:36 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:36.900357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:36.901067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:36.918362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:36.919119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:36.922767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:36.923611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:37.200908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:37.211458 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c33a3a1-24a5-4275-891d-e00169bfd21f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1280 microversion: 2.1 time: 0.317150 Jul 28 11:45:37.212048 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2155/4358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:36 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:37.263233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:37.263862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:37.276907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:37.277667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:37.288451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:37.290708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:37.839128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:37.840286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:37.849023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:37.853353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:37.855911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:37.860143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.126775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.136522 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c77f777c-ffa0-45dd-a02e-df0ffed0c3ad tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.878519 Jul 28 11:45:38.147113 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2204/4359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:37 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:38.163822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:38.164443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:38.186176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.188223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.189897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.191245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.217850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.235893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.243943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.252247 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38a58678-1502-4832-938c-68ea47f13079 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1366 microversion: 2.57 time: 0.415303 Jul 28 11:45:38.253816 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2156/4360] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:37 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:38.271380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:38.275829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:38.310189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.313040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.316301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.319798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.811259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.819645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36fb118a-d3ed-424a-8560-87cb8744663c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1290 microversion: 2.1 time: 0.559761 Jul 28 11:45:38.823359 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2157/4361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:38 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1290 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:38.890664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:38.917554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-539f80c1-51c0-47be-883a-9d1cb916b0dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.759596 Jul 28 11:45:38.920814 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2205/4362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:38 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:38.954948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:38.955612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:38.978593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.987307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:38.991349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:38.992563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.267308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:39.278187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92f6aa01-766b-4a87-879b-5bed6cb3b09b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.329652 Jul 28 11:45:39.280329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2158/4363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:38 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:39.301351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:39.301873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:39.302711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:39.303482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:39.330800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.331307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.332704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.333529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.333897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.334545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.346122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.346122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.515397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:39.528616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:39.531568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:39.533831 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d950ac1-a9c7-4c08-be67-ae02692f4230 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1372 microversion: 2.57 time: 0.236773 Jul 28 11:45:39.541927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2206/4364] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:39 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:39.726069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:39.737449 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9053ea3a-dbbb-4169-8f79-305217f39b9e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.439214 Jul 28 11:45:39.738321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2159/4365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:39 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:39.760003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:39.760892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:39.768190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.769564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.773988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.775319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.842591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:39.843596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:39.853790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.854655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:39.856880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:39.860867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.046789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.059191 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-332be0f8-42b8-424c-84ef-986dfa5e4329 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1278 microversion: 2.1 time: 0.218463 Jul 28 11:45:40.071098 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2160/4366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:39 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:40.150254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.159875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5009d144-c303-4163-a9fb-6852b8a1b143 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.403770 Jul 28 11:45:40.161019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2207/4367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:39 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:40.181654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:40.182702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:40.205004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.205684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.206871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.207494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.240069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lazy-loading 'flavor' on Instance uuid 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:45:40.336573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5a2c329-5b6c-49e4-a0ba-f56d8593a90b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.158362 Jul 28 11:45:40.337832 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2161/4368] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:45:40 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:45:40.345672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:40.346301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:40.353188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.353645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.354655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.355238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.536320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.546347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8909f53-2866-4d52-be11-c769c33e72a4 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1678 microversion: 2.1 time: 0.204514 Jul 28 11:45:40.547216 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2208/4369] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:40 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:40.567880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:40.568593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:40.578432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.579392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.580368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:40.581305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:40.699371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.715919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.722421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:40.725378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd99e5dd-1104-4d5a-8fc2-874bb6c6c076 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1372 microversion: 2.57 time: 0.161831 Jul 28 11:45:40.726983 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2162/4370] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:40 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:41.083058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:41.084128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.096805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.097394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.098297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.099547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.254174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:41.277648 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c3621e8-8181-4b8f-9110-0309df01ae15 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1278 microversion: 2.1 time: 0.198479 Jul 28 11:45:41.279902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2209/4371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:41 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:41.569347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:41.571174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.579448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.580117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.581632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.582238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.619571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:41.749951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:41.750746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.758240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.758688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.759513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.760141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.765658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:41.775372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab6e9459-34e8-4917-8cdd-b9f1ff929064 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1661 microversion: 2.1 time: 0.209630 Jul 28 11:45:41.776709 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2163/4372] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:41 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1661 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:41.797148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:41.797689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.805160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.805887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.806816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.807493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.838485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:41.846871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:41.853716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:41.858461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:41.860141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e45ba13e-40b0-4063-99d4-0a204d8bd59e tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1357 microversion: 2.57 time: 0.114252 Jul 28 11:45:41.862537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2210/4373] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:41 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:41.892251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:41.894468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.908191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.909092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.910193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.910832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.916167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d43c2e08-4f14-4fd8-bcbb-bc9c65668a64 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action" status: 202 len: 0 microversion: 2.1 time: 0.122623 Jul 28 11:45:41.917235 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2164/4374] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:45:41 2022] POST /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:45:41.928838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:41.931470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:41.939285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.940255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.941530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:41.941985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:41.988250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:45:42.158299 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc7298fe-d2f6-49cf-af69-0d1ebe6a0aff tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 204 len: 0 microversion: 2.57 time: 0.269793 Jul 28 11:45:42.159452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2211/4375] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:45:41 2022] DELETE /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 11:45:42.169039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:42.169757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:42.177316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:42.177773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:42.178753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:42.180824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:42.341174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:42.350142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:42.356468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:42.357996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:42.359391 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c95aa9ea-29a4-45e0-8c3c-a76e922f1a7c tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1363 microversion: 2.57 time: 0.194489 Jul 28 11:45:42.360522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2212/4376] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:42 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:45:42.361530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5677f4a-527e-4858-b787-602b0b39d997 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1667 microversion: 2.1 time: 0.440098 Jul 28 11:45:42.362376 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2165/4377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:41 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:42.365620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:42.366228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:42.372693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:42.373147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:42.373942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:42.375191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:42.839349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:42.861877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21c9596c-dcf8-4e71-82ba-aac02d5f1f40 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.500145 Jul 28 11:45:42.872258 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2213/4378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:42 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:43.389185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:43.389721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:43.407496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:43.408285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:43.412586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.413046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:43.414381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.415690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:43.417828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:43.425614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.426061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:43.435455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.435892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:43.639409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:43.649816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:43.651805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:43.653487 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed028a3f-87be-4304-bf93-b3f54c4dfa0f tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1363 microversion: 2.57 time: 0.260572 Jul 28 11:45:43.654141 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2214/4379] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:43 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:43.704553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:43.713966 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e1f9a63-16c2-469c-af30-cf8056ef6e81 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1667 microversion: 2.1 time: 0.334285 Jul 28 11:45:43.719379 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2166/4380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:43 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1667 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:43.884458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:43.885428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:43.891391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:43.892777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:43.895632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.896899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:43.897430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:43.898632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.251720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:44.263321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-653f54df-bf11-4541-a6f7-b1ce777459c7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.383074 Jul 28 11:45:44.283270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2215/4381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:43 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:44.545732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:44.612388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:44.670480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-42faa262-fa6c-47c7-b199-2439c6bb1154 req-980731c8-31a8-4b09-8885-d1d270965ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4864b898-f3d0-45e8-ab78-0f1ce5ee7f66", "tag": "30ec6bc3-06fc-4db2-913d-341352cbc4b7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:44.677935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:44.678535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:44.690067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.692762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.694452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-42faa262-fa6c-47c7-b199-2439c6bb1154 req-980731c8-31a8-4b09-8885-d1d270965ec2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.695884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-42faa262-fa6c-47c7-b199-2439c6bb1154 req-980731c8-31a8-4b09-8885-d1d270965ec2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.696385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.696841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.726533 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-42faa262-fa6c-47c7-b199-2439c6bb1154 req-980731c8-31a8-4b09-8885-d1d270965ec2 service nova] Creating event network-changed:30ec6bc3-06fc-4db2-913d-341352cbc4b7 for instance 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 on n-h1-851368-1 Jul 28 11:45:44.737470 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-42faa262-fa6c-47c7-b199-2439c6bb1154 req-980731c8-31a8-4b09-8885-d1d270965ec2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201401 Jul 28 11:45:44.738085 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2167/4382] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:44.744009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:44.748616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:44.768282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.768743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.769548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.769997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.780464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:44.781179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:44.781644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lazy-loading 'fault' on Instance uuid ac61bb8e-ce09-486c-842d-735c5796a40a {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:45:44.845358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:44.857072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:44.861096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7fde932d3c094630a9295dc3d72e55be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee878bdb457a4708bfdaa673ba26e94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:44.864446 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-378ca19c-0edf-4905-83de-38e479777f7d tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 200 len: 1368 microversion: 2.57 time: 0.190640 Jul 28 11:45:44.883214 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2216/4383] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:44 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:45:45.297159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:45.297989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:45.310994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:45.311809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:45.312865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:45.313446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:45.378922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:45.393609 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-25b5589f-76a1-4243-91b3-9aa8f27a2196 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1667 microversion: 2.1 time: 0.653862 Jul 28 11:45:45.407695 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2168/4384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:44 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1667 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:45.623795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:45.668877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c09ec8f0-0287-4c86-a8d2-f021c64b7801 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.345055 Jul 28 11:45:45.668877 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2217/4385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:45 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:45.901735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:45.903557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] [instance: ac61bb8e-ce09-486c-842d-735c5796a40a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:45.920795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:45.922508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:45.924996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:45.926953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:45.961992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] HTTP exception thrown: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Request method failure captured: Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a HTTP/1.1 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4na_h_w0g35qZ3ia_vfvtt6d6yzIocWufabLfJjOB7y6Rx1vDm8VBgu3qMOaHwXfzuz2zRYVSCdMbLaNRCp_DWxPHNCO88WBmfoe7dBHeYv_bsLzw18YLbMaNzJL1CfmdEJNPO0f7Qv4c0B_bMsx4jy3RUQEKAHVM0FL2dk3eIqH1-k Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.57 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: ee878bdb457a4708bfdaa673ba26e94c Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerShowV257Test-2080917392 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee878bdb457a4708bfdaa673ba26e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee878bdb457a4708bfdaa673ba26e94c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee878bdb457a4708bfdaa673ba26e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee878bdb457a4708bfdaa673ba26e94c"}]}] Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerShowV257Test-2080917392 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: ee878bdb457a4708bfdaa673ba26e94c Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerShowV257Test-2080917392 Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerShowV257Test-2080917392-project Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7fde932d3c094630a9295dc3d72e55be Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerShowV257Test-2080917392-project Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'ac61bb8e-ce09-486c-842d-735c5796a40a'} Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:45.970936 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. Jul 28 11:45:45.975620 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:45:45.978080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] Returning 404 to user: Instance ac61bb8e-ce09-486c-842d-735c5796a40a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:45:45.979166 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c66feb74-4c9f-4a90-806e-93ae900d4158 tempest-ServerShowV257Test-2080917392 tempest-ServerShowV257Test-2080917392-project] 10.222.0.93 "GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a" status: 404 len: 111 microversion: 2.57 time: 0.083760 Jul 28 11:45:45.980610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2169/4386] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:45:45 2022] GET /compute/v2.1/servers/ac61bb8e-ce09-486c-842d-735c5796a40a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:45:46.366568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:46.367158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:46.394987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.395808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:46.396759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.398708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:46.414411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:46.418420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:46.435584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.441153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:46.443574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.447061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:46.658056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lazy-loading 'services' on Instance uuid 2be83408-f030-40e8-b48b-6b36c90449f3 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:45:46.819397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-056e08e7-1425-4b92-9924-b2e2aa8b7350 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments/762a0ffa-dd70-464d-ac58-04b16ae66615" status: 202 len: 0 microversion: 2.1 time: 0.456059 Jul 28 11:45:46.843764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2218/4387] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:45:46 2022] DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments/762a0ffa-dd70-464d-ac58-04b16ae66615 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:45:46.864230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:46.865598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:46.917583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.919279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:46.920869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:46.921821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:47.182632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:47.200728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfc4441a-6f04-42a1-b541-b52a73bfac4e tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.790812 Jul 28 11:45:47.201308 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2170/4388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:46 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:47.220874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-950d379e-f94b-4600-ae75-c0f205e46fb7 req-2bfda4ea-44f5-4d1b-a11f-20b6cb6e257e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8caa4898-da56-4180-b2e8-0f07b4ac2695", "tag": "a4113c34-81c7-4ba8-8d4b-f77aafbd6b49"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:47.235780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-950d379e-f94b-4600-ae75-c0f205e46fb7 req-2bfda4ea-44f5-4d1b-a11f-20b6cb6e257e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:47.236623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-950d379e-f94b-4600-ae75-c0f205e46fb7 req-2bfda4ea-44f5-4d1b-a11f-20b6cb6e257e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:47.266655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-950d379e-f94b-4600-ae75-c0f205e46fb7 req-2bfda4ea-44f5-4d1b-a11f-20b6cb6e257e service nova] Creating event network-changed:a4113c34-81c7-4ba8-8d4b-f77aafbd6b49 for instance 8caa4898-da56-4180-b2e8-0f07b4ac2695 on n-h2-851368-1 Jul 28 11:45:47.278091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-950d379e-f94b-4600-ae75-c0f205e46fb7 req-2bfda4ea-44f5-4d1b-a11f-20b6cb6e257e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067004 Jul 28 11:45:47.279120 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2171/4389] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:47.284651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:47.285922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:47.301699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:47.302172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:47.307576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:47.310337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:47.689165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:47.699375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b27b164-9b14-4675-ac24-d3974acd6711 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.853627 Jul 28 11:45:47.703515 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2219/4390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:46 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:47.892864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:47.901116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94d5ad82-f953-4522-bc98-bc8a4cfff854 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1670 microversion: 2.1 time: 0.620549 Jul 28 11:45:47.920898 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2172/4391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:47 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1670 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:47.925254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:47.925781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:47.941175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:47.941853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:47.943022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:47.944041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:48.019041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:45:48.032544 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Working on deleting snapshot 99e8b981-fb85-4860-9ff5-cd1828052aef from shelved instance... Jul 28 11:45:48.726985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:48.727641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:48.731996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:48.747181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:48.748927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:48.751342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:48.755471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:49.937511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:49.950259 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 1.228512 Jul 28 11:45:49.951268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2173/4392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:48 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:49.973276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Doing local delete in cell db04e563-931a-4431-85d3-7168847bf9eb(cell1) {{(pid=119235) _delete /opt/stack/nova/nova/compute/api.py:2492}} Jul 28 11:45:49.973898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:49.974343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:49.974951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 28 11:45:49.991418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] deallocate_for_instance() {{(pid=119235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 11:45:49.996173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:49.997226 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001414 Jul 28 11:45:50.003999 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2174/4393] 10.222.0.93 () {56 vars in 886 bytes} [Thu Jul 28 11:45:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 28 11:45:50.005554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:50.006634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001705 Jul 28 11:45:50.007199 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2175/4394] 10.222.0.93 () {54 vars in 1035 bytes} [Thu Jul 28 11:45:50 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 28 11:45:50.014636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:50.016129 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jul 28 11:45:50.016853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2176/4395] 10.222.0.93 () {54 vars in 1041 bytes} [Thu Jul 28 11:45:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:45:50.028481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:50.029753 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b918be96-8b8e-44a7-bc28-3090ecc76da5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001580 Jul 28 11:45:50.030582 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2177/4396] 10.222.0.93 () {56 vars in 886 bytes} [Thu Jul 28 11:45:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 11:45:50.975229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:50.976527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:50.987158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:50.990320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:50.992679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:50.993357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:51.620853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:51.633345 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-93af26de-961e-4e20-83c9-9513e5ce1e02 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.664693 Jul 28 11:45:51.636681 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2178/4397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:50 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:51.805323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dbe7162f-496c-4f44-bc4d-1e05599b89b4 req-a114d5c1-6ac9-49dc-84df-d5a5dcda9d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ce33a9-ccf5-4fcb-bade-58039ff587b0", "name": "network-vif-deleted", "tag": "f7255663-125a-40c1-88ce-14e82c444a95"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:51.806250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Updating instance_info_cache with network_info: [] {{(pid=119235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:45:51.838999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dbe7162f-496c-4f44-bc4d-1e05599b89b4 req-a114d5c1-6ac9-49dc-84df-d5a5dcda9d43 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:51.839495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dbe7162f-496c-4f44-bc4d-1e05599b89b4 req-a114d5c1-6ac9-49dc-84df-d5a5dcda9d43 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:51.881635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_external_events [req-dbe7162f-496c-4f44-bc4d-1e05599b89b4 req-a114d5c1-6ac9-49dc-84df-d5a5dcda9d43 service nova] Unable to find a host for instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0. Dropping event network-vif-deleted {{(pid=119236) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 11:45:51.885203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dbe7162f-496c-4f44-bc4d-1e05599b89b4 req-a114d5c1-6ac9-49dc-84df-d5a5dcda9d43 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.083375 Jul 28 11:45:51.887226 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2179/4398] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 11:45:52.568227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:52.666433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:52.669169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:52.699159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.699994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.701485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.702248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.763399 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6980a171-a429-4531-a9d8-ca791bb3cd36 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 204 len: 0 microversion: 2.1 time: 4.840771 Jul 28 11:45:52.765945 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2220/4399] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:45:47 2022] DELETE /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 0 bytes in 4846 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:45:52.787753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:52.790790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 52ce33a9-ccf5-4fcb-bade-58039ff587b0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:52.811451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.812091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.812703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.813286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.845445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 HTTP/1.1 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '52ce33a9-ccf5-4fcb-bade-58039ff587b0'} Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:52.853026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. Jul 28 11:45:52.858298 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:52.868601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 404 to user: Instance 52ce33a9-ccf5-4fcb-bade-58039ff587b0 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:45:52.869597 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef26f924-c35c-4c43-b546-fad84346000b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0" status: 404 len: 111 microversion: 2.1 time: 0.099046 Jul 28 11:45:52.880581 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2221/4400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:52 2022] GET /compute/v2.1/servers/52ce33a9-ccf5-4fcb-bade-58039ff587b0 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:45:52.885634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:52.886148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:52.902818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.903516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.904525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:52.905133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:52.969978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:45:53.156987 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80dd24bf-47ef-43dd-a5d9-f574669c1c67 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 204 len: 0 microversion: 2.1 time: 0.274355 Jul 28 11:45:53.158475 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2222/4401] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:45:52 2022] DELETE /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:45:53.169772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:53.174117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:53.199854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:53.200320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:53.201117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:53.210343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:53.270839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:53.280249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5304043-e771-4a57-ae90-1753e6ecd899 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.622620 Jul 28 11:45:53.280851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2180/4402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:52 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:54.234251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:54.253237 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-83efea51-ce4a-431b-a9d8-aeb9ac4c7986 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1464 microversion: 2.1 time: 1.081760 Jul 28 11:45:54.254202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2223/4403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:53 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1464 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:54.303341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:54.304411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:54.320210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:54.320670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:54.321579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:54.322019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:54.897453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:54.905815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a4d3d99-130e-49b9-9c95-c28b35214807 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.606855 Jul 28 11:45:54.906417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2181/4404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:54 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:55.279839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:55.281199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:55.310818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:55.311706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:55.330180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:55.332496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:55.943181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:55.944483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:55.975503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:55.978104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:55.979191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:55.985832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:56.243371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:56.257804 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a05981a6-c62f-4b5c-bdd3-21ca4a935c6d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1464 microversion: 2.1 time: 0.983668 Jul 28 11:45:56.258408 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2224/4405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:55 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1464 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:56.574253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c32bacf1-1496-48b3-9b50-0f535aa8c1f4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:56.593081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32bacf1-1496-48b3-9b50-0f535aa8c1f4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:56.593556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c32bacf1-1496-48b3-9b50-0f535aa8c1f4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:56.636022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c32bacf1-1496-48b3-9b50-0f535aa8c1f4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:45:56.766563 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c32bacf1-1496-48b3-9b50-0f535aa8c1f4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action" status: 202 len: 0 microversion: 2.1 time: 0.196143 Jul 28 11:45:56.767521 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2225/4406] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:45:56 2022] POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:45:56.778343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:56.779535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:56.826222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:56.828295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:56.829474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:56.833942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:57.492014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:57.500457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8737955a-b933-4627-bf72-de195f524fff tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.726508 Jul 28 11:45:57.508362 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2226/4407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:56 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:57.519478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:57.519478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:57.526974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:57.527463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:57.528514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:57.528955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:57.575969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:57.588954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48ba8bf6-5ae6-438b-a576-9769be56b09a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 1.649463 Jul 28 11:45:57.590057 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2182/4408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:55 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:57.602622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e8186e93-89aa-4246-9630-a13cb91a351d req-1e38b7bf-16e3-4175-af6d-7b3008bfcecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38e9a34-3c26-4168-a8bc-a478b2cb2f23", "name": "network-vif-deleted", "tag": "7bbb7cff-c36b-4db6-b94a-90d15a06d4ce"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:57.630118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e8186e93-89aa-4246-9630-a13cb91a351d req-1e38b7bf-16e3-4175-af6d-7b3008bfcecb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:57.634250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e8186e93-89aa-4246-9630-a13cb91a351d req-1e38b7bf-16e3-4175-af6d-7b3008bfcecb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:57.665113 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e8186e93-89aa-4246-9630-a13cb91a351d req-1e38b7bf-16e3-4175-af6d-7b3008bfcecb service nova] Creating event network-vif-deleted:7bbb7cff-c36b-4db6-b94a-90d15a06d4ce for instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 on n-h2-851368-1 Jul 28 11:45:57.675377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e8186e93-89aa-4246-9630-a13cb91a351d req-1e38b7bf-16e3-4175-af6d-7b3008bfcecb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080383 Jul 28 11:45:57.676519 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2183/4409] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:45:57.778833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:57.788992 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-942d3b14-570a-4b06-8a37-9cc478e485cc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 200 len: 1464 microversion: 2.1 time: 0.278950 Jul 28 11:45:57.807974 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2227/4410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:57 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:57.858956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ce6a456-00e0-4659-ac5c-0a807fa4d6ca tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb1d0c670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:57.958749 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ce6a456-00e0-4659-ac5c-0a807fa4d6ca tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/3f325588-ae79-40da-a4c6-e18e4ec1819d" status: 200 len: 351 microversion: 2.1 time: 0.104891 Jul 28 11:45:57.959362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2184/4411] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:45:57 2022] GET /compute/v2.1/os-volumes/3f325588-ae79-40da-a4c6-e18e4ec1819d => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:58.495865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8d03fe60-d586-40e2-b2f6-81d872bacada req-93ff68ca-9daf-4c9b-818a-63e28b86a30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8caa4898-da56-4180-b2e8-0f07b4ac2695", "name": "network-vif-plugged", "status": "completed", "tag": "a4113c34-81c7-4ba8-8d4b-f77aafbd6b49"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:58.523908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8d03fe60-d586-40e2-b2f6-81d872bacada req-93ff68ca-9daf-4c9b-818a-63e28b86a30b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:58.524593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8d03fe60-d586-40e2-b2f6-81d872bacada req-93ff68ca-9daf-4c9b-818a-63e28b86a30b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:58.531461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:58.532250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:58.546251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:58.546706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:58.547707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:58.550793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:58.561284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8d03fe60-d586-40e2-b2f6-81d872bacada req-93ff68ca-9daf-4c9b-818a-63e28b86a30b service nova] Creating event network-vif-plugged:a4113c34-81c7-4ba8-8d4b-f77aafbd6b49 for instance 8caa4898-da56-4180-b2e8-0f07b4ac2695 on n-h2-851368-1 Jul 28 11:45:58.597481 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8d03fe60-d586-40e2-b2f6-81d872bacada req-93ff68ca-9daf-4c9b-818a-63e28b86a30b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341564 Jul 28 11:45:58.598896 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2228/4412] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:45:58.614305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:58.616944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:58.648453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:58.649320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:58.650617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:58.651300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.275804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:59.293855 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71144819-9e0b-4b10-94a4-8307e54d57e2 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.679743 Jul 28 11:45:59.295486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2229/4413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:58 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:45:59.300400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:59.301171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: f38e9a34-3c26-4168-a8bc-a478b2cb2f23] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:59.308684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.309433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.310683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.311903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.335969 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 HTTP/1.1 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f38e9a34-3c26-4168-a8bc-a478b2cb2f23'} Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:45:59.338157 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. Jul 28 11:45:59.342044 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:45:59.343862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 404 to user: Instance f38e9a34-3c26-4168-a8bc-a478b2cb2f23 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:45:59.345450 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0d65b8d-7f05-408b-82d9-d7fefc00ed3f tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23" status: 404 len: 111 microversion: 2.1 time: 0.048243 Jul 28 11:45:59.346517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2230/4414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:59 2022] GET /compute/v2.1/servers/f38e9a34-3c26-4168-a8bc-a478b2cb2f23 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:45:59.353903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2127581549", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d72fb4f7-79fc-4dad-b940-da945620c175"}], "security_groups": [{"name": "tempest-securitygroup--188779988"}], "key_name": "tempest-keypair-635533220", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c7eb230d-6f55-4b1f-bdd9-a12912f34103", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:45:59.368616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:45:59.379220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e545e2f3-bf43-400b-a066-a411a7dc38cf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.849299 Jul 28 11:45:59.394073 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2185/4415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:58 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:45:59.405405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:59.411658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:59.420485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.423028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.424525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.425575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.466831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:45:59.485815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:45:59.589565 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a037ff4-a502-424f-84f6-f00cfa5bbeae tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 204 len: 0 microversion: 2.1 time: 0.191801 Jul 28 11:45:59.593559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2186/4416] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:45:59 2022] DELETE /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:45:59.607654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:45:59.608734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:45:59.624839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.630237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.635268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:45:59.636251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:45:59.781236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] validate_networks() for [('d72fb4f7-79fc-4dad-b940-da945620c175', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:46:00.150368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:00.158256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00aa1848-f207-4e9d-94d7-ce0576ff68db tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1507 microversion: 2.1 time: 0.561789 Jul 28 11:46:00.159822 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2187/4417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:45:59 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:00.318728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:00.319537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:00.326071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:00.326627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:00.327552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:00.328066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.037045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:01.048092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db974ab8-39ba-4e42-8f03-311fa7269c74 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1320 microversion: 2.1 time: 0.733112 Jul 28 11:46:01.060290 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2188/4418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:00 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1320 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:01.070833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:01.071735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:01.078379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.078828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.079908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.080817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.348194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for project 696b282e6af143e085f825332724e8c9. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:01.355676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for user 2bf539bb83cc42c6bf522e6ca582c2c2 and project 696b282e6af143e085f825332724e8c9. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:01.363238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:01.369865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:46:01.370302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:46:01.370780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:46:01.371222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:46:01.371640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:46:01.372424 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-69fb8e53-9a32-45d8-9e8e-8a19f733cf9b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.310740 Jul 28 11:46:01.376955 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2189/4419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:01 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:01.382961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.383620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.384195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-07f6549b-1a4d-409e-a356-0668ac7c2d8b req-37e4cba6-7eab-4111-8a91-17943f0c048f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864b898-f3d0-45e8-ab78-0f1ce5ee7f66", "name": "network-vif-plugged", "status": "completed", "tag": "30ec6bc3-06fc-4db2-913d-341352cbc4b7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:01.384794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.385427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.395090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-07f6549b-1a4d-409e-a356-0668ac7c2d8b req-37e4cba6-7eab-4111-8a91-17943f0c048f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.395549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-07f6549b-1a4d-409e-a356-0668ac7c2d8b req-37e4cba6-7eab-4111-8a91-17943f0c048f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.404832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for project 696b282e6af143e085f825332724e8c9. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:01.407001 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-07f6549b-1a4d-409e-a356-0668ac7c2d8b req-37e4cba6-7eab-4111-8a91-17943f0c048f service nova] Creating event network-vif-plugged:30ec6bc3-06fc-4db2-913d-341352cbc4b7 for instance 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 on n-h1-851368-1 Jul 28 11:46:01.410721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Getting quotas for user 2bf539bb83cc42c6bf522e6ca582c2c2 and project 696b282e6af143e085f825332724e8c9. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:01.411850 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-07f6549b-1a4d-409e-a356-0668ac7c2d8b req-37e4cba6-7eab-4111-8a91-17943f0c048f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Jul 28 11:46:01.412449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2190/4420] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:01.419152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd3c299c-5b28-4ca1-b77f-cbde88247593 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2ebbe570d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:01.472616 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd3c299c-5b28-4ca1-b77f-cbde88247593 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/289d4f8d-76fc-4f3a-b3f0-f3cd46b61d7f" status: 200 len: 350 microversion: 2.1 time: 0.057704 Jul 28 11:46:01.473215 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2191/4421] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:46:01 2022] GET /compute/v2.1/os-volumes/289d4f8d-76fc-4f3a-b3f0-f3cd46b61d7f => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:01.478886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:01.482473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:46:01.484646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:01.486056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7eb230d-6f55-4b1f-bdd9-a12912f34103',volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:01.494200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.494728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.495515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:01.496402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:01.680099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:01.691358 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a6432d2-1b20-4bde-9d78-0c18c8fc37ba tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1507 microversion: 2.1 time: 0.216632 Jul 28 11:46:01.692799 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2192/4422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:01 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:01.696246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b928bf41-7566-43ee-bba4-85bbf4c15d55 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.346602 Jul 28 11:46:01.698865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2231/4423] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:45:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:46:01.720855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef227ce7-86c9-42f7-a077-b612298d2ed6 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:01.721471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef227ce7-86c9-42f7-a077-b612298d2ed6 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:01.802739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ef227ce7-86c9-42f7-a077-b612298d2ed6 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:01.810828 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef227ce7-86c9-42f7-a077-b612298d2ed6 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1121 microversion: 2.1 time: 0.102686 Jul 28 11:46:01.814459 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2193/4424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:01 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1121 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:02.072383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:02.073290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:02.081983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.089230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.090330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.091042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.394641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:02.395674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:02.409269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.409972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.410910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.414150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.700715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:02.715515 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffcd4fa2-78cb-4b28-a396-6cfe37b4c5f8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 200 len: 1507 microversion: 2.1 time: 0.647456 Jul 28 11:46:02.716808 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2232/4425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:02 2022] GET /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:02.730114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:02.730981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:02.741661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.746819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.748211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.749054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.918254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:02.933442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce3fd80a-8fef-4b65-a87d-4c9bef2cf860 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1465 microversion: 2.1 time: 0.211319 Jul 28 11:46:02.934566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2233/4426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:02 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:02.946116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:02.950695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:02.968007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.968701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:02.969591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:02.970110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:03.040068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:03.058246 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-243e8cba-ef3b-46f8-a342-ebe9040ed81f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.667341 Jul 28 11:46:03.063189 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2194/4427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:02 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:03.070403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:03.079301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:03.102742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:03.104053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:03.105210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:03.105873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:03.418747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:03.442356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-581b0c9d-f235-4e8d-9123-74de4dfe427e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1219 microversion: 2.1 time: 0.376659 Jul 28 11:46:03.443989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2195/4428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:03 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1219 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:03.467862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bcf356ca-b8c6-442a-92ee-1cd3dac7d5a2 req-3b6b58d6-c5c4-47c3-9bbd-be72792152e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ff646a-0e04-4fa6-aa38-550b5680889e", "name": "network-vif-deleted", "tag": "6298740e-c160-434c-9dc7-56024962f725"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:03.493850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bcf356ca-b8c6-442a-92ee-1cd3dac7d5a2 req-3b6b58d6-c5c4-47c3-9bbd-be72792152e8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:03.494393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bcf356ca-b8c6-442a-92ee-1cd3dac7d5a2 req-3b6b58d6-c5c4-47c3-9bbd-be72792152e8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:03.529120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bcf356ca-b8c6-442a-92ee-1cd3dac7d5a2 req-3b6b58d6-c5c4-47c3-9bbd-be72792152e8 service nova] Creating event network-vif-deleted:6298740e-c160-434c-9dc7-56024962f725 for instance c2ff646a-0e04-4fa6-aa38-550b5680889e on n-h1-851368-1 Jul 28 11:46:03.543277 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bcf356ca-b8c6-442a-92ee-1cd3dac7d5a2 req-3b6b58d6-c5c4-47c3-9bbd-be72792152e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096585 Jul 28 11:46:03.549872 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2196/4429] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:03.798084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:03.830281 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-023ee7da-f703-4e3d-ab5c-aa84bb6181fd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66" status: 200 len: 1320 microversion: 2.1 time: 0.892701 Jul 28 11:46:03.832416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2234/4430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:02 2022] GET /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 => generated 1320 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:03.966955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:03.968520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:03.989298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:03.989816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:03.990564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:03.991360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.061540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.061986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.062679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lazy-loading 'fault' on Instance uuid c2ff646a-0e04-4fa6-aa38-550b5680889e {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:46:04.086035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.086658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:04.105399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.105861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.106665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.107132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.125062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:04.290541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:04.306323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-29b3a201-869a-4637-992f-e5b4bfd0c59d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 200 len: 1305 microversion: 2.1 time: 0.350146 Jul 28 11:46:04.307478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2197/4431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:03 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 1305 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:04.312865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c7ab7dc-d268-44c3-9956-c457e2b27b41 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2ebbea2af0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.422194 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c7ab7dc-d268-44c3-9956-c457e2b27b41 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/61936775-1bb9-4011-a3c7-54c2fb29ed16" status: 200 len: 351 microversion: 2.1 time: 0.113281 Jul 28 11:46:04.430476 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2198/4432] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/os-volumes/61936775-1bb9-4011-a3c7-54c2fb29ed16 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:04.435524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a09ef3c-3966-4477-a10c-657498768c46 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb1c85310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.580687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a09ef3c-3966-4477-a10c-657498768c46 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.148774 Jul 28 11:46:04.581487 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2199/4433] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:04.605564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.606554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:04.613951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.614766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.616567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.617236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.815769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:04.862207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3002ac9-74c4-4be4-b2f4-3881490663e2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1237 microversion: 2.1 time: 0.262350 Jul 28 11:46:04.865036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2200/4434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1237 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:04.879461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:04.883372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a6a6d4f-c4e5-459a-b1b0-7f00b3fa3f04 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2ebbe57310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.887740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11cb7459-b1b6-4f16-a3ab-7e77e96fd150 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.806292 Jul 28 11:46:04.888331 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2235/4435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:04.912745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:04.916808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:04.939122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.939912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:04.941103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:04.941728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:05.054447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a6a6d4f-c4e5-459a-b1b0-7f00b3fa3f04 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185175 Jul 28 11:46:05.055021 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2201/4436] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:05.071507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c81a0eb-679d-4eb3-90bd-bdedce623068 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2ebbeadb80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.203937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c81a0eb-679d-4eb3-90bd-bdedce623068 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.137572 Jul 28 11:46:05.205327 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2202/4437] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:05.219171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dabde777-2772-4c10-962e-7c0880e45b12 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2ebbead040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.331109 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dabde777-2772-4c10-962e-7c0880e45b12 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.115706 Jul 28 11:46:05.341356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2203/4438] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:05.346756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.347351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: c2ff646a-0e04-4fa6-aa38-550b5680889e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:05.357710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:05.362215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:05.367845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:05.368321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:05.396977 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e HTTP/1.1 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c2ff646a-0e04-4fa6-aa38-550b5680889e'} Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:05.404921 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 404 to user: Instance c2ff646a-0e04-4fa6-aa38-550b5680889e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:05.408849 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ff7648a-2e75-49a0-9d2d-f2df338b8996 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e" status: 404 len: 111 microversion: 2.1 time: 0.063844 Jul 28 11:46:05.410200 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2204/4439] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/servers/c2ff646a-0e04-4fa6-aa38-550b5680889e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:46:05.423997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f70890c-5ebe-49c0-9cb1-2d0f650989ab tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb1c85310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.634245 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f70890c-5ebe-49c0-9cb1-2d0f650989ab tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222640 Jul 28 11:46:05.635021 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2205/4440] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:05.640178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.641122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:05.659692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:05.661386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:05.666571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:05.667472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:05.722213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:05.855412 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7abda385-3110-46f6-9684-cf3ecc945f61 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 204 len: 0 microversion: 2.1 time: 0.218814 Jul 28 11:46:05.856385 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2206/4441] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:05 2022] DELETE /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:05.862099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c779245-55d7-46ea-a697-e1a2b4cf1e28 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb2c0ff70>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:05.977508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:05.986236 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1c065c2-4315-42a0-868c-4c6e05932a00 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66" status: 200 len: 1507 microversion: 2.1 time: 1.077465 Jul 28 11:46:05.986825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2236/4442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:04 2022] GET /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 => generated 1507 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:05.997047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:06.002012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:06.016581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.017190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.019489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.020130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.109868 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c779245-55d7-46ea-a697-e1a2b4cf1e28 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.251965 Jul 28 11:46:06.110449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2207/4443] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:06.115290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:06.116231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:06.123716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.124387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.125351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.125949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.330699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:06.346089 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db08203f-c87f-4c15-8b2e-5d5bd079ccc7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1237 microversion: 2.1 time: 0.233779 Jul 28 11:46:06.347407 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2208/4444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:06 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1237 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:06.377381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:06.378692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:06.389999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.391297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.392653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.393368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.685384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:06.696807 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39a6ebd9-9142-4869-a05c-9da52364ec74 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1494 microversion: 2.1 time: 0.702910 Jul 28 11:46:06.698268 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2237/4445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:05 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1494 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:06.705870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:06.708097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:06.716800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.717847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.719881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:06.720575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:06.792170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:06.940384 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2afd15ca-eeab-4f15-a608-9d0dadbe52d9 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66" status: 204 len: 0 microversion: 2.1 time: 0.240323 Jul 28 11:46:06.947904 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2238/4446] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:06 2022] DELETE /compute/v2.1/servers/4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:06.955561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecdeb8d5-7ff9-4a93-bfe7-7c6dde328c60 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb244f040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:06.991315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:07.041057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6fb08c2-083c-4856-8a21-c0e779a1dfa1 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1676 microversion: 2.1 time: 0.691130 Jul 28 11:46:07.045443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2209/4447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:06 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1676 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:07.057366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:07.059194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:07.074017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:07.074471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:07.079886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:07.080416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:07.140427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 8caa4898-da56-4180-b2e8-0f07b4ac2695] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:07.196671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:07.220671 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecdeb8d5-7ff9-4a93-bfe7-7c6dde328c60 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.269815 Jul 28 11:46:07.222294 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2239/4448] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Jul 28 11:46:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:07.236651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ada60a77-5231-4c4b-9573-34c6fc1403e9 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] Calling method '.version_select at 0x7f2eb2690670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:07.372488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-646dde01-5979-4b0d-aaf3-3d2765de29a0 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695" status: 204 len: 0 microversion: 2.1 time: 0.324322 Jul 28 11:46:07.373821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2210/4449] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:07 2022] DELETE /compute/v2.1/servers/8caa4898-da56-4180-b2e8-0f07b4ac2695 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:07.379825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:07.380765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:07.397312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:07.398617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:07.399738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:07.400420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:07.544186 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ada60a77-5231-4c4b-9573-34c6fc1403e9 tempest-VolumesTestJSON-1450702051 tempest-VolumesTestJSON-1450702051-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.311545 Jul 28 11:46:07.545239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2240/4450] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:46:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:07.550515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-03061f36-8537-4de9-a020-33e1aea3415b req-d45f1521-1397-4abe-a18d-8d9461e514af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6c3c3c-8b1f-47db-bdd0-d7fed551897c", "name": "network-vif-deleted", "tag": "c30f7b07-a56c-46b3-abfa-3f812b5db62f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:07.578248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-03061f36-8537-4de9-a020-33e1aea3415b req-d45f1521-1397-4abe-a18d-8d9461e514af service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:07.578954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-03061f36-8537-4de9-a020-33e1aea3415b req-d45f1521-1397-4abe-a18d-8d9461e514af service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:07.618081 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-03061f36-8537-4de9-a020-33e1aea3415b req-d45f1521-1397-4abe-a18d-8d9461e514af service nova] Creating event network-vif-deleted:c30f7b07-a56c-46b3-abfa-3f812b5db62f for instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c on n-h1-851368-1 Jul 28 11:46:07.630459 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-03061f36-8537-4de9-a020-33e1aea3415b req-d45f1521-1397-4abe-a18d-8d9461e514af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081409 Jul 28 11:46:07.637215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2241/4451] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:07.653066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1573621138", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "182a03d8-908b-463f-8daa-cd0f8d95294c"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:07.744954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] validate_networks() for [('182a03d8-908b-463f-8daa-cd0f8d95294c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:46:08.169974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:08.180235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f898aea5-8ec4-4bd7-8fdb-470197630eb4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1304 microversion: 2.1 time: 0.804864 Jul 28 11:46:08.193788 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2211/4452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:07 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1304 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:08.198951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:08.199927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:08.211839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:08.212662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:08.214478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:08.223524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:08.449382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:08.466629 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2a1460b-404d-4049-b93f-8bbd8694da4b tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 200 len: 1286 microversion: 2.1 time: 0.271440 Jul 28 11:46:08.485499 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2212/4453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:08 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 1286 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:08.491848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:08.493707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:08.505839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:08.506458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:08.507478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:08.508105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:09.807431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:09.819336 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eddb5f8c-47ba-4e21-9c5f-675d6c9158bd tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1653 microversion: 2.1 time: 1.331178 Jul 28 11:46:09.822809 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2213/4454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:08 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1653 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:09.833440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:09.834351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:09.849275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:09.850081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:09.851997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:09.852962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.037115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:46:10.037688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:46:10.038331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:46:10.038815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:46:10.039270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:46:10.041545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:10.073370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.074494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.074780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.075318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.114480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Getting quotas for project 3365b56930b94dcc917dec4a16bbd190. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:10.150786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Getting quotas for user 833646315f904e32ab77a18777182dba and project 3365b56930b94dcc917dec4a16bbd190. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:10.175009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Going to run 2 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:46:10.178948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:10.231932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=746a18ef-bee6-4be7-9c28-6bca3849ea4f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:10.338812 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86cc1207-37e9-4a48-993b-b482d6ed1504 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.696204 Jul 28 11:46:10.340353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2242/4455] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:46:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 2702 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 11:46:10.351717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:10.354099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: fc6c3c3c-8b1f-47db-bdd0-d7fed551897c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:10.372549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.374465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.378217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.378632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.413599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c HTTP/1.1 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'fc6c3c3c-8b1f-47db-bdd0-d7fed551897c'} Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:10.418697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. Jul 28 11:46:10.424486 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:10.425700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 404 to user: Instance fc6c3c3c-8b1f-47db-bdd0-d7fed551897c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:10.428856 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20683e3f-65ab-4a65-880b-c4a265a2b969 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c" status: 404 len: 111 microversion: 2.1 time: 0.087178 Jul 28 11:46:10.433181 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2243/4456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:10 2022] GET /compute/v2.1/servers/fc6c3c3c-8b1f-47db-bdd0-d7fed551897c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:46:10.444285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-589a01f8-9a0b-4c03-bdbf-303e73db55f8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:10.457505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-589a01f8-9a0b-4c03-bdbf-303e73db55f8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.459237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-589a01f8-9a0b-4c03-bdbf-303e73db55f8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.517348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-589a01f8-9a0b-4c03-bdbf-303e73db55f8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Going to try to start instance {{(pid=119235) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 11:46:10.639320 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-589a01f8-9a0b-4c03-bdbf-303e73db55f8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action" status: 202 len: 0 microversion: 2.1 time: 0.203357 Jul 28 11:46:10.640870 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2244/4457] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:46:10 2022] POST /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:46:10.664939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:10.692685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:10.693842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Searching by: {'deleted': False, 'project_id': '3365b56930b94dcc917dec4a16bbd190'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:46:10.750736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.757701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.758870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:10.759530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:10.875580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:46:10.967474 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74d7b5dd-11dc-4dce-91c8-cfae6e94d2ac tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.310738 Jul 28 11:46:10.968895 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2245/4458] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:46:10 2022] GET /compute/v2.1/servers => generated 1337 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:10.973483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:10.974098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:11.018514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.028581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.029689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.030147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.102919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:11.313779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9ae1f46-916e-41a6-9c15-63f4d03355dc tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 204 len: 0 microversion: 2.1 time: 0.343329 Jul 28 11:46:11.320810 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2246/4459] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:10 2022] DELETE /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:11.342566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:11.355848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:11.384180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.385883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.389133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.389966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.560227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:11.572535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f944e91d-2c23-4d0a-acc8-a277e9e7721e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1304 microversion: 2.1 time: 1.748238 Jul 28 11:46:11.573136 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2214/4460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:09 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1304 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:11.578014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fb3135d0-a365-4cfd-bf58-e03c2eebb299 req-2790cead-ef14-422d-a8b3-d7c43de6e957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864b898-f3d0-45e8-ab78-0f1ce5ee7f66", "name": "network-vif-deleted", "tag": "30ec6bc3-06fc-4db2-913d-341352cbc4b7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:11.623045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fb3135d0-a365-4cfd-bf58-e03c2eebb299 req-2790cead-ef14-422d-a8b3-d7c43de6e957 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.624117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fb3135d0-a365-4cfd-bf58-e03c2eebb299 req-2790cead-ef14-422d-a8b3-d7c43de6e957 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.649341 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fb3135d0-a365-4cfd-bf58-e03c2eebb299 req-2790cead-ef14-422d-a8b3-d7c43de6e957 service nova] Creating event network-vif-deleted:30ec6bc3-06fc-4db2-913d-341352cbc4b7 for instance 4864b898-f3d0-45e8-ab78-0f1ce5ee7f66 on n-h1-851368-1 Jul 28 11:46:11.665219 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fb3135d0-a365-4cfd-bf58-e03c2eebb299 req-2790cead-ef14-422d-a8b3-d7c43de6e957 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088022 Jul 28 11:46:11.668046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2215/4461] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:11.709520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:11.715699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:11.734258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.736143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.739710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:11.740372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:11.809515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:12.142555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:12.158264 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30f95e92-cdef-42cd-ad17-55f0b65d9bb1 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1222 microversion: 2.1 time: 0.487183 Jul 28 11:46:12.174932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2216/4462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:11 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1222 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:12.195259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:12.200186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:12.221814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:12.224242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:12.228296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:12.231338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:13.026958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:13.039595 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f6935cc-98f6-48c8-ac74-41659aeef34f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1662 microversion: 2.1 time: 1.716851 Jul 28 11:46:13.040190 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2247/4463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:11 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1662 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:13.059538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:13.072233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:13.087222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:13.088215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:13.089193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:13.095216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:13.750252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:13.767704 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80e2a8f8-aefa-45a3-9f08-80eb610a48df tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1304 microversion: 2.1 time: 0.715329 Jul 28 11:46:13.787229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2248/4464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:13 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1304 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:13.798866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:13.799542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:13.819760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:13.820441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:13.822304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:13.822764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:14.006514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:14.034215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf0ca424-bb17-4b62-b322-79ab78da9961 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1676 microversion: 2.1 time: 1.857826 Jul 28 11:46:14.041048 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2217/4465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:12 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1676 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:14.048777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cfdbe649-c156-480d-bb0e-f5836178ff6e req-8d2744e0-1bde-4fac-8e3a-241089d6a7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8caa4898-da56-4180-b2e8-0f07b4ac2695", "name": "network-vif-deleted", "tag": "a4113c34-81c7-4ba8-8d4b-f77aafbd6b49"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:14.087526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cfdbe649-c156-480d-bb0e-f5836178ff6e req-8d2744e0-1bde-4fac-8e3a-241089d6a7fb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:14.088615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cfdbe649-c156-480d-bb0e-f5836178ff6e req-8d2744e0-1bde-4fac-8e3a-241089d6a7fb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:14.120852 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cfdbe649-c156-480d-bb0e-f5836178ff6e req-8d2744e0-1bde-4fac-8e3a-241089d6a7fb service nova] Creating event network-vif-deleted:a4113c34-81c7-4ba8-8d4b-f77aafbd6b49 for instance 8caa4898-da56-4180-b2e8-0f07b4ac2695 on n-h2-851368-1 Jul 28 11:46:14.126751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cfdbe649-c156-480d-bb0e-f5836178ff6e req-8d2744e0-1bde-4fac-8e3a-241089d6a7fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084130 Jul 28 11:46:14.128478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2218/4466] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:14.135358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:14.136441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:14.159906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:14.163964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:14.168474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:14.180163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:14.719516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:14.740454 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7fe33178-66aa-47bb-a80d-233f60552939 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1288 microversion: 2.1 time: 0.951559 Jul 28 11:46:14.759020 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2249/4467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:13 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1288 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:14.804449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:14.805338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:14.816258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:14.819974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:14.820994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:14.821604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.250849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:15.260219 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71b08285-daea-4097-856d-870831d71450 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1662 microversion: 2.1 time: 1.129903 Jul 28 11:46:15.260819 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2219/4468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:14 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1662 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:15.296232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:15.296920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:15.313482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:15.314224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.317513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:15.317993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.518822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:15.529046 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a529387-ac6f-496c-a43a-563a9c7dc4b5 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1608 microversion: 2.1 time: 0.241791 Jul 28 11:46:15.545514 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2220/4469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:15 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1608 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:15.551169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-39b06465-1aff-4e9e-8145-91682b517dd1 req-09f08937-5dc2-4a6a-aec0-b46afde61cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5404596b-ec64-4fae-af8d-5e617e2b5787", "tag": "e3595294-77fb-44e0-bc8c-5784faabf48e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:15.561654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-39b06465-1aff-4e9e-8145-91682b517dd1 req-09f08937-5dc2-4a6a-aec0-b46afde61cfc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:15.562464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-39b06465-1aff-4e9e-8145-91682b517dd1 req-09f08937-5dc2-4a6a-aec0-b46afde61cfc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.576356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-39b06465-1aff-4e9e-8145-91682b517dd1 req-09f08937-5dc2-4a6a-aec0-b46afde61cfc service nova] Creating event network-changed:e3595294-77fb-44e0-bc8c-5784faabf48e for instance 5404596b-ec64-4fae-af8d-5e617e2b5787 on n-h2-851368-1 Jul 28 11:46:15.581530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-39b06465-1aff-4e9e-8145-91682b517dd1 req-09f08937-5dc2-4a6a-aec0-b46afde61cfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034397 Jul 28 11:46:15.582527 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2221/4470] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:15.591228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:15.607645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4ff95f1-de99-46de-b39a-6e15384daaac tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.807410 Jul 28 11:46:15.608224 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2250/4471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:14 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:15.766299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:15.767270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:15.789942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:15.790581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.791872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:15.792462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:15.955901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:15.971701 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8dcae305-db5d-42dd-80c4-6fa3f462ede7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1276 microversion: 2.1 time: 0.209435 Jul 28 11:46:15.973324 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2222/4472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:15 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:16.281766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:16.283350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:16.305064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.306149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.307109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.307635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.314045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:16.552877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:16.554847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:16.561845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.562299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.563104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.563545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.702787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:16.731852 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-35b20bd8-6352-47bd-9d2f-3bb7c251ad57 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1608 microversion: 2.1 time: 0.178872 Jul 28 11:46:16.735724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2223/4473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:16 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1608 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:16.750923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:16.766666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-003d9252-9e16-48c2-b554-54e6b7cd13a6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1662 microversion: 2.1 time: 0.485641 Jul 28 11:46:16.767546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:16.768380 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2251/4474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:16 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1662 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:16.769218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:16.778864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.779648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.781715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:16.782365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:16.993795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:16.994679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:17.006669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.009249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:17.012976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.013641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:17.274868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:17.289487 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed8fda21-9202-4f64-bd5c-f1d0c04a79b5 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1276 microversion: 2.1 time: 0.294259 Jul 28 11:46:17.291087 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2252/4475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:16 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:17.760901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:17.761892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:17.775797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.776801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:17.780051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.780845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:17.827061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:17.842863 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-161ac8fb-8ddb-4a59-a0df-9853afcb56fd tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 1.105630 Jul 28 11:46:17.856495 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2224/4476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:16 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:17.862012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:17.867134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:17.879476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:17.881920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.882559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:17.886968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:17.887690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:18.172347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3489992bab7b4f57a6544f31ba18f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb229519f2fb4be4a84cc037285a03d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:18.183409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66f421e0-5cb8-4c4a-842b-448aecfaea5d tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 200 len: 1608 microversion: 2.1 time: 0.427271 Jul 28 11:46:18.195607 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2253/4477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:17 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 1608 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:18.201686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-33541913-3a44-4bfa-803e-73e4d447ae70 req-3d28a536-c44f-4971-8943-6fe2cbc504ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5", "name": "network-vif-deleted", "tag": "2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:18.223325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-33541913-3a44-4bfa-803e-73e4d447ae70 req-3d28a536-c44f-4971-8943-6fe2cbc504ee service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:18.224012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-33541913-3a44-4bfa-803e-73e4d447ae70 req-3d28a536-c44f-4971-8943-6fe2cbc504ee service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:18.263969 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-33541913-3a44-4bfa-803e-73e4d447ae70 req-3d28a536-c44f-4971-8943-6fe2cbc504ee service nova] Creating event network-vif-deleted:2d4b3b9e-6e07-4b7a-9370-2a6f5a60570a for instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 on n-h2-851368-1 Jul 28 11:46:18.272812 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-33541913-3a44-4bfa-803e-73e4d447ae70 req-3d28a536-c44f-4971-8943-6fe2cbc504ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084089 Jul 28 11:46:18.275143 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2254/4478] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:18.320024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:18.321434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:18.336556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:18.337252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:18.338519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:18.339167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:18.796726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:18.805112 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5f6f59a-49de-4073-82a5-73ed4c408295 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.492247 Jul 28 11:46:18.813500 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2255/4479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:18 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:18.863531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:18.864165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:18.874070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:18.874561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:18.880028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:18.880887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:19.102834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:19.121359 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-811af387-afe0-4af5-a72f-89365e6f5cf0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1666 microversion: 2.1 time: 1.263026 Jul 28 11:46:19.124137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2225/4480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:17 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1666 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:19.217303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:19.218086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] [instance: 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:19.225747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:19.226266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:19.227146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:19.227850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:19.253228 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] HTTP exception thrown: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Request method failure captured: Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 HTTP/1.1 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nTcsgwdouD4zTNVLIWqUva-0Grf1PBBiw2nJ3jO6fNbI24_0JOeqUYZCS8qNKck8UJrDbr3lMpmLw3UYccAqU-wwLPlQ0-8EwaxIsmznsBAtrJTE8WKwCefGP82Ir1o9PpHvjqUZhHFBkwLKEfeNl4FB9Qsb3uLtObL5a3SXJOkLrY Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eb229519f2fb4be4a84cc037285a03d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eb229519f2fb4be4a84cc037285a03d5"}]}] Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: eb229519f2fb4be4a84cc037285a03d5 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-119549498 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3489992bab7b4f57a6544f31ba18f621 Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-119549498-project Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5'} Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:19.255182 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Returning 404 to user: Instance 68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:19.259506 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f8cae74a-ee69-4846-83ab-db2d9956d567 tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5" status: 404 len: 111 microversion: 2.1 time: 0.052622 Jul 28 11:46:19.261024 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2226/4481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:19 2022] GET /compute/v2.1/servers/68eeee4c-8bf1-4b8c-b8ce-85ee56cc88b5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:46:19.266339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f627bcba-6209-45bf-a334-83dc45873a4c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] Calling method '.version_select at 0x7f2eb1af1ee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:19.290531 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f627bcba-6209-45bf-a334-83dc45873a4c tempest-ServerActionsTestJSON-119549498 tempest-ServerActionsTestJSON-119549498-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217522076" status: 202 len: 0 microversion: 2.1 time: 0.028270 Jul 28 11:46:19.294724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2227/4482] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217522076 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:46:19.720633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:19.731653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e0d9f05-493d-428f-a58a-0f9f1fc6434c tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.872270 Jul 28 11:46:19.747578 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2256/4483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:18 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:19.842963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:19.849524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:19.862541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:19.863414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:19.864447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:19.865112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:20.165913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:20.178017 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47f48970-9eba-4689-95fd-c91508e3b9be tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.349591 Jul 28 11:46:20.198365 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2228/4484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:19 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:20.614593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2f1ed84c-b504-467c-9af5-bea0d4bbc3a6 req-4b9e9ee2-ae3f-494b-a0b9-a034ca4f109e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746a18ef-bee6-4be7-9c28-6bca3849ea4f", "tag": "446013b5-a897-4ae3-a6fd-defd6bf8f97a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:20.644793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:20.670201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2f1ed84c-b504-467c-9af5-bea0d4bbc3a6 req-4b9e9ee2-ae3f-494b-a0b9-a034ca4f109e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:20.671394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2f1ed84c-b504-467c-9af5-bea0d4bbc3a6 req-4b9e9ee2-ae3f-494b-a0b9-a034ca4f109e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:20.692120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2f1ed84c-b504-467c-9af5-bea0d4bbc3a6 req-4b9e9ee2-ae3f-494b-a0b9-a034ca4f109e service nova] Creating event network-changed:446013b5-a897-4ae3-a6fd-defd6bf8f97a for instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f on n-h1-851368-1 Jul 28 11:46:20.701478 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2f1ed84c-b504-467c-9af5-bea0d4bbc3a6 req-4b9e9ee2-ae3f-494b-a0b9-a034ca4f109e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090073 Jul 28 11:46:20.702416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2257/4485] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:20.754262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:20.754895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:20.767860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:20.768324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:20.769129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:20.769577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:21.208104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:21.209932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:21.213411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:21.220767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:21.221472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:21.222544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:21.223455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:21.332595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:21.349011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:21.354979 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8f5d25d-0ce1-41a2-b55b-05d5bd2338e5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.605098 Jul 28 11:46:21.356573 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2229/4486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:20 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:21.503501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:21.531857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-122daef2-b6ef-4408-bb44-046491f7b53e tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.316873 Jul 28 11:46:21.545835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2258/4487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:21 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:22.377689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:22.378448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:22.394942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:22.395624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:22.396517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:22.397972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:22.553673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:22.554990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:22.563927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:22.564643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:22.565660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:22.566783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:22.776492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:22.784978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-815b7aa9-5b22-4c55-9759-81aa4253be68 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.412644 Jul 28 11:46:22.785918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2230/4488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:22 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:22.811028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a7055104-70a1-4d58-a047-7f825ed6f6b2 req-bf563cc5-28c6-4fa7-8f4c-f8fb8e9db045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d40418a-eb2d-47c5-a194-b41330e458c6", "tag": "302251a2-a26c-4144-aa58-2f3f7859229f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:22.825226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a7055104-70a1-4d58-a047-7f825ed6f6b2 req-bf563cc5-28c6-4fa7-8f4c-f8fb8e9db045 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:22.829090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a7055104-70a1-4d58-a047-7f825ed6f6b2 req-bf563cc5-28c6-4fa7-8f4c-f8fb8e9db045 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:22.847918 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a7055104-70a1-4d58-a047-7f825ed6f6b2 req-bf563cc5-28c6-4fa7-8f4c-f8fb8e9db045 service nova] Creating event network-changed:302251a2-a26c-4144-aa58-2f3f7859229f for instance 2d40418a-eb2d-47c5-a194-b41330e458c6 on n-h1-851368-1 Jul 28 11:46:22.854971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a7055104-70a1-4d58-a047-7f825ed6f6b2 req-bf563cc5-28c6-4fa7-8f4c-f8fb8e9db045 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051750 Jul 28 11:46:22.855774 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2231/4489] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:22.894751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:22.908922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0742b109-9405-4d2d-baaa-ee6e9a2f788f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.359354 Jul 28 11:46:22.927634 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2259/4490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:22 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:23.822816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:23.824312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:23.839593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:23.840267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:23.841234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:23.841839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:23.932518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:23.933483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:23.946075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:23.947111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:23.955499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:23.956258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:24.370491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:24.387741 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9bec9124-dc21-4bfb-849b-a65830839d93 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.580217 Jul 28 11:46:24.388648 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2232/4491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:23 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:24.470753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:24.486238 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88e5e9b6-39c4-401b-9489-45e8305870d8 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.558810 Jul 28 11:46:24.487346 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2260/4492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:23 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:25.409080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:25.409697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:25.421528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:25.424576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:25.425593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:25.426682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:25.508308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:25.509915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:25.518721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:25.519416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:25.526870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:25.531041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:25.875627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:25.887624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cdb00d1d-efc5-4dc9-8507-de78b75f806a tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.482384 Jul 28 11:46:25.888722 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2233/4493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:25 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:26.477379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:26.489688 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae20ca92-65f9-4500-9a8d-6164be6afc1c tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.985730 Jul 28 11:46:26.491314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2261/4494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:25 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:26.909241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:26.910731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:26.924246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:26.925308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:26.927689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:26.930900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:27.460466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:27.476792 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b2e8a6b-02a0-4f7d-9ce4-094ff501bfc2 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.571466 Jul 28 11:46:27.478431 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2234/4495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:26 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:27.516024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:27.516908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:27.531858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:27.533920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:27.535526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:27.539984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:27.983396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:27.998023 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc5209f8-5d9c-45aa-b616-93a52fee9acd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.486645 Jul 28 11:46:28.016715 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2262/4496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:27 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:28.500864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:28.503027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:28.521075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:28.523679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:28.525674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:28.527536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:28.921903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-19fc5e76-e803-4ab7-bd29-1b0261269791 req-d3794545-be5c-47db-a147-b3eff31f19a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5404596b-ec64-4fae-af8d-5e617e2b5787", "name": "network-vif-plugged", "status": "completed", "tag": "e3595294-77fb-44e0-bc8c-5784faabf48e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:28.972001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-19fc5e76-e803-4ab7-bd29-1b0261269791 req-d3794545-be5c-47db-a147-b3eff31f19a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:28.972001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-19fc5e76-e803-4ab7-bd29-1b0261269791 req-d3794545-be5c-47db-a147-b3eff31f19a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:28.995840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-19fc5e76-e803-4ab7-bd29-1b0261269791 req-d3794545-be5c-47db-a147-b3eff31f19a7 service nova] Creating event network-vif-plugged:e3595294-77fb-44e0-bc8c-5784faabf48e for instance 5404596b-ec64-4fae-af8d-5e617e2b5787 on n-h2-851368-1 Jul 28 11:46:29.003444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-19fc5e76-e803-4ab7-bd29-1b0261269791 req-d3794545-be5c-47db-a147-b3eff31f19a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086549 Jul 28 11:46:29.005021 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2263/4497] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:46:29.024515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:29.025432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:29.043680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:29.044147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:29.045176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:29.045801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:29.188172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:29.240640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9436c48f-caa8-490e-be00-0868e28e2036 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.743545 Jul 28 11:46:29.241807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2235/4498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:28 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:29.386147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:29.406316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9bd94c6e-4f8d-472d-8c62-8d926335f9d6 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.375399 Jul 28 11:46:29.429730 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2264/4499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:29 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:30.272539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:30.274741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:30.299021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:30.309393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:30.310409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:30.310758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:30.437973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:30.441167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:30.462899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:30.463715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:30.464585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:30.466481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:30.951044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:30.968464 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-444dca75-3a75-4cbd-bb45-d558343107b0 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1292 microversion: 2.1 time: 0.705124 Jul 28 11:46:30.971704 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2236/4500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:30 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1292 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:31.069137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-053dea00-441e-4981-8856-f84c43034c4e req-a3738571-43da-4719-8067-1721b370e99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d40418a-eb2d-47c5-a194-b41330e458c6", "name": "network-vif-plugged", "status": "completed", "tag": "302251a2-a26c-4144-aa58-2f3f7859229f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:31.085197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-053dea00-441e-4981-8856-f84c43034c4e req-a3738571-43da-4719-8067-1721b370e99e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:31.089697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-053dea00-441e-4981-8856-f84c43034c4e req-a3738571-43da-4719-8067-1721b370e99e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:31.105647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:31.117640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed4d5125-afa9-495a-bb98-ea5ff5b29a3a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.683622 Jul 28 11:46:31.119803 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2265/4501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:30 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:31.122773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-053dea00-441e-4981-8856-f84c43034c4e req-a3738571-43da-4719-8067-1721b370e99e service nova] Creating event network-vif-plugged:302251a2-a26c-4144-aa58-2f3f7859229f for instance 2d40418a-eb2d-47c5-a194-b41330e458c6 on n-h1-851368-1 Jul 28 11:46:31.129520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-053dea00-441e-4981-8856-f84c43034c4e req-a3738571-43da-4719-8067-1721b370e99e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064251 Jul 28 11:46:31.130969 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2237/4502] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:46:31.989906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:31.991402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:31.999984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.001283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:32.002711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.003471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:32.158308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:32.159764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:32.190743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.191811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:32.196904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.197678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:32.500556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:32.514305 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24669beb-3f64-4551-b7d7-3a1480c28d04 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1483 microversion: 2.1 time: 0.527416 Jul 28 11:46:32.516005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2266/4503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:31 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1483 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:32.536789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:32.538437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:32.546790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.547688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:32.549393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:32.550070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:33.103971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:33.112650 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb8b691d-2936-44d5-93cb-cfd3fbe8bfc4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1318 microversion: 2.1 time: 0.970744 Jul 28 11:46:33.113780 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2238/4504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:32 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:33.161645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-50294c7d-dc38-4c79-8d33-906351f71743 req-5e8b239d-169f-48d8-9c19-c5d4faef4003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746a18ef-bee6-4be7-9c28-6bca3849ea4f", "name": "network-vif-plugged", "status": "completed", "tag": "446013b5-a897-4ae3-a6fd-defd6bf8f97a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:33.180150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-50294c7d-dc38-4c79-8d33-906351f71743 req-5e8b239d-169f-48d8-9c19-c5d4faef4003 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:33.189808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-50294c7d-dc38-4c79-8d33-906351f71743 req-5e8b239d-169f-48d8-9c19-c5d4faef4003 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:33.212360 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-50294c7d-dc38-4c79-8d33-906351f71743 req-5e8b239d-169f-48d8-9c19-c5d4faef4003 service nova] Creating event network-vif-plugged:446013b5-a897-4ae3-a6fd-defd6bf8f97a for instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f on n-h1-851368-1 Jul 28 11:46:33.217851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-50294c7d-dc38-4c79-8d33-906351f71743 req-5e8b239d-169f-48d8-9c19-c5d4faef4003 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059765 Jul 28 11:46:33.219149 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2239/4505] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:46:33.235682 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-174e5f3a-251f-436b-87d2-81eed46c9dd4 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.703400 Jul 28 11:46:33.242478 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2267/4506] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:46:32 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787/os-interface => generated 284 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:46:34.138032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:34.138973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:34.155984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:34.160650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:34.164503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:34.165560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:34.656034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:34.686687 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97d705ea-780b-4381-8119-a7119bb41cfd tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 200 len: 1505 microversion: 2.1 time: 0.553292 Jul 28 11:46:34.688187 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2240/4507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:34 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:34.714640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:34.716287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:34.734196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:34.735458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:34.736983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:34.737657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:35.267019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:35.276916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1849d1a7-c977-48ed-b863-4d50b9917fcb tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1318 microversion: 2.1 time: 0.570351 Jul 28 11:46:35.280813 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2268/4508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:34 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:35.781727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:35.782351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:35.798299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:35.798946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:35.799825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:35.811346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.062450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-472963958", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:36.159339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:36.170920 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eff04858-a915-403e-b3e4-7c0793312340 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1483 microversion: 2.1 time: 0.392967 Jul 28 11:46:36.176005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2269/4509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:35 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1483 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:46:36.180629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:46:36.181078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:46:36.181569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:46:36.185474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:46:36.186147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:46:36.222913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:36.223518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.225817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:36.227406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.285878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6d846400-3f78-4104-a601-bfe3b64f7ed0 req-1fe50c10-5659-4de4-a4a4-6428069e1529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5404596b-ec64-4fae-af8d-5e617e2b5787", "tag": "e3595294-77fb-44e0-bc8c-5784faabf48e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:36.303391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Getting quotas for project 1470b685d68b4d24b39583b895678797. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:36.319411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Getting quotas for user 3a1ea1c23ca04523b4570b5fc8be38ef and project 1470b685d68b4d24b39583b895678797. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:36.326419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6d846400-3f78-4104-a601-bfe3b64f7ed0 req-1fe50c10-5659-4de4-a4a4-6428069e1529 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:36.327330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6d846400-3f78-4104-a601-bfe3b64f7ed0 req-1fe50c10-5659-4de4-a4a4-6428069e1529 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.340982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:46:36.344278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:36.381101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:36.393529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6d846400-3f78-4104-a601-bfe3b64f7ed0 req-1fe50c10-5659-4de4-a4a4-6428069e1529 service nova] Creating event network-changed:e3595294-77fb-44e0-bc8c-5784faabf48e for instance 5404596b-ec64-4fae-af8d-5e617e2b5787 on n-h2-851368-1 Jul 28 11:46:36.420070 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6d846400-3f78-4104-a601-bfe3b64f7ed0 req-1fe50c10-5659-4de4-a4a4-6428069e1529 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237913 Jul 28 11:46:36.422499 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2270/4510] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:36.430538 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-21437232-05fe-4048-a2fb-81b1f717ae95 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.939840 Jul 28 11:46:36.434969 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2241/4511] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:46:36.442785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:36.443979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:36.446301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:36.447123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:36.482401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:36.482870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.486298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:36.486746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:36.542920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:36.553305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:36.560044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:36.561590 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7bd69da2-149d-4696-b306-8d6213f80461 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1280 microversion: 2.47 time: 0.119700 Jul 28 11:46:36.564580 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2242/4512] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:36 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:46:37.046053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:37.056590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54e30f47-da76-45c5-bbc9-1687f74b5ee7 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1506 microversion: 2.1 time: 0.631404 Jul 28 11:46:37.068041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2271/4513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:36 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:37.093501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:37.094007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:37.105249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.105861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.106772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.111618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.166178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:37.373848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10c88a2a-dba7-4a7b-bd9b-2b7d7108dc6f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "DELETE /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 204 len: 0 microversion: 2.1 time: 0.284080 Jul 28 11:46:37.380015 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2243/4514] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:37 2022] DELETE /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:37.383481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:37.384044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:37.394064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.396136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.397521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.398004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.465232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:37.586285 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c963131e-632f-461b-9a4c-cd0adfc0dace tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 204 len: 0 microversion: 2.1 time: 0.207069 Jul 28 11:46:37.587473 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2272/4515] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:46:37 2022] DELETE /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:46:37.593100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:37.593805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:37.600696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:37.601679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:37.616577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.617520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.617980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.618521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.618773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.619278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:37.624134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:37.626532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:38.252749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:38.269616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:38.271270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:38.272461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7bfd3f85-1aad-45e3-a7bb-87f9f8c75b13 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1276 microversion: 2.47 time: 0.688521 Jul 28 11:46:38.273030 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2244/4516] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:37 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1276 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:38.795433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:38.807244 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3357ad4b-e19f-406e-ae9f-e4905cdf9e58 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1512 microversion: 2.1 time: 1.214640 Jul 28 11:46:38.809023 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2273/4517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:37 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1512 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:39.298279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:39.299367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:39.315629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:39.316141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:39.319137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:39.319834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:39.563443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:39.581347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:39.584879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:39.586070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d40f088-ac28-4a60-b7e8-67977da59184 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1338 microversion: 2.47 time: 0.292740 Jul 28 11:46:39.586633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2245/4518] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:39 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:46:39.833885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:39.835098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:39.848358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:39.848815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:39.849693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:39.850133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:40.330846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:40.378974 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d94cb996-bf9a-4737-b2d7-eee2ecae8271 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1512 microversion: 2.1 time: 0.549026 Jul 28 11:46:40.383608 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2274/4519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:39 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:40.610778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:40.612372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:40.624886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:40.629550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:40.630400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:40.632037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:40.790498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:40.805587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:40.812330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:40.817889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12b47d37-b2c7-4ad6-8962-de1d75fc02b2 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1338 microversion: 2.47 time: 0.210956 Jul 28 11:46:40.820839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2246/4520] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:40 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1338 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:41.410326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:41.411108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:41.416054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:41.425821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:41.430509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:41.431672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:41.445130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:41.845686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:41.846299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:41.854433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:41.855119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:41.856633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:41.857229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.010377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.027434 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6848fbf6-683f-41c4-94ab-c09884cb4951 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1512 microversion: 2.1 time: 0.622365 Jul 28 11:46:42.028501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.028724 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2275/4521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:41 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:42.043000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.046045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.049020 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cbe19a00-d9d5-4421-9221-91a0c2e63be3 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1359 microversion: 2.47 time: 0.206687 Jul 28 11:46:42.058389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2247/4522] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:41 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:46:42.075886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1280117163"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:42.079262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:42.087267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.088384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.089917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.090526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.375873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be33731a-ea0c-424d-b1f8-bd67b8f9af65 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "POST /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0/action" status: 202 len: 52 microversion: 2.47 time: 0.289993 Jul 28 11:46:42.404486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2276/4523] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:46:42 2022] POST /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0/action => generated 52 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:46:42.416940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:42.417626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:42.432510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.435881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.437502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.438112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.493880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:42.502289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:46:42.678907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb4d5954-741a-454a-85bf-89aa0dd119e4 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "DELETE /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 204 len: 0 microversion: 2.47 time: 0.270184 Jul 28 11:46:42.680164 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2248/4524] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:46:42 2022] DELETE /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:46:42.696048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:42.697712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:42.707348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.708023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.709027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.709685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.847406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.856933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.858728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:42.860506 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95cb4de1-a34e-4546-b4ea-26e830f583ff tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1365 microversion: 2.47 time: 0.172330 Jul 28 11:46:42.862719 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2277/4525] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:42 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:46:42.916756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b752ca34-7a00-4133-a5d0-a1e234aad7a4 req-76df28fd-cc85-4a2f-8a11-ec347fbb9930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746a18ef-bee6-4be7-9c28-6bca3849ea4f", "name": "network-vif-deleted", "tag": "446013b5-a897-4ae3-a6fd-defd6bf8f97a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:42.944911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b752ca34-7a00-4133-a5d0-a1e234aad7a4 req-76df28fd-cc85-4a2f-8a11-ec347fbb9930 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:42.945668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b752ca34-7a00-4133-a5d0-a1e234aad7a4 req-76df28fd-cc85-4a2f-8a11-ec347fbb9930 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:42.993678 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b752ca34-7a00-4133-a5d0-a1e234aad7a4 req-76df28fd-cc85-4a2f-8a11-ec347fbb9930 service nova] Creating event network-vif-deleted:446013b5-a897-4ae3-a6fd-defd6bf8f97a for instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f on n-h1-851368-1 Jul 28 11:46:43.002323 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b752ca34-7a00-4133-a5d0-a1e234aad7a4 req-76df28fd-cc85-4a2f-8a11-ec347fbb9930 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102595 Jul 28 11:46:43.003013 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2249/4526] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:43.053097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:43.054141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:43.061004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:43.061874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:43.063582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:43.064273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:43.106525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:43.108004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:43.109272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lazy-loading 'fault' on Instance uuid 746a18ef-bee6-4be7-9c28-6bca3849ea4f {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:46:43.207065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833646315f904e32ab77a18777182dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3365b56930b94dcc917dec4a16bbd190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:43.217597 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df30d1f9-8006-40a8-89c5-14a5f97c54c4 tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 200 len: 1308 microversion: 2.1 time: 0.168746 Jul 28 11:46:43.219279 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2278/4527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:43 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:46:43.893856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:43.895463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:43.924609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:43.926076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:43.929100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:43.931686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:44.054584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:44.076876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:44.081727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:44.085875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e237ca5-5932-4430-b1f5-e649236b4020 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1365 microversion: 2.47 time: 0.199357 Jul 28 11:46:44.100113 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2250/4528] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:43 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:44.242343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:44.242908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 746a18ef-bee6-4be7-9c28-6bca3849ea4f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:44.257404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:44.257861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:44.258658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:44.262287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:44.309420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] HTTP exception thrown: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Request method failure captured: Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f HTTP/1.1 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nbaPBq6QNlp-Wsl_UcBV3az0j9TUQ7bLhno83XTfugRmmVTBC0nnaX2Ihh76gWiRlgx6Q0LZGxOv7O9ejWN4uHddBiDP0KdlSbjTr2vCTgsC0PEqrjCXeg-mFBJ2AX9phZNuP5lIyyLcedX__QM6Tf8ruPsjW0NbNaJzvnAgDSc_t0 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3365b56930b94dcc917dec4a16bbd190 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3365b56930b94dcc917dec4a16bbd190"}]}] Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3365b56930b94dcc917dec4a16bbd190 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-MultipleCreateTestJSON-755615317-project Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 833646315f904e32ab77a18777182dba Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-MultipleCreateTestJSON-755615317-project Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '746a18ef-bee6-4be7-9c28-6bca3849ea4f'} Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:44.311142 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Returning 404 to user: Instance 746a18ef-bee6-4be7-9c28-6bca3849ea4f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bea98a89-64ad-4e02-93dd-a731070df44f tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f" status: 404 len: 111 microversion: 2.1 time: 0.075916 Jul 28 11:46:44.316145 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2279/4529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:44 2022] GET /compute/v2.1/servers/746a18ef-bee6-4be7-9c28-6bca3849ea4f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:46:44.325676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:44.326565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] [instance: 2d40418a-eb2d-47c5-a194-b41330e458c6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:44.337229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:44.337976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:44.341697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:44.342944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:44.396088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] HTTP exception thrown: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Request method failure captured: Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 HTTP/1.1 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nbaPBq6QNlp-Wsl_UcBV3az0j9TUQ7bLhno83XTfugRmmVTBC0nnaX2Ihh76gWiRlgx6Q0LZGxOv7O9ejWN4uHddBiDP0KdlSbjTr2vCTgsC0PEqrjCXeg-mFBJ2AX9phZNuP5lIyyLcedX__QM6Tf8ruPsjW0NbNaJzvnAgDSc_t0 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 3365b56930b94dcc917dec4a16bbd190 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3365b56930b94dcc917dec4a16bbd190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3365b56930b94dcc917dec4a16bbd190"}]}] Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 3365b56930b94dcc917dec4a16bbd190 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-MultipleCreateTestJSON-755615317 Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-MultipleCreateTestJSON-755615317-project Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 833646315f904e32ab77a18777182dba Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-MultipleCreateTestJSON-755615317-project Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2d40418a-eb2d-47c5-a194-b41330e458c6'} Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:44.398444 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] Returning 404 to user: Instance 2d40418a-eb2d-47c5-a194-b41330e458c6 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a0d86e3a-6bf1-4d85-a13f-74391e8a908a tempest-MultipleCreateTestJSON-755615317 tempest-MultipleCreateTestJSON-755615317-project] 10.222.0.93 "GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6" status: 404 len: 111 microversion: 2.1 time: 0.080696 Jul 28 11:46:44.403016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2251/4530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:46:44 2022] GET /compute/v2.1/servers/2d40418a-eb2d-47c5-a194-b41330e458c6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:46:45.051273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-93519140-b8e2-43d1-b8a0-494b9bf57e8f req-b810c2c2-1cb3-419a-8e2a-d00aeaa2278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d40418a-eb2d-47c5-a194-b41330e458c6", "name": "network-vif-deleted", "tag": "302251a2-a26c-4144-aa58-2f3f7859229f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:45.075836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-93519140-b8e2-43d1-b8a0-494b9bf57e8f req-b810c2c2-1cb3-419a-8e2a-d00aeaa2278e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:45.075836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-93519140-b8e2-43d1-b8a0-494b9bf57e8f req-b810c2c2-1cb3-419a-8e2a-d00aeaa2278e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:45.099119 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-93519140-b8e2-43d1-b8a0-494b9bf57e8f req-b810c2c2-1cb3-419a-8e2a-d00aeaa2278e service nova] Creating event network-vif-deleted:302251a2-a26c-4144-aa58-2f3f7859229f for instance 2d40418a-eb2d-47c5-a194-b41330e458c6 on n-h1-851368-1 Jul 28 11:46:45.108867 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-93519140-b8e2-43d1-b8a0-494b9bf57e8f req-b810c2c2-1cb3-419a-8e2a-d00aeaa2278e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062690 Jul 28 11:46:45.110157 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2280/4531] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:46:45.114117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:45.115511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:45.122846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:45.123414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:45.124261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:45.124899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:45.485580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:45.495587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:45.501875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a1ea1c23ca04523b4570b5fc8be38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1470b685d68b4d24b39583b895678797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:45.507938 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7bbf3cb-e4a8-4b06-adec-7b6834847c90 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 200 len: 1365 microversion: 2.47 time: 0.397795 Jul 28 11:46:45.511060 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2252/4532] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:45 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:46:46.533350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:46.535520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] [instance: 61a9b482-51ab-4d05-be34-4f8d5a882bb0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:46.558609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:46.560860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:46.562620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:46.564652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:46.596141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] HTTP exception thrown: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Request method failure captured: Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 HTTP/1.1 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4ncbR8wy4ZmNY65w0dizySzLDJyDSFAqk3t7QWK0S2OsLLjJy-zbVz68a2yykouHCN_fDb9yJjWORg4LG9dPdLTpwkv4vpnhPa5FIcgjm89DCSi0Ugxz90MQU_VFaltfX2mjOXriOlp49HsC1qHCcOcTEcBpYXGXDrRuROrvRPugbcs Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1470b685d68b4d24b39583b895678797 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAaction247Test-1360459972 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1470b685d68b4d24b39583b895678797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1470b685d68b4d24b39583b895678797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1470b685d68b4d24b39583b895678797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1470b685d68b4d24b39583b895678797"}]}] Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAaction247Test-1360459972 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1470b685d68b4d24b39583b895678797 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAaction247Test-1360459972 Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAaction247Test-1360459972-project Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3a1ea1c23ca04523b4570b5fc8be38ef Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAaction247Test-1360459972-project Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '61a9b482-51ab-4d05-be34-4f8d5a882bb0'} Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:46:46.600050 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. Jul 28 11:46:46.604042 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:46:46.611238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] Returning 404 to user: Instance 61a9b482-51ab-4d05-be34-4f8d5a882bb0 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:46:46.612344 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34b4fe0d-1f10-4808-8d9b-340f4e9ee8b0 tempest-ServersAaction247Test-1360459972 tempest-ServersAaction247Test-1360459972-project] 10.222.0.93 "GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0" status: 404 len: 111 microversion: 2.47 time: 0.084446 Jul 28 11:46:46.613126 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2281/4533] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:46 2022] GET /compute/v2.1/servers/61a9b482-51ab-4d05-be34-4f8d5a882bb0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:46:50.544729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:50.546342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:50.766610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2110810719", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:50.785779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:46:50.865378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:46:50.866032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:46:50.866697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:46:50.873358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:46:50.874139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:46:50.886948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:50.887619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:50.888576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:50.889166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:50.908733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Getting quotas for project 0caef9bac3c84df498c4a7ef531917fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:50.914750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Getting quotas for user af6d5380f8e14a93b8d26c3f01d22b5d and project 0caef9bac3c84df498c4a7ef531917fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:50.928397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:46:50.931648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:50.994941 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-869ef54f-9eaf-4e20-ac48-7c07efab1679 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.454821 Jul 28 11:46:50.996503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2253/4534] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:46:51.009415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:51.010058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:51.165761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:51.178576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:51.184169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:51.185745 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9eddb019-1e0e-49d4-8173-15ad9ec8c496 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 200 len: 1278 microversion: 2.47 time: 0.182414 Jul 28 11:46:51.188563 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2282/4535] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:51 2022] GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:51.278563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1557952084", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:51.385852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:46:51.385852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:46:51.386259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:46:51.386711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:46:51.387159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:46:51.400233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:51.400893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:51.401875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:51.402480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:51.442290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Getting quotas for project 0caef9bac3c84df498c4a7ef531917fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:46:51.469680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Getting quotas for user af6d5380f8e14a93b8d26c3f01d22b5d and project 0caef9bac3c84df498c4a7ef531917fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:46:51.501568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:46:51.504201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:46:51.643391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ace9655-dba6-4af1-b438-72baf6b70bfe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.369008 Jul 28 11:46:51.645739 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2254/4536] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 11:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:46:51.660554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5fa0648d-c6bc-48a7-be84-49a3f7e9ded6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:46:51.664076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5fa0648d-c6bc-48a7-be84-49a3f7e9ded6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:51.840937 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5fa0648d-c6bc-48a7-be84-49a3f7e9ded6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "PUT /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 992 microversion: 2.47 time: 0.185822 Jul 28 11:46:51.842416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2283/4537] 10.222.0.93 () {62 vars in 1297 bytes} [Thu Jul 28 11:46:51 2022] PUT /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 992 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:46:51.864289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:51.865302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:52.174451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:52.185780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:52.190051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:52.193145 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73eab548-fc34-42b7-8ae5-e68b200e5e71 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1278 microversion: 2.47 time: 0.333472 Jul 28 11:46:52.196035 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2255/4538] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:51 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1278 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:53.222427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:53.223060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:53.246372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:53.246831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:53.254053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:53.255870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:54.025545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:54.035349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:54.037170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:54.038555 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3ea8f3d-8c0e-4b3c-9ec8-03a4f2256ee2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1330 microversion: 2.47 time: 0.820177 Jul 28 11:46:54.039648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2284/4539] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:53 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1330 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:55.063355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:55.064266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:55.085401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:55.086001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:55.089292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:55.090915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:55.279789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:55.297839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:55.299498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:55.301674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e023697-123b-48de-8633-6174a73abd28 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1336 microversion: 2.47 time: 0.242658 Jul 28 11:46:55.302871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2256/4540] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:55 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1336 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:56.329695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:56.330330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:56.346491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:56.348393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:56.355646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:56.356597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:56.628958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:56.653448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:56.659830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:56.665696 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd47933c-02cd-4dab-b2bc-cceffd67e6c4 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1336 microversion: 2.47 time: 0.341390 Jul 28 11:46:56.683100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2285/4541] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:56 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1336 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:57.698792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:57.699903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:57.711032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:57.711919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:57.713136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:57.714228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:57.867450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:57.883441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:57.886652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:57.888256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b128c9b0-6326-419e-b32f-0354335c1c3e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1336 microversion: 2.47 time: 0.196378 Jul 28 11:46:57.889342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2257/4542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:57 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1336 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:46:58.916946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:46:58.918502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:46:58.931806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:58.932851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:58.935105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:46:58.938892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:46:59.090383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:59.105206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:59.110848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:46:59.112726 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9bb44b18-3467-4012-84a4-f8be68b38cbe tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1336 microversion: 2.47 time: 0.203727 Jul 28 11:46:59.113314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2286/4543] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:46:58 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:00.145484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:00.147676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:00.168349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:00.169576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:00.174180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:00.175627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:00.349454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:00.367424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:00.369493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:00.371244 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-675afb2e-d1c0-4555-baf6-ca34039a9111 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1336 microversion: 2.47 time: 0.231639 Jul 28 11:47:00.372214 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2258/4544] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:00 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1336 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:01.397203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:01.398744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:01.412199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:01.417049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.419105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.422007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.423944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.572809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:01.582059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:01.588984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:01.596599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f792979-2641-4c3a-a587-1c5fd0433536 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1357 microversion: 2.47 time: 0.200532 Jul 28 11:47:01.597928 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2287/4545] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:01 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:01.628357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:01.635874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:01.646413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:01.660587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.663192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.664250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.664732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.792234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:47:01.793028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:47:01.793749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:47:01.794453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:47:01.795812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:47:01.897401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:01.911255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.912804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.915886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:01.917797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:01.995418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-58bbe678-a6f1-4af9-b0fa-a4bb1634f1f9 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "POST /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc/action" status: 202 len: 1079 microversion: 2.47 time: 0.375224 Jul 28 11:47:02.007124 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2259/4546] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 11:47:01 2022] POST /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc/action => generated 1079 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 11:47:02.020278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:02.023046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:02.036362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:02.037971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:02.042218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:02.042985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:02.048671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:02.222247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:02.236325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:02.240031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:02.242738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25a1de93-a981-406a-b674-c70339b126e1 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.228699 Jul 28 11:47:02.254118 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2288/4547] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:02 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:03.268298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:03.268824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:03.271743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:03.286170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:03.287609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:03.296260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:03.297008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:03.540934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:03.559216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:03.561352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:03.563246 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e207d58-8db7-4bdc-b207-26e9778db925 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.299051 Jul 28 11:47:03.577230 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2260/4548] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:03 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:04.593094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:04.593901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:04.615172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:04.639695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:04.642712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:04.644400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:04.989778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:05.004001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:05.008227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:05.010586 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a3fa1c4-c1d3-4e02-9dab-2de3452ac7e5 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.423315 Jul 28 11:47:05.012976 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2289/4549] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:04 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:06.039159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:06.041182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:06.050164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:06.051256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:06.053093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:06.053754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:06.197083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:06.223145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:06.230779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:06.233889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2256d05d-34dc-4d46-baae-89cdb11d08cb tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.200438 Jul 28 11:47:06.236707 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2261/4550] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:06 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:47:07.261884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:07.262632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:07.284592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:07.285999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:07.287705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:07.290000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:07.622329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:07.635027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:07.636564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:07.637769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c5203e44-fdcc-42e3-8916-424e8701c87c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.380111 Jul 28 11:47:07.644476 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2290/4551] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:07 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:08.669060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:08.670232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:08.691863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:08.693152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:08.694316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:08.695269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:08.934631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:08.959983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:08.966174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:08.969516 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3296c9c4-e2d3-49e2-9c8a-8e4bc74ce007 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.304990 Jul 28 11:47:08.970914 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2262/4552] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:08 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:09.995704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:09.997938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:10.006235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:10.007094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:10.008451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:10.009217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:10.193348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:10.206271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:10.212599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:10.215536 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1027bf2b-b8db-4f36-b4e2-6b148118d83e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.225034 Jul 28 11:47:10.218773 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2291/4553] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:09 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:11.254200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:11.256041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:11.270193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.270979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.273420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.277932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.541386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1879036175", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:11.558792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=44 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:11.596496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:11.617069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:11.619597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:11.621280 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-467ca860-e894-46f8-bd76-c3a55936fb7e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.374367 Jul 28 11:47:11.622393 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2263/4554] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:11 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:11.625173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] validate_networks() for [('296d8e3d-c0bd-41f9-a9ef-9c3b5119623b', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:47:11.770446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:11.779185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:11.780946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Searching by: {'deleted': False, 'project_id': '696b282e6af143e085f825332724e8c9'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:47:11.794285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.795726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.796603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.797262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.828386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:47:11.863909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:11.868819 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e214eb34-3619-46dd-be7c-f4cc4cb7f260 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.103134 Jul 28 11:47:11.870616 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2264/4555] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:47:11 2022] GET /compute/v2.1/servers => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:11.894408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:11.901200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:11.902782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Searching by: {'deleted': False, 'project_id': '696b282e6af143e085f825332724e8c9'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:47:11.915477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.916211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.917175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:11.918099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:11.974829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:47:12.040085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:12.049553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:12.050401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:12.609099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-57beb858-9e24-449d-a8e6-995e80850c7b tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.726820 Jul 28 11:47:12.609775 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2265/4556] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:47:11 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:12.633858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-600abfec-9036-4a76-9855-15bab10822d3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:12.642902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-600abfec-9036-4a76-9855-15bab10822d3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013513 Jul 28 11:47:12.650622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2266/4557] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:47:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:47:12.657130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:12.657965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:12.665585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:12.666292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:12.667406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:12.667854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:12.769844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:12.781127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:12.783308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:12.785091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-78719a2e-c670-4a9a-85d5-1e787f91c029 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.133005 Jul 28 11:47:12.785821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2267/4558] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:12 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:13.102920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:47:13.105153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:47:13.105304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:47:13.105793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:47:13.106427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:47:13.136015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.137908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.146685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.148929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.196887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Getting quotas for project 0b484d29d9d84c1eb810d225067ed200. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:47:13.229355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Getting quotas for user aaf441a6a66c467caf33c537038ed741 and project 0b484d29d9d84c1eb810d225067ed200. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:47:13.262234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:47:13.273857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:47:13.277847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:13.278361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:13.304602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.305062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.314043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.314256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.402496 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e2d1716-3a61-4cb8-b0f7-afb014cfb704 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104965 Jul 28 11:47:13.411498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2292/4559] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:47:13.425835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-720d0958-be65-473e-9e7d-59aab94a5421 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:13.428223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-720d0958-be65-473e-9e7d-59aab94a5421 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:13.433968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:47:13.705702 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad28e41e-74fd-49d4-96a7-25a14d00eca3 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 204 len: 0 microversion: 2.1 time: 0.431943 Jul 28 11:47:13.707648 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2268/4560] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:47:13 2022] DELETE /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:47:13.718378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:13.720400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:13.733765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.735740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.737224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.737979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.836823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-720d0958-be65-473e-9e7d-59aab94a5421 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:13.847325 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-720d0958-be65-473e-9e7d-59aab94a5421 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1224 microversion: 2.1 time: 0.430838 Jul 28 11:47:13.848099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2293/4561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:13 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1224 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:13.859392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:13.863430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:13.882018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.884259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:13.885829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:13.888249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:14.173954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:14.186903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:14.199140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:14.204194 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6ab99c0-031d-45f7-b1b3-0e9a5fb34d45 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.352106 Jul 28 11:47:14.206805 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2294/4562] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:13 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:14.444450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:14.456993 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b94d2970-31bb-4751-b088-8b0692e4cfbb tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1608 microversion: 2.1 time: 0.744830 Jul 28 11:47:14.457682 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2269/4563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:13 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1608 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:14.876581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:14.877231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:14.919424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:14.919889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:14.920687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:14.921154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.132232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:15.141413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d885e0db-e56f-4695-81a0-f19f082d02f8 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1228 microversion: 2.1 time: 0.271456 Jul 28 11:47:15.143951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2295/4564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:14 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1228 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:15.220173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:15.222848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:15.245887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:15.249191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:15.268643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.272201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.272692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.274173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.274173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.279924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.280707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.281157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.361727 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1891d78f-a427-4406-8e1e-a682f794eea7 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145881 Jul 28 11:47:15.368167 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2270/4565] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:47:15 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:47:15.478103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:15.478900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:15.479166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:15.492962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.493672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.494700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.497448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.527524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:15.533404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:15.559600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f6f70fd-b8e8-4e77-b601-344800b7aa20 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.322217 Jul 28 11:47:15.569339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2296/4566] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:15 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:15.582725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:15.600508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:15.612713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:47:15.620549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.621440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.628075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.628867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.876895 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b9b844dd-d11d-40d7-94cf-5bc31307de12 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 204 len: 0 microversion: 2.1 time: 0.404520 Jul 28 11:47:15.877497 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2271/4567] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:47:15 2022] DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:47:15.889992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:15.891885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:15.911968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.912734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:15.913744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:15.914388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:16.445152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.455152 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd40bb20-0767-423c-9fc4-29cd01af94ec tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1608 microversion: 2.1 time: 0.884248 Jul 28 11:47:16.455734 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2297/4568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:15 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1608 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:16.476072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:16.476701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:16.501385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:16.502620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:16.503634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:16.504083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:16.668333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.681228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.681730 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-709b271f-9220-4cdf-8703-291d91e64896 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1282 microversion: 2.1 time: 0.223163 Jul 28 11:47:16.693546 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2298/4569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:16 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:16.701177 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c40b9947-b75e-4476-ae56-41ea98c41e5c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1672 microversion: 2.1 time: 0.817424 Jul 28 11:47:16.702051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:16.702182 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2272/4570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:15 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1672 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:16.703310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:16.716494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:16.718324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:16.721382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:16.722251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:16.953898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.978653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.995139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:16.998454 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3b43d4d-ccad-42fd-b122-7a6ab766b0e8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.302058 Jul 28 11:47:17.001322 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2299/4571] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:16 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:17.478012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:17.479111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:17.492832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.493300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.494091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.494538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.705380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:17.706738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:17.717563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.718098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.719694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.721203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.746570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:17.755856 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28016530-e9dd-4c94-a2b9-b86fe302ff2e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1541 microversion: 2.1 time: 0.282940 Jul 28 11:47:17.763292 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2273/4572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:17 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1541 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:17.770384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:17.779021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:17.797229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.798080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.799573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:17.800234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:17.969865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:17.985433 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9e5f110c-e9d2-42ac-9da1-4a136372fa4b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1282 microversion: 2.1 time: 0.284238 Jul 28 11:47:17.987879 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2300/4573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:17 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:18.034507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:18.035677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:18.049396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:18.052692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:18.053636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:18.058212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:18.239042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:18.252460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:18.257452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:18.260555 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8fd7bc22-701a-42cd-8e18-ccb8bec82ab0 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.241474 Jul 28 11:47:18.261566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2301/4574] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:18 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:18.399566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:18.409827 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd3885c9-2b33-4730-9673-024617248677 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1672 microversion: 2.1 time: 0.645106 Jul 28 11:47:18.423366 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2274/4575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:17 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1672 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:18.785836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:18.786465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:18.799522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:18.803037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:18.804071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:18.804685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.025498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:19.026163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:19.065166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.066498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.069308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.070019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.579198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:19.589476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0fe7a392-a2bc-4d63-861e-a9dd272ead09 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1541 microversion: 2.1 time: 0.806691 Jul 28 11:47:19.594714 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2302/4576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:18 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1541 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:19.603292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:19.603938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:19.618822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.621454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.623598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.624077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.881697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:19.893995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:19.897166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:19.901512 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-349602b6-ef7b-4a82-9281-f0d54b09ec99 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.304948 Jul 28 11:47:19.906704 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2303/4577] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:19 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:19.920020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:19.920659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:19.940485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.940958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:19.941762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:19.942255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.060967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:20.074421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b20cefb8-f8a5-4668-a660-72965551274f tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 1.065983 Jul 28 11:47:20.094109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2275/4578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:19 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:20.105958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-195d35a0-9fd0-47a3-bb28-b41cb63c3de1 req-b0d8ce54-507d-4ced-aa04-f25e841c4367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5404596b-ec64-4fae-af8d-5e617e2b5787", "name": "network-vif-deleted", "tag": "e3595294-77fb-44e0-bc8c-5784faabf48e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:20.147887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-195d35a0-9fd0-47a3-bb28-b41cb63c3de1 req-b0d8ce54-507d-4ced-aa04-f25e841c4367 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:20.150577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-195d35a0-9fd0-47a3-bb28-b41cb63c3de1 req-b0d8ce54-507d-4ced-aa04-f25e841c4367 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.184042 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-195d35a0-9fd0-47a3-bb28-b41cb63c3de1 req-b0d8ce54-507d-4ced-aa04-f25e841c4367 service nova] Creating event network-vif-deleted:e3595294-77fb-44e0-bc8c-5784faabf48e for instance 5404596b-ec64-4fae-af8d-5e617e2b5787 on n-h2-851368-1 Jul 28 11:47:20.197101 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-195d35a0-9fd0-47a3-bb28-b41cb63c3de1 req-b0d8ce54-507d-4ced-aa04-f25e841c4367 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100100 Jul 28 11:47:20.198062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2276/4579] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:20.295224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:20.305232 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a050d3f-0c6d-4682-91f5-98ffb66131a4 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1605 microversion: 2.1 time: 0.397295 Jul 28 11:47:20.306991 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2304/4580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:19 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1605 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:20.613823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:20.615139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:20.628246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:20.630173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.632198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:20.632809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.934180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:20.934912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:20.946602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:20.955467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.957138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:20.958378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:20.999436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.008412 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-155dba8d-6589-4176-9cd1-f5e153f27042 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1252 microversion: 2.1 time: 0.399387 Jul 28 11:47:21.018110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2277/4581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:20 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1252 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:21.103203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:21.103905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:21.120067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:21.121606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:21.122156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:21.131660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:21.132287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:21.345916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.356212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.369037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.371150 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a57f3d3e-39a3-49bf-9da9-591c12b266dd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.441259 Jul 28 11:47:21.379132 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2305/4582] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:20 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:47:21.385031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:21.392407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:21.401238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:21.408781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:21.409834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:21.410413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:21.465880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:21.660229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.675740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4430f45b-8c0c-4644-b428-b3a1a1f50e57 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1605 microversion: 2.1 time: 0.302428 Jul 28 11:47:21.679500 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2306/4583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:21 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1605 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:21.928813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:21.931209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:21.943530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3164d326-bb88-49ce-8046-9cfd0bc4b302 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.844844 Jul 28 11:47:21.944914 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2278/4584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:21 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:22.032750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:22.034478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:22.054830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.058208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.059324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.062464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.200571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:22.211008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa585b1a-5177-404e-800c-2c8b14da1b0e tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1252 microversion: 2.1 time: 0.183473 Jul 28 11:47:22.226728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2307/4585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:22 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1252 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:22.332835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d739b5e9-1e48-4a51-b096-7788142d62c7 req-0e0276c3-5b7b-4fbb-89a1-cbadc072fb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be83408-f030-40e8-b48b-6b36c90449f3", "name": "network-vif-deleted", "tag": "6fd36397-9386-4b92-bb1e-ecf102352fe9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:22.347921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:22.360403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d739b5e9-1e48-4a51-b096-7788142d62c7 req-0e0276c3-5b7b-4fbb-89a1-cbadc072fb58 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.362612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d739b5e9-1e48-4a51-b096-7788142d62c7 req-0e0276c3-5b7b-4fbb-89a1-cbadc072fb58 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.396444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:22.399122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:22.412889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:22.428890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.429460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.430300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.431051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.441396 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d739b5e9-1e48-4a51-b096-7788142d62c7 req-0e0276c3-5b7b-4fbb-89a1-cbadc072fb58 service nova] Creating event network-vif-deleted:6fd36397-9386-4b92-bb1e-ecf102352fe9 for instance 2be83408-f030-40e8-b48b-6b36c90449f3 on n-h1-851368-1 Jul 28 11:47:22.462947 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d739b5e9-1e48-4a51-b096-7788142d62c7 req-0e0276c3-5b7b-4fbb-89a1-cbadc072fb58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134002 Jul 28 11:47:22.474286 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2279/4586] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:22.649755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:22.666694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:22.669746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:22.675612 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8aec3ea7-ec31-4664-a9b1-8ddf8eb24b0f tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.284020 Jul 28 11:47:22.706406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:22.708236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:22.711553 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2308/4587] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:22 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:22.717469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.718163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.719140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.719735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.762273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.763185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.764241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lazy-loading 'fault' on Instance uuid 2be83408-f030-40e8-b48b-6b36c90449f3 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:47:22.905473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:22.919907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-635dba3a-dc19-4dae-9e97-9e462f818cdf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 200 len: 1327 microversion: 2.1 time: 0.221687 Jul 28 11:47:22.922882 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2280/4588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:22 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 1327 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:22.974612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:22.975379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:22.986914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.987603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:22.988631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:22.989651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.175596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:23.234846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:23.235634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:23.248247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.256152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.257097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.257646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.623139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:23.632306 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b353f9c6-0b57-4fa9-aef2-df693fb79e1a tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.671168 Jul 28 11:47:23.646183 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2309/4589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:22 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:23.668882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:23.686855 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5e19a311-12d0-49a7-b262-6ea3e4cb0733 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1252 microversion: 2.1 time: 0.455989 Jul 28 11:47:23.701460 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2281/4590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:23 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1252 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:23.713203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:23.714878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:23.730191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.730647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.741321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.741832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.845060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:23.944057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:23.945108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:23.959032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.959852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:23.962037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:23.965939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:24.006410 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 HTTP/1.1 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2be83408-f030-40e8-b48b-6b36c90449f3'} Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:24.008284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:24.014910 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13a9fc33-05d1-437a-a6de-66defe107434 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 404 len: 111 microversion: 2.1 time: 0.071784 Jul 28 11:47:24.017830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2282/4591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:23 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:47:24.030284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2fe00fb6-e017-480e-8a50-5e38de0861af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '.version_select at 0x7f2ebbeadb80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:24.091857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2fe00fb6-e017-480e-8a50-5e38de0861af tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993161568" status: 202 len: 0 microversion: 2.1 time: 0.065863 Jul 28 11:47:24.095907 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2283/4592] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993161568 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:47:24.120801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:24.133272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:24.138370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:24.144049 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59b54bdb-d77f-4646-9eb8-b05537bdf9fd tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.436714 Jul 28 11:47:24.146364 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2310/4593] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:23 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:24.664568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:24.665332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:24.686173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:24.686767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:24.687607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:24.687986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:24.708668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:24.709274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:24.756327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:24.757911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:24.759350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:24.761084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:25.021846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:25.030527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d381b6d3-0e73-4f49-ae8a-36ed36f759e7 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1252 microversion: 2.1 time: 0.326839 Jul 28 11:47:25.046245 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2311/4594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:24 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1252 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:25.051709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e5dd2aeb-fd6d-47da-85e5-a8e06d1aa85c req-fd19393b-878c-4d13-9ccb-719233e91d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88fa20b-50bd-412b-b385-a6b85d8c6495", "tag": "ed0b37ba-45f7-4887-b533-14dfa9bd0a9d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:25.069164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e5dd2aeb-fd6d-47da-85e5-a8e06d1aa85c req-fd19393b-878c-4d13-9ccb-719233e91d85 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:25.071736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e5dd2aeb-fd6d-47da-85e5-a8e06d1aa85c req-fd19393b-878c-4d13-9ccb-719233e91d85 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:25.129686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e5dd2aeb-fd6d-47da-85e5-a8e06d1aa85c req-fd19393b-878c-4d13-9ccb-719233e91d85 service nova] Creating event network-changed:ed0b37ba-45f7-4887-b533-14dfa9bd0a9d for instance c88fa20b-50bd-412b-b385-a6b85d8c6495 on n-h2-851368-1 Jul 28 11:47:25.137485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e5dd2aeb-fd6d-47da-85e5-a8e06d1aa85c req-fd19393b-878c-4d13-9ccb-719233e91d85 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097749 Jul 28 11:47:25.139115 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2312/4595] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:25.177336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:25.178153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:25.185651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:25.186342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:25.188293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:25.189912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:25.198141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:25.206825 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15269e58-7cc5-4623-b298-fbce7b6de8b9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.546926 Jul 28 11:47:25.207442 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2284/4596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:24 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:25.345198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:25.359931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:25.363648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:25.365559 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4105c7a1-334d-4e3a-ac36-af684451b1d7 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.194470 Jul 28 11:47:25.385053 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2313/4597] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:25 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:26.053441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:26.054057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:26.063935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.064641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.065649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.066313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.234356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:26.237454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:26.256687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.257746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.259797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.261030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.283276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:26.292903 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ba377c6c-6e1d-4e90-9e65-d26c9b1cb1a5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1252 microversion: 2.1 time: 0.244145 Jul 28 11:47:26.293769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2285/4598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:26 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1252 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:26.394537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:26.399134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:26.411638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.412021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.414886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:26.419478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:26.714085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:26.722849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:26.725788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:26.727102 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1ff5cd1-b04d-4102-9e95-a59ee6c5e10a tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.338699 Jul 28 11:47:26.727769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2286/4599] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:26 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:26.741681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b3fe887-776d-47d7-aa43-27a87957215d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: .version_select at 0x7f2ebbed0af0>, body: {"keypair": {"name": "tempest-keypair-1670795972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Xxutb6lf1BU4V0fHzKORXwazT9bqErO2j1t8+itIaxGtCyA+wMEczD7mTUONhPu7ovzBjZU2QsilIlLLC2g5UtXGkSc6JFqLA6NUGqOXNSf84OLlpx6PIEZW7wr2BYQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:26.749171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5b3fe887-776d-47d7-aa43-27a87957215d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for project a4f889574d214453a98946a8548d3f54. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:47:26.756052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5b3fe887-776d-47d7-aa43-27a87957215d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for user 7e1c75be51e843a8a9555b396bbc5163 and project a4f889574d214453a98946a8548d3f54. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:47:26.782699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b3fe887-776d-47d7-aa43-27a87957215d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053833 Jul 28 11:47:26.783340 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2287/4600] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:47:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:27.027663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:27.045825 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-864f4f6e-a498-4a7e-ae0c-3915556a960b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.810802 Jul 28 11:47:27.047381 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2314/4601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:26 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:27.317802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:27.318425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:27.338801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:27.339574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:27.341584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:27.343587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:27.465215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:27.466671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:27.468187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lazy-loading 'fault' on Instance uuid 5404596b-ec64-4fae-af8d-5e617e2b5787 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:47:27.584672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf539bb83cc42c6bf522e6ca582c2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696b282e6af143e085f825332724e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:27.608575 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-128bc9aa-6027-423f-bd1a-5eb49a9cb6ea tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 200 len: 1211 microversion: 2.1 time: 0.289600 Jul 28 11:47:27.612640 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2288/4602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:27 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 1211 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:27.752352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:27.752973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:27.762556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:27.763021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:27.763840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:27.775888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:28.070715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:28.071963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:28.084537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:28.091442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:28.099865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:28.100272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:28.372773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:28.391902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:28.394246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:28.396581 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58f87604-d058-4b3e-bc59-833e167c4f90 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1366 microversion: 2.47 time: 0.648166 Jul 28 11:47:28.397925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2315/4603] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:27 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:28.633853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:28.634664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] [instance: 5404596b-ec64-4fae-af8d-5e617e2b5787] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:28.641453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:28.642109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:28.643060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:28.643679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:28.658367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] HTTP exception thrown: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Request method failure captured: Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 HTTP/1.1 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nbOPl609AsTZi5nelWqoC9B4BjA4Qc9lgyQW6_sdV6vYXyldQdbUGmteDh6npo8zC45XVow1kq3VPWY7NEr0OyGDyzag0M4Hj8yeSmHTcMi0KyNP-C4nriY95Vu4_0wK6hub0kmMvVc8mf_qekd4ZqbCJiQg-GLkjtD3HUy_sH5z64 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 696b282e6af143e085f825332724e8c9 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestBootFromVolume-1010541942 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/696b282e6af143e085f825332724e8c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/696b282e6af143e085f825332724e8c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_696b282e6af143e085f825332724e8c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/696b282e6af143e085f825332724e8c9"}]}] Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestBootFromVolume-1010541942 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 696b282e6af143e085f825332724e8c9 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1010541942 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestBootFromVolume-1010541942-project Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2bf539bb83cc42c6bf522e6ca582c2c2 Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestBootFromVolume-1010541942-project Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5404596b-ec64-4fae-af8d-5e617e2b5787'} Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:28.660331 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. Jul 28 11:47:28.664966 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:28.666498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Returning 404 to user: Instance 5404596b-ec64-4fae-af8d-5e617e2b5787 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:28.667664 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c21b3a5b-dd25-4e1d-9318-443190646460 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787" status: 404 len: 111 microversion: 2.1 time: 0.038228 Jul 28 11:47:28.668781 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2316/4604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:28 2022] GET /compute/v2.1/servers/5404596b-ec64-4fae-af8d-5e617e2b5787 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:47:28.681364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94055dee-ab24-4ba0-8218-96364693d9d5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] Calling method '.version_select at 0x7f2eb285b8b0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:28.715516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-94055dee-ab24-4ba0-8218-96364693d9d5 tempest-ServersTestBootFromVolume-1010541942 tempest-ServersTestBootFromVolume-1010541942-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635533220" status: 202 len: 0 microversion: 2.1 time: 0.039055 Jul 28 11:47:28.722069 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2317/4605] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635533220 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:47:28.841168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:28.873960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27ce8737-dd05-4136-87df-349b2538f914 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.807968 Jul 28 11:47:28.877068 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2289/4606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:28 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:29.429603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:29.430495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:29.447630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:29.449293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:29.450795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:29.452526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:29.741065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:29.752452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:29.756534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:29.767645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9be96cad-5cb8-4531-b4c8-77ec60820534 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1372 microversion: 2.47 time: 0.335245 Jul 28 11:47:29.768400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2318/4607] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:29 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:29.898171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:29.898814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:29.915378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:29.915840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:29.916869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:29.918007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:30.359980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:30.378751 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b244912-5af3-4cd8-af32-c133d61bbc64 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 0.483811 Jul 28 11:47:30.381736 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2290/4608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:29 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:30.796260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:30.796806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:30.812848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:30.818979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:30.820258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:30.826848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:31.028951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:31.048281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:31.050690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:31.061445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-650f6e37-f89a-483f-85e6-55335c2ff8b2 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1372 microversion: 2.47 time: 0.260651 Jul 28 11:47:31.062904 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2319/4609] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:30 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:31.402916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:31.404103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:31.413575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:31.415992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:31.419667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:31.421765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:31.497585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-816115543", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "943a17d0-217a-43f4-abe4-3c73bf004c2d"}], "security_groups": [{"name": "tempest-securitygroup--694092264"}], "key_name": "tempest-keypair-1670795972", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:32.317637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] validate_networks() for [('943a17d0-217a-43f4-abe4-3c73bf004c2d', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:47:32.498179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:32.514365 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6be04178-fbfa-42b8-b936-10611c1ca4ac tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 1.113001 Jul 28 11:47:32.517213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2291/4610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:31 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:32.529501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:32.530500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:32.541926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:32.542660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:32.543991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:32.544946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:32.716364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:32.725235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:32.726749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:32.728220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-032a0c75-150d-4976-a463-99d8ca712217 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1372 microversion: 2.47 time: 0.210021 Jul 28 11:47:32.728950 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2292/4611] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:32 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:32.733696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e67c9890-989a-4ea0-bb93-7e6e7019458d req-89668b73-93ca-4da6-96aa-1bb9916111d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88fa20b-50bd-412b-b385-a6b85d8c6495", "name": "network-vif-plugged", "status": "completed", "tag": "ed0b37ba-45f7-4887-b533-14dfa9bd0a9d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:32.743797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e67c9890-989a-4ea0-bb93-7e6e7019458d req-89668b73-93ca-4da6-96aa-1bb9916111d3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:32.744607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e67c9890-989a-4ea0-bb93-7e6e7019458d req-89668b73-93ca-4da6-96aa-1bb9916111d3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:32.756648 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e67c9890-989a-4ea0-bb93-7e6e7019458d req-89668b73-93ca-4da6-96aa-1bb9916111d3 service nova] Creating event network-vif-plugged:ed0b37ba-45f7-4887-b533-14dfa9bd0a9d for instance c88fa20b-50bd-412b-b385-a6b85d8c6495 on n-h2-851368-1 Jul 28 11:47:32.761920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e67c9890-989a-4ea0-bb93-7e6e7019458d req-89668b73-93ca-4da6-96aa-1bb9916111d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 Jul 28 11:47:32.762608 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2293/4612] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:33.539393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:33.540992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:33.550895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:33.552302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:33.553471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:33.554127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.093082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:47:34.094087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:47:34.094926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:47:34.095574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:47:34.096653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:47:34.149629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.152768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.157312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.161874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.205045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for project a4f889574d214453a98946a8548d3f54. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:47:34.218972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Getting quotas for user 7e1c75be51e843a8a9555b396bbc5163 and project a4f889574d214453a98946a8548d3f54. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:47:34.239197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:47:34.243180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:47:34.310575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-340f8118-b8aa-46e6-8df6-f623545a229f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.817977 Jul 28 11:47:34.312197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2320/4613] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:47:34.317825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:34.318758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:34.326369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.327195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.328329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.328982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.638841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.655787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb3502b4-1538-434a-a767-13f848f9f3b3 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1324 microversion: 2.1 time: 1.120924 Jul 28 11:47:34.659386 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2294/4614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:33 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1324 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:34.667627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-820b78c2-73a7-495d-b469-45b58825711b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:34.668565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-820b78c2-73a7-495d-b469-45b58825711b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:34.690921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.708448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.710116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.711500 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc6cb448-b907-4b93-a63d-b03379f9aa7b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1357 microversion: 2.47 time: 0.398022 Jul 28 11:47:34.712328 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2321/4615] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:34 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1357 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:34.736925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:34.744215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.745532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Searching by: {'deleted': False, 'project_id': '0caef9bac3c84df498c4a7ef531917fd'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:47:34.752751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.753473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.755498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:34.756169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:34.839224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-820b78c2-73a7-495d-b469-45b58825711b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:34.851773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-820b78c2-73a7-495d-b469-45b58825711b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1237 microversion: 2.1 time: 0.189752 Jul 28 11:47:34.855408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2295/4616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:34 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1237 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:34.913592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:47:35.124190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.158271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.159125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.172407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.176651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.298906 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e5092aa1-987d-4a58-a781-e201e018ec2e tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.566194 Jul 28 11:47:35.300130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2322/4617] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Jul 28 11:47:34 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:35.336912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:35.337605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:35.350436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.351025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.359594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.360336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.453102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:47:35.661583 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2891902-e264-49de-8bac-cee399ac936d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 204 len: 0 microversion: 2.47 time: 0.332885 Jul 28 11:47:35.663543 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2296/4618] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:47:35 2022] DELETE /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:47:35.672370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:35.673549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:35.688017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:35.690177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:35.692639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.694174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.696299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.697894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.716651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.718379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.719912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.721409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.949269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.960004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.966079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:35.967407 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-986ddd31-aef5-42b1-8021-520994b51ae6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1363 microversion: 2.47 time: 0.299743 Jul 28 11:47:35.971365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2323/4619] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:35 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:35.987352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:35.988082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:35.996096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:35.997739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:35.999344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:35.999508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:36.000097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:36.270280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:36.281330 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0eaa7b9d-82e8-4b1b-8e0a-0e351ff65aa8 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1307 microversion: 2.1 time: 0.308974 Jul 28 11:47:36.282843 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2324/4620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:35 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:36.401977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:36.416265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-701aff34-2c9e-48ae-88e4-55d6a4c4972b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1519 microversion: 2.1 time: 0.738020 Jul 28 11:47:36.420538 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2297/4621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:35 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1519 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:36.544676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc1b4e12-ceb4-445c-ae44-f8c3ddad92c4 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-268040606", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc1b4e12-ceb4-445c-ae44-f8c3ddad92c4 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 242 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-268040606", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-268040606', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '296d8e3d-c0bd-41f9-a9ef-9c3b5119623b'}]}}} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:47:36.548962 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc1b4e12-ceb4-445c-ae44-f8c3ddad92c4 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc1b4e12-ceb4-445c-ae44-f8c3ddad92c4 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010035 Jul 28 11:47:36.564033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2325/4622] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:47:36.567828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:36.567828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: ab0f600a-0e76-45e3-a2e2-9d1022cb92ee] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:36.571409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] HTTP exception thrown: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/ab0f600a-0e76-45e3-a2e2-9d1022cb92ee/metadata HTTP/1.1 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': 'ab0f600a-0e76-45e3-a2e2-9d1022cb92ee'} Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.581715 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 404 to user: Instance ab0f600a-0e76-45e3-a2e2-9d1022cb92ee could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-308db185-f198-478a-becd-678fca5b6e9e tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/ab0f600a-0e76-45e3-a2e2-9d1022cb92ee/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024099 Jul 28 11:47:36.597682 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2298/4623] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:47:36 2022] GET /compute/v2.1/servers/ab0f600a-0e76-45e3-a2e2-9d1022cb92ee/metadata => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:47:36.641370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8952c2f-bb5d-491e-9254-637805c2ec0b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1344354964", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8952c2f-bb5d-491e-9254-637805c2ec0b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 499 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1344354964", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1344354964', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '296d8e3d-c0bd-41f9-a9ef-9c3b5119623b'}]}}} Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:47:36.645821 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.650489 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.654457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8952c2f-bb5d-491e-9254-637805c2ec0b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.655389 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8952c2f-bb5d-491e-9254-637805c2ec0b tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018200 Jul 28 11:47:36.655984 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2326/4624] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:47:36.710837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3f233a7-e533-4731-8cb6-ce9a05463fb2 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-617577912", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3f233a7-e533-4731-8cb6-ce9a05463fb2 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 499 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-617577912", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-617577912', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '296d8e3d-c0bd-41f9-a9ef-9c3b5119623b'}]}}} Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:47:36.716377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.720608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3f233a7-e533-4731-8cb6-ce9a05463fb2 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.724105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3f233a7-e533-4731-8cb6-ce9a05463fb2 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.013755 Jul 28 11:47:36.732117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2299/4625] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:36 2022] POST /compute/v2.1/servers => generated 689 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:47:36.802871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffc3dde8-3299-471b-88a8-2e742271d9d0 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-410054151", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffc3dde8-3299-471b-88a8-2e742271d9d0 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 753 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-410054151", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-410054151', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '296d8e3d-c0bd-41f9-a9ef-9c3b5119623b'}]}}} Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:47:36.807434 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:47:36.809905 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:47:36.813654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.813654 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.813654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ffc3dde8-3299-471b-88a8-2e742271d9d0 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.813654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ffc3dde8-3299-471b-88a8-2e742271d9d0 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015398 Jul 28 11:47:36.822522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2327/4626] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:47:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 28 11:47:36.866838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a3dd334-2067-4b29-8f66-201c5d1370bf tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1568660910", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a3dd334-2067-4b29-8f66-201c5d1370bf tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 1266 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1568660910", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "296d8e3d-c0bd-41f9-a9ef-9c3b5119623b"}]}} Jul 28 11:47:36.871733 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1568660910', 'imageRef': 'd754ca4d-54f2-4b37-ac95-af6564180b9e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '296d8e3d-c0bd-41f9-a9ef-9c3b5119623b'}]}}} Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.873843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 11:47:36.874898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 11:47:36.877956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 11:47:36.877956 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.877956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a3dd334-2067-4b29-8f66-201c5d1370bf tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.877956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a3dd334-2067-4b29-8f66-201c5d1370bf tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011055 Jul 28 11:47:36.877956 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2300/4627] 10.222.0.93 () {60 vars in 1148 bytes} [Thu Jul 28 11:47:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 28 11:47:36.885194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:36.885703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: 56ad8696-df40-448c-bab5-d344486ce33c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:36.892201 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] HTTP exception thrown: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/56ad8696-df40-448c-bab5-d344486ce33c/metadata/test2 HTTP/1.1 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '56ad8696-df40-448c-bab5-d344486ce33c', 'id': 'test2'} Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:36.893922 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 404 to user: Instance 56ad8696-df40-448c-bab5-d344486ce33c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:36.898590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fde4f344-2903-44be-845b-dcac54e312cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/56ad8696-df40-448c-bab5-d344486ce33c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015276 Jul 28 11:47:36.909194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:36.909625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:36.915659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2328/4628] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Jul 28 11:47:36 2022] GET /compute/v2.1/servers/56ad8696-df40-448c-bab5-d344486ce33c/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:47:36.918983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:36.919470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:36.920259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:36.920697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:36.949793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:36.958913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:47:37.003604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:37.006428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:37.020549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.021265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.026816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.027972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.060594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:37.101750 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85df1100-3195-4b9c-a7dd-d2ffc8ac0bee tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 204 len: 0 microversion: 2.1 time: 0.196086 Jul 28 11:47:37.102964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2301/4629] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:47:36 2022] DELETE /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:47:37.112446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:37.113364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:37.120118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.120559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.121576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.122018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.192212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:37.203587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:37.205427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:37.206968 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-482d6c70-ab85-4cbf-a977-a279215678b8 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1363 microversion: 2.47 time: 0.219178 Jul 28 11:47:37.224877 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2329/4630] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:36 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:47:37.314322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:37.326070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:37.345602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.346080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.347100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:37.347638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:37.369435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:37.383210 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5ffb8939-d1b7-46e3-87ce-46442ab137a9 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1525 microversion: 2.1 time: 0.275727 Jul 28 11:47:37.384469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2302/4631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:37 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1525 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:37.501524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:37.510405 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68d42780-f40e-4f2d-bbcb-a2fe3a5be75f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1295 microversion: 2.1 time: 0.209152 Jul 28 11:47:37.511589 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2330/4632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:37 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1295 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:38.237039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:38.239703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:38.278559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.281190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:38.283674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.285899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:38.408890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:38.411320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:38.420102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.420833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:38.421806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.422396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:38.482659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:38.504331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:38.505752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:38.507283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f2fcdca-a009-4111-b7d7-b060e688f39c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 200 len: 1363 microversion: 2.47 time: 0.276139 Jul 28 11:47:38.508445 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2303/4633] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:38 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:38.539614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:38.540587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:38.553433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.553897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:38.562965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:38.563883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.104646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:39.126693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e6119c5b-44ff-4f6b-a423-be07dbf9729a tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1295 microversion: 2.1 time: 0.587593 Jul 28 11:47:39.132080 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2304/4634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:38 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1295 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:39.419095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:39.428336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-989cde5d-3922-49a8-90b7-e8e26e4e39cc tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1525 microversion: 2.1 time: 1.026460 Jul 28 11:47:39.457563 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2331/4635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:38 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1525 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:39.550362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:39.552334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: b7ab987f-57bc-4a70-abf4-9cd596dad5dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:39.564681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.565325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.569238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.569876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.591784 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] HTTP exception thrown: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Request method failure captured: Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc HTTP/1.1 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ncqLCzw_xONDwkYM_KfYJ9k5uEnVFLmbi9mh2iBPfrpXepSCCyyx12ZwdsMvBsqkzFWpFda9UORDgETgbFuhkxd5yVFIC-7iTIUhWjhaYe8Yl1b8b0ka0DglT7CyLePklcL-3uUl2Uzg7BgQdO8k37aq8Blomcgze0g9X5PZcFhOhY Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0caef9bac3c84df498c4a7ef531917fd Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0caef9bac3c84df498c4a7ef531917fd"}]}] Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0caef9bac3c84df498c4a7ef531917fd Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerShowV247Test-1285632744-project Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: af6d5380f8e14a93b8d26c3f01d22b5d Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerShowV247Test-1285632744-project Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'b7ab987f-57bc-4a70-abf4-9cd596dad5dc'} Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:39.595128 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Returning 404 to user: Instance b7ab987f-57bc-4a70-abf4-9cd596dad5dc could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aeea5e1a-d4bd-41bc-babc-694f78559db6 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc" status: 404 len: 111 microversion: 2.47 time: 0.060384 Jul 28 11:47:39.600489 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2305/4636] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:39 2022] GET /compute/v2.1/servers/b7ab987f-57bc-4a70-abf4-9cd596dad5dc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:47:39.608282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:39.608795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:39.616218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.616676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.617462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.617902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.655464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:47:39.799519 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b8863fc-2605-43cb-b817-1013bdc36b8d tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 204 len: 0 microversion: 2.47 time: 0.194649 Jul 28 11:47:39.804385 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2332/4637] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:47:39 2022] DELETE /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:47:39.818970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:39.819802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:39.831289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.831913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:39.833112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:39.833720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:40.040880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:40.063271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:40.065335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:40.066881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e01c2d77-cd33-47f1-857c-3b73bece6f3c tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 200 len: 1363 microversion: 2.47 time: 0.261260 Jul 28 11:47:40.084277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2306/4638] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:39 2022] GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:47:40.157663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:40.161737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:40.169157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:40.170104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:40.175441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:40.178747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:40.462554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:40.463304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:40.473773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:40.475419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:40.476512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:40.477343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:40.898770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf441a6a66c467caf33c537038ed741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b484d29d9d84c1eb810d225067ed200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:40.907097 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7a6b132-3985-46c3-9d2d-d0f5721f451c tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 200 len: 1483 microversion: 2.1 time: 0.448298 Jul 28 11:47:40.908231 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2307/4639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:40 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 1483 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:47:40.918871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:40.931836 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-07ddc3af-5494-4c2a-8bc9-db54b965f8b3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.781328 Jul 28 11:47:40.934082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2333/4640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:40 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:40.968594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b874ad21-026a-4b75-9e8e-ce9473a8c928 req-d16ba659-a79f-4c46-acb6-85e143e4e19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88fa20b-50bd-412b-b385-a6b85d8c6495", "name": "network-vif-deleted", "tag": "ed0b37ba-45f7-4887-b533-14dfa9bd0a9d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:40.989650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b874ad21-026a-4b75-9e8e-ce9473a8c928 req-d16ba659-a79f-4c46-acb6-85e143e4e19f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:40.990093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b874ad21-026a-4b75-9e8e-ce9473a8c928 req-d16ba659-a79f-4c46-acb6-85e143e4e19f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.006911 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b874ad21-026a-4b75-9e8e-ce9473a8c928 req-d16ba659-a79f-4c46-acb6-85e143e4e19f service nova] Creating event network-vif-deleted:ed0b37ba-45f7-4887-b533-14dfa9bd0a9d for instance c88fa20b-50bd-412b-b385-a6b85d8c6495 on n-h2-851368-1 Jul 28 11:47:41.013453 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b874ad21-026a-4b75-9e8e-ce9473a8c928 req-d16ba659-a79f-4c46-acb6-85e143e4e19f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048588 Jul 28 11:47:41.015407 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2308/4641] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:47:41.107555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:41.108488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:41.118659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.119414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.120406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.121051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.274776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:41.287126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:41.289270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:41.290819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82942c3f-c96e-42a2-b9bc-bb3677e8a994 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 200 len: 1363 microversion: 2.47 time: 0.196644 Jul 28 11:47:41.299312 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2334/4642] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:41 2022] GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:47:41.936848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:41.941340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] [instance: c88fa20b-50bd-412b-b385-a6b85d8c6495] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:41.960643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:41.961268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:41.969225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.970281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.971594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.972602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.997201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.997663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.999016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:41.999553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:41.999963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] HTTP exception thrown: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Request method failure captured: Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 HTTP/1.1 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nc_52YNuCKc0-deOYtp7vR-sQW_sXtDUHhsY0iYzZLrEdqk686Rex9zMnY8knlKy4-msi_i9w_Aiuf_3hrm8c_ys2VbLnjliuyq-K96du5UPCl1Wo1AXiUdJCK1J0gNlk98syGo-PLNHaZ1kh0O5yVu3g61vueV8Zupcxl9BtlVKwk Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b484d29d9d84c1eb810d225067ed200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b484d29d9d84c1eb810d225067ed200"}]}] Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0b484d29d9d84c1eb810d225067ed200 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-547456328 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: aaf441a6a66c467caf33c537038ed741 Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-547456328-project Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c88fa20b-50bd-412b-b385-a6b85d8c6495'} Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:42.002188 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. Jul 28 11:47:42.009158 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:42.012205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] Returning 404 to user: Instance c88fa20b-50bd-412b-b385-a6b85d8c6495 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:42.013377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c0b02e5-b7f0-4f24-bef8-7c9f1cfafe57 tempest-ServerMetadataNegativeTestJSON-547456328 tempest-ServerMetadataNegativeTestJSON-547456328-project] 10.222.0.93 "GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495" status: 404 len: 111 microversion: 2.1 time: 0.088037 Jul 28 11:47:42.014631 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2309/4643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:41 2022] GET /compute/v2.1/servers/c88fa20b-50bd-412b-b385-a6b85d8c6495 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:47:42.317331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:42.318243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:42.325862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:42.326585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:42.327801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:42.328427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:42.561809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:42.568343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:42.578806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:42.581390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af6d5380f8e14a93b8d26c3f01d22b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0caef9bac3c84df498c4a7ef531917fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:42.584903 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-979dcdc8-a043-4e97-876f-ae23f6b06173 tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 200 len: 1363 microversion: 2.47 time: 0.273341 Jul 28 11:47:42.587821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6dc8b23-20f7-46bd-8fad-7dc5b7b2a384 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.633225 Jul 28 11:47:42.605646 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2310/4644] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:42 2022] GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:47:42.615923 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2335/4645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:41 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:43.618011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:43.621298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] [instance: 6263f12e-f866-4321-bcb5-521745dff003] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:43.638988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:43.639631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:43.639840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:43.640428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:43.641708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:43.643801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:43.664740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:43.665121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:43.668150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:43.670598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:43.690942 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] HTTP exception thrown: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Request method failure captured: Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 HTTP/1.1 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ncqLCzw_xONDwkYM_KfYJ9k5uEnVFLmbi9mh2iBPfrpXepSCCyyx12ZwdsMvBsqkzFWpFda9UORDgETgbFuhkxd5yVFIC-7iTIUhWjhaYe8Yl1b8b0ka0DglT7CyLePklcL-3uUl2Uzg7BgQdO8k37aq8Blomcgze0g9X5PZcFhOhY Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0caef9bac3c84df498c4a7ef531917fd Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0caef9bac3c84df498c4a7ef531917fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0caef9bac3c84df498c4a7ef531917fd"}]}] Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0caef9bac3c84df498c4a7ef531917fd Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerShowV247Test-1285632744 Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerShowV247Test-1285632744-project Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: af6d5380f8e14a93b8d26c3f01d22b5d Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerShowV247Test-1285632744-project Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6263f12e-f866-4321-bcb5-521745dff003'} Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:47:43.697131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. Jul 28 11:47:43.702292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:47:43.704385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] Returning 404 to user: Instance 6263f12e-f866-4321-bcb5-521745dff003 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:47:43.705510 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62861d15-53ba-494a-9b42-afbd034a8c6b tempest-ServerShowV247Test-1285632744 tempest-ServerShowV247Test-1285632744-project] 10.222.0.93 "GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003" status: 404 len: 111 microversion: 2.47 time: 0.091314 Jul 28 11:47:43.713032 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2311/4646] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:47:43 2022] GET /compute/v2.1/servers/6263f12e-f866-4321-bcb5-521745dff003 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:47:43.871507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c7652601-1836-42f9-92fc-9ac0110c1a9b req-fbb8c428-e3b9-4ef2-a456-89d2c1b07f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67bc045-daf2-4f97-92bc-3b9022642a75", "tag": "44411123-b4df-475e-918d-27c43fc0e588"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:43.897035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c7652601-1836-42f9-92fc-9ac0110c1a9b req-fbb8c428-e3b9-4ef2-a456-89d2c1b07f25 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:43.899417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c7652601-1836-42f9-92fc-9ac0110c1a9b req-fbb8c428-e3b9-4ef2-a456-89d2c1b07f25 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:43.932590 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c7652601-1836-42f9-92fc-9ac0110c1a9b req-fbb8c428-e3b9-4ef2-a456-89d2c1b07f25 service nova] Creating event network-changed:44411123-b4df-475e-918d-27c43fc0e588 for instance f67bc045-daf2-4f97-92bc-3b9022642a75 on n-h2-851368-1 Jul 28 11:47:43.948641 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c7652601-1836-42f9-92fc-9ac0110c1a9b req-fbb8c428-e3b9-4ef2-a456-89d2c1b07f25 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084447 Jul 28 11:47:43.951827 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2312/4647] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:44.223484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:44.249159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90766899-1ded-4a6c-ba52-e9f41bcdf0d5 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.609708 Jul 28 11:47:44.271358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2336/4648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:43 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:45.283740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:45.289807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:45.289925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:45.305173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:45.305624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:45.307853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:45.315150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:47.139195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:47.151062 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6e20e19b-4401-4dbf-83a8-cee01105fd92 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 1.869001 Jul 28 11:47:47.153911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2313/4649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:45 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:48.173833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:48.174466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:48.188784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:48.189545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:48.191318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:48.194448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:48.195591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:48.196217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:48.818733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:48.843529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ce76368c-23e7-487c-85c4-525748054aec tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.672575 Jul 28 11:47:48.844677 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2337/4650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:48 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:49.865598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:49.866201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:49.879172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:49.879636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:49.880426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:49.880861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:50.415719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:50.431347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-079109bf-6d4c-4cc4-a3d5-c5fa236e0ff0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.569589 Jul 28 11:47:50.432623 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2314/4651] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:49 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:51.469272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:51.469891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:51.484379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:51.485085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:51.486095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:51.486748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:52.073719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:52.085628 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df972c70-4977-4289-9681-d0f80e6d808d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 0.620886 Jul 28 11:47:52.087202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2338/4652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:51 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:53.109664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:53.110283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:53.118579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:47:53.134815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:53.135753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:53.137354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:53.137960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:53.393042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-197d3b94-817b-4227-97fd-62ea952ecbd2 req-8526333a-80f2-43d5-b309-653e3dee11b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67bc045-daf2-4f97-92bc-3b9022642a75", "name": "network-vif-plugged", "status": "completed", "tag": "44411123-b4df-475e-918d-27c43fc0e588"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:47:53.405430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-197d3b94-817b-4227-97fd-62ea952ecbd2 req-8526333a-80f2-43d5-b309-653e3dee11b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:53.406190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-197d3b94-817b-4227-97fd-62ea952ecbd2 req-8526333a-80f2-43d5-b309-653e3dee11b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:53.418101 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-197d3b94-817b-4227-97fd-62ea952ecbd2 req-8526333a-80f2-43d5-b309-653e3dee11b4 service nova] Creating event network-vif-plugged:44411123-b4df-475e-918d-27c43fc0e588 for instance f67bc045-daf2-4f97-92bc-3b9022642a75 on n-h2-851368-1 Jul 28 11:47:53.427184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-197d3b94-817b-4227-97fd-62ea952ecbd2 req-8526333a-80f2-43d5-b309-653e3dee11b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039267 Jul 28 11:47:53.428677 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2339/4653] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:47:54.338565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:54.366251 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5f4b27d-28bb-44b0-ba98-690ab1d76795 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1362 microversion: 2.1 time: 1.260377 Jul 28 11:47:54.373888 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2315/4654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:53 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1362 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:55.396003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:55.397368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:55.413834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:55.414635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:55.415664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:55.416266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:56.426880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:47:56.437123 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-311b097f-d5f6-4fa0-86bc-655cf3e783f2 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1548 microversion: 2.1 time: 1.045136 Jul 28 11:47:56.438469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2340/4655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:47:55 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1548 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:47:56.462823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:47:56.464244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:47:56.482914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:56.483681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:56.484643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:47:56.485837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:47:56.893574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6ebce700-1d64-4aae-bbac-f329c9f1d24b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.438811 Jul 28 11:47:56.894805 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2316/4656] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:47:56 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-interface => generated 284 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:01.429387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b5dd9487-6ea9-4e32-a264-6e868c8981fc req-5cb4d8f2-9b3b-419c-80db-e3cbaea40db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67bc045-daf2-4f97-92bc-3b9022642a75", "tag": "44411123-b4df-475e-918d-27c43fc0e588"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:01.448639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b5dd9487-6ea9-4e32-a264-6e868c8981fc req-5cb4d8f2-9b3b-419c-80db-e3cbaea40db4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:01.450576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b5dd9487-6ea9-4e32-a264-6e868c8981fc req-5cb4d8f2-9b3b-419c-80db-e3cbaea40db4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:01.477220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b5dd9487-6ea9-4e32-a264-6e868c8981fc req-5cb4d8f2-9b3b-419c-80db-e3cbaea40db4 service nova] Creating event network-changed:44411123-b4df-475e-918d-27c43fc0e588 for instance f67bc045-daf2-4f97-92bc-3b9022642a75 on n-h2-851368-1 Jul 28 11:48:01.486448 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b5dd9487-6ea9-4e32-a264-6e868c8981fc req-5cb4d8f2-9b3b-419c-80db-e3cbaea40db4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061535 Jul 28 11:48:01.490088 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2341/4657] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:48:03.348874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d703812-e53c-498d-8ac9-7437644d7659 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Action: 'create', calling method: .version_select at 0x7f2eb1997dc0>, body: {"keypair": {"name": "tempest-keypair-2073393573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEca/xs/VShgCblqr6BUNpAucn4VLCYZhh3p9lDGQNT3pmfGvBmndpHYtX5cZI1pbJ9iK8mx7jOvqE8WwG9orruoH89w21+kd1mtVg1LZUQ0+P+EH6EtlWmwmSMIdnczgg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:03.390340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8d703812-e53c-498d-8ac9-7437644d7659 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for project 4b95fd58a59d4b3d9515440076a102cc. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:03.402655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8d703812-e53c-498d-8ac9-7437644d7659 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for user b92da3ac2256422a9112700212b58aed and project 4b95fd58a59d4b3d9515440076a102cc. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:03.449427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d703812-e53c-498d-8ac9-7437644d7659 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.730633 Jul 28 11:48:03.453241 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2317/4658] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:07.888569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-766800812", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:07.912244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:07.995179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:48:11.091262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:48:11.092613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:48:11.093330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:48:11.093968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:48:11.094764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:48:11.109261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:11.114981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:11.116874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:11.119015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:11.134678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:11.154374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:11.171652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:11.202011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:48:11.205445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:48:11.343792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27f154a5-8642-44de-8348-a5a1bb9a541f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.569680 Jul 28 11:48:11.350620 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2342/4659] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:48:11.358733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bedaa189-e55f-43b5-8643-8fef8412df9b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:11.359410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bedaa189-e55f-43b5-8643-8fef8412df9b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:11.370009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:11.758274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bedaa189-e55f-43b5-8643-8fef8412df9b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:11.770486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bedaa189-e55f-43b5-8643-8fef8412df9b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1192 microversion: 2.1 time: 0.414990 Jul 28 11:48:11.773891 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2318/4660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:11 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1192 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:12.335279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-457909006", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "61ae468b-561d-4b41-8aa5-42cb059ffda2"}], "security_groups": [{"name": "tempest-securitygroup--789884725"}], "key_name": "tempest-keypair-2073393573", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:12.702475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] validate_networks() for [('61ae468b-561d-4b41-8aa5-42cb059ffda2', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:48:12.796685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:12.797928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:12.824676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:12.825572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:12.826881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:12.827737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:12.938476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:12.951293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f007f38-eded-4729-9c7d-9528a9c0ce1d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1244 microversion: 2.1 time: 0.158815 Jul 28 11:48:12.954110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2319/4661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:12 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1244 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:13.980612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:13.981330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:13.990044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:13.991619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:13.993247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:13.993247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:14.169089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:14.176966 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5105edc-01d3-4c2c-9527-830da72780ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1250 microversion: 2.1 time: 0.200276 Jul 28 11:48:14.177560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2320/4662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:13 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1250 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:14.489271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for project 4b95fd58a59d4b3d9515440076a102cc. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:14.515475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for user b92da3ac2256422a9112700212b58aed and project 4b95fd58a59d4b3d9515440076a102cc. Resources: dict_keys(['metadata_items']) {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:14.555396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:48:14.556194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:48:14.556904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:48:14.559550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:48:14.560370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:48:14.584024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:14.584770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:14.586246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:14.586882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:14.626228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for project 4b95fd58a59d4b3d9515440076a102cc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:14.638008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Getting quotas for user b92da3ac2256422a9112700212b58aed and project 4b95fd58a59d4b3d9515440076a102cc. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:14.668515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:48:14.672346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:48:14.771526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a86eabaa-18f3-42c4-9af0-879bda0d132f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.440791 Jul 28 11:48:14.773097 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2343/4663] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:48:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:48:14.785197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98d92ff8-31e9-4b22-8032-9ae6ba322df6 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:14.786093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98d92ff8-31e9-4b22-8032-9ae6ba322df6 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:15.053347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98d92ff8-31e9-4b22-8032-9ae6ba322df6 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:15.080424 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98d92ff8-31e9-4b22-8032-9ae6ba322df6 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1277 microversion: 2.1 time: 0.300936 Jul 28 11:48:15.083237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2321/4664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:14 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:15.204450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:15.205425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:15.221420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:15.221420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:15.222550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:15.239894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:15.504783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:15.515849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e46f631-9324-4e96-bb88-b29355e5abe5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1250 microversion: 2.1 time: 0.314585 Jul 28 11:48:15.518194 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2344/4665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:15 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1250 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:16.103729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:16.104921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:16.124038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:16.124841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:16.125794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:16.126434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:16.400741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:16.427978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a056a941-6115-4166-9d8f-9a0ca23895b0 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1329 microversion: 2.1 time: 0.328443 Jul 28 11:48:16.432261 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2322/4666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:16 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:16.540677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:16.541503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:16.557854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:16.558686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:16.559857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:16.560634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:17.106946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:17.121327 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8115bdb6-6e55-413c-8125-fc47f6b4b9d7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.587078 Jul 28 11:48:17.122424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2345/4667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:16 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:17.458902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:17.460284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:17.475918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:17.478025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:17.480713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:17.482609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:17.644230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:17.653467 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0403b072-c4be-4a31-ac09-d477e22f5c19 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1335 microversion: 2.1 time: 0.204978 Jul 28 11:48:17.654115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2323/4668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:17 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1335 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:18.145280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:18.145909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:18.168718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:18.169477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:18.170487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:18.171399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:18.656230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:18.674038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:18.676497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:18.703303 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9c631f8d-71a3-426f-9eb5-9f9648ccb54a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.555958 Jul 28 11:48:18.705358 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2346/4669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:18 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:18.710467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:18.711576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:18.713467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:18.713467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:18.819562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-8066226", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2b2b1b32-c76b-4898-bacd-85ee8db15548"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:18.856044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:18.876198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b030168-750c-4153-872c-8afb9295b38c tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1335 microversion: 2.1 time: 0.205445 Jul 28 11:48:18.878872 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2324/4670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:18 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1335 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:18.895435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6eb40e8a-99d2-40fe-b405-3424cbce9381 req-a2faa123-0c1e-4f42-9cc2-7700704e2baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d653098b-f79d-4178-9b6b-7a32e23235f2", "tag": "fea2eebc-054c-47df-b46a-ca7f4e5b7846"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:18.947889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6eb40e8a-99d2-40fe-b405-3424cbce9381 req-a2faa123-0c1e-4f42-9cc2-7700704e2baa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:18.948548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6eb40e8a-99d2-40fe-b405-3424cbce9381 req-a2faa123-0c1e-4f42-9cc2-7700704e2baa service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:18.969996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] validate_networks() for [('2b2b1b32-c76b-4898-bacd-85ee8db15548', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:48:19.005049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6eb40e8a-99d2-40fe-b405-3424cbce9381 req-a2faa123-0c1e-4f42-9cc2-7700704e2baa service nova] Creating event network-changed:fea2eebc-054c-47df-b46a-ca7f4e5b7846 for instance d653098b-f79d-4178-9b6b-7a32e23235f2 on n-h1-851368-1 Jul 28 11:48:19.020255 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6eb40e8a-99d2-40fe-b405-3424cbce9381 req-a2faa123-0c1e-4f42-9cc2-7700704e2baa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138210 Jul 28 11:48:19.020875 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2325/4671] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:19.741119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:19.743492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:19.765531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:19.766293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:19.770906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:19.771862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:20.724744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:48:20.725172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:48:20.725648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:48:20.726141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:48:20.726545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:48:20.750278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:20.750641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:20.751495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:20.751944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:20.807573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Getting quotas for project 1ca754153a0e4093a6c40eb36e289344. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:20.813927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Getting quotas for user e763cddf0f104f6c9920df40cf3ddafa and project 1ca754153a0e4093a6c40eb36e289344. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:20.853924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:48:20.854765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:20.867863 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd8940e1-3855-4106-b41a-943cb32a9d04 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 1.144324 Jul 28 11:48:20.873056 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2326/4672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:19 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:20.873612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:48:20.880851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:20.885569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:20.907563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:20.912682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:20.917217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:20.918605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:20.974527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c248672a-34c3-4171-b1ab-e6dd6b63784d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.265447 Jul 28 11:48:20.993003 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2347/4673] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:48:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:48:21.015627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c004527a-d364-4853-86e2-3a20dbfefb73 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:21.016849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c004527a-d364-4853-86e2-3a20dbfefb73 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:21.183849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c004527a-d364-4853-86e2-3a20dbfefb73 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:21.198444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c004527a-d364-4853-86e2-3a20dbfefb73 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1213 microversion: 2.1 time: 0.202956 Jul 28 11:48:21.204779 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2348/4674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:20 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1213 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:21.658865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:21.667364 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f254571-b8aa-4485-ab79-479586e87b20 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.792424 Jul 28 11:48:21.667956 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2327/4675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:20 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:21.892463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:21.894487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:21.908852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:21.912755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:21.914781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:21.915998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:22.228449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:22.230696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:22.244390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:22.245145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:22.246990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:22.247763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:22.504047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:22.526709 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca0c3d85-004d-4728-89d0-3bf2bf5f3499 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1209 microversion: 2.1 time: 0.301548 Jul 28 11:48:22.529506 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2328/4676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:22 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1209 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:22.560927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:22.572240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-620204fd-d50a-47b7-b572-33727131598f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.684464 Jul 28 11:48:22.575693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2349/4677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:21 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:22.689512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:22.690943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:22.703499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:22.706556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:22.710976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:22.711754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:22.998365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:23.012957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09d81980-7065-4516-85e2-a193b53f0bb8 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.328697 Jul 28 11:48:23.014978 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2329/4678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:22 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:23.558801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:23.560385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:23.571031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:23.573474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:23.575810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:23.576772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:23.601087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:23.601713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:23.603745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:23.623954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:23.625317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:23.629887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:23.631876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:23.754157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:23.762033 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d55be2b-5351-4b69-bfb4-9893c3db88a5 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1273 microversion: 2.1 time: 0.212134 Jul 28 11:48:23.763222 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2350/4679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:23 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:24.000890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:24.011941 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b05f8f0-bd87-41c6-93f2-10e53a644da2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.415951 Jul 28 11:48:24.023413 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2330/4680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:23 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:24.033683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:24.034827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:24.042823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:24.044680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:24.045750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:24.046523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:24.222912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a6a26983-9ef8-4519-9dd0-f38aeae55466 req-cf83718a-4f73-460a-b8b4-7435a96d5d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f74786-faec-4adb-9f64-70cacb76cfa6", "tag": "6efc75ae-57bc-4c5a-ae63-b9b4e320d278"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:24.261493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a6a26983-9ef8-4519-9dd0-f38aeae55466 req-cf83718a-4f73-460a-b8b4-7435a96d5d87 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:24.262007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a6a26983-9ef8-4519-9dd0-f38aeae55466 req-cf83718a-4f73-460a-b8b4-7435a96d5d87 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:24.297636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a6a26983-9ef8-4519-9dd0-f38aeae55466 req-cf83718a-4f73-460a-b8b4-7435a96d5d87 service nova] Creating event network-changed:6efc75ae-57bc-4c5a-ae63-b9b4e320d278 for instance f5f74786-faec-4adb-9f64-70cacb76cfa6 on n-h2-851368-1 Jul 28 11:48:24.305974 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a6a26983-9ef8-4519-9dd0-f38aeae55466 req-cf83718a-4f73-460a-b8b4-7435a96d5d87 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087307 Jul 28 11:48:24.306916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2331/4681] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:24.407964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:24.422359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67254128-0118-4bfa-9f32-726521383883 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.391799 Jul 28 11:48:24.436849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2351/4682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:24 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:24.785245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:24.785956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:24.803065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:24.805035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:24.807143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:24.807572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:24.912130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:24.920913 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91f80157-690d-42bf-9ad1-ba1485f35650 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1273 microversion: 2.1 time: 0.140530 Jul 28 11:48:24.926735 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2332/4683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:24 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:25.037154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:25.038453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:25.053191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:25.053899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:25.054908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:25.055599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:25.445322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:25.446376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:25.448651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:25.454926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:25.455555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:25.457403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:25.457944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:25.956063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:25.974151 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80415413-ef86-4ebc-b5ad-69d50e7e4562 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.941367 Jul 28 11:48:25.987729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2352/4684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:25 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:25.991897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:25.992706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:26.000754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:26.001216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:26.002004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:26.002444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:26.104615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:26.114164 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb940034-8cea-49eb-bd74-92fc7952a84f tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.672754 Jul 28 11:48:26.115109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2333/4685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:25 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:26.162691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:26.180451 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96e8d316-d2d5-4b23-814f-97c36e48ac18 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1271 microversion: 2.1 time: 0.194023 Jul 28 11:48:26.181041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2353/4686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:25 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:27.007164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:27.008890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:27.026982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.027695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.028762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.029366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.136174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:27.136977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:27.146553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.151580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.152620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.153313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.643323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:27.651922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72ccbea2-6a6c-4a91-ae18-8dd1a2f82d0e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.519503 Jul 28 11:48:27.653885 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2354/4687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:27 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:27.660290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:27.661252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:27.668870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.669462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.670365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:27.670909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:27.682267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:27.691736 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb5c0324-fa3a-4646-a451-aa3c935cf43f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.698258 Jul 28 11:48:27.708985 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2334/4688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:26 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:28.020330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:28.028753 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49bcf3eb-38dc-48f3-bb18-30b25ca0829d tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.373566 Jul 28 11:48:28.029690 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2355/4689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:27 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:28.673851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:28.675305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:28.691050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:28.691845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:28.693251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:28.694043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:28.716116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:28.716737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:28.728795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:28.729256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:28.730055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:28.741609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:29.732149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:29.742349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e99e556-8307-4493-937d-d86d1946dc2b tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 1.072313 Jul 28 11:48:29.755597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:29.756450 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2335/4690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:28 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:29.772417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-48f8355c-3ce7-4a19-88b5-50412e53e73e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 1.061009 Jul 28 11:48:29.773220 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2356/4691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:28 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:29.779583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-04ce3ae1-4a27-4bb4-9db7-e1b3f844c39f req-cfe08e95-5d34-48c9-a93e-b1e5d8b882e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3960d5-6507-44c4-953d-2d4ac508b67f", "tag": "16bab57f-779e-4b22-99d9-e3853e5ef9d7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:29.793230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:29.793854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:29.801501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:29.806368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-04ce3ae1-4a27-4bb4-9db7-e1b3f844c39f req-cfe08e95-5d34-48c9-a93e-b1e5d8b882e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:29.808516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:29.809448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-04ce3ae1-4a27-4bb4-9db7-e1b3f844c39f req-cfe08e95-5d34-48c9-a93e-b1e5d8b882e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:29.809772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:29.810241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:29.837072 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-04ce3ae1-4a27-4bb4-9db7-e1b3f844c39f req-cfe08e95-5d34-48c9-a93e-b1e5d8b882e0 service nova] Creating event network-changed:16bab57f-779e-4b22-99d9-e3853e5ef9d7 for instance 3e3960d5-6507-44c4-953d-2d4ac508b67f on n-h1-851368-1 Jul 28 11:48:29.853884 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-04ce3ae1-4a27-4bb4-9db7-e1b3f844c39f req-cfe08e95-5d34-48c9-a93e-b1e5d8b882e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095019 Jul 28 11:48:29.855020 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2336/4692] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:29.868413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0377c2af-7a14-4a6b-891a-2b397a7f48be req-a8e50ec1-d3e8-4b2b-8a42-2ec9588d2de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d653098b-f79d-4178-9b6b-7a32e23235f2", "name": "network-vif-plugged", "status": "completed", "tag": "fea2eebc-054c-47df-b46a-ca7f4e5b7846"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:29.897724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0377c2af-7a14-4a6b-891a-2b397a7f48be req-a8e50ec1-d3e8-4b2b-8a42-2ec9588d2de8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:29.898570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0377c2af-7a14-4a6b-891a-2b397a7f48be req-a8e50ec1-d3e8-4b2b-8a42-2ec9588d2de8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:29.917328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0377c2af-7a14-4a6b-891a-2b397a7f48be req-a8e50ec1-d3e8-4b2b-8a42-2ec9588d2de8 service nova] Creating event network-vif-plugged:fea2eebc-054c-47df-b46a-ca7f4e5b7846 for instance d653098b-f79d-4178-9b6b-7a32e23235f2 on n-h1-851368-1 Jul 28 11:48:29.930122 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0377c2af-7a14-4a6b-891a-2b397a7f48be req-a8e50ec1-d3e8-4b2b-8a42-2ec9588d2de8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068260 Jul 28 11:48:29.931177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2337/4693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:30.585159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:30.600554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b22d49a-160f-4b79-bdf5-0c21da18a993 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.825969 Jul 28 11:48:30.601745 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2357/4694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:29 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:30.769645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:30.770411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:30.789564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:30.790364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:30.793065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:30.793731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:30.794912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:30.795284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:30.800219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:30.811690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:30.812150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:30.812946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:30.813396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:31.195543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=24 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:31.302127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:31.313417 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cafe2839-890e-4769-8b26-50bc4272ffc2 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.551136 Jul 28 11:48:31.317318 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2338/4695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:30 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:31.425627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:31.441418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de77c590-5dc6-46bc-a43a-07420bd53a2a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.651173 Jul 28 11:48:31.443242 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2358/4696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:30 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:31.624162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:31.625163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:31.639041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:31.639898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:31.641073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:31.643556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:31.649354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:32.047622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-db00b2f5-7d2a-4575-93fd-6052a5e39f17 req-a3099c98-49be-42ba-8bfe-084cb99e73f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f74786-faec-4adb-9f64-70cacb76cfa6", "name": "network-vif-plugged", "status": "completed", "tag": "6efc75ae-57bc-4c5a-ae63-b9b4e320d278"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:32.070790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-db00b2f5-7d2a-4575-93fd-6052a5e39f17 req-a3099c98-49be-42ba-8bfe-084cb99e73f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:32.078844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-db00b2f5-7d2a-4575-93fd-6052a5e39f17 req-a3099c98-49be-42ba-8bfe-084cb99e73f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:32.102156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-db00b2f5-7d2a-4575-93fd-6052a5e39f17 req-a3099c98-49be-42ba-8bfe-084cb99e73f0 service nova] Creating event network-vif-plugged:6efc75ae-57bc-4c5a-ae63-b9b4e320d278 for instance f5f74786-faec-4adb-9f64-70cacb76cfa6 on n-h2-851368-1 Jul 28 11:48:32.119670 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-db00b2f5-7d2a-4575-93fd-6052a5e39f17 req-a3099c98-49be-42ba-8bfe-084cb99e73f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077737 Jul 28 11:48:32.120142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:32.121992 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2359/4697] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:48:32.135692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2eb0e49a-d507-4451-b149-35383e400549 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.515894 Jul 28 11:48:32.136948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2339/4698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:31 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:32.351748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:32.352471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:32.374991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:32.375494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:32.376302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:32.376749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:32.463640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:32.464527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:32.479191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:32.480008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:32.483535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:32.484553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:32.982444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:32.995763 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73855399-a711-492f-be32-c756f94bb0e5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 0.650844 Jul 28 11:48:32.996794 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2360/4699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:32 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:33.072822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:33.085092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1d58733-63c2-4f78-9140-6c0d3ae9e319 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1292 microversion: 2.1 time: 0.626110 Jul 28 11:48:33.085694 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2340/4700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:32 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1292 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:33.158359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:33.159596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:33.176977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:33.177862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:33.179498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:33.183709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:33.412078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:33.412580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:33.422420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:33.422878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:33.423686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:33.424116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:33.479302 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac54125d-c940-4694-bf7a-b93b42f48bc6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/ips" status: 200 len: 145 microversion: 2.1 time: 0.074675 Jul 28 11:48:33.499458 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2341/4701] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:48:33 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/ips => generated 145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:48:33.906596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:33.984653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf9a7819-cf90-434a-ad83-3754137d7bbb tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.802276 Jul 28 11:48:33.987633 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2361/4702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:33 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:34.026248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:34.027146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:34.040936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:34.041717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:34.043853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:34.044475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:34.108224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:34.109724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:34.123643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:34.124808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:34.129907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:34.131942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:34.171051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:35.453400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:35.472494 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f41ff9f-a8fd-48d1-8458-3575b2ad6e03 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1402 microversion: 2.1 time: 1.460140 Jul 28 11:48:35.487575 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2342/4703] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:34 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1402 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:35.521031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:35.521980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:35.541381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:35.544026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:35.545022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:35.546033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:35.566870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:35.579664 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d544763-6f92-40d1-bdfe-d88d9843955a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1473 microversion: 2.1 time: 1.477565 Jul 28 11:48:35.581051 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2362/4704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:34 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1473 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:35.885966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1093381316", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:35.921461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:35.935493 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c575cf68-d754-4276-97d5-25aec14a2631 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.442193 Jul 28 11:48:35.958147 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2343/4705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:35 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:35.968195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:48:36.300183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a78b1c2-5e41-404a-b9cb-83e54d1308c7"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:36.303406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:36.322784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:36.323604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:36.324577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:36.325170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:36.822523 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de49dc91-d93a-454e-9f6c-0b0d51b000b9 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526708 Jul 28 11:48:36.843871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2344/4706] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:48:36 2022] POST /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:48:36.855970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:36.857052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:36.867006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:36.867828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:36.868833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:36.869691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.242353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:48:37.242852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:48:37.243365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:48:37.243882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:48:37.244315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:48:37.271710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.272187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.273065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.273511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.316975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:37.332893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:37.384525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:37.421804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:48:37.424528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:48:37.433526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:37.449117 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-912586e5-740f-49dd-9437-e352f05bdb17 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1589 microversion: 2.1 time: 0.600466 Jul 28 11:48:37.451239 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2345/4707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:36 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1589 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:37.478287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:37.479898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:37.503811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.504351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.505690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.507404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.534098 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-667506c7-2225-44e8-9b04-520035b40820 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.651953 Jul 28 11:48:37.545780 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2363/4708] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:48:37.558296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:37.558812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:37.575343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.575801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:37.576595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:37.577041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:38.046348 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cdc19565-ab9c-46cf-86fc-2e055a8296f4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.499382 Jul 28 11:48:38.048081 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2364/4709] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:48:37 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6/os-interface => generated 284 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:38.053142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b00433f6-53dc-4328-8f5b-fdc96642bf43 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:38.053840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b00433f6-53dc-4328-8f5b-fdc96642bf43 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:38.103714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b00433f6-53dc-4328-8f5b-fdc96642bf43 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:48:38.514609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.scheduler.client.report [None req-b00433f6-53dc-4328-8f5b-fdc96642bf43 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Deleted allocations for instance 9396c343-732c-4545-9c1d-612cbdb4e686 Jul 28 11:48:38.570972 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b00433f6-53dc-4328-8f5b-fdc96642bf43 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686" status: 204 len: 0 microversion: 2.1 time: 0.521397 Jul 28 11:48:38.571779 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2365/4710] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:48:38 2022] DELETE /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:48:38.594297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:38.595061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:38.613176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:38.628468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-66cb54f3-8c6e-4119-abc1-5cbc6246855b tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 1.172786 Jul 28 11:48:38.639177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2346/4711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:37 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:38.657201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:38.657657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:38.658590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:38.659113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:38.919759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:38.943548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-000b0856-b733-4814-b532-99a64b8a2cba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686" status: 200 len: 1213 microversion: 2.1 time: 0.352311 Jul 28 11:48:38.949029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2366/4712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:38 2022] GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 => generated 1213 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:39.654703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:39.655373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:39.668502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:39.671065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:39.675970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:39.676443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:39.973370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:39.974169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:39.990005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:39.990542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:39.991706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:39.994222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:40.039488 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 HTTP/1.1 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '9396c343-732c-4545-9c1d-612cbdb4e686'} Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:40.045811 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:48:40.050901 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:40.052474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:48:40.055863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2de8796b-650a-4a42-9fe5-24813bc93025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686" status: 404 len: 111 microversion: 2.1 time: 0.085939 Jul 28 11:48:40.058211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2367/4713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:39 2022] GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:48:40.070648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f395e501-3e62-4fc7-903f-ee5e9eb3a6b2 req-ee99a3e0-4af4-4c1e-b01a-a84ea8b4909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3960d5-6507-44c4-953d-2d4ac508b67f", "name": "network-vif-plugged", "status": "completed", "tag": "16bab57f-779e-4b22-99d9-e3853e5ef9d7"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:40.087000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:40.100037 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-846bf03e-11b1-4a9a-bc05-e8e393c3505c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 0.450331 Jul 28 11:48:40.103060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f395e501-3e62-4fc7-903f-ee5e9eb3a6b2 req-ee99a3e0-4af4-4c1e-b01a-a84ea8b4909d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:40.104736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f395e501-3e62-4fc7-903f-ee5e9eb3a6b2 req-ee99a3e0-4af4-4c1e-b01a-a84ea8b4909d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:40.104885 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2347/4714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:39 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:40.137729 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f395e501-3e62-4fc7-903f-ee5e9eb3a6b2 req-ee99a3e0-4af4-4c1e-b01a-a84ea8b4909d service nova] Creating event network-vif-plugged:16bab57f-779e-4b22-99d9-e3853e5ef9d7 for instance 3e3960d5-6507-44c4-953d-2d4ac508b67f on n-h1-851368-1 Jul 28 11:48:40.158149 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f395e501-3e62-4fc7-903f-ee5e9eb3a6b2 req-ee99a3e0-4af4-4c1e-b01a-a84ea8b4909d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094964 Jul 28 11:48:40.161565 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2368/4715] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:40.468485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-954801643", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:40.601135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:48:41.124713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:41.126182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:41.141483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:41.143626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:41.144447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:41.147093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:42.230917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:42.241377 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f60fc7d-8b06-4f8a-8e37-3dbe145f987e tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1313 microversion: 2.1 time: 1.123520 Jul 28 11:48:42.258525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2369/4716] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:41 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1313 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:43.221909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:48:43.222911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:48:43.223947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:48:43.224535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:48:43.225117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:48:43.244087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:43.247726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:43.248836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:43.249439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:43.266033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:43.279493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:43.294505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:43.295204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:43.297230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:43.298310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:43.309450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:48:43.327110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:48:43.355414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:48:43.357768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:48:43.452238 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53072adb-3d47-4c11-81aa-6aa2435ff27f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.988706 Jul 28 11:48:43.461015 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2348/4717] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:48:43.474141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d9f695a-f798-4746-8589-8bc0a91e97fd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:43.475008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d9f695a-f798-4746-8589-8bc0a91e97fd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:43.705890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d9f695a-f798-4746-8589-8bc0a91e97fd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:43.721685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d9f695a-f798-4746-8589-8bc0a91e97fd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1220 microversion: 2.1 time: 0.243582 Jul 28 11:48:43.735206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2349/4718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:43 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1220 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:44.581729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:44.583090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:44.610606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:44.611688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:44.612737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:44.616472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:44.787148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:44.818429 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-405da95b-a998-453a-8e66-d6412d29877c tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1501 microversion: 2.1 time: 1.542326 Jul 28 11:48:44.843460 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2370/4719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:43 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1501 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:44.866827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a8477596-4b6c-4999-bb17-7ae166d2024a req-105d9f0f-668c-49b1-81c8-d75241b2f13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f74786-faec-4adb-9f64-70cacb76cfa6", "tag": "6efc75ae-57bc-4c5a-ae63-b9b4e320d278"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:44.917299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a8477596-4b6c-4999-bb17-7ae166d2024a req-105d9f0f-668c-49b1-81c8-d75241b2f13d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:44.927423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a8477596-4b6c-4999-bb17-7ae166d2024a req-105d9f0f-668c-49b1-81c8-d75241b2f13d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:44.987896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a8477596-4b6c-4999-bb17-7ae166d2024a req-105d9f0f-668c-49b1-81c8-d75241b2f13d service nova] Creating event network-changed:6efc75ae-57bc-4c5a-ae63-b9b4e320d278 for instance f5f74786-faec-4adb-9f64-70cacb76cfa6 on n-h2-851368-1 Jul 28 11:48:45.020193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a8477596-4b6c-4999-bb17-7ae166d2024a req-105d9f0f-668c-49b1-81c8-d75241b2f13d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168336 Jul 28 11:48:45.024221 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2371/4720] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:45.060620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:45.066609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:45.118628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:45.120536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:45.122003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:45.124767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:45.629825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:45.639649 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9127d299-329e-4be4-bb0e-52c7d23c7c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1224 microversion: 2.1 time: 0.610358 Jul 28 11:48:45.653404 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2372/4721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:45 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1224 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:45.680961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:45.684793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:45.716457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:45.717236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:45.722551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:45.726115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:45.958330 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e6cac76-6524-4f90-b47a-8e2ba14fb0d3 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.302123 Jul 28 11:48:45.966211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2373/4722] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Jul 28 11:48:45 2022] DELETE /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f/os-server-password => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:48:45.979681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:45.990310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:46.011721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.013561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.014800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.018355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.082863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-84faacc9-c168-4afe-bf37-45621034abb7 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.115149 Jul 28 11:48:46.083869 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2374/4723] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Jul 28 11:48:45 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f/os-server-password => generated 16 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:48:46.108907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:46.109844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:46.118538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.119144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.119931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.122409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.185628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:46.190124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:48:46.204501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0fb5341e-526a-4018-a2a9-14050de6aab5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1589 microversion: 2.1 time: 1.629122 Jul 28 11:48:46.222633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2350/4724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:44 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1589 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:46.508945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aec601ab-011c-47a9-8d9c-0a8c4568b392 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 204 len: 0 microversion: 2.1 time: 0.412905 Jul 28 11:48:46.515744 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2375/4725] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:48:46 2022] DELETE /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:48:46.520971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:46.521601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:46.557810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.558298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.559158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.559613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.679435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:46.680146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:46.697178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.697691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:46.702242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:46.706349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:47.191505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:47.203844 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe65ac63-0423-427f-9bda-aa0d4b4d1549 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1280 microversion: 2.1 time: 0.529662 Jul 28 11:48:47.216038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2376/4726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:46 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1280 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:47.675030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:47.686965 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b27bf327-a23e-4296-8551-e32c5d8b96fc tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1507 microversion: 2.1 time: 1.170956 Jul 28 11:48:47.687601 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2351/4727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:46 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1507 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:48:48.229802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:48.230695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:48.233536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:48.245540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:48.259773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:48.260832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:48.261579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:48.400929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:48.710111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:48.710748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:48.734266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:48.736117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:48.737496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:48.737955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:48.940896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:48.956112 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7acd3f02-9335-4630-8d13-0ab3ceb01d39 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1278 microversion: 2.1 time: 0.729088 Jul 28 11:48:48.957455 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2377/4728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:48 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1278 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:49.575709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:49.586953 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5780c211-1d9f-4c9f-864c-b1306d57c395 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1507 microversion: 2.1 time: 0.879434 Jul 28 11:48:49.588417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2352/4729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:48 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1507 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:49.982947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:49.983595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:50.000787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.002829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.005859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.015884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.188051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-45fc277d-b8df-436d-acd9-ff81cadb4c38 req-7725b6f3-785a-48bb-8c6e-597bd02ede5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3960d5-6507-44c4-953d-2d4ac508b67f", "name": "network-vif-deleted", "tag": "16bab57f-779e-4b22-99d9-e3853e5ef9d7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:50.221457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-45fc277d-b8df-436d-acd9-ff81cadb4c38 req-7725b6f3-785a-48bb-8c6e-597bd02ede5e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.222006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-45fc277d-b8df-436d-acd9-ff81cadb4c38 req-7725b6f3-785a-48bb-8c6e-597bd02ede5e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.232900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:50.243774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4dd4a94-dd7b-4eae-ae79-75cb3a135d0a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1278 microversion: 2.1 time: 0.264543 Jul 28 11:48:50.244969 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2378/4730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:49 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:50.256989 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-45fc277d-b8df-436d-acd9-ff81cadb4c38 req-7725b6f3-785a-48bb-8c6e-597bd02ede5e service nova] Creating event network-vif-deleted:16bab57f-779e-4b22-99d9-e3853e5ef9d7 for instance 3e3960d5-6507-44c4-953d-2d4ac508b67f on n-h1-851368-1 Jul 28 11:48:50.268724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-45fc277d-b8df-436d-acd9-ff81cadb4c38 req-7725b6f3-785a-48bb-8c6e-597bd02ede5e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084261 Jul 28 11:48:50.272834 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2353/4731] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:50.609364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:50.612269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:50.624918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.627985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.629125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.632450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.760420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:50.760808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:50.778078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lazy-loading 'fault' on Instance uuid 3e3960d5-6507-44c4-953d-2d4ac508b67f {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:48:50.935897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763cddf0f104f6c9920df40cf3ddafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca754153a0e4093a6c40eb36e289344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:50.974346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9b9f25a-f354-4608-91f4-cd839e9c500f tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 200 len: 1303 microversion: 2.1 time: 0.369802 Jul 28 11:48:50.993873 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2379/4732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:50 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 1303 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:51.269922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:51.270839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:51.285767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:51.287889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:51.289148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:51.291264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:51.945817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:51.961679 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee8d2d30-6454-497f-8a15-c90612720563 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 0.697308 Jul 28 11:48:51.962902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2354/4733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:51 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:52.001492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:52.002220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] [instance: 3e3960d5-6507-44c4-953d-2d4ac508b67f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:52.028127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:52.029321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:52.030378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:52.030974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:52.056488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:52.063961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] HTTP exception thrown: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Request method failure captured: Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f HTTP/1.1 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4neCkzSDXD7V2Z7U3yRD06rr2LdKPJUHOMNgTPlJDcQLvkZzvAQBsQwl3HmC6jbwfr3OhkJuepl9jyS2Pl_xK5wh0dX12R4j1XjY8OI-4RtlZMm5aphQz3YrguSiB-ZNux7FZotZLDFu6bns8qPWmUzheS2B1UYzeADPY6xmE9Cz5O8 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1ca754153a0e4093a6c40eb36e289344 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerPasswordTestJSON-1599903135 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca754153a0e4093a6c40eb36e289344"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ca754153a0e4093a6c40eb36e289344"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ca754153a0e4093a6c40eb36e289344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ca754153a0e4093a6c40eb36e289344"}]}] Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerPasswordTestJSON-1599903135 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1ca754153a0e4093a6c40eb36e289344 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1599903135 Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerPasswordTestJSON-1599903135-project Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e763cddf0f104f6c9920df40cf3ddafa Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerPasswordTestJSON-1599903135-project Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3e3960d5-6507-44c4-953d-2d4ac508b67f'} Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:48:52.068564 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. Jul 28 11:48:52.073694 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:48:52.076891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] Returning 404 to user: Instance 3e3960d5-6507-44c4-953d-2d4ac508b67f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:48:52.078266 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bafdb319-f6cf-4ba0-9339-0178226d1f67 tempest-ServerPasswordTestJSON-1599903135 tempest-ServerPasswordTestJSON-1599903135-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f" status: 404 len: 111 microversion: 2.1 time: 0.081069 Jul 28 11:48:52.081163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2380/4734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:51 2022] GET /compute/v2.1/servers/3e3960d5-6507-44c4-953d-2d4ac508b67f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:48:52.985473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:52.987620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:53.016235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:53.016619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:53.017657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:53.018256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:53.283715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:53.715216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:54.367595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:54.383058 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac710db9-83f5-4ea7-8bf9-d386e9fadcd0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 1.402979 Jul 28 11:48:54.395156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2355/4735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:52 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:55.411390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:55.412628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:55.445571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.461279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.464812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.469170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.552130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:55.554560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:55.568101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:55.576186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.583745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.586781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.587697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.683947 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea28a3b9-736a-4d6b-8271-7c6c88f8593b tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136313 Jul 28 11:48:55.685266 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2356/4736] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:48:55 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:55.699915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:55.702789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:55.721741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.722768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.723866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:55.725825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:55.786852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:48:55.801286 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f42ace67-a39e-4aae-a720-f2fea6adee52 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7" status: 200 len: 194 microversion: 2.1 time: 0.109458 Jul 28 11:48:55.807030 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2357/4737] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Jul 28 11:48:55 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:57.685328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:48:57.700863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52509f59-1ccc-4e11-be49-87db53c70149 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 2.293889 Jul 28 11:48:57.701453 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2381/4738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:55 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:48:57.806807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ee11b3c7-9453-4809-8c5b-1b7445b9ec4d req-57478be0-b4e3-43db-8c97-887b229738a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61a25ec-5e01-4b24-a3eb-6b0ebe4378db", "tag": "e87ed3a9-bdd5-43a8-b622-82a0ae205a1e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:57.837961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee11b3c7-9453-4809-8c5b-1b7445b9ec4d req-57478be0-b4e3-43db-8c97-887b229738a4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:57.838405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee11b3c7-9453-4809-8c5b-1b7445b9ec4d req-57478be0-b4e3-43db-8c97-887b229738a4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:57.881349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ee11b3c7-9453-4809-8c5b-1b7445b9ec4d req-57478be0-b4e3-43db-8c97-887b229738a4 service nova] Creating event network-changed:e87ed3a9-bdd5-43a8-b622-82a0ae205a1e for instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db on n-h2-851368-1 Jul 28 11:48:57.889329 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ee11b3c7-9453-4809-8c5b-1b7445b9ec4d req-57478be0-b4e3-43db-8c97-887b229738a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086653 Jul 28 11:48:57.890601 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2358/4739] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:48:58.700478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b1e3e60-428a-44ff-b7d5-ca914e542368"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:48:58.702903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:58.722640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:48:58.723345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:48:58.725273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:58.725663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:58.726364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:58.726816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:58.742829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:58.743450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:58.744137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:48:58.744820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:48:59.538562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe7aaca7-4955-49fb-87a1-10fff447c4c0 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "POST /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840523 Jul 28 11:48:59.540171 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2382/4740] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:48:58 2022] POST /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:00.325708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:00.337310 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ff00b98-e563-410f-bcba-5297820aa2d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 1.619042 Jul 28 11:49:00.340047 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2359/4741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:48:58 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:49:01.362302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:01.363137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:01.376521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:01.379943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:01.382247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:01.382706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:01.985594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:01.998569 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5dfb72b1-f81a-4cdf-98ff-2047510a54a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 0.638974 Jul 28 11:49:01.999586 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2383/4742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:01 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:03.024910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:03.025758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:03.049599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:03.053158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:03.057380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:03.058120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:05.040722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:05.078645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eecc0ea2-4785-4370-89ae-945d6cd51d72 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 2.051452 Jul 28 11:49:05.085348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2360/4743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:03 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:06.105796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:06.106412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:06.119763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:06.120216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:06.121005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:06.121443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:06.510322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:06.526996 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3ef1ee7-c7d0-45cf-9b07-5abc5102f37d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 0.424963 Jul 28 11:49:06.527906 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2384/4744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:06 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:07.565905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:07.566626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:07.606057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:07.606562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:07.607393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:07.607818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:08.509640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:08.561315 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16c41510-8a1e-4b14-91c8-7c17a6232e75 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 1.015236 Jul 28 11:49:08.564048 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2361/4745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:07 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:09.586959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:09.589106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:09.601529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:09.612212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:09.612683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:09.613491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:09.613932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:10.482385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:10.502203 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc224eaf-4b1a-472a-88ad-4fcafb8f4940 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 0.913780 Jul 28 11:49:10.503444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2385/4746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:09 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:10.978079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:10.984630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:10.985464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Searching by: {'deleted': False, 'project_id': '4b95fd58a59d4b3d9515440076a102cc'} {{(pid=119236) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:49:11.013808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.014280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.015099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.015559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.095993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.multi_cell_list [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119236) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:49:11.173477 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d434161-5e2a-4ea7-b5e5-2e0790636d50 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.201308 Jul 28 11:49:11.174196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2362/4747] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 11:49:10 2022] GET /compute/v2.1/servers => generated 339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:11.186556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:11.199128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:11.200184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Searching by: {'deleted': False, 'project_id': '4b95fd58a59d4b3d9515440076a102cc'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 11:49:11.224285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.224998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.226035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.229648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.299943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 11:49:11.424043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:11.462848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.463350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.531974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:11.532641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:11.541171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.541623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.542407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:11.542843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:11.874815 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a618aa13-4127-4607-aaa7-2c773e8f9e9e tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.691998 Jul 28 11:49:11.876113 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2386/4748] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 11:49:11 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:11.905580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3524d6c9-5c00-4947-8c7f-5a26cbc213c4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:11.932692 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3524d6c9-5c00-4947-8c7f-5a26cbc213c4 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035073 Jul 28 11:49:11.939454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2387/4749] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:49:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:12.251913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:12.258740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:12.274398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:12.274854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:12.275669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:12.276116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:12.366532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:49:12.595117 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-68788fe0-c41b-4ee1-ade0-610b40edbc95 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 204 len: 0 microversion: 2.1 time: 0.348465 Jul 28 11:49:12.599280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2388/4750] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:49:12 2022] DELETE /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:49:12.604997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:12.605901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:12.623155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:12.623958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:12.624990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:12.628164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:12.722685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:12.736905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-420f5aca-b606-4932-b67a-446985f91263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 1.209519 Jul 28 11:49:12.739915 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2363/4751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:11 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:13.433599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:13.441879 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-777eccb4-5a7f-48b9-b7eb-51b66f61cc84 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1714 microversion: 2.1 time: 0.841347 Jul 28 11:49:13.463992 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2389/4752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:12 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1714 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:13.535697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b65085f7-18dc-4629-85ac-033d1fdc335d req-76a342e8-f893-4079-9337-9484c1000e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61a25ec-5e01-4b24-a3eb-6b0ebe4378db", "name": "network-vif-plugged", "status": "completed", "tag": "e87ed3a9-bdd5-43a8-b622-82a0ae205a1e"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:13.569498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b65085f7-18dc-4629-85ac-033d1fdc335d req-76a342e8-f893-4079-9337-9484c1000e2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:13.569967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b65085f7-18dc-4629-85ac-033d1fdc335d req-76a342e8-f893-4079-9337-9484c1000e2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:13.601192 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b65085f7-18dc-4629-85ac-033d1fdc335d req-76a342e8-f893-4079-9337-9484c1000e2e service nova] Creating event network-vif-plugged:e87ed3a9-bdd5-43a8-b622-82a0ae205a1e for instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db on n-h2-851368-1 Jul 28 11:49:13.617630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b65085f7-18dc-4629-85ac-033d1fdc335d req-76a342e8-f893-4079-9337-9484c1000e2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084539 Jul 28 11:49:13.618591 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2364/4753] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:13.774218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:13.775700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:13.793445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:13.794391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:13.796462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:13.798932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:14.481406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:14.482909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:14.500616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:14.502135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:14.503511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:14.504432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:14.674755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:14.701156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2eb47eb8-f690-41cb-bcd7-9a345047a28c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 0.937163 Jul 28 11:49:14.702005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2390/4754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:13 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:15.160870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:15.170985 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2492dc14-d0f8-406d-9b57-3d84690d3d38 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1714 microversion: 2.1 time: 0.702586 Jul 28 11:49:15.176033 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2365/4755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:14 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1714 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:49:15.692425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:15.695758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:15.735797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:15.738294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:15.753957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:15.758067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:15.760676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:15.768139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:15.781260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:15.782002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:15.786076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:15.786326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:15.873679 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d31463a-0827-40b7-8fcb-601338449089 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.186311 Jul 28 11:49:15.879284 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2391/4756] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:49:15 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:16.023945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:16.024864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:16.041446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.042438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.043573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.044330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.130436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-29c048b3-2ad0-41fc-96f1-0306530a28bb tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7" status: 200 len: 194 microversion: 2.1 time: 0.111037 Jul 28 11:49:16.131887 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2392/4757] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Jul 28 11:49:16 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7 => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:16.144495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:16.145977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:16.153645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.155176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.156193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.156841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.286212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lazy-loading 'services' on Instance uuid f67bc045-daf2-4f97-92bc-3b9022642a75 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:49:16.442060 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-50ff79b6-0924-4d1f-860c-2d8cad5cba97 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7" status: 202 len: 0 microversion: 2.1 time: 0.302003 Jul 28 11:49:16.443802 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2393/4758] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:49:16 2022] DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/4a78b1c2-5e41-404a-b9cb-83e54d1308c7 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:49:16.533931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:16.536723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:16.574073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.580618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.581716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:16.582154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:16.638614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:16.762012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:16.770596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-337fbfcf-ff3d-4620-a164-fd3414aa0447 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1320 microversion: 2.1 time: 1.051038 Jul 28 11:49:16.777330 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2366/4759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:15 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:17.809933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:17.813537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:17.830984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:17.831934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:17.834287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:17.835774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:17.908240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:17.928395 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db28ebd2-f614-4105-9ad9-4a4d302846b5 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1714 microversion: 2.1 time: 1.482861 Jul 28 11:49:17.934627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2394/4760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:16 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1714 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:18.542685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:18.553272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eea38227-59ef-49b2-8fc4-1486b1248462 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1502 microversion: 2.1 time: 0.752547 Jul 28 11:49:18.557453 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2367/4761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:17 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1502 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:18.583328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:18.584217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:18.614663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:18.615368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:18.617445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:18.618633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:18.965108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:18.966342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:18.986144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:18.986897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:18.987916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:18.988522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:20.148055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:20.166428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8534dc07-11ba-4f32-a7fb-272c50d4645f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1502 microversion: 2.1 time: 1.588187 Jul 28 11:49:20.169891 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2395/4762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:18 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1502 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:20.182100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1f37c05f-2e64-434f-b672-df453811dba4 req-53a20c6f-25bb-43dc-adf1-d21737922b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f74786-faec-4adb-9f64-70cacb76cfa6", "name": "network-vif-deleted", "tag": "6efc75ae-57bc-4c5a-ae63-b9b4e320d278"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:20.216029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1f37c05f-2e64-434f-b672-df453811dba4 req-53a20c6f-25bb-43dc-adf1-d21737922b6d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:20.219268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da3ac2256422a9112700212b58aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95fd58a59d4b3d9515440076a102cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:20.220934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1f37c05f-2e64-434f-b672-df453811dba4 req-53a20c6f-25bb-43dc-adf1-d21737922b6d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:20.228920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b190bdc3-7941-4e96-85f3-5b11fb344f31 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 200 len: 1647 microversion: 2.1 time: 1.268850 Jul 28 11:49:20.232545 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2368/4763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:18 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 1647 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:20.251930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:20.255742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:20.255994 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1f37c05f-2e64-434f-b672-df453811dba4 req-53a20c6f-25bb-43dc-adf1-d21737922b6d service nova] Creating event network-vif-deleted:6efc75ae-57bc-4c5a-ae63-b9b4e320d278 for instance f5f74786-faec-4adb-9f64-70cacb76cfa6 on n-h2-851368-1 Jul 28 11:49:20.276906 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1f37c05f-2e64-434f-b672-df453811dba4 req-53a20c6f-25bb-43dc-adf1-d21737922b6d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103368 Jul 28 11:49:20.277829 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2396/4764] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:20.286458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:20.291191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:20.294488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:20.297395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:20.384359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:49:20.672218 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0889d55e-fbf3-43cb-98f5-01f1e20d3951 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 204 len: 0 microversion: 2.1 time: 0.436629 Jul 28 11:49:20.673188 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2369/4765] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:49:20 2022] DELETE /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:49:20.682960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:20.683769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:20.699894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:20.703842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:20.705323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:20.705856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:21.246477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:21.255497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:21.256113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] [instance: f5f74786-faec-4adb-9f64-70cacb76cfa6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:21.266928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:21.276587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:21.280533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:21.281494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:21.282141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:21.319631 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] HTTP exception thrown: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Request method failure captured: Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 HTTP/1.1 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ndy59Ll2m0AIl0IDCmZ-mpPkaeMAsV3FjgJGLl8wBu-0jtcs5YlGmA98cCpuMAYtsOZ4nx9JtEfJ6H8pYHEVR2NYOxMaZ34-QA7oecZYpAWjgIg5g69q3z6Eqd3v9HzZGISzBWgPUKbegTfB1yE2Z_gkvrbbULvvzemDowoH4pVNUE Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 4b95fd58a59d4b3d9515440076a102cc Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestManualDisk-905206437 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b95fd58a59d4b3d9515440076a102cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4b95fd58a59d4b3d9515440076a102cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4b95fd58a59d4b3d9515440076a102cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4b95fd58a59d4b3d9515440076a102cc"}]}] Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestManualDisk-905206437 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 4b95fd58a59d4b3d9515440076a102cc Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestManualDisk-905206437 Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestManualDisk-905206437-project Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b92da3ac2256422a9112700212b58aed Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestManualDisk-905206437-project Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f5f74786-faec-4adb-9f64-70cacb76cfa6'} Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:21.324986 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. Jul 28 11:49:21.329639 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:21.334999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Returning 404 to user: Instance f5f74786-faec-4adb-9f64-70cacb76cfa6 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:49:21.340620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73d93076-5ac0-4e7c-b276-8583d04c2550 tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6" status: 404 len: 111 microversion: 2.1 time: 0.088265 Jul 28 11:49:21.341602 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2370/4766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:21 2022] GET /compute/v2.1/servers/f5f74786-faec-4adb-9f64-70cacb76cfa6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:49:21.350362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c7e709e-ed63-4f53-b217-6a884568f6ea tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] Calling method '.version_select at 0x7f2eb19975e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:21.355522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:21.366368 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf6766dd-1a26-44d3-b933-d100563dcd4d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1508 microversion: 2.1 time: 0.688524 Jul 28 11:49:21.369957 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2397/4767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:20 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:21.417887 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c7e709e-ed63-4f53-b217-6a884568f6ea tempest-ServersTestManualDisk-905206437 tempest-ServersTestManualDisk-905206437-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073393573" status: 202 len: 0 microversion: 2.1 time: 0.071053 Jul 28 11:49:21.421763 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2371/4768] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:49:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073393573 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:49:22.402924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:22.404514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:22.415413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:22.421548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:22.423452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:22.425351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:22.429832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:23.543174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:23.558234 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2aca9ed-7971-45ec-8015-4ddcc5a75bd1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1508 microversion: 2.1 time: 1.166670 Jul 28 11:49:23.572326 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2398/4769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:22 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1508 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:24.594380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:24.596697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:24.615084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:24.615555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:24.625000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:24.625998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:25.356605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2fd5be4e-57d0-4719-a1a3-c9dd5e378c3b req-5b7acfe6-3566-423d-a04b-c7d30684727e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61a25ec-5e01-4b24-a3eb-6b0ebe4378db", "name": "network-vif-deleted", "tag": "e87ed3a9-bdd5-43a8-b622-82a0ae205a1e"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:25.380616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2fd5be4e-57d0-4719-a1a3-c9dd5e378c3b req-5b7acfe6-3566-423d-a04b-c7d30684727e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:25.382534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2fd5be4e-57d0-4719-a1a3-c9dd5e378c3b req-5b7acfe6-3566-423d-a04b-c7d30684727e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:25.419548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2fd5be4e-57d0-4719-a1a3-c9dd5e378c3b req-5b7acfe6-3566-423d-a04b-c7d30684727e service nova] Creating event network-vif-deleted:e87ed3a9-bdd5-43a8-b622-82a0ae205a1e for instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db on n-h2-851368-1 Jul 28 11:49:25.432900 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2fd5be4e-57d0-4719-a1a3-c9dd5e378c3b req-5b7acfe6-3566-423d-a04b-c7d30684727e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080715 Jul 28 11:49:25.437359 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2399/4770] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:49:25.622314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:25.633654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87ca6b95-830e-41e2-9fa6-3f6fce9acc22 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 200 len: 1466 microversion: 2.1 time: 1.047682 Jul 28 11:49:25.655518 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2372/4771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:24 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 1466 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:26.659644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:26.660345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:26.683668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:26.685006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:26.686928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:26.687685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:26.722600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db HTTP/1.1 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f61a25ec-5e01-4b24-a3eb-6b0ebe4378db'} Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:49:26.732429 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:49:26.738559 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:49:26.741891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:49:26.743349 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1a24086-7858-47ab-9090-882ae308c4f8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 404 len: 111 microversion: 2.1 time: 0.090799 Jul 28 11:49:26.744136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2400/4772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:26 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:49:26.760744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-146e0566-c18d-4c33-a150-93a5eb3d6b5f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: .version_select at 0x7f2eb19b81f0>, body: {"keypair": {"name": "tempest-key-1810597758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+IAEY9lcplihW/pX/ypYT4Ufat4+aceBRaIMYpqYIe6KfXg6G1HJS+t0DiJhrIQLXCPCE9UbboGmnU1Q+FUzd3GWoRo6E/IoFArHmb7BpnCyhN1z+rAmKieDsz9FTbhA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:26.774924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:26.853005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-146e0566-c18d-4c33-a150-93a5eb3d6b5f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:49:26.881305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-146e0566-c18d-4c33-a150-93a5eb3d6b5f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:49:26.971275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-146e0566-c18d-4c33-a150-93a5eb3d6b5f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.214836 Jul 28 11:49:26.972469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2373/4773] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:49:26 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:26.985092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d838db6f-1cc7-46fc-80f1-2db4a3bdf6a6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '.version_select at 0x7f2ebc01f820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:26.993153 n-d-851368-1 devstack@n-api.service[119235]: WARNING oslo_db.sqlalchemy.utils [None req-d838db6f-1cc7-46fc-80f1-2db4a3bdf6a6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 11:49:27.007873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d838db6f-1cc7-46fc-80f1-2db4a3bdf6a6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027632 Jul 28 11:49:27.011127 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2401/4774] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 11:49:26 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:49:27.260360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-538805018", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-key-1810597758", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:27.370998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:49:28.037643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:28.038775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:28.058047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:28.059038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:28.060286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:28.060969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:28.109235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db3db1a4-3aa2-47bf-a5b1-0c8e512f81ba tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/3b1e3e60-428a-44ff-b7d5-ca914e542368" status: 200 len: 194 microversion: 2.1 time: 0.076706 Jul 28 11:49:28.111149 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2402/4775] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Jul 28 11:49:28 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/3b1e3e60-428a-44ff-b7d5-ca914e542368 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:28.124408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:28.125361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:28.134446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:28.135132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:28.136364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:28.137141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:28.280816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lazy-loading 'services' on Instance uuid f67bc045-daf2-4f97-92bc-3b9022642a75 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:49:28.405478 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-131d5ba9-8c6f-4b4e-b6b1-cfe0f6e38e90 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/3b1e3e60-428a-44ff-b7d5-ca914e542368" status: 202 len: 0 microversion: 2.1 time: 0.287745 Jul 28 11:49:28.406978 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2403/4776] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:49:28 2022] DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments/3b1e3e60-428a-44ff-b7d5-ca914e542368 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:49:29.171605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:49:29.172177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:49:29.172562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:49:29.173024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:49:29.173490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:49:29.202385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:29.208381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:29.210615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:29.217766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:29.248315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:29.288297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:49:29.305872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:49:29.359842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:49:29.365592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:49:29.487705 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6db730c-58a1-48b9-a7ba-aabfab75ba0e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.231988 Jul 28 11:49:29.493874 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2374/4777] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:49:29.500472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9526a9e1-0fe7-47cb-8d20-e9fefce124e3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:29.501755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9526a9e1-0fe7-47cb-8d20-e9fefce124e3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:29.696236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9526a9e1-0fe7-47cb-8d20-e9fefce124e3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:29.705971 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9526a9e1-0fe7-47cb-8d20-e9fefce124e3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1228 microversion: 2.1 time: 0.209688 Jul 28 11:49:29.708468 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2404/4778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:29 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:49:30.729585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:30.730335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:30.748962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:30.749342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:30.753439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:30.758227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:31.096154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:31.112429 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-68634ebf-22de-4289-a414-410d3302450b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1280 microversion: 2.1 time: 0.389291 Jul 28 11:49:31.112993 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2375/4779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:30 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:32.133665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:32.134271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:32.161680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:32.164492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:32.168548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:32.169297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:32.559841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:32.575369 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e42d4740-63e1-416e-bfc1-66527e2a8df6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1286 microversion: 2.1 time: 0.444894 Jul 28 11:49:32.575958 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2405/4780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:32 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1286 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:33.613761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:33.616308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:33.640786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:33.643686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:33.655353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:33.656261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:33.854226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:33.865110 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1286 microversion: 2.1 time: 0.270782 Jul 28 11:49:33.870889 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2376/4781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:33 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:34.895618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:34.896324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:34.915194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:34.917459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:34.921479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:34.922013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:35.066842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:35.067937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-089d1e83-83e1-42cd-99c5-52699604be89 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001522 Jul 28 11:49:35.068401 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2377/4782] 10.222.0.93 () {56 vars in 886 bytes} [Thu Jul 28 11:49:35 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 11:49:35.122692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:35.131875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41f643e0-5e40-4d65-8283-14a08348cb19 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1286 microversion: 2.1 time: 0.240872 Jul 28 11:49:35.143876 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2406/4783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:34 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1286 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:36.161859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:36.162594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:36.177882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:36.180526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:36.181717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:36.189108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:36.850218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:36.858065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34ce5461-2b4e-4490-9eb1-c4875960c576 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1286 microversion: 2.1 time: 0.700937 Jul 28 11:49:36.863361 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2378/4784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:36 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1286 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:37.887346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:37.888461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:37.908869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:37.924574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:37.925441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:37.925889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:38.282497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:38.290434 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cdeb9313-70f3-4b70-b102-bd931c38815c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1286 microversion: 2.1 time: 0.406917 Jul 28 11:49:38.303229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2407/4785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:37 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1286 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:38.931910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:38.935026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:38.951205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:38.951661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:38.952451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:38.952888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.112872 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8bfa3070-1eff-45dd-99f1-ecc4ea0d22c3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.185100 Jul 28 11:49:39.114260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2379/4786] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:49:38 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:49:39.316508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:39.317116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:39.330544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.347172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:39.348168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:39.353188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:39.358479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:39.361911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.365556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.368134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.383397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.395032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.396096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.399731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.498441 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee62b764-0c89-4c59-8f23-40fe3a57da11 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151944 Jul 28 11:49:39.501953 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2380/4787] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:49:39 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 11:49:39.613874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:39.614384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:39.624778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.625490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.627929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.629779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.673773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:49:39.704763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:39.877100 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-937b2c54-a2dc-4f95-bde6-6d195778e0bf tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 204 len: 0 microversion: 2.1 time: 0.269716 Jul 28 11:49:39.880283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2381/4788] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:49:39 2022] DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:49:39.890256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:39.893168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:39.906456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.908717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:39.909691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:39.911415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:41.270173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:41.286149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db8c8e25-bf13-4596-80ea-f643d6d831d3 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1672 microversion: 2.1 time: 1.400521 Jul 28 11:49:41.288184 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2382/4789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:39 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1672 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:41.598829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:41.621056 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf1e1a3f-6879-43f6-8e8e-c55748b97745 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 2.307272 Jul 28 11:49:41.645135 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2408/4790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:39 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:42.320568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:42.321968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:42.331234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:42.334596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:42.337850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:42.338516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:42.652779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:42.653999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:42.657573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:42.669844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:42.680374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:42.682136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:42.682843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:43.061909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:43.130231 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5c84227-4469-4f4c-bfac-f5b7fae55999 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1672 microversion: 2.1 time: 0.813068 Jul 28 11:49:43.133838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2383/4791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:42 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1672 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:43.396850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:43.404551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e73723a-0c7d-4375-b60b-2538febb4eab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.755533 Jul 28 11:49:43.405887 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2409/4792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:42 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:49:44.161260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:44.161895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:44.176593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:44.182446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:44.184527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:44.187196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:44.344281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:44.378110 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cdacd9b0-f4da-490d-a1f8-0a9a2018943f tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1605 microversion: 2.1 time: 0.221457 Jul 28 11:49:44.378703 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2384/4793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:44 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:44.436285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:44.437441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:44.500383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:44.501972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:44.506339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:44.509286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:44.548301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1c7a2770-2073-43e3-b255-077e58b08bf3 req-b5e2dd5c-7226-4fc4-b496-4dbf3bb9a5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58370dc-43e0-4e16-b14f-8b3b0676ad1e", "tag": "5e261867-014c-4cf4-a825-591b327bc28b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:44.571495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1c7a2770-2073-43e3-b255-077e58b08bf3 req-b5e2dd5c-7226-4fc4-b496-4dbf3bb9a5b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:44.595788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1c7a2770-2073-43e3-b255-077e58b08bf3 req-b5e2dd5c-7226-4fc4-b496-4dbf3bb9a5b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:44.636666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1c7a2770-2073-43e3-b255-077e58b08bf3 req-b5e2dd5c-7226-4fc4-b496-4dbf3bb9a5b7 service nova] Creating event network-changed:5e261867-014c-4cf4-a825-591b327bc28b for instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e on n-h1-851368-1 Jul 28 11:49:44.644084 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1c7a2770-2073-43e3-b255-077e58b08bf3 req-b5e2dd5c-7226-4fc4-b496-4dbf3bb9a5b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099454 Jul 28 11:49:44.647402 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2385/4794] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:49:45.413696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:45.414411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:45.421651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:45.422955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:45.432412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:45.432412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:45.612589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:45.628522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:45.638329 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5e4b91e-a6f7-4b23-9c61-3943e002ddf6 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1605 microversion: 2.1 time: 0.228661 Jul 28 11:49:45.638961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac6d6353-9797-4fcb-8071-7562120a6a62 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 1.207725 Jul 28 11:49:45.640659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2410/4795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:44 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:45.642321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2386/4796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:45 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:46.664760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:46.667763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:46.668367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:46.668859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:46.694781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:46.699209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:46.700300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:46.701163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:46.704304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:46.707646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:46.708403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:46.709313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:46.788436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:46.973981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1c75be51e843a8a9555b396bbc5163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f889574d214453a98946a8548d3f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:46.994866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b57c9228-ad47-4a19-805c-dc140c17ea69 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 200 len: 1605 microversion: 2.1 time: 0.335256 Jul 28 11:49:46.997272 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2387/4797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:46 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:47.015303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5dfa4af7-3537-4625-ac06-61c5fca074da req-adc4ecb7-8715-4ffc-9571-9aa8a1e079ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67bc045-daf2-4f97-92bc-3b9022642a75", "name": "network-vif-deleted", "tag": "44411123-b4df-475e-918d-27c43fc0e588"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:47.029013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5dfa4af7-3537-4625-ac06-61c5fca074da req-adc4ecb7-8715-4ffc-9571-9aa8a1e079ce service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:47.035446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5dfa4af7-3537-4625-ac06-61c5fca074da req-adc4ecb7-8715-4ffc-9571-9aa8a1e079ce service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:47.060374 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5dfa4af7-3537-4625-ac06-61c5fca074da req-adc4ecb7-8715-4ffc-9571-9aa8a1e079ce service nova] Creating event network-vif-deleted:44411123-b4df-475e-918d-27c43fc0e588 for instance f67bc045-daf2-4f97-92bc-3b9022642a75 on n-h2-851368-1 Jul 28 11:49:47.077694 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5dfa4af7-3537-4625-ac06-61c5fca074da req-adc4ecb7-8715-4ffc-9571-9aa8a1e079ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074637 Jul 28 11:49:47.078647 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2388/4798] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:49:47.281352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:47.296914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ca5cdf5-9869-45a2-a59d-bd6908409347 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.637503 Jul 28 11:49:47.299495 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2411/4799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:46 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:48.026888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:48.028540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:48.046346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:48.047387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:48.052322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:48.054024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:48.088287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 HTTP/1.1 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f67bc045-daf2-4f97-92bc-3b9022642a75'} Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:49:48.090224 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:49:48.096716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:49:48.104223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6df39eb9-b344-47bd-9e06-a010b2482567 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 404 len: 111 microversion: 2.1 time: 0.082397 Jul 28 11:49:48.115551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2389/4800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:48 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:49:48.121553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0ff7b69-5d90-4669-88ec-ca1c9d0adf6d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '.version_select at 0x7f2eb1b7bee0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:48.162074 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0ff7b69-5d90-4669-88ec-ca1c9d0adf6d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670795972" status: 202 len: 0 microversion: 2.1 time: 0.045337 Jul 28 11:49:48.162674 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2412/4801] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:49:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670795972 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:49:48.323813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:48.324655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:48.335048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:48.336320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:48.338566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:48.340025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:49.118741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:49.127581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fb9a7d6-2e29-48f5-bc4f-103af32230de tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.808218 Jul 28 11:49:49.128154 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2390/4802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:48 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:50.151636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:50.153018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:50.175807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:50.179878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:50.181075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:50.187637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:51.561029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:51.573862 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b9f19a2-85f2-4ded-b66a-5eecbf4730fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 1.427013 Jul 28 11:49:51.576480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2413/4803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:50 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:52.599620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:52.600422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:52.615131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:52.615637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:52.616503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:52.616950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:52.944286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:52.965117 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d748d2c9-aea0-498f-81e8-164334c26eb9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.370935 Jul 28 11:49:52.966634 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2391/4804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:52 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:53.989069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:53.989689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:54.004992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:54.005438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:54.006222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:54.006675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:54.571161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:54.604946 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-281688b5-1f39-4a87-8d4f-5b7dcd8daec9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.620271 Jul 28 11:49:54.616238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2414/4805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:53 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:55.633873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:55.635178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:55.648314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:55.649014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:55.652534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:55.653315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:56.278856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9b2fd1a3-cf46-40f0-86e4-41a5fac79ff9 req-d2d9fa50-a870-493a-9bbe-a533ba160e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58370dc-43e0-4e16-b14f-8b3b0676ad1e", "name": "network-vif-plugged", "status": "completed", "tag": "5e261867-014c-4cf4-a825-591b327bc28b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:49:56.323563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9b2fd1a3-cf46-40f0-86e4-41a5fac79ff9 req-d2d9fa50-a870-493a-9bbe-a533ba160e06 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:56.326828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9b2fd1a3-cf46-40f0-86e4-41a5fac79ff9 req-d2d9fa50-a870-493a-9bbe-a533ba160e06 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:56.362549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9b2fd1a3-cf46-40f0-86e4-41a5fac79ff9 req-d2d9fa50-a870-493a-9bbe-a533ba160e06 service nova] Creating event network-vif-plugged:5e261867-014c-4cf4-a825-591b327bc28b for instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e on n-h1-851368-1 Jul 28 11:49:56.382738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9b2fd1a3-cf46-40f0-86e4-41a5fac79ff9 req-d2d9fa50-a870-493a-9bbe-a533ba160e06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106174 Jul 28 11:49:56.383414 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2415/4806] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:49:56.536578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:56.542996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:49:56.545119 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-03c4d22a-e302-47ba-aa3d-90e34a377a7e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 0.918280 Jul 28 11:49:56.545708 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2392/4807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:55 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:49:57.582995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:49:57.596682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:49:57.646914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:57.648990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:57.657666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:49:57.666877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:49:59.373092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:49:59.390427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c4d5955-2e94-4b1c-b73b-a3532ef2b86a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1328 microversion: 2.1 time: 1.821519 Jul 28 11:49:59.391468 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2416/4808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:49:57 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1328 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:00.412009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:00.412637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:00.433961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:00.447341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:00.450756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:00.451702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:00.452149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:02.353954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:02.363609 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ed51b3b-3ec0-46f4-a7ec-bd5affcca3d5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1510 microversion: 2.1 time: 1.955764 Jul 28 11:50:02.376352 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2393/4809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:00 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1510 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:02.404212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:02.405460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:02.419375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:02.421755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:02.423441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:02.426601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:02.892320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:02.905820 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1ff0e47-a113-419f-a039-6d01d3c2c87a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1510 microversion: 2.1 time: 0.505354 Jul 28 11:50:02.909111 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2417/4810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:02 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:02.931412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:02.934256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:02.953927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:02.955256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:02.957002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:02.958902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:03.065008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:50:03.255574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-64d5cc16-e4e0-4173-933e-248cd5ea74ec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 204 len: 0 microversion: 2.1 time: 0.327964 Jul 28 11:50:03.263762 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2394/4811] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:50:02 2022] DELETE /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:50:03.272776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:03.273759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:03.281824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:03.289109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:03.292917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:03.298745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:04.074006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:04.087113 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8293a1a7-9619-4140-b532-29c4b30b4c2e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1516 microversion: 2.1 time: 0.817134 Jul 28 11:50:04.090374 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2418/4812] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:03 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1516 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:05.111125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:05.112363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:05.132545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:05.133113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:05.136381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:05.141915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:06.836854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:06.852366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e33261df-5172-4330-91dc-bd2239556223 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1516 microversion: 2.1 time: 1.741102 Jul 28 11:50:06.859196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2395/4813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:05 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1516 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:07.652205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:07.655900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:07.670223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.671271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:07.675316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.676107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:07.706188 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 HTTP/1.1 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f67bc045-daf2-4f97-92bc-3b9022642a75'} Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:07.707892 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.713249 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.715247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:07.716384 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d17ce670-ecf7-4ff9-ad85-4b1de50d939d tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 404 len: 111 microversion: 2.1 time: 0.068433 Jul 28 11:50:07.717434 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2419/4814] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:50:07 2022] DELETE /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:07.726470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:07.727789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: f67bc045-daf2-4f97-92bc-3b9022642a75] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:07.739398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.739861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:07.740662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.741106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:07.794290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 HTTP/1.1 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f67bc045-daf2-4f97-92bc-3b9022642a75'} Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:07.797211 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance f67bc045-daf2-4f97-92bc-3b9022642a75 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:07.801801 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3503023-6c41-41a2-805f-7691d427781c tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75" status: 404 len: 111 microversion: 2.1 time: 0.077972 Jul 28 11:50:07.806290 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2396/4815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:07 2022] GET /compute/v2.1/servers/f67bc045-daf2-4f97-92bc-3b9022642a75 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:07.877175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:07.878540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:07.897244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.898872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:07.904382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:07.904933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:08.270186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:08.284332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72b4fe20-9eac-442b-a043-376e62fb366d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1516 microversion: 2.1 time: 0.411446 Jul 28 11:50:08.301284 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2420/4816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:07 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:08.756968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4ef9715d-c89a-40fe-baa6-ffb0b64876df req-c41cbcc7-d691-4e1d-a5d9-5cf0b82135f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58370dc-43e0-4e16-b14f-8b3b0676ad1e", "name": "network-vif-deleted", "tag": "5e261867-014c-4cf4-a825-591b327bc28b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:08.807720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4ef9715d-c89a-40fe-baa6-ffb0b64876df req-c41cbcc7-d691-4e1d-a5d9-5cf0b82135f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:08.808321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4ef9715d-c89a-40fe-baa6-ffb0b64876df req-c41cbcc7-d691-4e1d-a5d9-5cf0b82135f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:08.858416 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4ef9715d-c89a-40fe-baa6-ffb0b64876df req-c41cbcc7-d691-4e1d-a5d9-5cf0b82135f0 service nova] Creating event network-vif-deleted:5e261867-014c-4cf4-a825-591b327bc28b for instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e on n-h1-851368-1 Jul 28 11:50:08.897018 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4ef9715d-c89a-40fe-baa6-ffb0b64876df req-c41cbcc7-d691-4e1d-a5d9-5cf0b82135f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143592 Jul 28 11:50:08.898264 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2397/4817] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:09.306471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:09.307212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:09.327370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:09.327830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:09.329188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:09.334498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:09.513013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:09.513484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:09.513965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lazy-loading 'fault' on Instance uuid d58370dc-43e0-4e16-b14f-8b3b0676ad1e {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:50:09.689390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:09.709486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fcdd95a9-87f4-460a-b6ad-055334994e34 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 200 len: 1318 microversion: 2.1 time: 0.406106 Jul 28 11:50:09.710827 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2398/4818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:09 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:09.727533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1498107848", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "32044429-0100-4e69-86e6-bb935370d67d"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:09.838582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] validate_networks() for [('32044429-0100-4e69-86e6-bb935370d67d', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:50:10.736898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:10.737564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:10.754644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:10.757384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:10.760729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:10.761917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:10.808274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e HTTP/1.1 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd58370dc-43e0-4e16-b14f-8b3b0676ad1e'} Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:10.845848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:50:10.850394 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:10.852964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:10.858135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b30a77d-257b-4bc5-af75-7174cc22c06a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 404 len: 111 microversion: 2.1 time: 0.125287 Jul 28 11:50:10.873563 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2399/4819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:10 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:50:10.909780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83642e25-476e-4922-a6ec-413723660241 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '.version_select at 0x7f2eb19234c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:10.956062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:50:10.957237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:50:10.957835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:50:10.958379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:50:10.959206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:50:10.961465 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83642e25-476e-4922-a6ec-413723660241 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-key-1810597758" status: 202 len: 0 microversion: 2.1 time: 0.076425 Jul 28 11:50:10.962739 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2400/4820] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Jul 28 11:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1810597758 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:50:10.996799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:10.999708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:11.003686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:11.004777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:11.047597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Getting quotas for project 5b94aa3d29f7465b9fff2b23feb6b061. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:50:11.058365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Getting quotas for user 299e9382b76641e79c85b9e261e7eaec and project 5b94aa3d29f7465b9fff2b23feb6b061. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:50:11.077729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:50:11.080989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:50:11.167708 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5c2ff1c-c644-4fe1-8dd9-271da7e29122 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952221 Jul 28 11:50:11.177615 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2421/4821] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:50:11.182772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afc04c69-c0e0-45fe-a9ea-f9e74370e985 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:11.184605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afc04c69-c0e0-45fe-a9ea-f9e74370e985 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:11.248374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-216584237", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:11.345509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:50:11.516985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afc04c69-c0e0-45fe-a9ea-f9e74370e985 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:11.528570 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afc04c69-c0e0-45fe-a9ea-f9e74370e985 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1214 microversion: 2.1 time: 0.351264 Jul 28 11:50:11.529507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2401/4822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:11 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:12.551598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:12.552290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:12.573902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:12.574369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:12.575196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:12.575640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:13.120783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:13.143486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05e4905d-6da8-4079-824a-af58bec8f52b tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1218 microversion: 2.1 time: 0.597289 Jul 28 11:50:13.144205 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2402/4823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:12 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1218 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:13.548447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:50:13.548982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:50:13.549348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:50:13.549931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:50:13.550182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:50:13.557186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:13.592617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:13.593084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:13.593948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:13.604278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:13.707162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:50:13.720666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:50:13.793981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:50:13.796302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:50:13.952326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d61508c1-2ce4-449d-9e2c-2940900a730a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.708571 Jul 28 11:50:13.953033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2422/4824] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:50:13.966260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dfc5c51-7722-4b23-a303-30c582f3bd8b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:13.968033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1dfc5c51-7722-4b23-a303-30c582f3bd8b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:14.165948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:14.166885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:14.182431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:14.184353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:14.186164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:14.189239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:14.239567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1dfc5c51-7722-4b23-a303-30c582f3bd8b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:14.253054 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dfc5c51-7722-4b23-a303-30c582f3bd8b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1208 microversion: 2.1 time: 0.290983 Jul 28 11:50:14.255307 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2403/4825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:13 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1208 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:14.717646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:14.728493 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac6fe4b3-0fc4-4da3-b0bf-ff344559e3f3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1272 microversion: 2.1 time: 0.567777 Jul 28 11:50:14.729102 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2423/4826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:14 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1272 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:15.293613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:15.294495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:15.307063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:15.324276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:15.327613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:15.331176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:15.708118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:15.731022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-647e506c-6a94-4a84-8e51-77af08af4810 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1204 microversion: 2.1 time: 0.455407 Jul 28 11:50:15.736417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2404/4827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:15 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1204 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:15.761697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:15.763586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:15.807659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:15.808663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:15.813254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:15.815632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:15.975443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:15.976182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:15.998575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.007851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.009154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.009837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.034044 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 HTTP/1.1 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2be83408-f030-40e8-b48b-6b36c90449f3'} Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:16.042718 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.048540 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.051679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:16.052826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f25c6eee-f9b1-4c0c-8dbf-fc1b61cd3c93 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 404 len: 111 microversion: 2.1 time: 0.085180 Jul 28 11:50:16.054530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2405/4828] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:50:15 2022] DELETE /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:16.068058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:16.069759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] [instance: 2be83408-f030-40e8-b48b-6b36c90449f3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:16.085510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.087688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.088660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.090950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.127926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:16.149159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13ba9eb9-f54a-4567-bb26-336e4448a81c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1272 microversion: 2.1 time: 0.398962 Jul 28 11:50:16.165507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2424/4829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:15 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:16.171055 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] HTTP exception thrown: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Request method failure captured: Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 HTTP/1.1 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nX9jDcsOCex7HtxMsh9iXt_kklJmRZP3-I_AbyLMvMNNLM0mmCB_S927IRQHELWm-Q7uDIQspGan4m6owPR62NvqGm52ZD2l9m3pZ4XsWrJNzaH3U0f6-LzXXbBPMrMjmn8I3Rm2seDNn9ZqYNTKNiB4b4JY-Cw_bVyem2r4OxkpmQ Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a4f889574d214453a98946a8548d3f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a4f889574d214453a98946a8548d3f54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a4f889574d214453a98946a8548d3f54"}]}] Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: a4f889574d214453a98946a8548d3f54 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1269181191 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7e1c75be51e843a8a9555b396bbc5163 Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeTestJSON-1269181191-project Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2be83408-f030-40e8-b48b-6b36c90449f3'} Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:16.177169 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. Jul 28 11:50:16.182266 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:16.184511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] Returning 404 to user: Instance 2be83408-f030-40e8-b48b-6b36c90449f3 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:16.185551 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4e337e2a-6fc6-403b-a803-3e59e4264f26 tempest-AttachVolumeTestJSON-1269181191 tempest-AttachVolumeTestJSON-1269181191-project] 10.222.0.93 "GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3" status: 404 len: 111 microversion: 2.1 time: 0.126670 Jul 28 11:50:16.188412 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2406/4830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:16 2022] GET /compute/v2.1/servers/2be83408-f030-40e8-b48b-6b36c90449f3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:16.763116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:16.764051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:16.782549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.787467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.789102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:16.792532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:16.846035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=62 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:16.997753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:17.013311 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d85ca176-c9cf-42e1-ba16-1c829a46afca tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1266 microversion: 2.1 time: 0.251135 Jul 28 11:50:17.016234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2425/4831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:16 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:17.178213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:17.179646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:17.192242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:17.196968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:17.204209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:17.205445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:17.382901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:17.400460 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-514b2cfb-e7f7-4d59-9b5a-9bdbef7f0fc4 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1272 microversion: 2.1 time: 0.222826 Jul 28 11:50:17.402506 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2407/4832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:17 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:18.037707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:18.038439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:18.049616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:18.053215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:18.054881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:18.055776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:18.214112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:18.228093 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b256d86-e47b-41d0-908b-494225d78399 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1266 microversion: 2.1 time: 0.194241 Jul 28 11:50:18.232346 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2426/4833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:18 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:18.428959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:18.429909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:18.449656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:18.452789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:18.454637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:18.456341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:18.658754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:18.675624 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbdf3c9d-98e6-4a9b-9fb8-491d35712895 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1272 microversion: 2.1 time: 0.249853 Jul 28 11:50:18.675624 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2408/4834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:18 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:19.253326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:19.254551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:19.269539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:19.272366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:19.274626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:19.277643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:19.715449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:19.716746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:19.735660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:19.737417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:19.738858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:19.739828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:19.988546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:19.998666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80c8ed2a-553d-4e34-a43d-e877e1ae6263 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1266 microversion: 2.1 time: 0.750656 Jul 28 11:50:20.007754 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2427/4835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:19 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1266 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:20.045623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:20.055221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1061c44b-3e8c-49fe-a412-0862629b439e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1272 microversion: 2.1 time: 0.344197 Jul 28 11:50:20.058865 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2409/4836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:19 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:21.028656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:21.029275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:21.037456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:21.044340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:21.045398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:21.049269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:21.080049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:21.083113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:21.101090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:21.102297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:21.106998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:21.110360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:21.566135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:21.575512 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fc6e14a-d0a9-467b-9b6c-9205600c0556 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.550716 Jul 28 11:50:21.580489 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2428/4837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:21 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:21.582972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:21.619483 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c464b43f-2dd9-42b8-80d0-eba503a82113 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.538597 Jul 28 11:50:21.632213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2410/4838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:21 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:22.601845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:22.603278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:22.625056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:22.631539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:22.632509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:22.634090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:22.643348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:22.643966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:22.655299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:22.667900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:22.668759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:22.669201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:23.669592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:23.766517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:23.854218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:23.867662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e3ad64b-6ee7-43a1-9569-9a9abb70373c tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 1.229446 Jul 28 11:50:23.884631 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2411/4839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:22 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:23.917059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:23.929977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b142cc2b-33a9-4f8f-979a-75c1149112f9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 1.332465 Jul 28 11:50:23.930918 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2429/4840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:22 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:24.898897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:24.900161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:24.922003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:24.937941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:24.939345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:24.940352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:24.940994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:24.959243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:24.959969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:24.976794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:24.987049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:24.987049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:24.987049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:25.660517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:25.668469 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ec968bc-7cc1-469d-b128-b49252b07457 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.775781 Jul 28 11:50:25.679833 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2412/4841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:24 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:25.688479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5e1d749d-8124-4366-8e1b-d843d218a652 req-732b81c8-bcf0-41b3-b37a-7cfba1a6b84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe48f4-0aa8-48e0-8205-56413e1b8661", "tag": "71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:25.698909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5e1d749d-8124-4366-8e1b-d843d218a652 req-732b81c8-bcf0-41b3-b37a-7cfba1a6b84a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:25.699386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5e1d749d-8124-4366-8e1b-d843d218a652 req-732b81c8-bcf0-41b3-b37a-7cfba1a6b84a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:25.713005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5e1d749d-8124-4366-8e1b-d843d218a652 req-732b81c8-bcf0-41b3-b37a-7cfba1a6b84a service nova] Creating event network-changed:71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1 for instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 on n-h2-851368-1 Jul 28 11:50:25.719770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5e1d749d-8124-4366-8e1b-d843d218a652 req-732b81c8-bcf0-41b3-b37a-7cfba1a6b84a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038654 Jul 28 11:50:25.721100 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2413/4842] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:25.860981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:25.872269 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-108d07dd-8af8-466b-977f-2cac9ab18d0c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.924557 Jul 28 11:50:25.873128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2430/4843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:24 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:26.697699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:26.699395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:26.714100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:26.715606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:26.719924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:26.720647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:26.779057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:26.894546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:26.896117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:26.911031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:26.912233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:26.914529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:26.917184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:27.455300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:27.465544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd9181cf-001c-4f96-81d0-d593740a036e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.774550 Jul 28 11:50:27.482660 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2414/4844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:26 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:27.599793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:27.609195 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8490a680-6ac8-44be-b277-afbf0aff5ef5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.719355 Jul 28 11:50:27.611759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2431/4845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:26 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:27.775706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-770920d1-abce-4744-afd2-42608a1d63ce req-12ba1077-cfb4-4c85-8d04-4b76578bdd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82c51c5-b428-4cf9-a76f-29e954e7eeef", "tag": "06192775-1067-47f2-92f8-94ecd2d81143"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:27.796635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-770920d1-abce-4744-afd2-42608a1d63ce req-12ba1077-cfb4-4c85-8d04-4b76578bdd60 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:27.797101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-770920d1-abce-4744-afd2-42608a1d63ce req-12ba1077-cfb4-4c85-8d04-4b76578bdd60 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:27.828069 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-770920d1-abce-4744-afd2-42608a1d63ce req-12ba1077-cfb4-4c85-8d04-4b76578bdd60 service nova] Creating event network-changed:06192775-1067-47f2-92f8-94ecd2d81143 for instance f82c51c5-b428-4cf9-a76f-29e954e7eeef on n-h1-851368-1 Jul 28 11:50:27.845784 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-770920d1-abce-4744-afd2-42608a1d63ce req-12ba1077-cfb4-4c85-8d04-4b76578bdd60 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074446 Jul 28 11:50:27.846399 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2415/4846] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:28.487947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:28.488871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:28.506802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:28.507420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:28.508873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:28.509441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:28.635996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:28.637891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:28.648894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:28.650571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:28.654309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:28.656251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:29.047429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:29.072233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:29.082311 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-11d495d0-d992-4c5f-99cd-e2a644a15a93 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.451974 Jul 28 11:50:29.086327 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78c403c6-066e-4000-af93-bd2b6b235205 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.604162 Jul 28 11:50:29.086681 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2416/4847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:28 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:29.098559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2432/4848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:28 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:30.116397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:30.119510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:30.120381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:30.123277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:30.154740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:30.156772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:30.157415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:30.158222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:30.159266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:30.160276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:30.161439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:30.163958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:30.567318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:30.578620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d9d7fa1-fbd5-43ba-9e68-781112de9cd3 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.472537 Jul 28 11:50:30.592745 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2433/4849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:30 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:30.646771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:30.656346 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38f65471-f729-46a0-9882-d788303b2a37 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.547932 Jul 28 11:50:30.656959 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2417/4850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:30 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:30.788231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ccea4c9f-0d9a-4999-96f8-8e326a0b7ed4 req-ebff25bb-a787-490f-a378-4e2d3f0de877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe48f4-0aa8-48e0-8205-56413e1b8661", "name": "network-vif-plugged", "status": "completed", "tag": "71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:30.803726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ccea4c9f-0d9a-4999-96f8-8e326a0b7ed4 req-ebff25bb-a787-490f-a378-4e2d3f0de877 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:30.804446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ccea4c9f-0d9a-4999-96f8-8e326a0b7ed4 req-ebff25bb-a787-490f-a378-4e2d3f0de877 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:30.844359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ccea4c9f-0d9a-4999-96f8-8e326a0b7ed4 req-ebff25bb-a787-490f-a378-4e2d3f0de877 service nova] Creating event network-vif-plugged:71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1 for instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 on n-h2-851368-1 Jul 28 11:50:30.854155 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ccea4c9f-0d9a-4999-96f8-8e326a0b7ed4 req-ebff25bb-a787-490f-a378-4e2d3f0de877 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070301 Jul 28 11:50:30.855442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2434/4851] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:31.617485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:31.618111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:31.622699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:31.629283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:31.629749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:31.630538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:31.631128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:31.685844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:31.687643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:31.707034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:31.709020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:31.710094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:31.712149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:31.902569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:31.914930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f226604-19c0-4cf1-adbf-020e24d7db4e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1314 microversion: 2.1 time: 0.301461 Jul 28 11:50:31.931126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2418/4852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:31 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:31.957306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:31.973692 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-025fe39a-4308-4894-830b-31fd2a1c00ff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.294489 Jul 28 11:50:31.974495 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2435/4853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:31 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:32.939425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:32.940053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:32.966434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:32.966904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:32.967747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:32.973032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:33.000344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f34d9e71-1b0b-4c1a-83e9-b18098fa7419 req-d5c3563a-348e-4fe7-a8e9-b9470f12a378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82c51c5-b428-4cf9-a76f-29e954e7eeef", "name": "network-vif-plugged", "status": "completed", "tag": "06192775-1067-47f2-92f8-94ecd2d81143"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:33.039234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f34d9e71-1b0b-4c1a-83e9-b18098fa7419 req-d5c3563a-348e-4fe7-a8e9-b9470f12a378 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:33.039692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f34d9e71-1b0b-4c1a-83e9-b18098fa7419 req-d5c3563a-348e-4fe7-a8e9-b9470f12a378 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:33.074083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f34d9e71-1b0b-4c1a-83e9-b18098fa7419 req-d5c3563a-348e-4fe7-a8e9-b9470f12a378 service nova] Creating event network-vif-plugged:06192775-1067-47f2-92f8-94ecd2d81143 for instance f82c51c5-b428-4cf9-a76f-29e954e7eeef on n-h1-851368-1 Jul 28 11:50:33.088610 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f34d9e71-1b0b-4c1a-83e9-b18098fa7419 req-d5c3563a-348e-4fe7-a8e9-b9470f12a378 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094855 Jul 28 11:50:33.091784 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2436/4854] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:33.098959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:33.099867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:33.106819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:33.107673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:33.109570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:33.110219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:33.469195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:33.502619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5edb0f37-782b-4939-b0dc-5d8625081a91 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1498 microversion: 2.1 time: 0.568603 Jul 28 11:50:33.506156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2419/4855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:32 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1498 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:33.591554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:33.600165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1f93be8-cd28-466f-b0a1-10d85619f82e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.506941 Jul 28 11:50:33.606606 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2437/4856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:33 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:33.958164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e663e3c-c0b3-4533-aa4e-286877e778e1 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Action: 'create', calling method: .version_select at 0x7f2eb1a0c310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1175507234"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:34.626780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:34.627432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:34.649413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:34.650184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:34.652416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:34.652796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:34.799642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3e663e3c-c0b3-4533-aa4e-286877e778e1 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.292136 Jul 28 11:50:34.801437 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2420/4857] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Jul 28 11:50:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1294 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 11:50:34.815179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f19abbfe-3630-45a5-9d64-d29d0c3762c4 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1bd3040>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:34.980007 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f19abbfe-3630-45a5-9d64-d29d0c3762c4 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.169845 Jul 28 11:50:34.980597 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2421/4858] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:34 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:50:35.245299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:35.264560 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ae73f31-d481-4f39-b14a-9f672b3b9477 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1308 microversion: 2.1 time: 0.632789 Jul 28 11:50:35.266567 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2438/4859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:34 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1308 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:35.995792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c97e997-0ea1-4026-b35f-4c1d278b54ba tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a0c310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:36.127824 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c97e997-0ea1-4026-b35f-4c1d278b54ba tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.137826 Jul 28 11:50:36.129189 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2422/4860] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:35 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:36.287028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:36.288191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:36.332015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:36.337505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:36.339984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:36.342545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:36.942282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:36.969114 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e1e86104-fd93-402f-93c0-bf14ef0219f3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1490 microversion: 2.1 time: 0.687105 Jul 28 11:50:36.977711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2439/4861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:36 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1490 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:37.142957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-111f76d7-19ae-48a3-86f4-f8b85da3faa3 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19da0d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:37.246308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-216584237", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:37.301865 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-111f76d7-19ae-48a3-86f4-f8b85da3faa3 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 346 microversion: 2.1 time: 0.164526 Jul 28 11:50:37.303197 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2423/4862] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:37 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:37.323836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9ce1efb-82cc-483c-95b3-290bb6640508 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Action: 'create', calling method: .version_select at 0x7f2eb1a0c940>, body: {"snapshot": {"volume_id": "19a64030-95d0-4ba9-8cea-a44c4a49b526", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2067133612"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:37.368479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:50:37.700932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9ce1efb-82cc-483c-95b3-290bb6640508 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.386592 Jul 28 11:50:37.708894 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2424/4863] 10.222.0.93 () {60 vars in 1162 bytes} [Thu Jul 28 11:50:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:37.716470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-acd28095-98ab-478f-8f55-c96f654086f4 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1bd3940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:37.789168 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-acd28095-98ab-478f-8f55-c96f654086f4 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.078570 Jul 28 11:50:37.789914 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2425/4864] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:37 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:37.801575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b90b755-c505-4145-bbd2-13cbd863b99a tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19da5e0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:37.861481 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b90b755-c505-4145-bbd2-13cbd863b99a tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.062279 Jul 28 11:50:37.861481 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2426/4865] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Jul 28 11:50:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:37.873376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-538a113b-3769-4c9c-aca5-6dc75a9de1d2 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2ebbeef3a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:37.913713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-538a113b-3769-4c9c-aca5-6dc75a9de1d2 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.045130 Jul 28 11:50:37.919535 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2427/4866] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:37 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:38.381607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:50:38.382101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:50:38.382507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:50:38.382923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:50:38.391329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:50:38.426132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:38.431327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:38.432822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:38.433283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:38.559432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:50:38.584873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:50:38.649895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:50:38.666051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:50:38.910184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc30c72b-468e-4daf-a52f-c4b4cb87f9ac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668043 Jul 28 11:50:38.925912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e4cb0f0a-b088-4230-a550-d96a6a95091f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19da160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:38.947280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2440/4867] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:50:38.998442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4290ae75-d1d3-47b4-9e3e-3748a4bac5cb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:39.013186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4290ae75-d1d3-47b4-9e3e-3748a4bac5cb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:39.155826 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e4cb0f0a-b088-4230-a550-d96a6a95091f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.233458 Jul 28 11:50:39.156701 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2428/4868] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:38 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:50:39.206985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4290ae75-d1d3-47b4-9e3e-3748a4bac5cb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:39.225036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4290ae75-d1d3-47b4-9e3e-3748a4bac5cb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1208 microversion: 2.1 time: 0.264225 Jul 28 11:50:39.228035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2441/4869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:38 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1208 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:40.181611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b56b3de7-f7a3-467c-950b-130dd7b559a5 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1bd3940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:40.255439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:40.259704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:40.281793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:40.291794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:40.293705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:40.294742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:40.352585 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b56b3de7-f7a3-467c-950b-130dd7b559a5 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.187340 Jul 28 11:50:40.357788 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2429/4870] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:40 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:40.519173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:40.528724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2a33d75-fa3a-4a5b-a4aa-7897068763a2 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1204 microversion: 2.1 time: 0.278665 Jul 28 11:50:40.529320 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2442/4871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:40 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1204 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:41.353477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.354792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:41.364564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.365600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc437471-fa55-4a10-ac10-6524631ce474 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1aa1670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.366706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.368358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.369096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.438574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:50:41.453934 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc437471-fa55-4a10-ac10-6524631ce474 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 288 microversion: 2.1 time: 0.091510 Jul 28 11:50:41.460660 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2443/4872] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:41 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:41.469225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-338c1929-dc89-4008-b70c-2a0fb381adc9 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a78670>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.657830 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-338c1929-dc89-4008-b70c-2a0fb381adc9 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 202 len: 0 microversion: 2.1 time: 0.195982 Jul 28 11:50:41.662092 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2444/4873] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Jul 28 11:50:41 2022] DELETE /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:50:41.680541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.681568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:41.710200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.710656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.711537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.717206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.778674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1727c21-d6e8-4697-9511-45430596a833 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 204 len: 0 microversion: 2.1 time: 0.427570 Jul 28 11:50:41.780388 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2430/4874] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:50:41 2022] DELETE /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:50:41.791237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd20ea56-ab7a-497b-bc66-da0ea07366dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1ca5790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.855036 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd20ea56-ab7a-497b-bc66-da0ea07366dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.071282 Jul 28 11:50:41.856079 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2431/4875] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:41 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:41.862660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:41.863189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:41.882086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.883662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.886451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:41.887825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:41.891238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:41.902950 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-007ba64b-db16-405b-a34e-8bc9288c1e57 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1266 microversion: 2.1 time: 0.237631 Jul 28 11:50:41.907534 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2445/4876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:41 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:42.239649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:42.255063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5a2e6eb-f0ff-4f67-8df0-ebc0a6e12e2e tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1504 microversion: 2.1 time: 0.397713 Jul 28 11:50:42.267470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2432/4877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:41 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:42.869318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bc80c4e-c54e-40b7-95db-022f3461689f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2ebbe1b9d0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:42.929509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:42.930165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:42.944802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:42.945271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:42.960015 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bc80c4e-c54e-40b7-95db-022f3461689f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.095493 Jul 28 11:50:42.960895 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2446/4878] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:42 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:42.962301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:42.962955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:43.310627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:43.314679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:43.356595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:43.378777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:43.379815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:43.380457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:44.055485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:44.072677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c8c3747-8778-4792-bc85-fc55dc2d8962 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 1.141521 Jul 28 11:50:44.072677 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2433/4879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:42 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:44.073070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ac1d5be-ece2-4869-89a9-6e7dfed3a23c tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb2f591f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:44.136141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ac1d5be-ece2-4869-89a9-6e7dfed3a23c tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.068045 Jul 28 11:50:44.141936 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2434/4880] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:44 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:44.236920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:44.245897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:44.259020 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-496a589b-ad3b-4ccc-9dbe-e8c7166f63c7 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1504 microversion: 2.1 time: 0.963179 Jul 28 11:50:44.261099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2447/4881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:43 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:45.038576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-27a13cfb-4776-44e9-b957-6901bf914eb2 req-5ec197df-a930-4497-bb5a-a4370386c179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe48f4-0aa8-48e0-8205-56413e1b8661", "name": "network-vif-deleted", "tag": "71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:45.070438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-27a13cfb-4776-44e9-b957-6901bf914eb2 req-5ec197df-a930-4497-bb5a-a4370386c179 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.072579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-27a13cfb-4776-44e9-b957-6901bf914eb2 req-5ec197df-a930-4497-bb5a-a4370386c179 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.087795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:45.088470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:45.094107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:45.095955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-27a13cfb-4776-44e9-b957-6901bf914eb2 req-5ec197df-a930-4497-bb5a-a4370386c179 service nova] Creating event network-vif-deleted:71548b3e-5b5e-49e1-bd9a-fe4db0a31dd1 for instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 on n-h2-851368-1 Jul 28 11:50:45.120894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.121669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.122080 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-27a13cfb-4776-44e9-b957-6901bf914eb2 req-5ec197df-a930-4497-bb5a-a4370386c179 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091183 Jul 28 11:50:45.127316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.128051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.140930 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2435/4882] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:45.160191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-21e9c881-8b80-4252-8a15-eeeb7eb7fe79 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19234c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:45.235196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-21e9c881-8b80-4252-8a15-eeeb7eb7fe79 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 200 len: 287 microversion: 2.1 time: 0.089411 Jul 28 11:50:45.236134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2436/4883] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:45 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:45.300330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:45.301060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:45.329376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.339101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.344957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.346393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.555029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:45.555508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:45.555885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lazy-loading 'fault' on Instance uuid d7fe48f4-0aa8-48e0-8205-56413e1b8661 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:50:45.566919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:45.580620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34650cef-e1aa-41dd-aab8-c0b11e3f8441 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.497172 Jul 28 11:50:45.596446 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2448/4884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:45 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:45.734601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299e9382b76641e79c85b9e261e7eaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b94aa3d29f7465b9fff2b23feb6b061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:45.751221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1657e0f6-5ede-4c26-89be-62af9f989855 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 200 len: 1304 microversion: 2.1 time: 0.470146 Jul 28 11:50:45.755865 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2437/4885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:45 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 1304 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:50:46.248499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb53fe26-1c4b-44fe-bf2d-ca8c934ab3fd tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19239d0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:46.312763 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-fb53fe26-1c4b-44fe-bf2d-ca8c934ab3fd tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] HTTP exception thrown: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb53fe26-1c4b-44fe-bf2d-ca8c934ab3fd tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Request method failure captured: Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 HTTP/1.1 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ngJuoIUP2wzwzSENPo5khv5e4ZzeDZcGMmuXsRIq8f-z4JxDQIp66hf2OqP2Jw45SLDB0ZHWsIdjhnxqHBHaADQMHaI4IddC4zjlPXEhiIyMQAYgV_y9KowZcqNWnFe_ZiaiIh66-qphxBXmUjRUCFjXrrzg015GREyPLgYoCg6YB4 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cd83581b546a47f5867c086ae3f51251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}] Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b7e130e097ba46f4be64e45c756a78d4 Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: exception: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '06b97142-6c8c-47e1-9679-fcbe9068b808'} Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. (HTTP 404) (Request-ID: req-b64cd914-4e57-43b2-9065-3d5bc983d53b) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:50:46.322264 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. Jul 28 11:50:46.328108 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.333626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb53fe26-1c4b-44fe-bf2d-ca8c934ab3fd tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Returning 404 to user: Snapshot 06b97142-6c8c-47e1-9679-fcbe9068b808 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:46.334674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb53fe26-1c4b-44fe-bf2d-ca8c934ab3fd tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808" status: 404 len: 111 microversion: 2.1 time: 0.090323 Jul 28 11:50:46.335463 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2438/4886] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 11:50:46 2022] GET /compute/v2.1/os-snapshots/06b97142-6c8c-47e1-9679-fcbe9068b808 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:50:46.361816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-767fe274-4ba9-43df-acdd-3a28a3ca430d tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1ca5160>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:46.535155 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-767fe274-4ba9-43df-acdd-3a28a3ca430d tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 202 len: 0 microversion: 2.1 time: 0.194713 Jul 28 11:50:46.536477 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2439/4887] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:50:46 2022] DELETE /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:50:46.548000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4bb937e5-65a8-42a0-a6b5-3411b9ea4f4d tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb19234c0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:46.698031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-24d58511-59a6-4b4c-8025-76fcb57d62d7 req-9f38317e-da8b-422d-85df-1f5da3a95126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2998ec1-7d14-41c2-8d04-9da78cba6b67", "tag": "4b18b538-6d1b-47b9-b619-8e40bcec6e41"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:46.719337 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4bb937e5-65a8-42a0-a6b5-3411b9ea4f4d tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.178279 Jul 28 11:50:46.720539 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2440/4888] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:46 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:50:46.727035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:46.727964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:46.743960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:46.749103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-24d58511-59a6-4b4c-8025-76fcb57d62d7 req-9f38317e-da8b-422d-85df-1f5da3a95126 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:46.751099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:46.752221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:46.753019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:46.753738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-24d58511-59a6-4b4c-8025-76fcb57d62d7 req-9f38317e-da8b-422d-85df-1f5da3a95126 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:46.794119 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-24d58511-59a6-4b4c-8025-76fcb57d62d7 req-9f38317e-da8b-422d-85df-1f5da3a95126 service nova] Creating event network-changed:4b18b538-6d1b-47b9-b619-8e40bcec6e41 for instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 on n-h2-851368-1 Jul 28 11:50:46.817823 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-24d58511-59a6-4b4c-8025-76fcb57d62d7 req-9f38317e-da8b-422d-85df-1f5da3a95126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.741384 Jul 28 11:50:46.828445 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2449/4889] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:46.849427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:46.858417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] [instance: d7fe48f4-0aa8-48e0-8205-56413e1b8661] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:46.876350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:46.877268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:46.884526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:46.885418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:46.943259 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] HTTP exception thrown: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Request method failure captured: Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 HTTP/1.1 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nfsIu1BL4E0TLKsVu9EvC5JPEbU0uT8oUSce9gZkT64db5hS8yLYNU44E5TysHkC5r7pOjSRUag1w9IszRdccfjb4nB42ew_2uagm_Jb6AhhMK9M8rZvSkLOLBIGC22wszeASJeZbm43ithoKxC9scCnh225wC6aY9rnYMlEnFBq7A Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 5b94aa3d29f7465b9fff2b23feb6b061 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesActionsTest-1753061593 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b94aa3d29f7465b9fff2b23feb6b061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5b94aa3d29f7465b9fff2b23feb6b061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5b94aa3d29f7465b9fff2b23feb6b061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5b94aa3d29f7465b9fff2b23feb6b061"}]}] Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesActionsTest-1753061593 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 5b94aa3d29f7465b9fff2b23feb6b061 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesActionsTest-1753061593 Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesActionsTest-1753061593-project Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 299e9382b76641e79c85b9e261e7eaec Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesActionsTest-1753061593-project Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd7fe48f4-0aa8-48e0-8205-56413e1b8661'} Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:46.948981 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. Jul 28 11:50:46.955708 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:46.961374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] Returning 404 to user: Instance d7fe48f4-0aa8-48e0-8205-56413e1b8661 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:46.962640 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00a8a43a-6289-4db2-8ea5-e07aaf9f4406 tempest-VolumesActionsTest-1753061593 tempest-VolumesActionsTest-1753061593-project] 10.222.0.93 "GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661" status: 404 len: 111 microversion: 2.1 time: 0.129242 Jul 28 11:50:46.969644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2450/4890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:46 2022] GET /compute/v2.1/servers/d7fe48f4-0aa8-48e0-8205-56413e1b8661 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:47.183684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:47.196069 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd1cb47d-baf4-4b48-a82e-f712b5e2d8cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.474158 Jul 28 11:50:47.197034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2441/4891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:46 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:47.741377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d46065c9-e844-415e-894d-6306c3ae2368 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2ebbe19ca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:47.911717 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d46065c9-e844-415e-894d-6306c3ae2368 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.176682 Jul 28 11:50:47.912674 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2451/4892] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:47 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:48.218625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:48.219997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:48.233754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:48.235772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:48.236981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:48.239742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:48.792022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:48.825101 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-14acb1e6-5f3e-42be-ba9f-403a81fa3158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.606812 Jul 28 11:50:48.850317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2442/4893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:48 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:48.926514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc2f9e9e-cbbd-49f2-aca0-f6cf38a3cfd9 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a78b80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:48.945668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:49.065284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc2f9e9e-cbbd-49f2-aca0-f6cf38a3cfd9 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.142386 Jul 28 11:50:49.066216 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2452/4894] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:48 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:49.854786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:49.856126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:49.885883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:49.886616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:49.887478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:49.913178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:50.092142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:50.114099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0130e46b-acad-4f58-898e-a27c21f8d27f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a6c310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:50.322828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0130e46b-acad-4f58-898e-a27c21f8d27f tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.245755 Jul 28 11:50:50.330379 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2453/4895] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:50 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:50.446700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:50.471509 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d671f933-3a7c-4a43-a12b-708c30038181 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.604699 Jul 28 11:50:50.472745 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2443/4896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:49 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:51.339760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f082b1ea-a4ed-4a98-a923-ba7949754649 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a6cf70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:51.494959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:51.496411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:51.526131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:51.526596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:51.528066 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f082b1ea-a4ed-4a98-a923-ba7949754649 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.194426 Jul 28 11:50:51.528658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:51.528788 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2454/4897] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:51 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:51.529110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:52.165740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:52.184024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c131d684-de03-48d4-8e1e-4bb35736c6a7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.692785 Jul 28 11:50:52.185328 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2444/4898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:51 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:52.546140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6ec68e5-f0c8-4560-bd08-311dea80a829 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a6c310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:52.648181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2d3d3e8a-f7be-465f-9f91-91b0bdc9945f req-dac6d4b4-aa9e-4fb0-87d0-8b2be1fdbbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2998ec1-7d14-41c2-8d04-9da78cba6b67", "name": "network-vif-plugged", "status": "completed", "tag": "4b18b538-6d1b-47b9-b619-8e40bcec6e41"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:52.676065 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6ec68e5-f0c8-4560-bd08-311dea80a829 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 200 len: 345 microversion: 2.1 time: 0.136301 Jul 28 11:50:52.678042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2455/4899] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:52 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:52.678915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2d3d3e8a-f7be-465f-9f91-91b0bdc9945f req-dac6d4b4-aa9e-4fb0-87d0-8b2be1fdbbe7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:52.680543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2d3d3e8a-f7be-465f-9f91-91b0bdc9945f req-dac6d4b4-aa9e-4fb0-87d0-8b2be1fdbbe7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:52.719735 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2d3d3e8a-f7be-465f-9f91-91b0bdc9945f req-dac6d4b4-aa9e-4fb0-87d0-8b2be1fdbbe7 service nova] Creating event network-vif-plugged:4b18b538-6d1b-47b9-b619-8e40bcec6e41 for instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 on n-h2-851368-1 Jul 28 11:50:52.744803 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2d3d3e8a-f7be-465f-9f91-91b0bdc9945f req-dac6d4b4-aa9e-4fb0-87d0-8b2be1fdbbe7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099555 Jul 28 11:50:52.745775 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2445/4900] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:50:53.208488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:53.209104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:53.218965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:53.238741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:53.245469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:53.250322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:53.690949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56f702b7-31a9-4c66-bdf6-0dd9d3b38e73 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2ebbeef670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:53.775235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-56f702b7-31a9-4c66-bdf6-0dd9d3b38e73 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] HTTP exception thrown: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56f702b7-31a9-4c66-bdf6-0dd9d3b38e73 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Request method failure captured: Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 HTTP/1.1 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ngJuoIUP2wzwzSENPo5khv5e4ZzeDZcGMmuXsRIq8f-z4JxDQIp66hf2OqP2Jw45SLDB0ZHWsIdjhnxqHBHaADQMHaI4IddC4zjlPXEhiIyMQAYgV_y9KowZcqNWnFe_ZiaiIh66-qphxBXmUjRUCFjXrrzg015GREyPLgYoCg6YB4 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cd83581b546a47f5867c086ae3f51251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}] Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b7e130e097ba46f4be64e45c756a78d4 Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: exception: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '19a64030-95d0-4ba9-8cea-a44c4a49b526'} Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. (HTTP 404) (Request-ID: req-b7721dfe-0914-4110-8d24-8e4a95acb6e2) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:50:53.777477 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56f702b7-31a9-4c66-bdf6-0dd9d3b38e73 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Returning 404 to user: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56f702b7-31a9-4c66-bdf6-0dd9d3b38e73 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 404 len: 109 microversion: 2.1 time: 0.092640 Jul 28 11:50:53.788009 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2446/4901] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:53 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:50:53.794139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5ed8500-815c-40d8-90a7-e59513d45aa8 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2ebbeef430>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:53.848848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:53.860357 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7cca349-daba-4b67-90fd-6690570213df tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1308 microversion: 2.1 time: 0.655638 Jul 28 11:50:53.880644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2456/4902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:53 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:53.923968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d5ed8500-815c-40d8-90a7-e59513d45aa8 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] HTTP exception thrown: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5ed8500-815c-40d8-90a7-e59513d45aa8 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Request method failure captured: Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 HTTP/1.1 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ngJuoIUP2wzwzSENPo5khv5e4ZzeDZcGMmuXsRIq8f-z4JxDQIp66hf2OqP2Jw45SLDB0ZHWsIdjhnxqHBHaADQMHaI4IddC4zjlPXEhiIyMQAYgV_y9KowZcqNWnFe_ZiaiIh66-qphxBXmUjRUCFjXrrzg015GREyPLgYoCg6YB4 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cd83581b546a47f5867c086ae3f51251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}] Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b7e130e097ba46f4be64e45c756a78d4 Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: exception: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '19a64030-95d0-4ba9-8cea-a44c4a49b526'} Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. (HTTP 404) (Request-ID: req-58d3fb34-e8cd-4f71-8a4c-dcc56f0d09ff) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:50:53.927062 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d5ed8500-815c-40d8-90a7-e59513d45aa8 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Returning 404 to user: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d5ed8500-815c-40d8-90a7-e59513d45aa8 tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 404 len: 109 microversion: 2.1 time: 0.142907 Jul 28 11:50:53.935468 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2447/4903] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:50:53 2022] DELETE /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:50:53.944535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5fc278c-77d7-4b45-b196-3248060088dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Calling method '.version_select at 0x7f2eb1a77040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:54.017919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b5fc278c-77d7-4b45-b196-3248060088dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] HTTP exception thrown: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5fc278c-77d7-4b45-b196-3248060088dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Request method failure captured: Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 HTTP/1.1 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4ngJuoIUP2wzwzSENPo5khv5e4ZzeDZcGMmuXsRIq8f-z4JxDQIp66hf2OqP2Jw45SLDB0ZHWsIdjhnxqHBHaADQMHaI4IddC4zjlPXEhiIyMQAYgV_y9KowZcqNWnFe_ZiaiIh66-qphxBXmUjRUCFjXrrzg015GREyPLgYoCg6YB4 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cd83581b546a47f5867c086ae3f51251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cd83581b546a47f5867c086ae3f51251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cd83581b546a47f5867c086ae3f51251"}]}] Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cd83581b546a47f5867c086ae3f51251 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-736473468 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b7e130e097ba46f4be64e45c756a78d4 Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-736473468-project Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: exception: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '19a64030-95d0-4ba9-8cea-a44c4a49b526'} Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. (HTTP 404) (Request-ID: req-774d8001-7290-45e0-835b-cfeaa03f0569) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 11:50:54.020393 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. Jul 28 11:50:54.025275 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:50:54.030875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5fc278c-77d7-4b45-b196-3248060088dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] Returning 404 to user: Volume 19a64030-95d0-4ba9-8cea-a44c4a49b526 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:50:54.032378 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5fc278c-77d7-4b45-b196-3248060088dc tempest-VolumesSnapshotsTestJSON-736473468 tempest-VolumesSnapshotsTestJSON-736473468-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526" status: 404 len: 109 microversion: 2.1 time: 0.091830 Jul 28 11:50:54.036766 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2457/4904] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 11:50:53 2022] GET /compute/v2.1/os-volumes/19a64030-95d0-4ba9-8cea-a44c4a49b526 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:50:54.890079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:54.891583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:54.907921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:54.918793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:54.920028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:54.921192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:55.244298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:55.257266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-529f2026-5b42-43f7-a5ab-5aa003c19504 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1489 microversion: 2.1 time: 0.371506 Jul 28 11:50:55.259857 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2448/4905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:54 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1489 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:55.291165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:55.291797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:55.326384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:55.332215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:55.333948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:55.334411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:56.062764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:56.075239 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0303b942-37fb-4ab2-9d48-a65aeba194bd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1490 microversion: 2.1 time: 0.798921 Jul 28 11:50:56.088542 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2458/4906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:55 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1490 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:56.098644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:56.099926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:56.113650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:56.116011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:56.118389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:56.118389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:56.224687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:50:56.760610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:56.772745 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d7cbff1-929f-41c3-88a3-5b07fa906236 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1489 microversion: 2.1 time: 0.677919 Jul 28 11:50:56.786382 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2449/4907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:56 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1489 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:56.811947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:56.813202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:56.832475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:56.832939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:56.833752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:56.834200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:56.934251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:50:57.135234 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f677d8f0-fae5-4210-9f7c-6587b3a3308f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 204 len: 0 microversion: 2.1 time: 0.325505 Jul 28 11:50:57.136798 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2459/4908] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:50:56 2022] DELETE /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:50:57.149818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:57.150657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:57.161866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:57.162613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:57.163690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:57.164847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:57.497785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:57.510193 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d43ce4bf-2553-47a7-acc3-3a48cf400d6c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1495 microversion: 2.1 time: 0.367764 Jul 28 11:50:57.511001 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2450/4909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:57 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1495 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:58.533750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:50:58.534479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:50:58.553813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:58.554196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:58.554998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:58.555468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:59.000353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:50:59.023331 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e4e4749-ecb2-457e-8107-55057c90203f tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1495 microversion: 2.1 time: 0.493126 Jul 28 11:50:59.026047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2460/4910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:50:58 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1495 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:50:59.716418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a39de556-b02d-4164-99b8-2ae3f8e7b96d req-6cd6275a-a790-4825-9664-484915ba6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2998ec1-7d14-41c2-8d04-9da78cba6b67", "name": "network-vif-deleted", "tag": "4b18b538-6d1b-47b9-b619-8e40bcec6e41"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:50:59.775401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a39de556-b02d-4164-99b8-2ae3f8e7b96d req-6cd6275a-a790-4825-9664-484915ba6a8c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:50:59.777336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a39de556-b02d-4164-99b8-2ae3f8e7b96d req-6cd6275a-a790-4825-9664-484915ba6a8c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:50:59.847374 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a39de556-b02d-4164-99b8-2ae3f8e7b96d req-6cd6275a-a790-4825-9664-484915ba6a8c service nova] Creating event network-vif-deleted:4b18b538-6d1b-47b9-b619-8e40bcec6e41 for instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 on n-h2-851368-1 Jul 28 11:50:59.896409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a39de556-b02d-4164-99b8-2ae3f8e7b96d req-6cd6275a-a790-4825-9664-484915ba6a8c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185683 Jul 28 11:50:59.899668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2451/4911] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:00.044939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:00.046500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:00.065603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:00.068614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:00.070584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:00.074779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:00.145533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:00.146371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:00.147217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lazy-loading 'fault' on Instance uuid e2998ec1-7d14-41c2-8d04-9da78cba6b67 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:51:00.290855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:00.310478 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9094cff0-7d99-4ec0-90fa-4bbbd578ceb5 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 200 len: 1298 microversion: 2.1 time: 0.267868 Jul 28 11:51:00.330140 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2461/4912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:00 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:01.338210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:01.339602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:01.353807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.356966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:01.360337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.360785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:01.394305 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 HTTP/1.1 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e2998ec1-7d14-41c2-8d04-9da78cba6b67'} Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:01.405408 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:51:01.427774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-860dbc7b-ec3f-4884-b7e5-8e0b2047b270 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 404 len: 111 microversion: 2.1 time: 0.090938 Jul 28 11:51:01.434846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:01.436599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:01.443599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2452/4913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:01 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:51:01.448278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.449119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:01.450799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.452112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:01.517647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:51:01.697117 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7e1800e-6c75-4ed4-8545-ba1e243a9f76 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 204 len: 0 microversion: 2.1 time: 0.266767 Jul 28 11:51:01.699902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2462/4914] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:51:01 2022] DELETE /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:51:01.709359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:01.710793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:01.720345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:01.723182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.724295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:01.725475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:01.726259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:02.076850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:02.096116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0a04bd9-159b-4ea3-bc4f-a79a55c4b140 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1496 microversion: 2.1 time: 0.392306 Jul 28 11:51:02.097111 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2453/4915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:01 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1496 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:03.143748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:03.152252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:03.186877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:03.187878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:03.189150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:03.195932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:03.604702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:03.616894 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4534545-f063-44a5-9dd2-407e541d2e78 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1496 microversion: 2.1 time: 0.483835 Jul 28 11:51:03.618249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2463/4916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:03 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1496 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:04.641831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:04.643288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:04.671447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:04.672195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:04.676276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:04.676742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:04.726674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8099a525-2b80-434d-a15e-738edd2a0b0b req-8780a3b3-af0c-4a76-85e3-b0c31ef3e457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82c51c5-b428-4cf9-a76f-29e954e7eeef", "name": "network-vif-deleted", "tag": "06192775-1067-47f2-92f8-94ecd2d81143"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:04.777984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8099a525-2b80-434d-a15e-738edd2a0b0b req-8780a3b3-af0c-4a76-85e3-b0c31ef3e457 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:04.778462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8099a525-2b80-434d-a15e-738edd2a0b0b req-8780a3b3-af0c-4a76-85e3-b0c31ef3e457 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:04.829857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8099a525-2b80-434d-a15e-738edd2a0b0b req-8780a3b3-af0c-4a76-85e3-b0c31ef3e457 service nova] Creating event network-vif-deleted:06192775-1067-47f2-92f8-94ecd2d81143 for instance f82c51c5-b428-4cf9-a76f-29e954e7eeef on n-h1-851368-1 Jul 28 11:51:04.853801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8099a525-2b80-434d-a15e-738edd2a0b0b req-8780a3b3-af0c-4a76-85e3-b0c31ef3e457 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128272 Jul 28 11:51:04.858304 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2464/4917] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:05.022569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:05.038774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afb20c3c-3227-4677-8087-e1a35b190e56 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 200 len: 1454 microversion: 2.1 time: 0.396067 Jul 28 11:51:05.042642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2454/4918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:04 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 1454 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:06.066147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:06.066783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:06.098697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:06.108452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:06.111182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:06.114416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:06.155974 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef HTTP/1.1 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f82c51c5-b428-4cf9-a76f-29e954e7eeef'} Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:51:06.157662 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:51:06.164541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3288dcbd-3b13-4cb3-9cd0-d69f13783327 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 404 len: 111 microversion: 2.1 time: 0.098181 Jul 28 11:51:06.167350 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2465/4919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:06 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:51:06.401163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2013599947", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:06.577349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:51:07.673680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:51:07.675043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:51:07.675774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:51:07.676481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:51:07.677623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:51:07.702707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:07.703252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:07.705239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:07.705692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:07.762290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:51:07.772566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:51:07.791508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:51:07.796787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:51:07.901027 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c58ce18-ac61-428a-919e-df702b8ab857 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506713 Jul 28 11:51:07.912182 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2455/4920] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:51:07.918347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37cfb5e3-2f58-4dd2-9907-f62eb9de5eec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:07.920858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37cfb5e3-2f58-4dd2-9907-f62eb9de5eec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:08.102142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37cfb5e3-2f58-4dd2-9907-f62eb9de5eec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:08.126243 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37cfb5e3-2f58-4dd2-9907-f62eb9de5eec tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1209 microversion: 2.1 time: 0.215418 Jul 28 11:51:08.134029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2466/4921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:07 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1209 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:09.156407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:09.157062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:09.192156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:09.196885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:09.202035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:09.202856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:09.377614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:09.389937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65b8b2a1-70f1-457e-8fe8-e54225cd3928 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1213 microversion: 2.1 time: 0.238519 Jul 28 11:51:09.391966 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2456/4922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:09 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:10.413149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:10.414510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:10.430701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:10.434263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:10.439749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:10.441940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:10.682287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:10.698998 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f528812f-0ca5-4db5-8bd6-3fd0573bcd9a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1267 microversion: 2.1 time: 0.291105 Jul 28 11:51:10.704277 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2467/4923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:10 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:11.721462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:11.723127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:11.746981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:11.751893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:11.757490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:11.758202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:12.222022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:12.232200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc0c2818-5f67-485a-a539-cc35f28e45db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 0.514556 Jul 28 11:51:12.237045 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2457/4924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:11 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:13.258622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:13.259628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:13.275114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:13.275945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:13.276472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:13.277432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:13.485326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-09f44ba7-b1b9-49c8-a039-2ecec5079cae req-06e4e390-c294-497f-b97e-04a8ad7b5ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92fbd715-b33f-4056-b60d-4e180fd6f4f7", "tag": "f6355f8a-f921-4ffc-8a90-09404b18ab9c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:13.513687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-09f44ba7-b1b9-49c8-a039-2ecec5079cae req-06e4e390-c294-497f-b97e-04a8ad7b5ade service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:13.515879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-09f44ba7-b1b9-49c8-a039-2ecec5079cae req-06e4e390-c294-497f-b97e-04a8ad7b5ade service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:13.546699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-09f44ba7-b1b9-49c8-a039-2ecec5079cae req-06e4e390-c294-497f-b97e-04a8ad7b5ade service nova] Creating event network-changed:f6355f8a-f921-4ffc-8a90-09404b18ab9c for instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 on n-h2-851368-1 Jul 28 11:51:13.559736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:13.569279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df818092-5e7e-4bbc-8dc9-ce3ecdaf054d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 0.315609 Jul 28 11:51:13.569867 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2468/4925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:13 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:13.580207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-09f44ba7-b1b9-49c8-a039-2ecec5079cae req-06e4e390-c294-497f-b97e-04a8ad7b5ade service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092641 Jul 28 11:51:13.581490 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2458/4926] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:51:14.595195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:14.596582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:14.613728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:14.614866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:14.616364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:14.618179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:14.924915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:14.933404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89fc2290-2352-4a28-8b17-2fead5f87742 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 0.343831 Jul 28 11:51:14.934945 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2469/4927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:14 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:15.957115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:15.957739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:15.975017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:15.975475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:15.976273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:15.976721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:16.233463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:16.247393 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f13b5e9-22c1-4578-b4be-42dac3223564 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 0.293802 Jul 28 11:51:16.270480 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2459/4928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:15 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:17.274818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:17.275470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:17.279632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:17.293810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:17.294275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:17.297656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:17.298161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:17.312910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:17.590368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:17.598766 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-72953dc9-b84c-406a-aeaf-b92699709838 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 0.327764 Jul 28 11:51:17.599749 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2470/4929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:17 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:18.563047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:18.564483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:18.620688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:18.621301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:18.624149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:18.648730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:18.649189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:18.650040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:18.650540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:19.162906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9d982a25-6117-4eb3-94de-40797758d25b req-a2425fc9-4387-4fab-b0c0-9538f9bed23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fbd715-b33f-4056-b60d-4e180fd6f4f7", "name": "network-vif-plugged", "status": "completed", "tag": "f6355f8a-f921-4ffc-8a90-09404b18ab9c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:19.185924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d982a25-6117-4eb3-94de-40797758d25b req-a2425fc9-4387-4fab-b0c0-9538f9bed23e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:19.186371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d982a25-6117-4eb3-94de-40797758d25b req-a2425fc9-4387-4fab-b0c0-9538f9bed23e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:19.231473 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9d982a25-6117-4eb3-94de-40797758d25b req-a2425fc9-4387-4fab-b0c0-9538f9bed23e service nova] Creating event network-vif-plugged:f6355f8a-f921-4ffc-8a90-09404b18ab9c for instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 on n-h2-851368-1 Jul 28 11:51:19.249058 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9d982a25-6117-4eb3-94de-40797758d25b req-a2425fc9-4387-4fab-b0c0-9538f9bed23e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.691426 Jul 28 11:51:19.249678 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2460/4930] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:20.587518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:20.632383 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1acae97f-0287-41fa-b8f2-b5c97664ee79 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1309 microversion: 2.1 time: 2.013259 Jul 28 11:51:20.637534 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2471/4931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:18 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1309 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:51:21.663338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:21.664069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:21.690234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:21.693000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:21.696641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:21.698079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:22.380850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:22.392207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d6414d1-ec53-4c6c-8e8e-4c8603e0f8b0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1491 microversion: 2.1 time: 0.730994 Jul 28 11:51:22.394622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2461/4932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:21 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1491 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:22.420964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:22.424918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:22.438838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:22.443837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:22.447035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:22.447784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:22.677116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8bdcdd3-71a6-42f3-b098-5909b6091916 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "PUT /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1086 microversion: 2.1 time: 0.261228 Jul 28 11:51:22.679578 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2472/4933] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:51:22 2022] PUT /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1086 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:22.702543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:22.703345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:22.727864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:22.729763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:22.734584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:22.735550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.043549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:23.055457 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-69aa3e86-c53e-418a-ae4a-8684ba9e71d8 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1512 microversion: 2.1 time: 0.358307 Jul 28 11:51:23.072559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2462/4934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:22 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:51:23.080021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:23.080617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:23.104766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.105046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.105856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.106304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.443284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:23.455304 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba5f1d31-6091-448a-9372-72a707831bea tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1512 microversion: 2.1 time: 0.380127 Jul 28 11:51:23.457652 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2473/4935] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:23 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:23.478470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:23.478931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:23.495004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.495498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.496309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.496759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.597936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:51:23.814427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5601d08d-dd4d-4298-a341-ec9230e5a3ad tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 204 len: 0 microversion: 2.1 time: 0.339765 Jul 28 11:51:23.815417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2463/4936] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:51:23 2022] DELETE /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:51:23.824162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:23.825233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:23.838829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.839566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:23.840547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:23.842134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:24.470552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:24.481064 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e297fc8d-e1e4-4d3c-80ca-cb1f2ee62eb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1518 microversion: 2.1 time: 0.660951 Jul 28 11:51:24.481678 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2474/4937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:23 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1518 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:25.504516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:25.507663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:25.537571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:25.538810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:25.540769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:25.543131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:25.842216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:25.852685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bbdc380b-83a5-40d4-8b25-3706aa096e02 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 200 len: 1518 microversion: 2.1 time: 0.353613 Jul 28 11:51:25.854604 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2464/4938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:25 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:26.175926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2979d99c-31a2-4cb3-8fd4-55c4a2832657 req-90757a1d-1cc3-4563-ae4e-edab38f42a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fbd715-b33f-4056-b60d-4e180fd6f4f7", "name": "network-vif-deleted", "tag": "f6355f8a-f921-4ffc-8a90-09404b18ab9c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:26.211758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2979d99c-31a2-4cb3-8fd4-55c4a2832657 req-90757a1d-1cc3-4563-ae4e-edab38f42a3c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:26.212341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2979d99c-31a2-4cb3-8fd4-55c4a2832657 req-90757a1d-1cc3-4563-ae4e-edab38f42a3c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:26.285426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2979d99c-31a2-4cb3-8fd4-55c4a2832657 req-90757a1d-1cc3-4563-ae4e-edab38f42a3c service nova] Creating event network-vif-deleted:f6355f8a-f921-4ffc-8a90-09404b18ab9c for instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 on n-h2-851368-1 Jul 28 11:51:26.306420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2979d99c-31a2-4cb3-8fd4-55c4a2832657 req-90757a1d-1cc3-4563-ae4e-edab38f42a3c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137421 Jul 28 11:51:26.313617 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2475/4939] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:26.884298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:26.885583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:26.897069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:26.900155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:26.902620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:26.903475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:26.958846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:26.960252 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 HTTP/1.1 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '92fbd715-b33f-4056-b60d-4e180fd6f4f7'} Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:26.961944 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:51:26.968762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:51:26.974860 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81a506a3-d691-4d54-b8e6-b3ace62e442c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 404 len: 111 microversion: 2.1 time: 0.089919 Jul 28 11:51:26.976023 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2465/4940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:26 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:51:27.668820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-170268087", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "69a05c7f-c11b-4429-b33d-ca9a84a0e3cd"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:27.816143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] validate_networks() for [('69a05c7f-c11b-4429-b33d-ca9a84a0e3cd', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:51:28.561789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:51:28.562233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:51:28.562727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:51:28.563666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:51:28.565211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:51:28.588460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:28.596309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:28.599686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:28.600172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:28.660157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:51:28.678591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Getting quotas for user 6c575c012e5c4083977709d05910e0af and project fb5b513e9c644612b995f9278cb9b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:51:28.697241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:51:28.704134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:51:28.773869 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75a55d2a-7a38-42e5-8b27-c817f843d629 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110781 Jul 28 11:51:28.781755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2476/4941] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:51:28.786542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd09f02b-8292-47d8-ab7d-b5550b2105db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:28.787220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd09f02b-8292-47d8-ab7d-b5550b2105db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:28.881477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd09f02b-8292-47d8-ab7d-b5550b2105db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:28.889021 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd09f02b-8292-47d8-ab7d-b5550b2105db tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1208 microversion: 2.1 time: 0.105818 Jul 28 11:51:28.889925 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2466/4942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:28 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1208 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:29.912242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:29.913240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:29.928519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:29.928982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:29.938014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:29.938872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:30.184920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:30.194481 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff6ba390-01b3-413e-af2f-03b5306b59ab tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1204 microversion: 2.1 time: 0.287934 Jul 28 11:51:30.195163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2477/4943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:29 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1204 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:31.221533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:31.222756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:31.257208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:31.258401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:31.262341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:31.268795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:31.436154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:31.450037 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-351e6a30-4777-405a-9ddb-46c7fd31a1a0 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1266 microversion: 2.1 time: 0.232335 Jul 28 11:51:31.455897 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2467/4944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:31 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:32.474541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:32.475226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:32.488981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:32.494627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:32.498853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:32.502277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:33.746634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:33.759717 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7c450566-7213-46cd-862d-15f7dc3a4d40 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 1.289702 Jul 28 11:51:33.760298 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2478/4945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:32 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:34.784429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:34.785056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:34.797113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:34.804506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:34.811515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:34.812952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:34.819841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:35.508412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:35.523188 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab388649-b0ee-4c6c-aa8d-59205695d025 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.740084 Jul 28 11:51:35.554530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2468/4946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:34 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:35.719812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-23cd14ad-31d2-4a2d-8d11-ab82a341c65c req-95e547e1-55f4-434c-84b3-47b9bbf383cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d", "tag": "08e48478-0e0e-4d5f-a915-8c0237aafa5b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:35.741852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-23cd14ad-31d2-4a2d-8d11-ab82a341c65c req-95e547e1-55f4-434c-84b3-47b9bbf383cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:35.742304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-23cd14ad-31d2-4a2d-8d11-ab82a341c65c req-95e547e1-55f4-434c-84b3-47b9bbf383cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:35.784136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-23cd14ad-31d2-4a2d-8d11-ab82a341c65c req-95e547e1-55f4-434c-84b3-47b9bbf383cf service nova] Creating event network-changed:08e48478-0e0e-4d5f-a915-8c0237aafa5b for instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d on n-h2-851368-1 Jul 28 11:51:35.798108 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-23cd14ad-31d2-4a2d-8d11-ab82a341c65c req-95e547e1-55f4-434c-84b3-47b9bbf383cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082826 Jul 28 11:51:35.798729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2479/4947] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:36.563347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:36.563994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:36.600666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:36.601256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:36.603511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:36.605237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:37.346810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:37.375874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7774d33a-35a5-4e25-adfa-ebeb066b8b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.826651 Jul 28 11:51:37.377183 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2469/4948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:36 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:38.398806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:38.399547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:38.416697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:38.417156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:38.417962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:38.418403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:38.634948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:38.690838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:39.198957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:39.207783 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d760d119-108f-4df1-8a10-fbab11f4a35b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.814023 Jul 28 11:51:39.219902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2480/4949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:38 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:39.784159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48e0520b-00b2-4033-9dfe-20a9f3a67519 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Action: 'create', calling method: .version_select at 0x7f2eb1ce95e0>, body: {"keypair": {"name": "tempest-keypair-1404836476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8Ue5Z84iyfeG8UcUVDrsMpzIuPO08pQIDuGf+SU4viFAD9TrcTP6AkWSOAdiWMVeObxzhorBY/gV8akNHl1khUPWEcqWRKSSNyLOUvKJXcGuV0lx6RR5Bc0H24yi9sBw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:39.790685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:39.849485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-48e0520b-00b2-4033-9dfe-20a9f3a67519 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Getting quotas for project 540f145b3dea4f158c024ba16dc71f23. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:51:39.896366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-48e0520b-00b2-4033-9dfe-20a9f3a67519 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Getting quotas for user e55b800bc55f4eda98f8756caca122f4 and project 540f145b3dea4f158c024ba16dc71f23. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:51:40.015895 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48e0520b-00b2-4033-9dfe-20a9f3a67519 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.237133 Jul 28 11:51:40.016657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2470/4950] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 11:51:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 239 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 11:51:40.233661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:40.234368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:40.250751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:40.251241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:40.252033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:40.252471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:40.691373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:40.708141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a63beba-e87a-4920-a5e0-df4acb8f1b4a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.478109 Jul 28 11:51:40.708937 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2481/4951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:40 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:40.977264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2050487512", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "6797bf53-6321-41ea-844f-2cd3ba713103"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:41.077745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] validate_networks() for [('6797bf53-6321-41ea-844f-2cd3ba713103', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:51:41.729748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:41.730364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:41.745279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:41.745734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:41.746524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:41.746959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:41.797404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:51:41.798230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:51:41.799097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:51:41.799780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:51:41.800326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:51:41.814019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:41.820525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:41.821830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:41.826353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:41.849988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Getting quotas for project 898bc4095c9c424b93bfd392765419bb. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:51:41.856910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Getting quotas for user ca3123b40c7b45a1acc13eebc2b9c560 and project 898bc4095c9c424b93bfd392765419bb. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:51:41.875204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:51:41.877977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:51:41.958933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9362a79-5162-4ee1-86f9-69828ad04ae5 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996180 Jul 28 11:51:41.960031 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2471/4952] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:51:41.974063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-026851fb-5b9d-4ab2-890b-658c36725a4b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:41.975156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-026851fb-5b9d-4ab2-890b-658c36725a4b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:42.051228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:42.062675 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f2d1992-c7b0-439b-81c4-da37c62d9bac tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.336699 Jul 28 11:51:42.076005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2482/4953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:41 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:42.104277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-026851fb-5b9d-4ab2-890b-658c36725a4b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:42.114203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-026851fb-5b9d-4ab2-890b-658c36725a4b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1214 microversion: 2.1 time: 0.146870 Jul 28 11:51:42.115159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2472/4954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:41 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:42.687939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cfc61127-c64c-4d73-96c9-cc3acf86a9ef req-3b2c6991-625f-4144-85bf-aeb0257c92f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d", "name": "network-vif-plugged", "status": "completed", "tag": "08e48478-0e0e-4d5f-a915-8c0237aafa5b"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:42.701708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cfc61127-c64c-4d73-96c9-cc3acf86a9ef req-3b2c6991-625f-4144-85bf-aeb0257c92f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:42.702467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cfc61127-c64c-4d73-96c9-cc3acf86a9ef req-3b2c6991-625f-4144-85bf-aeb0257c92f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:42.718885 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cfc61127-c64c-4d73-96c9-cc3acf86a9ef req-3b2c6991-625f-4144-85bf-aeb0257c92f1 service nova] Creating event network-vif-plugged:08e48478-0e0e-4d5f-a915-8c0237aafa5b for instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d on n-h2-851368-1 Jul 28 11:51:42.724452 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cfc61127-c64c-4d73-96c9-cc3acf86a9ef req-3b2c6991-625f-4144-85bf-aeb0257c92f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Jul 28 11:51:42.725544 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2483/4955] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:43.088515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:43.089603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:43.100811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:43.101810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:43.102627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:43.103091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:43.139493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:43.140372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:43.163323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:43.166196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:43.166196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:43.166196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:43.318816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:43.330226 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf359aff-7bfe-4265-8281-4e977c87b339 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1266 microversion: 2.1 time: 0.197869 Jul 28 11:51:43.335665 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2484/4956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:43 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:43.453874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:43.468000 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-effa88d0-fe8a-4256-b71b-8215839313bb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1308 microversion: 2.1 time: 0.383407 Jul 28 11:51:43.469516 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2473/4957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:43 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:44.354109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:44.355628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:44.368409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:44.370301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:44.371519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:44.373613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:44.490305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:44.490861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:44.509276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:44.510123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:44.513575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:44.518219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:44.541381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:44.553257 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-489bbcc2-bed1-46d1-899b-8dc5d8ff6fce tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1272 microversion: 2.1 time: 0.202209 Jul 28 11:51:44.555593 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2485/4958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:44 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:45.203740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:45.216948 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87f6a72c-5b72-4a1b-8370-fde0d4313cb6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1489 microversion: 2.1 time: 0.727705 Jul 28 11:51:45.219782 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2474/4959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:44 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1489 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:45.247023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1482665157"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:45.258563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:45.282860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.284725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:45.286401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.291307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:45.576854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:45.577492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:45.606834 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e5ed230-b20c-46e3-9ea7-98da33663b6d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "PUT /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1075 microversion: 2.1 time: 0.364827 Jul 28 11:51:45.614112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.614580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:45.640710 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2486/4960] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:51:45 2022] PUT /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1075 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:45.640827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.640827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:45.645338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:45.657426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:45.674709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.715432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:45.718887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:45.725801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:46.267976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:46.282656 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d691d1d8-ee31-4850-a195-12e0121416ae tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.711477 Jul 28 11:51:46.304905 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2475/4961] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:45 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:46.324520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1599230051", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "021e8896-69b5-4ecb-bb6a-2b779e1def0c"}, {"port": "a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d", "tag": "port-1"}, {"port": "fbf24f87-ab7b-4722-b9e1-39c187362f06", "tag": "port-2"}, {"uuid": "f807f98e-2e94-4210-8d48-12d7a88d08df", "tag": "net-1"}, {"uuid": "f807f98e-2e94-4210-8d48-12d7a88d08df"}, {"uuid": "b8912652-bac5-46be-9587-6f9fdd7f9dfe", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b8912652-bac5-46be-9587-6f9fdd7f9dfe", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bea8ec0d-52f1-41d0-b00b-9c715f4bc385", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4ddbdd8f-9c1e-4090-b839-a3dacef9c9a9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e657af54-dd32-4a5d-8a35-20c999befa78", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--190705668"}], "key_name": "tempest-keypair-1404836476", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:46.359194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:46.377682 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7937d9f3-c60d-4cbd-a98c-bdb4908803fb tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1501 microversion: 2.1 time: 0.734449 Jul 28 11:51:46.378984 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2487/4962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:45 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1501 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:46.411251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:46.412259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:46.433999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:46.437761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:46.445359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:46.446223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:46.489682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:47.075851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] validate_networks() for [('021e8896-69b5-4ecb-bb6a-2b779e1def0c', None, None, None, None, None), (None, None, 'a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d', None, None, None), (None, None, 'fbf24f87-ab7b-4722-b9e1-39c187362f06', None, None, None), ('f807f98e-2e94-4210-8d48-12d7a88d08df', None, None, None, None, None), ('f807f98e-2e94-4210-8d48-12d7a88d08df', None, None, None, None, None), ('b8912652-bac5-46be-9587-6f9fdd7f9dfe', '10.2.2.100', None, None, None, None), ('b8912652-bac5-46be-9587-6f9fdd7f9dfe', '10.2.2.200', None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:51:47.170767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:47.187396 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8227b23-918c-4102-9ce5-3b28e2293c9e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1501 microversion: 2.1 time: 0.785645 Jul 28 11:51:47.188546 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2488/4963] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:46 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1501 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:47.211674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afd10be9-b42f-4570-9e4c-7cb3e25e80ef tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:47.222970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afd10be9-b42f-4570-9e4c-7cb3e25e80ef tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:47.224670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afd10be9-b42f-4570-9e4c-7cb3e25e80ef tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:47.281513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afd10be9-b42f-4570-9e4c-7cb3e25e80ef tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Going to try to stop instance {{(pid=119235) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 11:51:47.394312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afd10be9-b42f-4570-9e4c-7cb3e25e80ef tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "POST /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.185330 Jul 28 11:51:47.394935 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2489/4964] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:51:47 2022] POST /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:51:47.433575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:47.440186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:47.458818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:47.477984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:47.481929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:47.493481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:47.494276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:48.663632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:48.691291 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d33a199-7f67-40f3-874d-df902122b083 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 1.270324 Jul 28 11:51:48.691291 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2490/4965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:47 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:48.697569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:48.702898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:48.716952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:48.717454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:48.723289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:48.725176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:49.162410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:49.178431 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f2fa0c8-c1b8-4fa7-aaab-dfe60a26278d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.488270 Jul 28 11:51:49.183374 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2491/4966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:48 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:49.193704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c15243a5-a3cb-4ee8-8e05-546f93a71ceb req-edefdc58-662e-499c-a2c9-0d7ff84bd8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8f0ebc-3076-41ab-b932-564cc765d3a0", "tag": "961ebf0f-2700-46ae-9d1f-a769b79cd960"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:49.218679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c15243a5-a3cb-4ee8-8e05-546f93a71ceb req-edefdc58-662e-499c-a2c9-0d7ff84bd8e9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:49.219872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c15243a5-a3cb-4ee8-8e05-546f93a71ceb req-edefdc58-662e-499c-a2c9-0d7ff84bd8e9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:49.235980 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c15243a5-a3cb-4ee8-8e05-546f93a71ceb req-edefdc58-662e-499c-a2c9-0d7ff84bd8e9 service nova] Creating event network-changed:961ebf0f-2700-46ae-9d1f-a769b79cd960 for instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 on n-h1-851368-1 Jul 28 11:51:49.243330 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c15243a5-a3cb-4ee8-8e05-546f93a71ceb req-edefdc58-662e-499c-a2c9-0d7ff84bd8e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058138 Jul 28 11:51:49.244706 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2492/4967] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:49.711576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:49.712924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:49.728913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:49.730908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:49.733865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:49.734504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:50.006409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:50.025231 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb1ff690-d574-4c51-a63b-c72e811ae2d8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.316532 Jul 28 11:51:50.028308 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2493/4968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:49 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:50.206883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:50.207773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:50.219929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:50.220843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:50.225457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:50.226381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:50.711542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:50.721078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d11e65dd-494a-4f11-9bcc-65e31b21d502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.519020 Jul 28 11:51:50.728061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2494/4969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:50 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:51.050979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:51.052089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:51.066210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:51.069074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:51.071413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:51.072196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:51.617401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:51.631246 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04ba4e56-c33b-48f4-aabb-d5ee6436266c tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.585319 Jul 28 11:51:51.635317 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2495/4970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:51 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:51:51.748472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:51.759614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:51.781797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:51.782604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:51.785328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:51.786217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:51.838155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:52.109905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:52.237004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:52.255343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-811ba486-98ad-482b-8ba6-46064065d7dc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.512866 Jul 28 11:51:52.259158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2496/4971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:51 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:52.666536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:52.667241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:52.682029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:52.687951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:52.691772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:52.702664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:53.134186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:53.148272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53e28a0c-c91d-45f5-89eb-620b8b0dc174 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.487637 Jul 28 11:51:53.148864 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2497/4972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:52 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:53.170105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:51:53.171558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:51:53.172232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:51:53.172836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:51:53.173482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:51:53.184080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:53.184854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:53.185999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:53.187128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:53.213017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Getting quotas for project 540f145b3dea4f158c024ba16dc71f23. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:51:53.224316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Getting quotas for user e55b800bc55f4eda98f8756caca122f4 and project 540f145b3dea4f158c024ba16dc71f23. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:51:53.290792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:53.292732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:53.336220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:53.336913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:53.337984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:53.338828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:53.568513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:53.582652 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5084eef2-1cc2-44a4-af2f-a16e643ec158 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.308678 Jul 28 11:51:53.584790 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2498/4973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:53 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:51:53.695609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:51:53.698176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bea8ec0d-52f1-41d0-b00b-9c715f4bc385',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4ddbdd8f-9c1e-4090-b839-a3dacef9c9a9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e657af54-dd32-4a5d-8a35-20c999befa78',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:51:54.176396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:54.177743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:54.198273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:54.200765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:54.202212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:54.204990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:54.644077 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62c86f3b-a751-4834-986f-f4ffe2e193be tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.337758 Jul 28 11:51:54.654277 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2476/4974] 10.222.0.93 () {62 vars in 1189 bytes} [Thu Jul 28 11:51:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 8349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 11:51:54.665797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:54.666790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:54.684834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:54.686771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:54.689182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:54.696390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:54.968067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:54.976754 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca72bbb7-c90d-47eb-8a99-52b4a4461a28 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.805087 Jul 28 11:51:54.981761 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2499/4975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:54 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:54.993143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:54.994117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:55.053508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:55.072089 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7fc52c5-f673-4649-a769-28caf03e07cc tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.409659 Jul 28 11:51:55.074266 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2477/4976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:54 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:55.142502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:55.154751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:55.162201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:55.164267 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b76dfe48-0a98-4ec9-8999-d7f465a2966f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1286 microversion: 2.32 time: 0.181283 Jul 28 11:51:55.178775 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2500/4977] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:51:54 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:51:55.476541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a786a060-2188-40d0-bf04-91ce0d5d69a3 req-7c252321-bd0c-4cb1-ab29-3207ce1d73e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8f0ebc-3076-41ab-b932-564cc765d3a0", "name": "network-vif-plugged", "status": "completed", "tag": "961ebf0f-2700-46ae-9d1f-a769b79cd960"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:51:55.512036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a786a060-2188-40d0-bf04-91ce0d5d69a3 req-7c252321-bd0c-4cb1-ab29-3207ce1d73e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:55.512555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a786a060-2188-40d0-bf04-91ce0d5d69a3 req-7c252321-bd0c-4cb1-ab29-3207ce1d73e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:55.573715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a786a060-2188-40d0-bf04-91ce0d5d69a3 req-7c252321-bd0c-4cb1-ab29-3207ce1d73e1 service nova] Creating event network-vif-plugged:961ebf0f-2700-46ae-9d1f-a769b79cd960 for instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 on n-h1-851368-1 Jul 28 11:51:55.595677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a786a060-2188-40d0-bf04-91ce0d5d69a3 req-7c252321-bd0c-4cb1-ab29-3207ce1d73e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124580 Jul 28 11:51:55.596383 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2478/4978] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:51:56.016743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:56.017611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:56.035242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:56.036050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:56.037738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:56.038837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:56.114537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:56.116047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:56.125237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:56.126069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:56.127176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:56.127848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:56.660350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:56.668175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-29e19e8b-7ff1-477c-8e9c-08056831b0ff tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.655178 Jul 28 11:51:56.677271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2501/4979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:56 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:56.682146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:56.684033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:56.694308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a365540-4282-4ce4-8620-cbd148730ac3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.594474 Jul 28 11:51:56.695618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:56.719924 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2479/4980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:56 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:56.811923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:56.830724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:56.835584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:56.843840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1bf048b0-0349-438f-bb20-b17761d31af9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1286 microversion: 2.32 time: 0.162517 Jul 28 11:51:56.844465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2502/4981] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:51:56 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:51:57.699597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:57.701649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:57.717546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:57.721133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:57.722363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:57.723065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:57.723733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:57.724486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:57.739617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:57.740374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:57.743377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:57.744016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:58.252739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:58.271439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc398bfa-4511-40d1-8afc-5caef412f0ec tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1314 microversion: 2.1 time: 0.574961 Jul 28 11:51:58.273711 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2480/4982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:57 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:58.282309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:58.286173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:58.306248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:58.319014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:58.320739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:58.321010 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-314de6da-88d7-4818-a80d-5c2f38a524af tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.600987 Jul 28 11:51:58.322093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:58.322940 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2503/4983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:57 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:51:58.324483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:58.495007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:58.514492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:58.518760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:51:58.522621 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7536a73-20ab-4389-8b17-4521d606c285 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1594 microversion: 2.32 time: 0.247522 Jul 28 11:51:58.527598 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2481/4984] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:51:58 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1594 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:51:59.294369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:59.295148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:59.307775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:59.308228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:59.309012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:59.315137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:59.347935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:51:59.349154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:51:59.368788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:59.374265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:59.384613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:51:59.384613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:51:59.433185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=68 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:51:59.993098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:00.013902 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-973e598c-7685-4821-9be0-5cc74f464f42 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1499 microversion: 2.1 time: 0.718779 Jul 28 11:52:00.016399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2504/4985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:59 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1499 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:00.022844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:00.024104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:00.035490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:00.037130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:00.040202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:00.049403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:00.071845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:00.089407 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c8fa182-eacd-4c3d-90c9-6437d28c021a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.741587 Jul 28 11:52:00.105634 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2482/4986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:51:59 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:00.740337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:00.761803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:00.767358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:00.769045 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13ef42f2-24b0-44ee-abee-6a087675b20f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1661 microversion: 2.32 time: 0.751290 Jul 28 11:52:00.773759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2505/4987] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:00 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1661 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:01.115537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:01.116240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:01.131121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.132094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:01.133173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.133854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:01.158424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:01.158941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:01.177623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.178272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:01.179267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.187000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:01.222335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:01.252668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:52:01.554693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba452396-bd75-4ab9-930d-fde3cc220293 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 204 len: 0 microversion: 2.1 time: 0.400395 Jul 28 11:52:01.558624 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2506/4988] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:01 2022] DELETE /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:52:01.574297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:01.575987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:01.588914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.589595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:01.593558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:01.595403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:02.214257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:02.230209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0a093e5-a4f7-4fd5-a240-3d902f8bfd8a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 1.120146 Jul 28 11:52:02.247123 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2483/4989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:01 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:02.247123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:02.247123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:02.260107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:02.260777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:02.261730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:02.262390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:02.284159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:02.293114 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a882f19f-599f-46b8-aa97-af96113b5c6b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1505 microversion: 2.1 time: 0.733113 Jul 28 11:52:02.307661 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2507/4990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:01 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:03.203248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:03.214367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:03.244517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:03.255367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:03.256973 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c1b4456f-ae2c-4d47-8a17-958ce91abd9c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1707 microversion: 2.32 time: 1.018468 Jul 28 11:52:03.257560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2484/4991] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:02 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1707 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:03.287804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:03.288436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:03.313544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:03.315492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:03.316382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:03.317895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:03.319505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:03.320042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:03.328377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:03.338969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:03.342176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:03.343094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:03.347631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:03.892874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:03.904866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afbb5887-4db4-4638-8de2-6a90d6e9d0f1 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1505 microversion: 2.1 time: 0.592789 Jul 28 11:52:03.907557 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2485/4992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:03 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:04.001521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:04.014392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d132626e-9d73-4cda-baad-c571a9a9911e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.732265 Jul 28 11:52:04.015568 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2508/4993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:03 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:04.285908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:04.287176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:04.295474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:04.298488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:04.300475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:04.304386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:04.931203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:04.932509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:04.945213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:04.948331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:04.949358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:04.951309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:04.988452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:05.004975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:05.016270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:05.017717 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53274ab5-ed7b-45ce-a6ca-4398843b07e9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1753 microversion: 2.32 time: 0.736444 Jul 28 11:52:05.020321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2486/4994] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:04 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1753 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:05.051851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:05.051851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:05.057720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:05.060249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:05.062501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:05.062501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:05.062501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:05.194529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:05.204764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1a06fdf-8fca-4712-80b5-6e144b0ceb2b tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 200 len: 1463 microversion: 2.1 time: 0.278740 Jul 28 11:52:05.209157 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2509/4995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:04 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:05.307529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:05.318200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ecf6fb65-a63c-435f-8e63-4efd42a86786 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.272606 Jul 28 11:52:05.338144 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2487/4996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:05 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:05.410399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a4f73407-f0ad-47e9-85e4-6b7c9ddd06e4 req-67e082d9-b9d4-4927-9898-7f5dc8a7e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8f0ebc-3076-41ab-b932-564cc765d3a0", "name": "network-vif-deleted", "tag": "961ebf0f-2700-46ae-9d1f-a769b79cd960"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:05.430502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a4f73407-f0ad-47e9-85e4-6b7c9ddd06e4 req-67e082d9-b9d4-4927-9898-7f5dc8a7e10a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:05.430931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a4f73407-f0ad-47e9-85e4-6b7c9ddd06e4 req-67e082d9-b9d4-4927-9898-7f5dc8a7e10a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:05.472711 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a4f73407-f0ad-47e9-85e4-6b7c9ddd06e4 req-67e082d9-b9d4-4927-9898-7f5dc8a7e10a service nova] Creating event network-vif-deleted:961ebf0f-2700-46ae-9d1f-a769b79cd960 for instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 on n-h1-851368-1 Jul 28 11:52:05.485955 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a4f73407-f0ad-47e9-85e4-6b7c9ddd06e4 req-67e082d9-b9d4-4927-9898-7f5dc8a7e10a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080919 Jul 28 11:52:05.495316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2510/4997] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:52:06.047091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:06.047916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:06.063466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.074571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.080231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.083961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.235546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:06.236422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: 0c8f0ebc-3076-41ab-b932-564cc765d3a0] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:06.266021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.266983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.272107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.274589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.344177 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] HTTP exception thrown: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Request method failure captured: Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 HTTP/1.1 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nhI-MsjVH5fMk7mJwvpKOUB2flcLfBSrVc_PkCX9B1i5KzL2T6A5zdEmAKJAjlrY9uXf7k-3ywQGxzs2ryGG3jwpEK-7P4xR31HghwYUh0lT29gVi6a0PVuBCQaa2b4yhKeCqoS4Z0DxpH2lKCOr16nVsUSE2zBjIVCYMcjmAqU1Lw Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 898bc4095c9c424b93bfd392765419bb Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesActionsTest-659493512 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/898bc4095c9c424b93bfd392765419bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/898bc4095c9c424b93bfd392765419bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_898bc4095c9c424b93bfd392765419bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/898bc4095c9c424b93bfd392765419bb"}]}] Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesActionsTest-659493512 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 898bc4095c9c424b93bfd392765419bb Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesActionsTest-659493512 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesActionsTest-659493512-project Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ca3123b40c7b45a1acc13eebc2b9c560 Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesActionsTest-659493512-project Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0c8f0ebc-3076-41ab-b932-564cc765d3a0'} Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:06.347207 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. Jul 28 11:52:06.350676 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:06.353500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Returning 404 to user: Instance 0c8f0ebc-3076-41ab-b932-564cc765d3a0 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:06.356332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5ef5e10-5c0b-4db2-ad97-8c285e21c8cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0" status: 404 len: 111 microversion: 2.1 time: 0.126446 Jul 28 11:52:06.370865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2511/4998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:06 2022] GET /compute/v2.1/servers/0c8f0ebc-3076-41ab-b932-564cc765d3a0 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:52:06.383923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:06.385494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:06.405626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.408271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.410617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:06.412002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:06.819860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:07.002742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:07.023036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:07.025251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:07.026698 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd202fd9-f85d-4202-9fac-222a224c1493 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1753 microversion: 2.32 time: 0.988293 Jul 28 11:52:07.032135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2488/4999] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:06 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1753 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:07.046967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1538180256", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "6797bf53-6321-41ea-844f-2cd3ba713103"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:07.180865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:07.198845 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-129a4adc-9d84-4064-a8de-724a82a6f2d3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.826414 Jul 28 11:52:07.199823 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2512/5000] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:06 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:07.209855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] validate_networks() for [('6797bf53-6321-41ea-844f-2cd3ba713103', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:52:08.057092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:08.057987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:08.074033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.080547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:08.086690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.090950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:08.386613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:52:08.387727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:52:08.388426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:52:08.389219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:52:08.389703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:52:08.427480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.428358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:08.441043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.444692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:08.514181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Getting quotas for project 898bc4095c9c424b93bfd392765419bb. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:52:08.532659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Getting quotas for user ca3123b40c7b45a1acc13eebc2b9c560 and project 898bc4095c9c424b93bfd392765419bb. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:52:08.574350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:52:08.581249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:52:08.740537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-431c8c92-71b5-4226-b5be-3a06bd0d2b06 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.707049 Jul 28 11:52:08.748915 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2489/5001] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:52:08.754022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:08.764733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:08.787817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.790493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:08.793989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:08.797622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:09.169448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:09.196037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:09.197555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:09.198763 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fbddeda5-30b6-4662-aff4-4038484a09aa tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1799 microversion: 2.32 time: 1.145852 Jul 28 11:52:09.226875 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2513/5002] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:08 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1799 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:09.249536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-138ca01d-76d5-41b0-898a-877c3e1ff292 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:09.253520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-138ca01d-76d5-41b0-898a-877c3e1ff292 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:09.471807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:09.486034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-50cc9f5d-c054-4a6e-9cf4-bac53509c05c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 0.735848 Jul 28 11:52:09.492622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2490/5003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:08 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:09.572434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-138ca01d-76d5-41b0-898a-877c3e1ff292 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:09.593296 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-138ca01d-76d5-41b0-898a-877c3e1ff292 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1214 microversion: 2.1 time: 0.360736 Jul 28 11:52:09.595769 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2514/5004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:09 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1214 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:10.250843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:10.251731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:10.270667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:10.272093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:10.292928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:10.295326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:10.509215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:10.510413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:10.546225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:10.549110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:10.555526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:10.556866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:12.136925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:12.146228 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46c05109-bd2d-4626-ab5d-20526c2e7197 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1511 microversion: 2.1 time: 1.641929 Jul 28 11:52:12.147416 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2515/5005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:10 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1511 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:52:12.152451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:12.164001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:12.171265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:12.188257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:12.189764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:12.190628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:12.202990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:12.238546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:12.253519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:12.255003 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e47e46d7-d18c-40a2-8a9e-f15bd300ef12 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1845 microversion: 2.32 time: 2.009380 Jul 28 11:52:12.271164 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2491/5006] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:10 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1845 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:12.417259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:12.434821 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2cbdaa8e-ff24-4eca-ae3d-9f8daca30ba7 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1272 microversion: 2.1 time: 0.280166 Jul 28 11:52:12.435657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2516/5007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:12 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:13.173870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:13.174766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:13.193078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.196514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.197675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.202383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.284885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:13.286116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:13.297502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.307032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.308185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.309629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.762589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:13.777032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:13.796375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd271eb8-f5af-4821-94f9-4375c8b21914 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1488 microversion: 2.1 time: 0.625970 Jul 28 11:52:13.797173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2492/5008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:13 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1488 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:13.815818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:13.817616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:13.819143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3fc9e96f-0668-4070-9217-2385b16e15b8 req-f89238b4-0733-48ba-a066-17629a8fa91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "e710460c-5df7-41b9-bec1-22225c568f23"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:13.830784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-36f09bd5-cc7a-4795-94e6-2426716d688d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1845 microversion: 2.32 time: 0.538801 Jul 28 11:52:13.833285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2517/5009] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:13 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1845 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:13.846405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3fc9e96f-0668-4070-9217-2385b16e15b8 req-f89238b4-0733-48ba-a066-17629a8fa91a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.846865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3fc9e96f-0668-4070-9217-2385b16e15b8 req-f89238b4-0733-48ba-a066-17629a8fa91a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.866256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:13.870882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:13.873734 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3fc9e96f-0668-4070-9217-2385b16e15b8 req-f89238b4-0733-48ba-a066-17629a8fa91a service nova] Creating event network-changed:e710460c-5df7-41b9-bec1-22225c568f23 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:13.885518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3fc9e96f-0668-4070-9217-2385b16e15b8 req-f89238b4-0733-48ba-a066-17629a8fa91a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087273 Jul 28 11:52:13.886278 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2493/5010] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:13.891056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.895752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.896814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.897416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.906143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1606678645"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:13.921008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:13.943189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.943854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:13.944797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:13.948527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:14.200578 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47ce990d-5344-40ea-af77-183dd6595502 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "PUT /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1061 microversion: 2.1 time: 0.311466 Jul 28 11:52:14.204769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2494/5011] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 11:52:13 2022] PUT /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1061 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:14.224359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:14.226958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:14.247705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:14.257120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:14.261744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:14.265359 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-046a7444-a3b6-4698-9eac-50438a8dd0de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1272 microversion: 2.1 time: 0.417838 Jul 28 11:52:14.265622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:14.268064 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2518/5012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:13 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1272 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:14.271911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:14.861083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:14.861696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:14.883518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:14.884011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:14.886672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:14.887212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:15.375912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:15.388354 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b34d3313-ab19-4909-9e2b-dd76157708cd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1488 microversion: 2.1 time: 1.167909 Jul 28 11:52:15.391793 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2495/5013] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:14 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1488 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:15.398677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:15.412029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:15.439385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:15.440225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:15.441554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:15.442207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:15.641937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:15.656521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:15.660662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:15.664057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82dfc7ca-2c9a-478d-9de1-3ad7c71fe892 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1845 microversion: 2.32 time: 0.807988 Jul 28 11:52:15.677906 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2519/5014] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:14 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1845 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:15.694245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:15.695125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:15.711333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:15.712068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:15.725609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:15.726382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:15.738282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:15.745410 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f80fc255-fa2f-4db0-80f5-345f4d91ea93 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1272 microversion: 2.1 time: 0.350644 Jul 28 11:52:15.751835 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2496/5015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:15 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:16.134436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:16.148188 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-687f0d5f-b451-49df-9c53-69ddadb885f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1488 microversion: 2.1 time: 0.468874 Jul 28 11:52:16.149197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2520/5016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:15 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1488 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:16.175107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:16.175796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:16.192215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.193604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.195300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.198111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.298008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:52:16.406828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:16.471135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f703fe5d-1411-4382-8be8-e97aa30121d6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 204 len: 0 microversion: 2.1 time: 0.299753 Jul 28 11:52:16.472428 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2497/5017] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:16 2022] DELETE /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:52:16.482363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:16.483441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:16.497241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.497784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.498867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.499661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.692438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:16.693763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:16.713361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.713979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.714909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.716382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.896355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:16.905632 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2940470e-644f-4f0a-95ec-97b5fc902905 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1494 microversion: 2.1 time: 0.428768 Jul 28 11:52:16.921327 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2521/5018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:16 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1494 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:16.933229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:16.934128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:16.952891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.953437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:16.954283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:16.954921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:17.434912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:17.446081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:17.447865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:17.449340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d32d11da-abcf-48b9-9f92-5fc6120a6b71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1866 microversion: 2.32 time: 0.761372 Jul 28 11:52:17.451000 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2498/5019] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:16 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1866 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:17.543187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:17.555463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4210a0d6-9252-41b9-b00f-0cb40c4f0947 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.630508 Jul 28 11:52:17.556075 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2522/5020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:16 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:17.936245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:17.937241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:17.945180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:17.945869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:17.946893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:17.947565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:18.283273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:18.294466 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e4c8e79a-af24-48be-9935-b5a5ca826c2d tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1494 microversion: 2.1 time: 0.363230 Jul 28 11:52:18.298308 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2499/5021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:17 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1494 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:18.476689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:18.477593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:18.504396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:18.506637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:18.507361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:18.508877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:18.509558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:18.583105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:18.584441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:18.597181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:18.598844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:18.604309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:18.606876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:18.608300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:18.608977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:19.195964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:19.208430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b81a5cef-781d-476e-a46f-e03fd9c3e092 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.629960 Jul 28 11:52:19.211792 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2500/5022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:18 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:52:19.233573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:19.241244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:19.268941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:19.282349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:19.284492 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-595165fa-1f24-425b-9888-9233d28fd152 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1866 microversion: 2.32 time: 0.814798 Jul 28 11:52:19.285065 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2523/5023] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:18 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1866 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:19.324987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:19.325899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:19.342080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:19.343740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:19.344728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:19.346790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:19.461592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:19.462058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:19.462515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lazy-loading 'fault' on Instance uuid 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:52:19.579493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:19.589466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:19.602192 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c1074a46-f056-480a-9723-8f37c00716ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 200 len: 1310 microversion: 2.1 time: 0.282990 Jul 28 11:52:19.604454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2524/5024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:19 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:19.757295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-639526ed-c43d-4671-a036-0d1224d3457f req-7202320f-3af4-40a2-a9e0-a2622f039e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d", "name": "network-vif-deleted", "tag": "08e48478-0e0e-4d5f-a915-8c0237aafa5b"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:19.770161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-639526ed-c43d-4671-a036-0d1224d3457f req-7202320f-3af4-40a2-a9e0-a2622f039e6e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:19.770641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-639526ed-c43d-4671-a036-0d1224d3457f req-7202320f-3af4-40a2-a9e0-a2622f039e6e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:19.786099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-639526ed-c43d-4671-a036-0d1224d3457f req-7202320f-3af4-40a2-a9e0-a2622f039e6e service nova] Creating event network-vif-deleted:08e48478-0e0e-4d5f-a915-8c0237aafa5b for instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d on n-h2-851368-1 Jul 28 11:52:19.794081 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-639526ed-c43d-4671-a036-0d1224d3457f req-7202320f-3af4-40a2-a9e0-a2622f039e6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.578837 Jul 28 11:52:19.799844 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2501/5025] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:20.040141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dc65b709-e85b-4662-8158-5561f4f96e5a req-6a7370f2-b706-4ad3-8582-ef563821465c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:20.072519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc65b709-e85b-4662-8158-5561f4f96e5a req-6a7370f2-b706-4ad3-8582-ef563821465c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:20.074076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dc65b709-e85b-4662-8158-5561f4f96e5a req-6a7370f2-b706-4ad3-8582-ef563821465c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:20.097630 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dc65b709-e85b-4662-8158-5561f4f96e5a req-6a7370f2-b706-4ad3-8582-ef563821465c service nova] Creating event network-changed:a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:20.109533 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dc65b709-e85b-4662-8158-5561f4f96e5a req-6a7370f2-b706-4ad3-8582-ef563821465c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072068 Jul 28 11:52:20.111366 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2525/5026] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:20.244221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:20.246320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:20.279604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:20.280076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:20.280911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:20.281341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:20.310977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:20.312210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:20.326354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:20.351208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:20.352191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:20.354467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.070342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:21.080934 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a755868-5583-4217-81e6-0da66652e47d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.842341 Jul 28 11:52:21.103556 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2502/5027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:20 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:21.121029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.121029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.134269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.138625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.141036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.142886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.203312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d HTTP/1.1 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d'} Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.205742 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.209801 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.212047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.213380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c579c6d6-b62a-477c-9afc-141d7bd2e51b tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 404 len: 111 microversion: 2.1 time: 0.108138 Jul 28 11:52:21.215834 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2503/5028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.238893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.239640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.250412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.252061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.252998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.256060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.271389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:21.283676 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d HTTP/1.1 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d'} Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.295664 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.298904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e85fbfe9-073b-4c33-9156-ff21147ea32a tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 404 len: 111 microversion: 2.1 time: 0.062753 Jul 28 11:52:21.299560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:21.302006 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2504/5029] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:52:21.308055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.309076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.311407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:21.315483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e60938c9-af28-437b-88ad-71591cd0dc0c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1866 microversion: 2.32 time: 1.009784 Jul 28 11:52:21.319671 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2526/5030] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:20 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1866 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:21.325897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.326628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.327751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.328442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.370981 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d HTTP/1.1 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d'} Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.383878 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. Jul 28 11:52:21.387830 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.396717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.398366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c7c022b-493b-46b2-8f97-279296d502ba tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d" status: 404 len: 111 microversion: 2.1 time: 0.094997 Jul 28 11:52:21.402980 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2505/5031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/2f27d41a-d85e-475c-b3cc-09bb2a3f6b7d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.413644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.414389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.421994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.422865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.423953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.424645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.440399 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 HTTP/1.1 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '92fbd715-b33f-4056-b60d-4e180fd6f4f7'} Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.443318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.446648 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.448971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.450633 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc5cee2e-5368-4b9a-b562-ad082bc80686 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 404 len: 111 microversion: 2.1 time: 0.042751 Jul 28 11:52:21.454342 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2527/5032] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.464162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.465678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 92fbd715-b33f-4056-b60d-4e180fd6f4f7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.474089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.474940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.476157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.476846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.495010 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 HTTP/1.1 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '92fbd715-b33f-4056-b60d-4e180fd6f4f7'} Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.497205 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. Jul 28 11:52:21.501255 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.503301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 92fbd715-b33f-4056-b60d-4e180fd6f4f7 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.504580 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c17c7ba1-d823-4c7c-a99e-2a54f082ce77 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7" status: 404 len: 111 microversion: 2.1 time: 0.046020 Jul 28 11:52:21.506063 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2506/5033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/92fbd715-b33f-4056-b60d-4e180fd6f4f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.516768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.517745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.532375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.533830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.535011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.535988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.575720 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 HTTP/1.1 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e2998ec1-7d14-41c2-8d04-9da78cba6b67'} Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.577884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.589078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.593916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35152e90-11d2-4365-a161-390f994765a3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 404 len: 111 microversion: 2.1 time: 0.076342 Jul 28 11:52:21.605643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2528/5034] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.608329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.609215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: e2998ec1-7d14-41c2-8d04-9da78cba6b67] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.617528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.618439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.619564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.622937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.659739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 HTTP/1.1 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e2998ec1-7d14-41c2-8d04-9da78cba6b67'} Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.661489 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance e2998ec1-7d14-41c2-8d04-9da78cba6b67 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.666748 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af6f5ab5-2015-4154-ba00-30bdd91c2470 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67" status: 404 len: 111 microversion: 2.1 time: 0.062047 Jul 28 11:52:21.671018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2507/5035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/e2998ec1-7d14-41c2-8d04-9da78cba6b67 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:52:21.681438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.682156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.689896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.690592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.691551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.692442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.717772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef HTTP/1.1 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f82c51c5-b428-4cf9-a76f-29e954e7eeef'} Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.719631 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.724026 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.726985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.728695 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47fa2529-f915-47ed-8842-80f1df6d6af7 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 404 len: 111 microversion: 2.1 time: 0.052063 Jul 28 11:52:21.733530 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2529/5036] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.738458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.739105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f82c51c5-b428-4cf9-a76f-29e954e7eeef] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.750841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.751660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.752648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.752895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.791279 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef HTTP/1.1 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f82c51c5-b428-4cf9-a76f-29e954e7eeef'} Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.796669 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. Jul 28 11:52:21.802022 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.806219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f82c51c5-b428-4cf9-a76f-29e954e7eeef could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.808008 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dd8fcd4-ae41-4cf6-b753-0f4edcc16eff tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef" status: 404 len: 111 microversion: 2.1 time: 0.073226 Jul 28 11:52:21.810916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2508/5037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/f82c51c5-b428-4cf9-a76f-29e954e7eeef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:52:21.820376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.820957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.833601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.835556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.837099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.844104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.884158 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e HTTP/1.1 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd58370dc-43e0-4e16-b14f-8b3b0676ad1e'} Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.885744 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.889517 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4878aa9-ecc9-4b14-acf0-487469caab6e tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 404 len: 111 microversion: 2.1 time: 0.071982 Jul 28 11:52:21.893883 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2530/5038] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.897243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.897972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d58370dc-43e0-4e16-b14f-8b3b0676ad1e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.915026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.917154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.918559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:21.919005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:21.958385 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e HTTP/1.1 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd58370dc-43e0-4e16-b14f-8b3b0676ad1e'} Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.960003 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. Jul 28 11:52:21.963629 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:21.966843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance d58370dc-43e0-4e16-b14f-8b3b0676ad1e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:21.968106 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-188195f0-11df-400c-a732-da96cc7399ed tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e" status: 404 len: 111 microversion: 2.1 time: 0.075767 Jul 28 11:52:21.969206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2509/5039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:21 2022] GET /compute/v2.1/servers/d58370dc-43e0-4e16-b14f-8b3b0676ad1e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:21.986473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:21.987124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:21.997734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.001203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.005534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.007434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.071629 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db HTTP/1.1 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f61a25ec-5e01-4b24-a3eb-6b0ebe4378db'} Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:22.079865 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.084025 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.085293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:22.089096 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7138cc5-828c-4ae2-a8b9-0b7b380acdfd tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 404 len: 111 microversion: 2.1 time: 0.106102 Jul 28 11:52:22.094959 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2531/5040] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:21 2022] DELETE /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:22.105408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.106612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: f61a25ec-5e01-4b24-a3eb-6b0ebe4378db] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:22.122080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.126367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:22.128917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.130137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.133368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.133821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.152858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.153315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.158157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.158604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.194212 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db HTTP/1.1 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f61a25ec-5e01-4b24-a3eb-6b0ebe4378db'} Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.205503 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance f61a25ec-5e01-4b24-a3eb-6b0ebe4378db could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:22.209847 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-313d4cc3-5422-40d4-ac1b-ff01f53da942 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db" status: 404 len: 111 microversion: 2.1 time: 0.107958 Jul 28 11:52:22.215306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2510/5041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:22 2022] GET /compute/v2.1/servers/f61a25ec-5e01-4b24-a3eb-6b0ebe4378db => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:22.230117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.232574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:22.248605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.254566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.258133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.259431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.287778 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 HTTP/1.1 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '9396c343-732c-4545-9c1d-612cbdb4e686'} Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:22.289961 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.293812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.298168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:22.299587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be2d694d-5f2d-4c19-9f99-a60db5759de6 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686" status: 404 len: 111 microversion: 2.1 time: 0.082171 Jul 28 11:52:22.309468 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2511/5042] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:22 2022] DELETE /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:22.315972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.317016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: 9396c343-732c-4545-9c1d-612cbdb4e686] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:22.324962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.325560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.326606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.327491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.353034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 HTTP/1.1 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '9396c343-732c-4545-9c1d-612cbdb4e686'} Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.358533 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance 9396c343-732c-4545-9c1d-612cbdb4e686 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:22.364821 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-219e4d1f-ca1c-4d69-b807-104f0ba1d26c tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686" status: 404 len: 111 microversion: 2.1 time: 0.049440 Jul 28 11:52:22.366439 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2512/5043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:22 2022] GET /compute/v2.1/servers/9396c343-732c-4545-9c1d-612cbdb4e686 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:22.374097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.374826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:22.384301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.385042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.386137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:22.387642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:22.941993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:22.959684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:22.968762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:22.970428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a30ddc6-4d60-474b-a35a-7caf67d0865c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1866 microversion: 2.32 time: 0.603228 Jul 28 11:52:22.972814 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2513/5044] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:22 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1866 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:22.986706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:22.993458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:23.014805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:23.016786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:23.019333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:23.019953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:23.107699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:52:23.189751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:23.207418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b4069ea-2f3a-4498-9874-ab6a4efc5c2d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 1.099022 Jul 28 11:52:23.212770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2532/5045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:22 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:23.364862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6771aef6-f888-41a9-b079-d45f4abc3ae9 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 204 len: 0 microversion: 2.1 time: 0.389858 Jul 28 11:52:23.366829 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2514/5046] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:22 2022] DELETE /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:52:23.377031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:23.378044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:23.396737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:23.397729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:23.400198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:23.401899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:23.999769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:24.001091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:24.014111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:24.018816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:24.021447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:24.023639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:25.259506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:25.285318 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b11df25-fa43-400f-9491-cc42222b74f1 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1479 microversion: 2.1 time: 1.912223 Jul 28 11:52:25.286329 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2533/5047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:23 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1479 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:25.313828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:25.316287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:25.349060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:25.349918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:25.351064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:25.351744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:25.599383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:25.619111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:25.626679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:25.628112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-817ff45a-f459-4bab-a24d-724f4b0a4d56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1887 microversion: 2.32 time: 1.635519 Jul 28 11:52:25.628675 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2515/5048] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:23 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1887 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:25.648000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9c98f480-4670-4039-8295-9ce598e5ee8b req-9e0bfb77-1b24-466d-b0bc-4247733de734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105f819-bb82-4ebc-866b-662a63c3a44a", "tag": "76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:25.675693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9c98f480-4670-4039-8295-9ce598e5ee8b req-9e0bfb77-1b24-466d-b0bc-4247733de734 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:25.676490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9c98f480-4670-4039-8295-9ce598e5ee8b req-9e0bfb77-1b24-466d-b0bc-4247733de734 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:25.698875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9c98f480-4670-4039-8295-9ce598e5ee8b req-9e0bfb77-1b24-466d-b0bc-4247733de734 service nova] Creating event network-changed:76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d for instance f105f819-bb82-4ebc-866b-662a63c3a44a on n-h1-851368-1 Jul 28 11:52:25.718141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9c98f480-4670-4039-8295-9ce598e5ee8b req-9e0bfb77-1b24-466d-b0bc-4247733de734 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083515 Jul 28 11:52:25.719331 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2516/5049] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:25.815657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:25.824810 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13d2df7a-f732-4371-9dca-e64d74658928 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.522902 Jul 28 11:52:25.839442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2534/5050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:25 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:26.308029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:26.310191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:26.326852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.335619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:26.337531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.339513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:26.659049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:26.669069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:26.708411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.708870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:26.725587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.726096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:26.806674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:26.819771 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-beaf8c21-4d5d-4b5e-be84-95ca40042d87 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1479 microversion: 2.1 time: 0.511698 Jul 28 11:52:26.833662 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2517/5051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:26 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1479 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:26.849720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:26.850554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:26.862510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.862978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:26.863890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:26.864235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:27.810305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:27.833940 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc7d1d00-1c69-4fcb-aff9-0b5e27458f30 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.987344 Jul 28 11:52:27.850283 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2518/5052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:26 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:27.872366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:27.872979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:27.893922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:27.908422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:27.908877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:27.909688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:27.910122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:27.916639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:27.918707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:27.930431 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67964b05-f5de-4e70-af00-985560189781 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1887 microversion: 2.32 time: 1.275477 Jul 28 11:52:27.956253 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2535/5053] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:26 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1887 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:28.001178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-99057457-5a76-49b8-9b49-718120510dfb req-c21764eb-0e1c-4443-af2c-ca3f0f7500cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "fbf24f87-ab7b-4722-b9e1-39c187362f06"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:28.025023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-99057457-5a76-49b8-9b49-718120510dfb req-c21764eb-0e1c-4443-af2c-ca3f0f7500cc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:28.025478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-99057457-5a76-49b8-9b49-718120510dfb req-c21764eb-0e1c-4443-af2c-ca3f0f7500cc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:28.083296 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-99057457-5a76-49b8-9b49-718120510dfb req-c21764eb-0e1c-4443-af2c-ca3f0f7500cc service nova] Creating event network-changed:fbf24f87-ab7b-4722-b9e1-39c187362f06 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:28.123570 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-99057457-5a76-49b8-9b49-718120510dfb req-c21764eb-0e1c-4443-af2c-ca3f0f7500cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165654 Jul 28 11:52:28.124187 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2536/5054] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:28.518363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c575c012e5c4083977709d05910e0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5b513e9c644612b995f9278cb9b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:28.550697 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39cef206-dd18-424e-9269-b8eb9c463b12 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 200 len: 1479 microversion: 2.1 time: 0.680245 Jul 28 11:52:28.577050 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2519/5055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:27 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 1479 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:28.863702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:28.864337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:28.881515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:28.884973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:28.891858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:28.897820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:28.959570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:28.960950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:28.988777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:28.989234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:28.990026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:28.990465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:29.962216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:29.972549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2c98a90-fcfb-4143-b276-60cabaf8f6e9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 1.114887 Jul 28 11:52:29.986454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2537/5056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:28 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:29.995320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:29.995995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] [instance: d653098b-f79d-4178-9b6b-7a32e23235f2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:30.039206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:30.040560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:30.041431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:30.041880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:30.099247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] HTTP exception thrown: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Request method failure captured: Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 HTTP/1.1 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nd3LRpXT-vuQK0Q3rKJrfZmFPV2cLo352Rklcp___lb5mjodSPuwSgHsRg8nLSR1iTA7-_w41vhwniSuw3rxQD1aqCwJoXuQYy12m1PKq96LOeY4Vpg60Ya0FrPbK5wwsFPtX9iUFwp4rSOXKh1d1f9cry5pfXiUM4cmOcHj7o1fgk Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb5b513e9c644612b995f9278cb9b26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb5b513e9c644612b995f9278cb9b26c"}]}] Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersTestJSON-1603000897 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fb5b513e9c644612b995f9278cb9b26c Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersTestJSON-1603000897 Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 6c575c012e5c4083977709d05910e0af Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersTestJSON-1603000897-project Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd653098b-f79d-4178-9b6b-7a32e23235f2'} Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:30.100956 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] Returning 404 to user: Instance d653098b-f79d-4178-9b6b-7a32e23235f2 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:30.104524 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e9affa12-2d66-4505-8846-545484a7cef3 tempest-ServersTestJSON-1603000897 tempest-ServersTestJSON-1603000897-project] 10.222.0.93 "GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2" status: 404 len: 111 microversion: 2.1 time: 0.115705 Jul 28 11:52:30.110914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:30.114499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:30.122814 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2538/5057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:29 2022] GET /compute/v2.1/servers/d653098b-f79d-4178-9b6b-7a32e23235f2 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:30.131956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:30.141779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:30.151492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be557780-6152-4293-9898-aed22acef05d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1887 microversion: 2.32 time: 1.194494 Jul 28 11:52:30.170406 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2520/5058] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:28 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1887 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:30.293089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-26afc5aa-fd1f-44a7-9866-90025ec15f84 req-a0aefe11-4d42-4f40-ac04-166c579d1ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d653098b-f79d-4178-9b6b-7a32e23235f2", "name": "network-vif-deleted", "tag": "fea2eebc-054c-47df-b46a-ca7f4e5b7846"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:30.320386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-26afc5aa-fd1f-44a7-9866-90025ec15f84 req-a0aefe11-4d42-4f40-ac04-166c579d1ea8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:30.320937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-26afc5aa-fd1f-44a7-9866-90025ec15f84 req-a0aefe11-4d42-4f40-ac04-166c579d1ea8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:30.353914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-26afc5aa-fd1f-44a7-9866-90025ec15f84 req-a0aefe11-4d42-4f40-ac04-166c579d1ea8 service nova] Creating event network-vif-deleted:fea2eebc-054c-47df-b46a-ca7f4e5b7846 for instance d653098b-f79d-4178-9b6b-7a32e23235f2 on n-h1-851368-1 Jul 28 11:52:30.384433 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-26afc5aa-fd1f-44a7-9866-90025ec15f84 req-a0aefe11-4d42-4f40-ac04-166c579d1ea8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094933 Jul 28 11:52:30.388640 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2539/5059] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:31.007620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:31.013034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:31.141727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:31.142394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:31.149414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:31.152467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:31.196372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:31.197671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:31.225225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:31.227672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:31.238946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:31.239648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:31.932317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:31.940326 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb3922e5-57dc-40f8-b97b-15c25b79b07d tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.947560 Jul 28 11:52:31.951040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2521/5060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:30 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:32.132236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:32.147595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:32.149343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:32.153093 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f9d31e1-2171-411b-afeb-581df0754a06 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1887 microversion: 2.32 time: 0.967386 Jul 28 11:52:32.155827 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2540/5061] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:31 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1887 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:32.976967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:32.978088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:32.992280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:32.996916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:33.002427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:33.004432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:33.180701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:33.182008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:33.204041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:33.204855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:33.205963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:33.211658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:34.200677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:34.210379 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f72abf81-9652-4eca-b4ad-ef1815cbe3de tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 1.238331 Jul 28 11:52:34.215393 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2522/5062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:32 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:34.220735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-98c4a671-595e-41f1-a882-daf6d3ee6ab2 req-355173f0-2c03-4917-9a8c-a2280c75ed75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "629a90ad-31bd-4e98-bdc8-4b2fb2fbab50"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:34.264661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:34.276607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:34.279366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-98c4a671-595e-41f1-a882-daf6d3ee6ab2 req-355173f0-2c03-4917-9a8c-a2280c75ed75 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:34.285713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:34.286529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-98c4a671-595e-41f1-a882-daf6d3ee6ab2 req-355173f0-2c03-4917-9a8c-a2280c75ed75 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:34.296583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ae3a2a5-95b6-433b-82c6-24d3638876f3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1887 microversion: 2.32 time: 1.119759 Jul 28 11:52:34.302886 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2541/5063] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:33 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1887 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:34.330063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-98c4a671-595e-41f1-a882-daf6d3ee6ab2 req-355173f0-2c03-4917-9a8c-a2280c75ed75 service nova] Creating event network-changed:629a90ad-31bd-4e98-bdc8-4b2fb2fbab50 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:34.337138 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-98c4a671-595e-41f1-a882-daf6d3ee6ab2 req-355173f0-2c03-4917-9a8c-a2280c75ed75 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120226 Jul 28 11:52:34.347900 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2523/5064] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:35.236373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:35.237239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:35.246065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:35.259903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:35.261024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:35.261723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:35.327349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:35.328840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:35.341899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:35.344029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:35.349409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:35.350544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:35.351239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:35.674121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:35.685693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9081a3a8-4707-423d-a822-4ede629dffbb tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.454948 Jul 28 11:52:35.688835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2542/5065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:35 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:35.700793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-99562030-73be-4c85-a6c1-9ae6f21bbda5 req-561b5a45-bc5c-4938-855a-16c2409037ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105f819-bb82-4ebc-866b-662a63c3a44a", "name": "network-vif-plugged", "status": "completed", "tag": "76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:35.753216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-99562030-73be-4c85-a6c1-9ae6f21bbda5 req-561b5a45-bc5c-4938-855a-16c2409037ef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:35.754034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-99562030-73be-4c85-a6c1-9ae6f21bbda5 req-561b5a45-bc5c-4938-855a-16c2409037ef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:35.832848 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-99562030-73be-4c85-a6c1-9ae6f21bbda5 req-561b5a45-bc5c-4938-855a-16c2409037ef service nova] Creating event network-vif-plugged:76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d for instance f105f819-bb82-4ebc-866b-662a63c3a44a on n-h1-851368-1 Jul 28 11:52:35.841769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-99562030-73be-4c85-a6c1-9ae6f21bbda5 req-561b5a45-bc5c-4938-855a-16c2409037ef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148100 Jul 28 11:52:35.843234 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2543/5066] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:35.940262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:35.968657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:35.972048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:35.973693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-24438f62-193d-42d8-96f0-3a506adf3b07 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.650785 Jul 28 11:52:35.974493 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2524/5067] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:35 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:36.565629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a5c5a5a8-f1c5-418e-9847-540ddd1ee59d req-245c40a0-7555-4f49-a9cd-44a06302896f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "84e3b817-4c85-49a7-86bd-632a3dc72aa8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:36.581276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a5c5a5a8-f1c5-418e-9847-540ddd1ee59d req-245c40a0-7555-4f49-a9cd-44a06302896f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:36.586340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a5c5a5a8-f1c5-418e-9847-540ddd1ee59d req-245c40a0-7555-4f49-a9cd-44a06302896f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:36.626361 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a5c5a5a8-f1c5-418e-9847-540ddd1ee59d req-245c40a0-7555-4f49-a9cd-44a06302896f service nova] Creating event network-changed:84e3b817-4c85-49a7-86bd-632a3dc72aa8 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:36.644639 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a5c5a5a8-f1c5-418e-9847-540ddd1ee59d req-245c40a0-7555-4f49-a9cd-44a06302896f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082400 Jul 28 11:52:36.648556 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2544/5068] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:36.715708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:36.716981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:36.734912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:36.735507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:36.737772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:36.739952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:37.010893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:37.012178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:37.026849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:37.029153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:37.030124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:37.032806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:37.359947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:37.369375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4746bb22-5844-4433-95bf-79eed1a8bfe8 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 0.659395 Jul 28 11:52:37.370172 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2525/5069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:36 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:37.535183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:37.545537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:37.547053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:37.548243 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c8bbbb9-9af1-47a4-bad9-9ec5ba1d09e6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.542173 Jul 28 11:52:37.559982 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2545/5070] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:37 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:52:38.391885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:38.392516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:38.409336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:38.409798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:38.410775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:38.411417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:38.574621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:38.575948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:38.595293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:38.599265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:38.607309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:38.609237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:40.012592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:40.020907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46bd939e-d6eb-4b4c-98b2-7077b961518f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1314 microversion: 2.1 time: 1.633572 Jul 28 11:52:40.042267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2526/5071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:38 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1314 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:40.047887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f3f3e074-ff44-42a3-9236-c6302646dd7f req-33069aa3-0c2e-4548-a6a1-c0d67280c136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "ebcb42f2-afe9-4414-b679-500abf344176"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:40.060616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f3f3e074-ff44-42a3-9236-c6302646dd7f req-33069aa3-0c2e-4548-a6a1-c0d67280c136 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:40.061550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f3f3e074-ff44-42a3-9236-c6302646dd7f req-33069aa3-0c2e-4548-a6a1-c0d67280c136 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:40.075131 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f3f3e074-ff44-42a3-9236-c6302646dd7f req-33069aa3-0c2e-4548-a6a1-c0d67280c136 service nova] Creating event network-changed:ebcb42f2-afe9-4414-b679-500abf344176 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:40.080586 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f3f3e074-ff44-42a3-9236-c6302646dd7f req-33069aa3-0c2e-4548-a6a1-c0d67280c136 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036334 Jul 28 11:52:40.085107 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2527/5072] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:40.549812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:40.560747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:40.562248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:40.573096 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5742c2e1-3224-447e-8812-96ad7d4b25c1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.993191 Jul 28 11:52:40.574085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2546/5073] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:38 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:41.049540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:41.051438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:41.087694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:41.088165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:41.088988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:41.089492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:41.610032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:41.613222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:41.638807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:41.639765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:41.642655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:41.643952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:41.692648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:42.004513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:42.030566 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73b1e947-7a98-4fd1-ae3b-8110b0f17802 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1498 microversion: 2.1 time: 0.979420 Jul 28 11:52:42.034452 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2528/5074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:41 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1498 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:42.613800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6fdcd4c2-6f45-43c4-ab9d-fc7ea64d9840 req-bdb31848-1c97-4689-9927-1226d3063e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "b2e949ed-7b99-480b-946f-45f3b750f2a9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:42.641458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6fdcd4c2-6f45-43c4-ab9d-fc7ea64d9840 req-bdb31848-1c97-4689-9927-1226d3063e55 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:42.641942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6fdcd4c2-6f45-43c4-ab9d-fc7ea64d9840 req-bdb31848-1c97-4689-9927-1226d3063e55 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:42.673515 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6fdcd4c2-6f45-43c4-ab9d-fc7ea64d9840 req-bdb31848-1c97-4689-9927-1226d3063e55 service nova] Creating event network-changed:b2e949ed-7b99-480b-946f-45f3b750f2a9 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:52:42.684684 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6fdcd4c2-6f45-43c4-ab9d-fc7ea64d9840 req-bdb31848-1c97-4689-9927-1226d3063e55 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074636 Jul 28 11:52:42.685884 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2529/5075] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:43.014247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:43.015354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:43.030240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:43.032718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:43.038602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:43.039279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:43.084844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:52:43.227233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:43.242780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a0d54db-a4a3-4164-ad23-daa59f65e3cd tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 204 len: 0 microversion: 2.1 time: 0.231449 Jul 28 11:52:43.244832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:43.245604 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2530/5076] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:52:43 2022] DELETE /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:52:43.249113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:43.251992 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec5ace11-0382-40d5-86a4-1e715063d2d2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.658649 Jul 28 11:52:43.258351 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2547/5077] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:41 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:43.282158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:43.283365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:43.299328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:43.299865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:43.317166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:43.318481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:43.916423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:43.929655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3efe81d-5ed5-4457-916a-f175f680eb47 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1504 microversion: 2.1 time: 0.675826 Jul 28 11:52:43.930304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2531/5078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:43 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:44.285808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:44.287085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:44.294856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:44.295311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:44.309658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:44.310123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:44.952207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:44.956250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:44.977633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:44.978576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:44.983154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:44.984549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:45.634913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:45.651775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:45.660912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:45.662543 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-225872fb-578a-457d-8c05-47e844f5f2f1 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.380729 Jul 28 11:52:45.667665 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2548/5079] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:44 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:45.789728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:45.801144 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73b8c314-addf-45c0-8b67-2f38380019a9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1504 microversion: 2.1 time: 0.853356 Jul 28 11:52:45.804043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2532/5080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:44 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1504 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:46.695881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:46.696593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:46.715253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:46.715882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:46.719977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:46.720713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:46.826575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:46.827476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:46.849088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:46.849539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:46.852599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:46.853063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:47.732294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:47.743701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3123b40c7b45a1acc13eebc2b9c560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '898bc4095c9c424b93bfd392765419bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:47.751064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:47.755337 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a202d17-107a-4817-9a87-88b4980f252f tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 200 len: 1504 microversion: 2.1 time: 0.930212 Jul 28 11:52:47.756421 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2533/5081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:46 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 1504 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:52:47.758485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:47.763829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e03eb63-816c-43dc-a420-ae223d06aaef tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.070185 Jul 28 11:52:47.764681 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2549/5082] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:46 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:47.878256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-acb0f511-743a-4a47-a68c-cca9fc7a39f5 req-38383c5d-30f0-4d98-bdfc-7bd97aba98ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105f819-bb82-4ebc-866b-662a63c3a44a", "name": "network-vif-deleted", "tag": "76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:52:47.896963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-acb0f511-743a-4a47-a68c-cca9fc7a39f5 req-38383c5d-30f0-4d98-bdfc-7bd97aba98ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:47.897451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-acb0f511-743a-4a47-a68c-cca9fc7a39f5 req-38383c5d-30f0-4d98-bdfc-7bd97aba98ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:47.936162 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-acb0f511-743a-4a47-a68c-cca9fc7a39f5 req-38383c5d-30f0-4d98-bdfc-7bd97aba98ed service nova] Creating event network-vif-deleted:76e5bf9c-3f56-4cd0-8b56-9dd55842cc8d for instance f105f819-bb82-4ebc-866b-662a63c3a44a on n-h1-851368-1 Jul 28 11:52:47.944980 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-acb0f511-743a-4a47-a68c-cca9fc7a39f5 req-38383c5d-30f0-4d98-bdfc-7bd97aba98ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069662 Jul 28 11:52:47.949302 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2534/5083] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:48.781337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:48.782596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] [instance: f105f819-bb82-4ebc-866b-662a63c3a44a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:48.795502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:48.797998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:48.800965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=56 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:52:48.807577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:48.808253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:48.817881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:48.818689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:48.824024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:48.824628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:48.826872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:48.830342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:48.858685 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] HTTP exception thrown: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Request method failure captured: Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a HTTP/1.1 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nhI-MsjVH5fMk7mJwvpKOUB2flcLfBSrVc_PkCX9B1i5KzL2T6A5zdEmAKJAjlrY9uXf7k-3ywQGxzs2ryGG3jwpEK-7P4xR31HghwYUh0lT29gVi6a0PVuBCQaa2b4yhKeCqoS4Z0DxpH2lKCOr16nVsUSE2zBjIVCYMcjmAqU1Lw Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 898bc4095c9c424b93bfd392765419bb Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesActionsTest-659493512 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/898bc4095c9c424b93bfd392765419bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/898bc4095c9c424b93bfd392765419bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_898bc4095c9c424b93bfd392765419bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/898bc4095c9c424b93bfd392765419bb"}]}] Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesActionsTest-659493512 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 898bc4095c9c424b93bfd392765419bb Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesActionsTest-659493512 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesActionsTest-659493512-project Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ca3123b40c7b45a1acc13eebc2b9c560 Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesActionsTest-659493512-project Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f105f819-bb82-4ebc-866b-662a63c3a44a'} Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:52:48.873341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] Returning 404 to user: Instance f105f819-bb82-4ebc-866b-662a63c3a44a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:52:48.880596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-83b80ef0-6d35-4d6a-8490-eac579e90fa9 tempest-VolumesActionsTest-659493512 tempest-VolumesActionsTest-659493512-project] 10.222.0.93 "GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a" status: 404 len: 111 microversion: 2.1 time: 0.100101 Jul 28 11:52:48.888094 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2550/5084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:52:48 2022] GET /compute/v2.1/servers/f105f819-bb82-4ebc-866b-662a63c3a44a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:52:49.627369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:49.646258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:49.653914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:49.655260 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d183c5c-411f-479e-8a14-1f2697502435 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.866828 Jul 28 11:52:49.662666 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2535/5085] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:48 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:50.691859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:50.693634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:50.707570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:50.709182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:50.711819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:50.714004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:51.462900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:51.498253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:51.499945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:51.501165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54d24200-425b-4960-9c78-d7cfbb2afc4a tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.814514 Jul 28 11:52:51.501751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2551/5086] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:50 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:52.529148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:52.529780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:52.547104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:52.547104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:52.553190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:52.553698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:53.644556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e76c64cc-9fff-405b-a53a-8343ca3104db tempest-ExtensionsTest-95702819 tempest-ExtensionsTest-95702819-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:53.649613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e76c64cc-9fff-405b-a53a-8343ca3104db tempest-ExtensionsTest-95702819 tempest-ExtensionsTest-95702819-project] 10.222.0.93 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.496213 Jul 28 11:52:53.651211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2552/5087] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Jul 28 11:52:53 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:52:53.670435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c89a4f0-492f-40b4-9504-851f8360e487 tempest-ExtensionsTest-95702819 tempest-ExtensionsTest-95702819-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:53.677492 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c89a4f0-492f-40b4-9504-851f8360e487 tempest-ExtensionsTest-95702819 tempest-ExtensionsTest-95702819-project] 10.222.0.93 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.017688 Jul 28 11:52:53.685954 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2553/5088] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Jul 28 11:52:53 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 11:52:53.841112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:53.863318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:53.879059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:53.887936 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-233536fa-580c-438a-ba96-7c13eaa3ae94 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.362764 Jul 28 11:52:53.911807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2536/5089] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:52 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:54.952368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:54.953727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:54.999413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:55.005095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:55.007853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:55.008538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:55.879628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:55.893089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:55.894612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:55.895832 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-458ba556-e1ac-4d82-a858-075a907fe59e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.950151 Jul 28 11:52:55.896390 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2554/5090] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:54 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:56.924080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:56.925071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:56.941049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:56.941667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:56.942584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:56.943170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:57.907399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:57.922841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:57.930064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:52:57.935786 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a932a93-f3f3-48a8-853c-892b1334a975 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.012238 Jul 28 11:52:57.936593 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2537/5091] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:56 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:52:58.963422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:52:58.964634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:52:58.976689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:58.990648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:52:58.992055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:52:58.992531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:00.914742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:00.934564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:00.939161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:00.944723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77642478-9aac-45d4-888f-94ce4b879a56 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.985053 Jul 28 11:53:00.966407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2555/5092] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:52:58 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:01.975882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:01.976508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:01.988476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:01.988928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:01.989720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:02.009619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:02.034189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:02.637558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:02.663618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:02.666161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:02.676409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a0225c5-4d5c-4fbf-8fba-9c7287cdaf19 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.702658 Jul 28 11:53:02.680112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2538/5093] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:01 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:03.705924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:03.707591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:03.742473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:03.746282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:03.747260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:03.750569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:05.060927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:05.074427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:05.075938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:05.089001 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e5f34fe-2f65-4374-a6c6-428ddc7848ea tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.390854 Jul 28 11:53:05.108703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2556/5094] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:03 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:06.121998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:06.124639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:06.150066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:06.153194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:06.177760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:06.178820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:06.180338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:07.038194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:07.060217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:07.064380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:07.068771 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-490bd31c-0879-48f1-8428-5e020e12347d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.953006 Jul 28 11:53:07.070443 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2539/5095] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:06 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:08.095461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:08.096772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:08.108394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:08.117084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:08.122863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:08.128207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:09.064812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:09.106326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:09.123601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:09.124858 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27f1ed6e-9992-40e5-9dd6-317147e19626 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.035750 Jul 28 11:53:09.133355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2557/5096] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:08 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:10.152984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:10.153627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:10.177955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:10.199484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:10.200523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:10.200980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:11.005357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:11.015622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:11.023482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:11.024853 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b593cad-4d2b-4a11-b940-f94232297f64 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.876949 Jul 28 11:53:11.039559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2540/5097] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:10 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:12.054297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:12.056041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:12.080537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:12.081176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:12.082034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:12.095164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:12.195593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=48 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:13.182928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:13.201016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:13.211970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:13.219390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-530dc8fd-b929-459c-97a3-d22059b5c39b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.164395 Jul 28 11:53:13.231749 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2558/5098] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:12 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:14.247782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:14.249102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:14.263426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:14.277911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:14.280821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:14.284180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:16.074273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:16.090937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:16.097707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:16.100459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-addd085e-943f-41a7-94f8-e494b4985854 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.856965 Jul 28 11:53:16.102447 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2541/5099] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:14 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:17.132574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:17.133849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:17.157144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:17.157980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:17.162052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:17.163010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:18.258788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:18.277283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:18.296956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:18.305254 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-63c746bb-7177-4466-a54a-8df096865c2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.177342 Jul 28 11:53:18.321000 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2559/5100] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:17 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:18.909844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7649c9ce-11f0-4d44-8a54-cd2fa6de4539 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: .version_select at 0x7f2ebbe84e50>, body: {"keypair": {"name": "tempest-keypair-952314151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw3bMeqaBnUnSldwRz8Edh2dI8BoaRYBkRF+sDvx4PvGojkZgAGGMnzF91POboBEk0gq7gT+CT8v8MrHlh1s2dSpyxzH/fqyFcla9gRJR3eg9J9pN2hdm1ekvgJhBcI6w=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:19.008190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7649c9ce-11f0-4d44-8a54-cd2fa6de4539 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:53:19.047854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7649c9ce-11f0-4d44-8a54-cd2fa6de4539 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:53:19.174948 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7649c9ce-11f0-4d44-8a54-cd2fa6de4539 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.555975 Jul 28 11:53:19.179972 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2542/5101] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:53:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:19.339553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:19.343341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:19.386873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=16 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:19.389575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:19.390421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:19.391483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:19.392098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:20.591439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:20.608105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:20.610011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:20.616577 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afad0a76-b5eb-40ae-b179-9f0ffd4e955b tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.283760 Jul 28 11:53:20.627773 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2560/5102] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:19 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:21.645736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:21.647453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:21.666108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:21.671761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:21.672836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:21.673615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:22.225727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:22.304810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:22.307809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:22.323790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7bea5ee2-2a46-4dd1-b420-039632ff8902 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.673037 Jul 28 11:53:22.324820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2543/5103] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:21 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:23.361971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:23.362815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:23.388812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:23.389278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:23.404069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:23.407141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:24.874614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:24.904002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:24.910737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:24.918494 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59b1d345-1666-4098-afa2-9fa038c7a172 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.568094 Jul 28 11:53:24.931656 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2561/5104] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:23 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:25.944096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:25.944755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:25.974340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:25.974801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:25.975645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:25.976088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:26.623038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1980416958", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3441235-2c87-4705-8e5e-070086c01f1c"}], "security_groups": [{"name": "tempest-securitygroup--100515331"}], "key_name": "tempest-keypair-952314151", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:26.700677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:26.731320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:26.732864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:26.734084 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7673eef9-35f3-4199-8d3c-c3e0ef362fd9 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.794477 Jul 28 11:53:26.765393 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2544/5105] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:25 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:27.605511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-71edf40e-b2cd-4a2a-a5d3-a89635027c2a req-cf85b8e0-31cf-41b0-babf-9e920bce23d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:27.620044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-71edf40e-b2cd-4a2a-a5d3-a89635027c2a req-cf85b8e0-31cf-41b0-babf-9e920bce23d2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:27.620503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-71edf40e-b2cd-4a2a-a5d3-a89635027c2a req-cf85b8e0-31cf-41b0-babf-9e920bce23d2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:27.656763 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-71edf40e-b2cd-4a2a-a5d3-a89635027c2a req-cf85b8e0-31cf-41b0-babf-9e920bce23d2 service nova] Creating event network-vif-plugged:a9e4626b-86c4-47a2-bd43-b7ca6e7b9e0d for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:27.677234 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-71edf40e-b2cd-4a2a-a5d3-a89635027c2a req-cf85b8e0-31cf-41b0-babf-9e920bce23d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075632 Jul 28 11:53:27.679991 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2545/5106] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:53:27.758087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:27.759128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:27.773647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:27.785578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:27.787423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:27.788699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:28.660629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:28.679931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:28.701938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:28.703823 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f5594d3-be8b-45f7-874e-a6c65613b07d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.950285 Jul 28 11:53:28.719716 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2546/5107] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:27 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:29.732310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:29.733052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:29.735844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:29.779706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:29.780159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:29.794857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:29.795900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:29.836515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] validate_networks() for [('a3441235-2c87-4705-8e5e-070086c01f1c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:53:30.949843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:30.975784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:30.977646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:30.978944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff2ca5f7-a19c-4e43-974e-7a06d2cbff05 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.250502 Jul 28 11:53:31.025079 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2547/5108] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:29 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:31.064921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-98c2c2e3-4f3d-4d80-a8c5-43021b7f8ead req-ac0418fe-b3c4-49b0-8563-e7e0e9a08065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "b2e949ed-7b99-480b-946f-45f3b750f2a9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:31.150182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-98c2c2e3-4f3d-4d80-a8c5-43021b7f8ead req-ac0418fe-b3c4-49b0-8563-e7e0e9a08065 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:31.151615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-98c2c2e3-4f3d-4d80-a8c5-43021b7f8ead req-ac0418fe-b3c4-49b0-8563-e7e0e9a08065 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:31.186591 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-98c2c2e3-4f3d-4d80-a8c5-43021b7f8ead req-ac0418fe-b3c4-49b0-8563-e7e0e9a08065 service nova] Creating event network-vif-plugged:b2e949ed-7b99-480b-946f-45f3b750f2a9 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:31.196810 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-98c2c2e3-4f3d-4d80-a8c5-43021b7f8ead req-ac0418fe-b3c4-49b0-8563-e7e0e9a08065 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169712 Jul 28 11:53:31.201281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2548/5109] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:32.014175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:32.014871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:32.049532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:32.050106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:32.050960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:32.051442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:32.702340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:32.710075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=56 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:32.716222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:32.718337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:32.720201 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec700815-ef1f-46d0-b4f7-81f546bf011e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 0.710211 Jul 28 11:53:32.736592 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2549/5110] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:32 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:53:32.798335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:53:32.799420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:53:32.800654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:53:32.801246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:53:32.801827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:53:32.821157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:32.835471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:32.837934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:32.842554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:32.877266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:53:32.883279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:53:32.922087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:53:32.926318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:53:33.056257 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51de9e9e-8016-4047-8599-a8f2532d872b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.438316 Jul 28 11:53:33.059457 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2562/5111] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:53:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 6442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:53:33.079363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9036a97-864f-46da-8fc6-2cb48d5a85b9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:33.080088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9036a97-864f-46da-8fc6-2cb48d5a85b9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:33.277513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9036a97-864f-46da-8fc6-2cb48d5a85b9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:33.285064 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9036a97-864f-46da-8fc6-2cb48d5a85b9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1241 microversion: 2.1 time: 0.214232 Jul 28 11:53:33.287820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2550/5112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:33 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1241 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:33.333302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "fbf24f87-ab7b-4722-b9e1-39c187362f06"}, {"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "e710460c-5df7-41b9-bec1-22225c568f23"}, {"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "629a90ad-31bd-4e98-bdc8-4b2fb2fbab50"}, {"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "84e3b817-4c85-49a7-86bd-632a3dc72aa8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:33.374677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:33.383911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:33.492228 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Creating event network-vif-plugged:fbf24f87-ab7b-4722-b9e1-39c187362f06 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:33.507805 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Creating event network-vif-plugged:e710460c-5df7-41b9-bec1-22225c568f23 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:33.508488 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Creating event network-vif-plugged:629a90ad-31bd-4e98-bdc8-4b2fb2fbab50 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:33.509009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] Creating event network-vif-plugged:84e3b817-4c85-49a7-86bd-632a3dc72aa8 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:33.533675 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9e0434d0-5f8e-4b41-a27d-6848c2681c57 req-2f9081d4-912d-45df-8b0e-6b774649c818 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.194722 Jul 28 11:53:33.536532 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2563/5113] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:33.745832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:33.746732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:33.764530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:33.765132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:33.766576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:33.775420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:34.310925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83ce9ffa-523e-4e05-803d-13a416ae302f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:34.314610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-83ce9ffa-523e-4e05-803d-13a416ae302f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:34.782935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83ce9ffa-523e-4e05-803d-13a416ae302f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:34.790646 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-83ce9ffa-523e-4e05-803d-13a416ae302f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1241 microversion: 2.1 time: 0.483938 Jul 28 11:53:34.794611 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2564/5114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:34 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1241 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:35.005159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:35.031169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:35.039214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:35.052503 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3cff1b6-7de1-46de-b3bb-78fbeee74417 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 1.306291 Jul 28 11:53:35.059253 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2551/5115] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:33 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:35.659497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b74d7ef4-ade0-46c4-92a2-ab61f7926bbc req-ec034dd1-9c88-4dd8-8bae-7861cf0030f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-plugged", "status": "completed", "tag": "ebcb42f2-afe9-4414-b679-500abf344176"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:35.689359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b74d7ef4-ade0-46c4-92a2-ab61f7926bbc req-ec034dd1-9c88-4dd8-8bae-7861cf0030f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:35.694287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b74d7ef4-ade0-46c4-92a2-ab61f7926bbc req-ec034dd1-9c88-4dd8-8bae-7861cf0030f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:35.770904 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b74d7ef4-ade0-46c4-92a2-ab61f7926bbc req-ec034dd1-9c88-4dd8-8bae-7861cf0030f7 service nova] Creating event network-vif-plugged:ebcb42f2-afe9-4414-b679-500abf344176 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:35.787788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b74d7ef4-ade0-46c4-92a2-ab61f7926bbc req-ec034dd1-9c88-4dd8-8bae-7861cf0030f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131721 Jul 28 11:53:35.789542 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2565/5116] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:35.820461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:35.820461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:35.838439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:35.843310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:35.844349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:35.847740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:36.093847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:36.094791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:36.127688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:36.128289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:36.134760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:36.137734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:36.420253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:36.485946 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c39fb25c-0627-4c0e-933c-b25de999e21d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1301 microversion: 2.1 time: 0.671473 Jul 28 11:53:36.509258 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2552/5117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:35 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1301 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:37.532633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:37.533295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:37.536486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:37.584646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:37.585108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:37.599983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:37.602284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:38.562006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:38.583483 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38e75f46-f1f9-4624-a24e-1859cda4a84d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1299 microversion: 2.1 time: 1.053289 Jul 28 11:53:38.598013 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2553/5118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:37 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1299 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:38.821155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:38.847536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:38.852103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:38.871542 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6fa8c91a-8f5b-45c4-bba5-bc8c4df97270 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1875 microversion: 2.32 time: 2.782944 Jul 28 11:53:38.877458 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2566/5119] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:36 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1875 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:39.615009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:39.616332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:39.637293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:39.644457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:39.646296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:39.651123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:39.902348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:39.904057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:39.936864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:39.937754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:39.944310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:39.945025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:41.177505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:41.190015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:41.193514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:41.207461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c56a7ea5-c88d-4615-b7ce-c8975dbac47f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.592154 Jul 28 11:53:41.208377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2554/5120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:39 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:41.208964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:41.210302 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a71b7fa-b3af-474c-b363-57f71ef03dbc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2827 microversion: 2.32 time: 1.314316 Jul 28 11:53:41.210854 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2567/5121] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:53:39 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2827 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:41.238604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:41.239406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:41.250600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:41.251594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:41.254391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:41.255506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:41.699848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34c134c9-acf8-4525-814d-71aa31b4b7ba tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.464326 Jul 28 11:53:41.700282 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2555/5122] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 11:53:41 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c/os-interface => generated 1831 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:53:42.231029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:42.232296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:42.246008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:42.246743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:42.247745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:42.248341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:42.311021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=44 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:42.869116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:43.773231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:43.806279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7c846fc3-6f41-4b3a-8edf-6e8d4a3ec25b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.557749 Jul 28 11:53:43.807835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2568/5123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:42 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:44.182588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:44.198700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-322bb1dc-c323-45b8-9388-7498939c458a req-f4dd6bd2-bf0e-4a17-addd-360ae4ee15f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f3d970-c95b-4126-8ae5-511cf410c7ea", "tag": "a5268822-38d3-4f31-a721-78133a0f4d07"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:44.337160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-322bb1dc-c323-45b8-9388-7498939c458a req-f4dd6bd2-bf0e-4a17-addd-360ae4ee15f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:44.348380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-322bb1dc-c323-45b8-9388-7498939c458a req-f4dd6bd2-bf0e-4a17-addd-360ae4ee15f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:44.485710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-322bb1dc-c323-45b8-9388-7498939c458a req-f4dd6bd2-bf0e-4a17-addd-360ae4ee15f0 service nova] Creating event network-changed:a5268822-38d3-4f31-a721-78133a0f4d07 for instance c0f3d970-c95b-4126-8ae5-511cf410c7ea on n-h1-851368-1 Jul 28 11:53:44.527200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-322bb1dc-c323-45b8-9388-7498939c458a req-f4dd6bd2-bf0e-4a17-addd-360ae4ee15f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321006 Jul 28 11:53:44.530815 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2556/5124] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:44.835001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:44.835990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:44.857114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:44.859338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:44.860640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:44.863540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:44.864372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:46.878055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-25d3aeb6-4f4a-4809-b9b8-06054632c82d req-8c944b5a-b55d-43a5-83fb-0f51d25a3cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "tag": "e710460c-5df7-41b9-bec1-22225c568f23"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:46.917938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-25d3aeb6-4f4a-4809-b9b8-06054632c82d req-8c944b5a-b55d-43a5-83fb-0f51d25a3cb1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:46.918312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-25d3aeb6-4f4a-4809-b9b8-06054632c82d req-8c944b5a-b55d-43a5-83fb-0f51d25a3cb1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:46.998806 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-25d3aeb6-4f4a-4809-b9b8-06054632c82d req-8c944b5a-b55d-43a5-83fb-0f51d25a3cb1 service nova] Creating event network-changed:e710460c-5df7-41b9-bec1-22225c568f23 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:53:47.028653 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-25d3aeb6-4f4a-4809-b9b8-06054632c82d req-8c944b5a-b55d-43a5-83fb-0f51d25a3cb1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150575 Jul 28 11:53:47.033136 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2557/5125] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:53:47.050257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:47.066854 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6cda8c6-1780-4724-8043-685ff5aa55bb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 2.236892 Jul 28 11:53:47.079672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2569/5126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:44 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:48.101132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:48.103008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:48.118091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:48.120037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:48.123516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:48.125974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:49.973474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:50.001833 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88936e9c-c4d7-474b-b853-1136fdd0ee5e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.905473 Jul 28 11:53:50.020521 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2558/5127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:48 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:51.050030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:51.057620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:51.089495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:53:51.096502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:51.101738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:51.102616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:51.108561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:52.144479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:52.154696 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee0608f6-5703-4b04-9831-d5e4d8119167 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.124351 Jul 28 11:53:52.180365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2570/5128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:51 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:53.183191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:53.183703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:53.218465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:53.219195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:53.221954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:53.222609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:53.904793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-bc5c301d-129c-43d6-9825-ada9b86b0fdf req-98971fbb-3a39-4710-833c-e75fb24d1d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f3d970-c95b-4126-8ae5-511cf410c7ea", "name": "network-vif-plugged", "status": "completed", "tag": "a5268822-38d3-4f31-a721-78133a0f4d07"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:53:53.939055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bc5c301d-129c-43d6-9825-ada9b86b0fdf req-98971fbb-3a39-4710-833c-e75fb24d1d45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:53.961790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bc5c301d-129c-43d6-9825-ada9b86b0fdf req-98971fbb-3a39-4710-833c-e75fb24d1d45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:54.023584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-bc5c301d-129c-43d6-9825-ada9b86b0fdf req-98971fbb-3a39-4710-833c-e75fb24d1d45 service nova] Creating event network-vif-plugged:a5268822-38d3-4f31-a721-78133a0f4d07 for instance c0f3d970-c95b-4126-8ae5-511cf410c7ea on n-h1-851368-1 Jul 28 11:53:54.071769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-bc5c301d-129c-43d6-9825-ada9b86b0fdf req-98971fbb-3a39-4710-833c-e75fb24d1d45 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164657 Jul 28 11:53:54.075133 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2571/5129] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:53:54.492482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:54.510301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e05bf9d0-24b4-4500-b2ef-10eaf9c3bdda tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.333357 Jul 28 11:53:54.523697 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2559/5130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:53 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:55.543707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:55.544775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:55.553608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:55.554288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:55.555274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:55.555888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:56.638017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:56.645997 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5734562-c857-4ea8-8668-9107ea64bf30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1366 microversion: 2.1 time: 1.112344 Jul 28 11:53:56.646580 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2572/5131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:55 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1366 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:57.667775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:57.669027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:57.679803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:57.684581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:57.685753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:57.686361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:58.051527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:53:58.065207 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0745b9b-596f-49c3-a6cc-de02d330c05e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1556 microversion: 2.1 time: 0.401894 Jul 28 11:53:58.066425 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2560/5132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:53:57 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1556 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:53:58.093619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:53:58.094885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:53:58.110639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:58.115641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:58.118490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:53:58.122468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:53:58.325565 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b98d65c8-c30d-4830-93ad-077415cbb069 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236393 Jul 28 11:53:58.326286 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2573/5133] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:53:58 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:00.784557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5eaf79de-19a0-42f2-889e-9831501a92f2 req-5b22fc3c-22f2-4e7e-8875-84239cf3c242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f3d970-c95b-4126-8ae5-511cf410c7ea", "tag": "a5268822-38d3-4f31-a721-78133a0f4d07"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:00.811498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5eaf79de-19a0-42f2-889e-9831501a92f2 req-5b22fc3c-22f2-4e7e-8875-84239cf3c242 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:00.813672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5eaf79de-19a0-42f2-889e-9831501a92f2 req-5b22fc3c-22f2-4e7e-8875-84239cf3c242 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:00.849119 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5eaf79de-19a0-42f2-889e-9831501a92f2 req-5b22fc3c-22f2-4e7e-8875-84239cf3c242 service nova] Creating event network-changed:a5268822-38d3-4f31-a721-78133a0f4d07 for instance c0f3d970-c95b-4126-8ae5-511cf410c7ea on n-h1-851368-1 Jul 28 11:54:00.862948 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5eaf79de-19a0-42f2-889e-9831501a92f2 req-5b22fc3c-22f2-4e7e-8875-84239cf3c242 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083060 Jul 28 11:54:00.868096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2561/5134] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:28.556831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:28.562551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=27 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:28.573450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:28.579343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:54:28.611101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:28.611562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:28.612809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:28.620878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:31.792169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:54:31.852304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:54:31.877579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:54:31.892668 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79db4880-f9a7-4750-a89b-2ac3a4a4ffc2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2945 microversion: 2.32 time: 3.339242 Jul 28 11:54:31.895536 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2574/5135] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:54:28 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2945 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:54:31.923373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:31.923373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:54:31.948970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=17 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:31.951198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=53 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:31.953192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:31.953650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:31.954505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:31.955125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:32.577813 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9869419d-2d86-4b22-ad32-e865ea89a144 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.660341 Jul 28 11:54:32.581903 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2562/5136] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 11:54:31 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c/os-interface => generated 1831 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:54:46.002106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:46.002868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:46.405488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38485146-4299-4803-8c3f-5710585a73ef tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2066607456", "availability_zone": "foo_zone"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:46.495533 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:46.495533 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:46.498288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.aggregate [None req-38485146-4299-4803-8c3f-5710585a73ef tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Generated uuid 27267fab-a29c-4670-873b-ebfffe0c7eff for aggregate {{(pid=119235) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 11:54:46.511183 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38485146-4299-4803-8c3f-5710585a73ef tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] [7e6317d1-6469-4ac0-a2cf-13efe80257ce] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 11:54:47.520587 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [None req-38485146-4299-4803-8c3f-5710585a73ef tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] [7e6317d1-6469-4ac0-a2cf-13efe80257ce] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 43488. Jul 28 11:54:47.593728 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38485146-4299-4803-8c3f-5710585a73ef tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.594790 Jul 28 11:54:47.604773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:47.606878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:54:47.611972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5083e71-52a1-41f5-acb5-a52019193848 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:47.612670 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2575/5137] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Jul 28 11:54:45 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:47.616257 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:47.616257 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:54:47.718344 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5083e71-52a1-41f5-acb5-a52019193848 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.115400 Jul 28 11:54:47.719920 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2563/5138] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:54:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:47.731628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:47.735104 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:47.735104 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:47.740989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:47.741454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:47.742405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:47.755014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:47.891116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45577161-c61e-4e83-ba1b-575ae7636953 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.163022 Jul 28 11:54:47.897708 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2576/5139] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Jul 28 11:54:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:47.903254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b320d10-9a19-464c-88c9-a0ac698c6594 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:47.904371 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:47.904371 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:54:47.918917 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b320d10-9a19-464c-88c9-a0ac698c6594 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019615 Jul 28 11:54:47.932729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2564/5140] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Jul 28 11:54:47 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:47.937779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76cd2730-e6bc-409c-b860-d35f0bb5d929 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851368-1"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:47.945010 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:47.945010 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:47.986696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76cd2730-e6bc-409c-b860-d35f0bb5d929 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:47.988182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76cd2730-e6bc-409c-b860-d35f0bb5d929 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:48.923584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76cd2730-e6bc-409c-b860-d35f0bb5d929 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.989399 Jul 28 11:54:48.926539 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2577/5141] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:54:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:48.935471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-280d314e-8bcd-4abe-94e7-e6b9ec7027f8 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:48.937013 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:48.937013 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:54:48.972767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-280d314e-8bcd-4abe-94e7-e6b9ec7027f8 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.038829 Jul 28 11:54:48.978485 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2565/5142] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:54:48 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:48.986289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80ce9be2-a509-4ea9-b8db-2b337e353c9c tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1054499841", "availability_zone": "foo_zone"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:49.249507 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:49.249507 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:49.399488 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80ce9be2-a509-4ea9-b8db-2b337e353c9c tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.416956 Jul 28 11:54:49.405935 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2578/5143] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Jul 28 11:54:48 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:49.412583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3a12358-be99-4477-98af-e2abc9f367da tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:49.416658 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:49.416658 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:54:49.479010 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3a12358-be99-4477-98af-e2abc9f367da tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.069043 Jul 28 11:54:49.483435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2566/5144] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:54:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:49.493773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-004e3ee0-4b48-4f99-a26f-55c3f2d1b149 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:49.494585 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:49.494585 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:49.514132 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-004e3ee0-4b48-4f99-a26f-55c3f2d1b149 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.025179 Jul 28 11:54:49.514817 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2579/5145] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jul 28 11:54:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:49.526426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f148694a-0f34-4ca0-b4a7-c1059e325e87 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851368-1"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:54:49.529609 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:49.529609 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 11:54:49.541598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f148694a-0f34-4ca0-b4a7-c1059e325e87 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:54:49.542323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f148694a-0f34-4ca0-b4a7-c1059e325e87 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:54:49.997620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f148694a-0f34-4ca0-b4a7-c1059e325e87 tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.475271 Jul 28 11:54:50.003478 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2567/5146] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Jul 28 11:54:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:54:50.016084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b25b3644-b80d-41cc-aeec-512e1ecaac9d tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:54:50.017571 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:54:50.017571 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 11:54:50.072649 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b25b3644-b80d-41cc-aeec-512e1ecaac9d tempest-TestAggregatesBasicOps-846822695 tempest-TestAggregatesBasicOps-846822695-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.062572 Jul 28 11:54:50.074040 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2580/5147] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 11:54:50 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 11:55:04.841973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:04.843624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:04.848032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:04.848765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:04.873049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:04.884772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:04.885641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:04.886112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:05.005202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd616233-8e82-4459-aa05-494bf995daf0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/ips" status: 200 len: 150 microversion: 2.1 time: 0.164825 Jul 28 11:55:05.018281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2568/5148] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:55:04 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/ips => generated 150 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:55:08.258644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00821400-5193-432d-b7ee-f08636897f2d"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:08.261113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:08.266199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:08.270041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:08.272040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:08.284940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:08.287712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:08.288819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:08.295899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:09.455187 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06d2dc37-1857-4659-be10-23075ae8b41c tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.213565 Jul 28 11:55:09.456519 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2581/5149] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:55:08 2022] POST /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 194 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:55:26.832646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c333f1b-df08-48f7-8673-89bef55c5581 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: .version_select at 0x7f2eb2881310>, body: {"keypair": {"name": "tempest-keypair-1474236734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkzp8Wx5ZS4h1v09/oPJdb35DRBP+wuK0UB4zGeIaEh6XumGYtcOAgS/9WW3Cnv9PwH2k+X5M2+fYFIodUuF26dwLHUpfblDehKorzYqk11yhwbOD4wErp7qDPmReXe+w=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:26.842260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:26.856603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9c333f1b-df08-48f7-8673-89bef55c5581 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:55:26.862954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9c333f1b-df08-48f7-8673-89bef55c5581 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:55:26.903951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c333f1b-df08-48f7-8673-89bef55c5581 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078453 Jul 28 11:55:26.916261 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2569/5150] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:55:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:55:30.220198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267644141", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3441235-2c87-4705-8e5e-070086c01f1c"}], "security_groups": [{"name": "tempest-securitygroup--2024629621"}], "key_name": "tempest-keypair-1474236734", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:30.275339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:30.276119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:30.577131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] validate_networks() for [('a3441235-2c87-4705-8e5e-070086c01f1c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:55:31.613679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:55:31.616842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:55:31.617334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:55:31.617803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:55:31.618745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:55:31.638085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:31.640582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:31.641434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:31.641870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:31.685966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:55:31.698075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:55:31.731462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:55:31.733849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:55:31.866189 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45e43503-a401-4a71-935c-5d88d0b0aa68 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.657325 Jul 28 11:55:31.868211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2582/5151] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:55:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:55:31.880588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-415c5807-911e-47a9-90fd-131b5834b994 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:31.890108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-415c5807-911e-47a9-90fd-131b5834b994 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:32.899516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-415c5807-911e-47a9-90fd-131b5834b994 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:32.917692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-415c5807-911e-47a9-90fd-131b5834b994 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1241 microversion: 2.1 time: 1.035940 Jul 28 11:55:32.932988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2570/5152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:31 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1241 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:33.943088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:33.943961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:33.953464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:33.961789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:33.963800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:33.969116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:34.102965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:34.114874 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34e8a2cf-538a-4a80-8611-13c4cae7e27e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1299 microversion: 2.1 time: 0.177183 Jul 28 11:55:34.119487 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2583/5153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:33 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:34.149100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1975145509", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2506aba9-b543-429e-9b76-4a85aca1bba4"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:34.215055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] validate_networks() for [('2506aba9-b543-429e-9b76-4a85aca1bba4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:55:34.875369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:55:34.876427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:55:34.876963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:55:34.877555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:55:34.878412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:55:34.892417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:34.893131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:34.894219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:34.894884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:34.924160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Getting quotas for project 3c4f32a65d424e1693f6d8f3f3bd4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:55:34.931334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Getting quotas for user 5571ef6d92814dbab639da99b0e2c581 and project 3c4f32a65d424e1693f6d8f3f3bd4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:55:34.951168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:55:34.953986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:55:35.019947 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c214376c-220e-4b17-8317-aa12f3f81213 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874479 Jul 28 11:55:35.021565 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2571/5154] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:55:35.050710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-baa84ad0-2e1d-4fc4-b6fe-9a9352e982e9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:35.051999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-baa84ad0-2e1d-4fc4-b6fe-9a9352e982e9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:35.143361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:35.144517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:35.177957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:35.184183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:35.185494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:35.187724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:35.275638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-baa84ad0-2e1d-4fc4-b6fe-9a9352e982e9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:35.283601 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-baa84ad0-2e1d-4fc4-b6fe-9a9352e982e9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1219 microversion: 2.1 time: 0.252778 Jul 28 11:55:35.286718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2584/5155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:35 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:35.374728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:35.388249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b595be41-7e91-4292-8855-f46683e8e5a0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1299 microversion: 2.1 time: 0.253493 Jul 28 11:55:35.399291 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2572/5156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:35 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:36.311525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:36.314159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:36.338717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:36.340423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:36.343676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:36.346311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:36.423884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:36.425230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:36.441205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:36.441888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:36.449362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:36.450639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:36.545898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:36.565278 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6a748170-3ff7-45c1-8d1a-8c91ad5e35a5 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1215 microversion: 2.1 time: 0.261773 Jul 28 11:55:36.576930 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2585/5157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:36 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:36.863878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:36.875590 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a82fdbf9-cc90-40a7-b3f6-181558947a98 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.459388 Jul 28 11:55:36.888228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2573/5158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:36 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:37.598215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:37.598980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:37.612470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:37.615114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:37.616423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:37.617127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:37.787571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:37.800687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac7a3ad0-ab8c-4a86-8965-66e2d1f9443b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1277 microversion: 2.1 time: 0.207282 Jul 28 11:55:37.815130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2586/5159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:37 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:37.904582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:37.905321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:37.917879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:37.918797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:37.919853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:37.920565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:38.602812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:38.616604 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04cc79b7-69c4-49d7-b995-b25fc5393393 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.715727 Jul 28 11:55:38.633469 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2574/5160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:37 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:38.827319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:38.828703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:38.846180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:38.846911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:38.847899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:38.848494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:39.061020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:39.070700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b7157d7-8d0a-4ad2-98c1-0072a6485f7b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1277 microversion: 2.1 time: 0.252651 Jul 28 11:55:39.081866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2587/5161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:38 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:39.645255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:39.645989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:39.663974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:39.664449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:39.665968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:39.671446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:39.931679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b7ee598e-1941-4136-88b2-c8bfbfe5b81c req-1797f454-33ea-42bc-8ea7-a3247789dd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d27f0a-da4c-4d4b-aa70-b32fadf8f299", "tag": "ea9f4287-b75b-4344-989a-c9d7dfe7aa75"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:39.953188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b7ee598e-1941-4136-88b2-c8bfbfe5b81c req-1797f454-33ea-42bc-8ea7-a3247789dd45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:39.953635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b7ee598e-1941-4136-88b2-c8bfbfe5b81c req-1797f454-33ea-42bc-8ea7-a3247789dd45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:39.996920 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b7ee598e-1941-4136-88b2-c8bfbfe5b81c req-1797f454-33ea-42bc-8ea7-a3247789dd45 service nova] Creating event network-changed:ea9f4287-b75b-4344-989a-c9d7dfe7aa75 for instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 on n-h1-851368-1 Jul 28 11:55:40.010421 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b7ee598e-1941-4136-88b2-c8bfbfe5b81c req-1797f454-33ea-42bc-8ea7-a3247789dd45 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090958 Jul 28 11:55:40.013457 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2588/5162] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:55:40.097674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:40.099396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:40.127502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:40.127984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:40.128800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:40.129239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:41.048067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:41.065573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-062c91b6-da42-4acd-a488-714f94a01ca5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 1.426198 Jul 28 11:55:41.066173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2575/5163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:39 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:41.216995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:41.247339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7b08f98-0267-4da5-925e-2c347ea4ab0e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 1.147915 Jul 28 11:55:41.249395 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2589/5164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:40 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:42.102612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:42.105225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:42.128295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:42.128886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:42.130190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:42.136342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:42.285076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:42.286328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:42.289266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:42.322011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:42.323312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:42.325663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:42.326535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:42.711861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:42.721393 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7748cc68-7663-4281-8fd1-eeed5bd93984 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.637810 Jul 28 11:55:42.724405 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2576/5165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:42 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:42.738055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ee8bf68f-1c05-4a24-b199-e2453ab2a90a req-36b7b6d4-124d-40ae-9229-81c00a26075e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f748b6e-a671-455a-8ed3-8df06ae3d0dc", "tag": "efec08be-7ffa-4aec-976d-5a49425c1bee"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:42.760960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee8bf68f-1c05-4a24-b199-e2453ab2a90a req-36b7b6d4-124d-40ae-9229-81c00a26075e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:42.761789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ee8bf68f-1c05-4a24-b199-e2453ab2a90a req-36b7b6d4-124d-40ae-9229-81c00a26075e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:42.785167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ee8bf68f-1c05-4a24-b199-e2453ab2a90a req-36b7b6d4-124d-40ae-9229-81c00a26075e service nova] Creating event network-changed:efec08be-7ffa-4aec-976d-5a49425c1bee for instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc on n-h2-851368-1 Jul 28 11:55:42.797841 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ee8bf68f-1c05-4a24-b199-e2453ab2a90a req-36b7b6d4-124d-40ae-9229-81c00a26075e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069704 Jul 28 11:55:42.801894 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2577/5166] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:55:42.982967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:42.993708 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14425c14-25ad-43bc-8d43-df96c9b02480 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.715742 Jul 28 11:55:42.998217 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2590/5167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:42 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:43.745692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:43.746849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:43.762347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:43.762810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:43.765460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:43.768419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:44.003188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:44.021064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:44.021698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:44.030930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d18cf32-6f31-4447-a201-c11a34b5432f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.290366 Jul 28 11:55:44.032618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2578/5168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:43 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:44.034707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:44.035216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:44.036567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:44.037019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:44.358531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:44.369757 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-44f41837-54b3-44d1-ba34-c93b961ffc14 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.353141 Jul 28 11:55:44.370743 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2591/5169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:44 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:45.063094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:45.065987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:45.079552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:45.081696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:45.099978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:45.102894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:45.109173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:45.112544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:45.391783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:45.392495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:45.402678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:55:45.409142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:45.409685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:45.414017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:45.414648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:45.485879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:45.497872 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fbddf24-6a56-4b73-b581-0ed494624db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.447390 Jul 28 11:55:45.502529 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2579/5170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:45 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:46.240472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:46.265038 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d9894bd-2f71-4b4f-b8f1-e6f58c205f34 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.877114 Jul 28 11:55:46.279268 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2592/5171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:45 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:46.528974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:46.530355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:46.551296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:46.557488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:46.558439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:46.558890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:46.906088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:46.915915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fff9dc48-9e39-4681-8b1c-fcbfdce631d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.391369 Jul 28 11:55:46.917361 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2580/5172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:46 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:47.285916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:47.286754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:47.303655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:47.306336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:47.308626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:47.309925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:47.505800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:47.517580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f4e976ef-7531-45a5-9d69-97e65b51ec80 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.235680 Jul 28 11:55:47.518162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2593/5173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:47 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:47.937926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:47.939623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:47.963013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:47.964023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:47.966118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:47.966797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:48.168071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:48.179571 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee55df56-f622-4751-9a86-72baf50234ea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.246191 Jul 28 11:55:48.192442 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2581/5174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:47 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:48.492667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-408b4968-2ae2-47a9-8ac3-5f73ac2b5c31 req-048d95ae-249e-417c-b934-19edea0b3b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d27f0a-da4c-4d4b-aa70-b32fadf8f299", "name": "network-vif-plugged", "status": "completed", "tag": "ea9f4287-b75b-4344-989a-c9d7dfe7aa75"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:48.510551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-408b4968-2ae2-47a9-8ac3-5f73ac2b5c31 req-048d95ae-249e-417c-b934-19edea0b3b9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:48.511304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-408b4968-2ae2-47a9-8ac3-5f73ac2b5c31 req-048d95ae-249e-417c-b934-19edea0b3b9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:48.528390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-408b4968-2ae2-47a9-8ac3-5f73ac2b5c31 req-048d95ae-249e-417c-b934-19edea0b3b9d service nova] Creating event network-vif-plugged:ea9f4287-b75b-4344-989a-c9d7dfe7aa75 for instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 on n-h1-851368-1 Jul 28 11:55:48.537899 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-408b4968-2ae2-47a9-8ac3-5f73ac2b5c31 req-048d95ae-249e-417c-b934-19edea0b3b9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050932 Jul 28 11:55:48.538370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:48.538995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:48.539264 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2594/5175] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:55:48.551649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:48.552378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:48.555976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:48.556704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:48.900417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:48.917050 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a886296-3406-4005-b4e8-a2a79428da75 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.382783 Jul 28 11:55:48.917987 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2582/5176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:48 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:49.202578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:49.203330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:49.212225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:49.212935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:49.214288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:49.214896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:49.499270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:49.507824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9d40813-d45b-4101-956d-b9aeffbcc10b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.310422 Jul 28 11:55:49.508091 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2595/5177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:49 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:49.938012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:49.938676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:49.948588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:49.948914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:49.950093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:49.950682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:50.228914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:50.255781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cadef08-6d69-495a-88b7-a5966b69ee79 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.321830 Jul 28 11:55:50.257733 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2583/5178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:49 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:50.528351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:50.529235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:50.536386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:50.536911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:50.538291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:50.538799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:50.620692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-60810f29-3dd2-43cc-9f7f-61861bcf8de8 req-57801a8c-f02d-43e3-96bb-b85f9909451b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f748b6e-a671-455a-8ed3-8df06ae3d0dc", "name": "network-vif-plugged", "status": "completed", "tag": "efec08be-7ffa-4aec-976d-5a49425c1bee"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:50.641352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-60810f29-3dd2-43cc-9f7f-61861bcf8de8 req-57801a8c-f02d-43e3-96bb-b85f9909451b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:50.642083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-60810f29-3dd2-43cc-9f7f-61861bcf8de8 req-57801a8c-f02d-43e3-96bb-b85f9909451b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:50.664448 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-60810f29-3dd2-43cc-9f7f-61861bcf8de8 req-57801a8c-f02d-43e3-96bb-b85f9909451b service nova] Creating event network-vif-plugged:efec08be-7ffa-4aec-976d-5a49425c1bee for instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc on n-h2-851368-1 Jul 28 11:55:50.673928 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-60810f29-3dd2-43cc-9f7f-61861bcf8de8 req-57801a8c-f02d-43e3-96bb-b85f9909451b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058743 Jul 28 11:55:50.674761 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2584/5179] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:55:50.725101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:50.737924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6bd7da0-3775-45c0-89a2-07617c4e5f71 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1367 microversion: 2.1 time: 0.213120 Jul 28 11:55:50.738825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2596/5180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:50 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:51.282285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:51.283492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:51.303976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:51.304435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:51.305222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:51.305678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:51.498421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:51.506209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a3df63e7-238f-49b5-81a4-95fdb7d44e07 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1319 microversion: 2.1 time: 0.231685 Jul 28 11:55:51.520247 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2585/5181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:51 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:51.766906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:51.768084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:51.777484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:51.778131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:51.779346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:51.780636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:52.067164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:52.075774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec46ebcc-8426-4486-9e1b-b7b8ff31c478 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1557 microversion: 2.1 time: 0.313894 Jul 28 11:55:52.076427 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2597/5182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:51 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1557 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:52.097211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:52.097726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:52.105336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:52.105797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:52.106577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:52.108512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:52.264731 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b01e72a-6ac8-43ea-80b1-61551571160a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171512 Jul 28 11:55:52.265888 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2586/5183] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:55:52 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:55:52.531265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:55:52.533526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:55:52.544641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:52.549366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:52.550531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:52.551175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:52.940203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:55:52.965722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd77c65d-fe74-413b-ba0d-ca2f9d26563a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1509 microversion: 2.1 time: 0.426980 Jul 28 11:55:52.966696 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2598/5184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:55:52 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:55:54.629225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-20148780-119d-4c00-b6c4-57cb391a85c0 req-5de9812f-74d0-47c3-8df7-1ecbb86c255b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d27f0a-da4c-4d4b-aa70-b32fadf8f299", "tag": "ea9f4287-b75b-4344-989a-c9d7dfe7aa75"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:55:54.649241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20148780-119d-4c00-b6c4-57cb391a85c0 req-5de9812f-74d0-47c3-8df7-1ecbb86c255b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:55:54.651780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20148780-119d-4c00-b6c4-57cb391a85c0 req-5de9812f-74d0-47c3-8df7-1ecbb86c255b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:55:54.676398 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-20148780-119d-4c00-b6c4-57cb391a85c0 req-5de9812f-74d0-47c3-8df7-1ecbb86c255b service nova] Creating event network-changed:ea9f4287-b75b-4344-989a-c9d7dfe7aa75 for instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 on n-h1-851368-1 Jul 28 11:55:54.710962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-20148780-119d-4c00-b6c4-57cb391a85c0 req-5de9812f-74d0-47c3-8df7-1ecbb86c255b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292520 Jul 28 11:55:54.714027 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2587/5185] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:17.588383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "874afe3e-86eb-4358-8e5e-e932566218d3", "device": "/dev/sdb"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:17.591282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:17.598108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:17.599424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=84 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:17.606681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:17.607162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:17.608127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:17.608572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:17.892275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8a41389-486d-41c7-85f0-8bacc2ba68ee tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "POST /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308374 Jul 28 11:56:17.892928 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2599/5186] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:56:17 2022] POST /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:38.302732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:38.304028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=84 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:38.539198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:38.539811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:38.556095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:38.556484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:38.557260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:38.557698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:38.587665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:56:38.686273 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ae94579-6a32-4093-9ff6-412626225452 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 204 len: 0 microversion: 2.32 time: 0.386043 Jul 28 11:56:38.687161 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2588/5187] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:56:38 2022] DELETE /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:56:38.693892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:38.694702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:38.698894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:38.699637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:38.707204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:38.707853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:38.708681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:38.709154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:38.896676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:38.906161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:38.907674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:38.909155 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4cc67c5-6672-4d03-bf65-fcb7809a8f33 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2951 microversion: 2.32 time: 0.217478 Jul 28 11:56:38.909721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2600/5188] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:38 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2951 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:39.941411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:39.942122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:39.949842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:39.950482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:39.951302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:39.951748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:40.193095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:40.203190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:40.205328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:40.206843 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7110d398-3c78-4102-b0ca-971be05cd5f7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2951 microversion: 2.32 time: 0.269893 Jul 28 11:56:40.224448 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2589/5189] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:39 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2951 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:41.236902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:41.237800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:41.245650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:41.246183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:41.247049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:41.247617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:41.487921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:41.499921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:41.502037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:41.503584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0cff71dc-1245-41e5-a632-66c0257f072d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2951 microversion: 2.32 time: 0.272843 Jul 28 11:56:41.504187 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2601/5190] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:41 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2951 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:42.531756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:42.532359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:42.546866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:42.547358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:42.548141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:42.548582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:42.937755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:42.961626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:42.977181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:42.978957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fab9310-b685-4918-8e78-e1ac052086a5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2930 microversion: 2.32 time: 0.451439 Jul 28 11:56:42.980151 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2590/5191] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:42 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2930 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:43.507324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:43.508191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:43.517957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:43.518593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:43.519928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:43.521377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:43.524083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-815e2915-5d89-4517-bb90-85774c02172e req-9c7f571c-0230-4f82-871a-a3ea94bc92ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-deleted", "tag": "ebcb42f2-afe9-4414-b679-500abf344176"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:43.533899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-815e2915-5d89-4517-bb90-85774c02172e req-9c7f571c-0230-4f82-871a-a3ea94bc92ab service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:43.534985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-815e2915-5d89-4517-bb90-85774c02172e req-9c7f571c-0230-4f82-871a-a3ea94bc92ab service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:43.566184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-815e2915-5d89-4517-bb90-85774c02172e req-9c7f571c-0230-4f82-871a-a3ea94bc92ab service nova] Creating event network-vif-deleted:ebcb42f2-afe9-4414-b679-500abf344176 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:43.573012 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-815e2915-5d89-4517-bb90-85774c02172e req-9c7f571c-0230-4f82-871a-a3ea94bc92ab service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053394 Jul 28 11:56:43.574974 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2591/5192] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:56:43.652498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lazy-loading 'services' on Instance uuid 7f748b6e-a671-455a-8ed3-8df06ae3d0dc {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:56:43.736654 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f1be820-0bde-4409-82a5-bb400721b960 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc/os-volume_attachments/874afe3e-86eb-4358-8e5e-e932566218d3" status: 202 len: 0 microversion: 2.1 time: 0.234802 Jul 28 11:56:43.737949 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2602/5193] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:56:43 2022] DELETE /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc/os-volume_attachments/874afe3e-86eb-4358-8e5e-e932566218d3 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:56:44.007007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:44.007755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:44.015846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:44.016342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:44.017087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:44.017522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:44.172005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:44.181681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:44.183230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:44.184518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-48688f95-65c1-443c-aa73-c96777c18e27 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2703 microversion: 2.32 time: 0.181792 Jul 28 11:56:44.185111 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2592/5194] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:44 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2703 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:44.815023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-263b46b2-a567-4fe3-aec1-0a79f0cc7ff7 req-2f099324-dc87-4ecb-965d-49e7f31981b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "b2e949ed-7b99-480b-946f-45f3b750f2a9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:44.833706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-263b46b2-a567-4fe3-aec1-0a79f0cc7ff7 req-2f099324-dc87-4ecb-965d-49e7f31981b6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:44.834163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-263b46b2-a567-4fe3-aec1-0a79f0cc7ff7 req-2f099324-dc87-4ecb-965d-49e7f31981b6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:44.876703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-263b46b2-a567-4fe3-aec1-0a79f0cc7ff7 req-2f099324-dc87-4ecb-965d-49e7f31981b6 service nova] Creating event network-vif-unplugged:b2e949ed-7b99-480b-946f-45f3b750f2a9 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:44.918881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-263b46b2-a567-4fe3-aec1-0a79f0cc7ff7 req-2f099324-dc87-4ecb-965d-49e7f31981b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189331 Jul 28 11:56:44.920542 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2603/5195] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:45.211666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:45.212394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:45.228536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:45.230325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:45.231161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:45.238052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:45.603814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-deleted", "tag": "84e3b817-4c85-49a7-86bd-632a3dc72aa8"}, {"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-deleted", "tag": "e710460c-5df7-41b9-bec1-22225c568f23"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:45.619901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:45.632661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:45.633421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:45.634899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:45.638439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:45.639755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84f57b36-69eb-4bbc-afc4-d5f1666500c3 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2657 microversion: 2.32 time: 0.434427 Jul 28 11:56:45.651004 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2593/5196] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:45 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2657 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:45.682340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] Creating event network-vif-deleted:84e3b817-4c85-49a7-86bd-632a3dc72aa8 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:45.683946 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] Creating event network-vif-deleted:e710460c-5df7-41b9-bec1-22225c568f23 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:45.703016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fd641da2-3fad-4361-bebf-1beb8375eaba req-4184824c-878e-4d62-bcba-c8f4365a1e8a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105057 Jul 28 11:56:45.706445 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2604/5197] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:46.681207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:46.682868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:46.698633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:46.699486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:46.703248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:46.703248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:46.984417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:46.996784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:47.007389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:47.009174 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c03ff84-9aee-48d0-8646-fcd3586ba287 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 2212 microversion: 2.32 time: 0.334757 Jul 28 11:56:47.009992 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2594/5198] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:46 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 2212 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:47.015477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-08aa8b39-7cc4-4abd-8e08-e91710095828 req-a10d9da6-b3a5-439c-b482-b76e9d4d71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "629a90ad-31bd-4e98-bdc8-4b2fb2fbab50"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:47.049063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-08aa8b39-7cc4-4abd-8e08-e91710095828 req-a10d9da6-b3a5-439c-b482-b76e9d4d71d3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:47.049525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-08aa8b39-7cc4-4abd-8e08-e91710095828 req-a10d9da6-b3a5-439c-b482-b76e9d4d71d3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:47.107866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-08aa8b39-7cc4-4abd-8e08-e91710095828 req-a10d9da6-b3a5-439c-b482-b76e9d4d71d3 service nova] Creating event network-vif-unplugged:629a90ad-31bd-4e98-bdc8-4b2fb2fbab50 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:47.113183 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-08aa8b39-7cc4-4abd-8e08-e91710095828 req-a10d9da6-b3a5-439c-b482-b76e9d4d71d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103086 Jul 28 11:56:47.116203 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2605/5199] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:56:47.850744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-deleted", "tag": "b2e949ed-7b99-480b-946f-45f3b750f2a9"}, {"server_uuid": "bb8242a3-6a27-4c84-835f-1b8604364c6c", "name": "network-vif-deleted", "tag": "629a90ad-31bd-4e98-bdc8-4b2fb2fbab50"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:47.863047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:47.863524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:47.876398 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] Creating event network-vif-deleted:b2e949ed-7b99-480b-946f-45f3b750f2a9 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:47.876930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] Creating event network-vif-deleted:629a90ad-31bd-4e98-bdc8-4b2fb2fbab50 for instance bb8242a3-6a27-4c84-835f-1b8604364c6c on n-h2-851368-1 Jul 28 11:56:47.882186 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c7e00ac2-24b5-40ba-bef4-256a47ee5c2b req-db07ef41-a08e-4b4a-8e98-3515f63cc2f8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035634 Jul 28 11:56:47.883178 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2595/5200] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:48.039466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:48.040167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:48.046654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:48.047142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:48.047938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:48.048513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:48.122479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:48.132297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:48.134226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:48.135621 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39be54a3-6d82-4d68-9d8f-9e87c9d8f226 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.101543 Jul 28 11:56:48.149019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2606/5201] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:48 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:49.159630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:49.161142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:49.167917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:49.168455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:49.169287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:49.169789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:49.239115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:49.248296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:49.249799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:49.251231 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ec4f005-b295-4e50-96f1-fa993b98eb2f tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.097125 Jul 28 11:56:49.251999 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2596/5202] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:49 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:50.049573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:50.050069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:50.060987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.061447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.062231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.062678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.096069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:56:50.196028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73a31837-8d98-4a38-9d29-7285cfc7e153 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 204 len: 0 microversion: 2.1 time: 0.149176 Jul 28 11:56:50.197772 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2607/5203] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:56:50 2022] DELETE /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:56:50.206812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:50.207533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:50.222906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.223933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.224923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.225518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.276217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:50.277206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:50.292358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.292358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.293094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:50.293719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:50.428247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:50.439034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:50.440566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:50.441766 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7cb3b77d-c00d-4ac0-81d8-9277a82afc22 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.169791 Jul 28 11:56:50.448251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:50.455823 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b059c44f-35a2-403b-a583-37da708881ff tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1515 microversion: 2.1 time: 0.253362 Jul 28 11:56:50.458186 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2597/5204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:56:50 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:56:50.458411 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2608/5205] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:50 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:51.477902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:51.479816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:51.480997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:51.486334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:51.490161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:51.490912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:51.491970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:51.495139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:51.501336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:51.501835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:51.502662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:51.503327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:51.676879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:51.685321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:51.691818 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ec01370-8ff5-41c8-9423-a3dec232d998 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1515 microversion: 2.1 time: 0.215603 Jul 28 11:56:51.693590 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2609/5206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:56:51 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:56:51.707087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:51.709516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:51.711157 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41f6abe9-c5ca-4322-9f5b-34082e6e3874 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.243687 Jul 28 11:56:51.718028 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2598/5207] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:51 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:52.722123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a8172b99-6d4c-4c99-928f-9f10afc268a5 req-6370be52-2d4e-4ab9-bffc-90805159b947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f748b6e-a671-455a-8ed3-8df06ae3d0dc", "name": "network-vif-deleted", "tag": "efec08be-7ffa-4aec-976d-5a49425c1bee"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:52.723676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:52.725510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:52.735793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:52.736715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:52.737846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:52.738686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:52.748392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a8172b99-6d4c-4c99-928f-9f10afc268a5 req-6370be52-2d4e-4ab9-bffc-90805159b947 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:52.749005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a8172b99-6d4c-4c99-928f-9f10afc268a5 req-6370be52-2d4e-4ab9-bffc-90805159b947 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:52.787596 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a8172b99-6d4c-4c99-928f-9f10afc268a5 req-6370be52-2d4e-4ab9-bffc-90805159b947 service nova] Creating event network-vif-deleted:efec08be-7ffa-4aec-976d-5a49425c1bee for instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc on n-h2-851368-1 Jul 28 11:56:52.808874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a8172b99-6d4c-4c99-928f-9f10afc268a5 req-6370be52-2d4e-4ab9-bffc-90805159b947 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092876 Jul 28 11:56:52.822791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:52.823043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2599/5208] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:52.834167 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9696de7b-495c-41f4-8f23-851ec2f6d16f tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 200 len: 1473 microversion: 2.1 time: 0.122116 Jul 28 11:56:52.835334 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2610/5209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:56:52 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 1473 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:56:52.838355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:52.845115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:52.858207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:52.859029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:52.860094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:52.865169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:52.946433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:52.968690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:52.974255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:52.976328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ed626f1-fd48-4407-81f4-7b49fa0035e0 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.151069 Jul 28 11:56:52.977404 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2600/5210] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:52 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:53.855625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:53.856441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 7f748b6e-a671-455a-8ed3-8df06ae3d0dc] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:53.863600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:53.864418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:53.865766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:53.866306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:53.880168 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] HTTP exception thrown: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Request method failure captured: Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc HTTP/1.1 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4ni4bq2rS0VMzkG9uQfsYXjbEklEXERO_beKxCwWj6YT37oxanq--zPokGgtFI18XixU0BY7EFKrCEt9irmjQ5GrmOM8_8b3XV1bWcVv7Q5RozCRyurTtgAu99pBIeVy2dJqywRHBH-LEdXASf9kUOa2s7qtO4U5HWoViBZ6ts1QtDQ Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3c4f32a65d424e1693f6d8f3f3bd4aba Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}] Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3c4f32a65d424e1693f6d8f3f3bd4aba Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesSnapshotTestJSON-1357915886-project Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5571ef6d92814dbab639da99b0e2c581 Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesSnapshotTestJSON-1357915886-project Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7f748b6e-a671-455a-8ed3-8df06ae3d0dc'} Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:56:53.893129 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Returning 404 to user: Instance 7f748b6e-a671-455a-8ed3-8df06ae3d0dc could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:56:53.898457 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2434459c-f483-472d-9b23-2e248fc1cd09 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc" status: 404 len: 111 microversion: 2.1 time: 0.044932 Jul 28 11:56:53.899042 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2611/5211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:56:53 2022] GET /compute/v2.1/servers/7f748b6e-a671-455a-8ed3-8df06ae3d0dc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:56:54.000980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:54.003253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:54.015181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:54.015679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:54.016523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:54.017033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:54.097764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:54.118958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:54.121136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:54.123862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10dc348e-ee3f-44e8-a6e0-ac67451632a2 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.128433 Jul 28 11:56:54.124965 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2601/5212] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:53 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:55.148147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:55.149315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:55.157870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:55.158488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:55.159484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:55.160075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:55.280237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:55.305704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:55.318610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:55.320221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a8bae58-96e6-43e5-9707-ecd125dd4531 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.176182 Jul 28 11:56:55.321421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2612/5213] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:55 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:56.345762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:56.346528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:56.353978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:56.354561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:56.355540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:56.356136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:56.479481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:56.490472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:56.492165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:56.493597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-32ddc2fa-98b8-4d5e-a3ec-28ec0047f17c tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.152326 Jul 28 11:56:56.494915 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2602/5214] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:56 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:57.526348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:57.527086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:57.544070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:57.544634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:57.545514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:57.546090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:57.625143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:57.635754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:57.637512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:57.638814 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25852f1f-ef27-482c-8ba9-d70c73b60de5 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.117133 Jul 28 11:56:57.639653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2613/5215] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:57 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 11:56:58.662621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:58.663418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:58.671109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:58.671570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:58.672818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:58.673260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:58.750837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:58.760665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:58.762168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:58.773904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00b62b1a-3792-475e-bed8-b791fe155f71 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.115359 Jul 28 11:56:58.774491 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2603/5216] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:58 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:56:59.713860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:59.714932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:59.729993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.730706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.731713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.732315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.782154 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f756e51a-204c-4852-9cd7-266697b64a0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/ips" status: 200 len: 149 microversion: 2.1 time: 0.071965 Jul 28 11:56:59.783255 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2614/5217] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:56:59 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:56:59.797688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00821400-5193-432d-b7ee-f08636897f2d"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:56:59.807259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:59.809549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:56:59.811196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:56:59.820477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.823778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.825288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.826296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.826909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.827531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.828512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:56:59.831638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:56:59.963668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:56:59.966611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/os-volume_attachments HTTP/1.1 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 74 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: {"volumeAttachment": {"volumeId": "00821400-5193-432d-b7ee-f08636897f2d"}} Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '11d27f0a-da4c-4d4b-aa70-b32fadf8f299', 'body': {'volumeAttachment': {'volumeId': '00821400-5193-432d-b7ee-f08636897f2d'}}} Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:56:59.975106 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea Jul 28 11:56:59.979800 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:56:59.988690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:56:59.992764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 400 to user: Invalid volume: volume 00821400-5193-432d-b7ee-f08636897f2d is already attached to instances: c0f3d970-c95b-4126-8ae5-511cf410c7ea {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:56:59.993683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ff3e878-4f61-4f21-af20-de309cef69b0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200110 Jul 28 11:56:59.997635 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2604/5218] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:56:59 2022] POST /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299/os-volume_attachments => generated 174 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:57:00.002295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:00.004378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:00.005852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55a036ff-4d45-4b4a-842d-baafc424ad2d tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.206451 Jul 28 11:57:00.006914 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2615/5219] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:56:59 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:00.012016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:00.012780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:00.019520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:00.021418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:00.023704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:00.024985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:00.088231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:57:00.230127 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0902db9f-ff76-4654-940a-18896250fd2a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 204 len: 0 microversion: 2.1 time: 0.227979 Jul 28 11:57:00.230904 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2605/5220] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:56:59 2022] DELETE /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:57:00.242012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:00.242542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:00.255398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:00.256796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:00.257879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:00.258561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:00.610254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:00.619924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3c7f0717-fc14-4d56-8f78-b0b0c3739d60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1681 microversion: 2.1 time: 0.384685 Jul 28 11:57:00.633654 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2616/5221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:00 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1681 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:01.033146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:01.035968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:01.046693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:01.054244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1182275737", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2506aba9-b543-429e-9b76-4a85aca1bba4"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:01.064717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:01.065950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:01.066659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:01.149626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] validate_networks() for [('2506aba9-b543-429e-9b76-4a85aca1bba4', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:57:01.175574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:01.190570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:01.203763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:01.205280 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d167313f-aac0-4444-ab86-43a3ceedef6e tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.176528 Jul 28 11:57:01.219584 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2606/5222] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:01 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:01.643919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:01.644701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:01.667961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:01.668333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:01.693150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:01.693769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:01.960201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:01.979307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-505a46bb-f5d5-4a53-871a-ef1e954b67b1 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1681 microversion: 2.1 time: 0.341667 Jul 28 11:57:01.980237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2607/5223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:01 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:57:02.233260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:02.233880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:02.244442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:02.248425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:02.252255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:02.252733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:02.255937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:57:02.257236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:57:02.257956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:57:02.258603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:57:02.259279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:57:02.270451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:02.271331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:02.272372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:02.273365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:02.287579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:02.299358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Getting quotas for project 3c4f32a65d424e1693f6d8f3f3bd4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:57:02.315548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Getting quotas for user 5571ef6d92814dbab639da99b0e2c581 and project 3c4f32a65d424e1693f6d8f3f3bd4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:57:02.361345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:57:02.364255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:57:02.370664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:02.381144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:02.384087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:02.385469 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e49c5674-2a87-495b-aed8-eca5517decfc tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.159135 Jul 28 11:57:02.386648 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2608/5224] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:02 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:02.457624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c4080d1-0ebc-4232-89a0-cd5431c97c0c tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408837 Jul 28 11:57:02.458764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2617/5225] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:57:02.469389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3a621c19-82e8-4b7c-9b4b-9259ba9c6296 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:02.470252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3a621c19-82e8-4b7c-9b4b-9259ba9c6296 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:02.591785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3a621c19-82e8-4b7c-9b4b-9259ba9c6296 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:02.599789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3a621c19-82e8-4b7c-9b4b-9259ba9c6296 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1219 microversion: 2.1 time: 0.134489 Jul 28 11:57:02.600386 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2609/5226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:02 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:03.001783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:03.002408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:03.021435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.022169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.023239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.024509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.155530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:03.169130 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70f4b365-6f26-4ccc-8680-4edfef93f9aa tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1613 microversion: 2.1 time: 0.171536 Jul 28 11:57:03.169754 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2618/5227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:02 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1613 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:03.410860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:03.411494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:03.420384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.421241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.422289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.422895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.473209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5234d464-8cd0-4b53-a37a-7231c325cdc7 req-4bd7d09c-3383-4cb4-a90b-1e0aa49a2e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d27f0a-da4c-4d4b-aa70-b32fadf8f299", "name": "network-vif-deleted", "tag": "ea9f4287-b75b-4344-989a-c9d7dfe7aa75"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:03.486891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5234d464-8cd0-4b53-a37a-7231c325cdc7 req-4bd7d09c-3383-4cb4-a90b-1e0aa49a2e60 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.487496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5234d464-8cd0-4b53-a37a-7231c325cdc7 req-4bd7d09c-3383-4cb4-a90b-1e0aa49a2e60 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.533504 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5234d464-8cd0-4b53-a37a-7231c325cdc7 req-4bd7d09c-3383-4cb4-a90b-1e0aa49a2e60 service nova] Creating event network-vif-deleted:ea9f4287-b75b-4344-989a-c9d7dfe7aa75 for instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 on n-h1-851368-1 Jul 28 11:57:03.546062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5234d464-8cd0-4b53-a37a-7231c325cdc7 req-4bd7d09c-3383-4cb4-a90b-1e0aa49a2e60 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076874 Jul 28 11:57:03.549190 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2619/5228] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:57:03.564175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:03.574847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:03.576562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:03.577769 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d0c1ebd-643c-4bb3-b6f3-e8375aaa4dc6 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.170974 Jul 28 11:57:03.579383 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2610/5229] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:03 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:03.623865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:03.624843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:03.637613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.638459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.638862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:03.639337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:03.799971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:03.809175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b285baf-1585-4579-9b86-e50ddc061ddd tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1215 microversion: 2.1 time: 0.190903 Jul 28 11:57:03.813212 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2620/5230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:03 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:04.192736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:04.193785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:04.203991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.204785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.205775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.206438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.293860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.294657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.296271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'fault' on Instance uuid 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:57:04.438112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:04.451956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5aa243b-66ed-4688-9b80-455089c622e8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 200 len: 1331 microversion: 2.1 time: 0.263321 Jul 28 11:57:04.452818 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2611/5231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:04 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 1331 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:04.606449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:04.607340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:04.616815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.617627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.618513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.633986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.745425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:04.767723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:04.770574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:04.773275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d55cb087-62fe-4afd-97d4-cda2db1dca02 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.170752 Jul 28 11:57:04.774499 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2621/5232] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:04 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:04.832255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:04.833005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:04.849860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.850496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.851479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:04.852036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:04.980222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:04.994881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da3f0a08-3456-4db0-9803-fd52b1336364 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1277 microversion: 2.1 time: 0.166001 Jul 28 11:57:04.996789 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2612/5233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:04 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:05.476428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:05.477688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:05.489943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:05.490674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:05.492986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:05.494361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:05.527182 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 HTTP/1.1 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '11d27f0a-da4c-4d4b-aa70-b32fadf8f299'} Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:05.532133 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 11:57:05.537398 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:05.539445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:05.541312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1af19769-38ff-4a9f-9d19-a18e2cc8151b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 404 len: 111 microversion: 2.1 time: 0.070897 Jul 28 11:57:05.552105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d79e591-eb99-4d7c-b962-90f3c29b517b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '.version_select at 0x7f2eb27f1d30>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:05.553531 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2622/5234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:05 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:57:05.599862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3d79e591-eb99-4d7c-b962-90f3c29b517b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474236734" status: 202 len: 0 microversion: 2.1 time: 0.051830 Jul 28 11:57:05.600494 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2613/5235] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 11:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474236734 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 11:57:05.805002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:05.806303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:05.818362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:05.822723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:05.825830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:05.826837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:05.930888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:05.949686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:05.951718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e55b800bc55f4eda98f8756caca122f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540f145b3dea4f158c024ba16dc71f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:05.952978 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6381a6fa-5750-494f-85e3-32be9dae8749 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 200 len: 1605 microversion: 2.32 time: 0.155745 Jul 28 11:57:05.960083 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2623/5236] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:05 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 11:57:06.017496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:06.018122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:06.026275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.026727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.027545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.027982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.375842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:06.385600 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ec9292f-30e8-4272-b615-e359b27886ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1319 microversion: 2.1 time: 0.372074 Jul 28 11:57:06.390586 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2614/5237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:06 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:06.662676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-77c9a917-fb4e-405b-9c3f-1934daf7fa40 req-0fec4e15-cf22-4161-a397-1d70eade2831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a77195-87dc-4748-8bb5-4b1da6b82da8", "tag": "635b4efb-a60c-4617-a8cb-d3951db3ea3c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:06.709471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-77c9a917-fb4e-405b-9c3f-1934daf7fa40 req-0fec4e15-cf22-4161-a397-1d70eade2831 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.710382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-77c9a917-fb4e-405b-9c3f-1934daf7fa40 req-0fec4e15-cf22-4161-a397-1d70eade2831 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.742931 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-77c9a917-fb4e-405b-9c3f-1934daf7fa40 req-0fec4e15-cf22-4161-a397-1d70eade2831 service nova] Creating event network-changed:635b4efb-a60c-4617-a8cb-d3951db3ea3c for instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 on n-h2-851368-1 Jul 28 11:57:06.791702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-77c9a917-fb4e-405b-9c3f-1934daf7fa40 req-0fec4e15-cf22-4161-a397-1d70eade2831 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124454 Jul 28 11:57:06.793251 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2624/5238] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:06.885531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:06.886225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:06.893961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.894414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.895965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.896581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.986465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:06.987785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:06.995023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.995677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:06.996930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:06.997370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:07.004497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'services' on Instance uuid c0f3d970-c95b-4126-8ae5-511cf410c7ea {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:57:07.038927 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] HTTP exception thrown: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Request method failure captured: Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c HTTP/1.1 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nf0ejQ7RUubGvBu40K_tChuNM5vVhHJjegFGhW4x8iHonpH0SPEsymkpZh5l5iA-CogIVMcbtsRIFo6cVo9taHi1NK8COPBzA33Z6gMO_Fzqfa0H83KLN8gIR_tM61RcztbSdgZBt6flifxScscG5uZalgNluMr3JlmEQB8RsO59h4 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}] Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e55b800bc55f4eda98f8756caca122f4 Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bb8242a3-6a27-4c84-835f-1b8604364c6c'} Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:07.040886 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:07.045724 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:07.047277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Returning 404 to user: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:07.048305 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2c73039-d3b4-4072-9e7a-d17bac7b4730 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 404 len: 111 microversion: 2.32 time: 0.067433 Jul 28 11:57:07.053174 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2625/5239] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:06 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 11:57:07.058074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca2c7e23-ff41-4186-9e2f-471554592ae7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '.version_select at 0x7f2eb19c6040>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:07.081958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca2c7e23-ff41-4186-9e2f-471554592ae7 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404836476" status: 204 len: 0 microversion: 2.32 time: 0.027354 Jul 28 11:57:07.083211 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2626/5240] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 11:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404836476 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 11:57:07.094535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc2af7ce-f9cf-4837-be37-71d7d23c47e0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments/00821400-5193-432d-b7ee-f08636897f2d" status: 202 len: 0 microversion: 2.1 time: 0.211860 Jul 28 11:57:07.095189 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2615/5241] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:57:06 2022] DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments/00821400-5193-432d-b7ee-f08636897f2d => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:57:07.119701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:07.122025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:07.130675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:07.131444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:07.132215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:07.132835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:07.169592 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d27d6128-257c-4971-8e73-cded123c4e97 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064819 Jul 28 11:57:07.170817 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2627/5242] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:07 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:07.410384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:07.411147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:07.417585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:07.418046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:07.418833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:07.419302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:07.628375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:07.639183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a99a9193-b48f-440d-86f1-c70c8146bf4e tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1319 microversion: 2.1 time: 0.232742 Jul 28 11:57:07.640024 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2616/5243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:07 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:08.185808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:08.188261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:08.205046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:08.205522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:08.208166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:08.208696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:08.281924 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3472f16d-dce7-4943-ae0d-73954e0916d8 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102448 Jul 28 11:57:08.282837 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2628/5244] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:08 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:08.661401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:08.662017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:08.669134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:08.694048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:08.694508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:08.700675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:08.701563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:09.152146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:09.163516 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e23a399a-d163-4e03-97ae-00bba6d328eb tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1319 microversion: 2.1 time: 0.506195 Jul 28 11:57:09.164221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2617/5245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:08 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:09.293793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:09.296202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:09.303089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:09.304750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:09.305364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:09.306910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:09.307567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:09.382086 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21a88b23-f379-4bb7-9f1b-c13c08cfc37a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092084 Jul 28 11:57:09.382664 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2629/5246] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:09 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:10.188536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:10.189273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:10.197821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:10.198651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:10.199718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:10.200264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:10.404749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:10.415852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:10.416075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:10.425891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c66178a6-d64d-4058-a821-6b11fd86cb8a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1319 microversion: 2.1 time: 0.241938 Jul 28 11:57:10.427752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:10.428816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:10.431783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:10.436662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:10.440165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2618/5247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:10 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:10.502686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-600db988-221a-4373-9bb2-a782f74f69c6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105723 Jul 28 11:57:10.503300 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2630/5248] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:10 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:10.878762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-59262092-b0f1-47e8-9f3c-ef2039eed626 req-03d27cc1-4fc5-4610-a175-e2cffca002f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a77195-87dc-4748-8bb5-4b1da6b82da8", "name": "network-vif-plugged", "status": "completed", "tag": "635b4efb-a60c-4617-a8cb-d3951db3ea3c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:10.918909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-59262092-b0f1-47e8-9f3c-ef2039eed626 req-03d27cc1-4fc5-4610-a175-e2cffca002f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:10.919453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-59262092-b0f1-47e8-9f3c-ef2039eed626 req-03d27cc1-4fc5-4610-a175-e2cffca002f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:10.971388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-59262092-b0f1-47e8-9f3c-ef2039eed626 req-03d27cc1-4fc5-4610-a175-e2cffca002f9 service nova] Creating event network-vif-plugged:635b4efb-a60c-4617-a8cb-d3951db3ea3c for instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 on n-h2-851368-1 Jul 28 11:57:10.978559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-59262092-b0f1-47e8-9f3c-ef2039eed626 req-03d27cc1-4fc5-4610-a175-e2cffca002f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104107 Jul 28 11:57:10.980212 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2619/5249] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:11.389036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:11.389885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:11.396652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.397243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.398160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.398693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.413286 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] HTTP exception thrown: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Request method failure captured: Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c HTTP/1.1 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nf0ejQ7RUubGvBu40K_tChuNM5vVhHJjegFGhW4x8iHonpH0SPEsymkpZh5l5iA-CogIVMcbtsRIFo6cVo9taHi1NK8COPBzA33Z6gMO_Fzqfa0H83KLN8gIR_tM61RcztbSdgZBt6flifxScscG5uZalgNluMr3JlmEQB8RsO59h4 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}] Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e55b800bc55f4eda98f8756caca122f4 Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'bb8242a3-6a27-4c84-835f-1b8604364c6c'} Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:11.414998 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Returning 404 to user: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:11.419725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9fe2bedd-8497-438a-b2f2-9dc222024632 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 404 len: 111 microversion: 2.32 time: 0.032879 Jul 28 11:57:11.420595 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2631/5250] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 11:57:11 2022] DELETE /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:57:11.429140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:11.429911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] [instance: bb8242a3-6a27-4c84-835f-1b8604364c6c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:11.441157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.441809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.442711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.448130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:11.448966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:11.452589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.458522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.459252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.460167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.460756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.474994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] HTTP exception thrown: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Request method failure captured: Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c HTTP/1.1 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nf0ejQ7RUubGvBu40K_tChuNM5vVhHJjegFGhW4x8iHonpH0SPEsymkpZh5l5iA-CogIVMcbtsRIFo6cVo9taHi1NK8COPBzA33Z6gMO_Fzqfa0H83KLN8gIR_tM61RcztbSdgZBt6flifxScscG5uZalgNluMr3JlmEQB8RsO59h4 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_540f145b3dea4f158c024ba16dc71f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/540f145b3dea4f158c024ba16dc71f23"}]}] Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 540f145b3dea4f158c024ba16dc71f23 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420167722 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e55b800bc55f4eda98f8756caca122f4 Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TaggedBootDevicesTest-420167722-project Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bb8242a3-6a27-4c84-835f-1b8604364c6c'} Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:11.477114 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. Jul 28 11:57:11.481959 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:11.484395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] Returning 404 to user: Instance bb8242a3-6a27-4c84-835f-1b8604364c6c could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:11.485502 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45b61d50-b6fe-4bd3-acca-4c5ef53190d4 tempest-TaggedBootDevicesTest-420167722 tempest-TaggedBootDevicesTest-420167722-project] 10.222.0.93 "GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c" status: 404 len: 111 microversion: 2.32 time: 0.061340 Jul 28 11:57:11.486609 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2620/5251] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 11:57:11 2022] GET /compute/v2.1/servers/bb8242a3-6a27-4c84-835f-1b8604364c6c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:57:11.522387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:11.526239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:11.534116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.536506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.538102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:11.538566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:11.584634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f14889b-bc0c-410c-8059-fad1381ee543 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073077 Jul 28 11:57:11.585600 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2621/5252] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:11 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:57:11.665161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:11.673005 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb34e962-55ce-4340-a8ad-9e1769c8e282 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1319 microversion: 2.1 time: 0.228875 Jul 28 11:57:11.673573 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2632/5253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:11 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:12.596507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:12.599264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:12.602134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:12.608135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.608598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:12.609373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.609821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:12.613539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:12.653404 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07a9a20f-1a85-46a7-a65d-7a89b6f22ea7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055061 Jul 28 11:57:12.653404 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2622/5254] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:12 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:12.694013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:12.694681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:12.696606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:12.697295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:12.703992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.704448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:12.705233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.705675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:12.853361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:12.863140 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ca764102-d0ef-4ca7-b2dc-69f326102d4b tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1508 microversion: 2.1 time: 0.173158 Jul 28 11:57:12.876028 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2633/5255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:12 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:12.887431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059a7ef1-68cf-4b44-8e0e-26b98d0149dd", "device": "/dev/sdb"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:12.890078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:12.896900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.897361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:12.898143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:12.898742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.353318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-445de40f-59db-4dbf-921c-69c3af4ce1b4 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "POST /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469947 Jul 28 11:57:13.354306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2623/5256] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:57:12 2022] POST /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:13.663277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:13.665378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:13.671648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.672260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.673057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.673503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.713726 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac4154c8-a16d-41e0-bd7f-d381b956b0fb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056878 Jul 28 11:57:13.715285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2634/5257] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:57:13 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:57:13.781731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:13.782266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:13.794749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.797452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.799200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.800537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.830618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:57:13.925842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33d9f2ff-b83b-4d30-a6e1-cd051c9a9797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 204 len: 0 microversion: 2.1 time: 0.149012 Jul 28 11:57:13.926451 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2624/5258] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:57:13 2022] DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:57:13.934822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:13.935610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:13.943402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.943871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:13.945025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:13.945478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:14.110457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:14.132904 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-528b65b0-f00c-4202-b515-5bccb87fef15 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1681 microversion: 2.1 time: 0.202038 Jul 28 11:57:14.146100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2635/5259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:13 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:15.155966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:15.156676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:15.164376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:15.164827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:15.165610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:15.166056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:15.317099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:15.324866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d93259a0-1f3d-438b-935d-4c13b74a2f52 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1681 microversion: 2.1 time: 0.173153 Jul 28 11:57:15.325442 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2625/5260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:15 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:16.348847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:16.349580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:16.357225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:16.357990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:16.358996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:16.359656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:16.492232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:16.501182 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ebad790-66c2-453f-9f64-8199d1945b78 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1614 microversion: 2.1 time: 0.157189 Jul 28 11:57:16.502666 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2636/5261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:16 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:17.406271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5270a9af-2ef2-4c51-866c-21510f059006 req-c24f00d1-02f0-4cd8-8fe9-700242748224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f3d970-c95b-4126-8ae5-511cf410c7ea", "name": "network-vif-deleted", "tag": "a5268822-38d3-4f31-a721-78133a0f4d07"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:17.426695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5270a9af-2ef2-4c51-866c-21510f059006 req-c24f00d1-02f0-4cd8-8fe9-700242748224 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:17.427184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5270a9af-2ef2-4c51-866c-21510f059006 req-c24f00d1-02f0-4cd8-8fe9-700242748224 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:17.455135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5270a9af-2ef2-4c51-866c-21510f059006 req-c24f00d1-02f0-4cd8-8fe9-700242748224 service nova] Creating event network-vif-deleted:a5268822-38d3-4f31-a721-78133a0f4d07 for instance c0f3d970-c95b-4126-8ae5-511cf410c7ea on n-h1-851368-1 Jul 28 11:57:17.468186 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5270a9af-2ef2-4c51-866c-21510f059006 req-c24f00d1-02f0-4cd8-8fe9-700242748224 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066073 Jul 28 11:57:17.469530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2626/5262] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:17.526228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:17.526857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:17.538942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:17.539435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:17.540224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:17.540668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:17.614992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:17.620019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:17.622704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'fault' on Instance uuid c0f3d970-c95b-4126-8ae5-511cf410c7ea {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:57:17.698755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:17.708984 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8686fdb7-92ef-4f46-8e2b-2856723afcea tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 200 len: 1331 microversion: 2.1 time: 0.186524 Jul 28 11:57:17.712115 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2637/5263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:17 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:18.733870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:18.739497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:18.752156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:18.752971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:18.754084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:18.754743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:18.772459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea HTTP/1.1 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c0f3d970-c95b-4126-8ae5-511cf410c7ea'} Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:18.775057 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 11:57:18.779254 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:57:18.781211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:18.782453 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-220e5849-4957-4c3a-9dee-19b670406797 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 404 len: 111 microversion: 2.1 time: 0.052723 Jul 28 11:57:18.785993 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2627/5264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:18 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:57:18.792052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-40092d8e-55c0-47fd-a586-6c298690f123 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '.version_select at 0x7f2eb19ed160>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:18.837951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-40092d8e-55c0-47fd-a586-6c298690f123 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952314151" status: 202 len: 0 microversion: 2.1 time: 0.049603 Jul 28 11:57:18.838825 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2638/5265] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952314151 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:57:19.703139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a182a2c-0d18-40fb-9e7a-05fd420bb684 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: .version_select at 0x7f2eb26274c0>, body: {"keypair": {"name": "tempest-keypair-597232638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWAk65aI5kw0AJ0O2srCbWFGjBtLdLESQwBgYKF7TY1UJYRt9Lp4/gXKZdkm8dNLO/GO0EKS03qojc/XAlghcjevt6JIdHBwcD4HFkTlj/pQHwf9wxGs9BbD/a0WyHBBg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:19.737033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5a182a2c-0d18-40fb-9e7a-05fd420bb684 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:57:19.754051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5a182a2c-0d18-40fb-9e7a-05fd420bb684 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:57:19.809045 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a182a2c-0d18-40fb-9e7a-05fd420bb684 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111148 Jul 28 11:57:19.809736 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2628/5266] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:57:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:21.682649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-841990821", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3441235-2c87-4705-8e5e-070086c01f1c"}], "security_groups": [{"name": "tempest-securitygroup--796206125"}], "key_name": "tempest-keypair-597232638", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:21.818355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] validate_networks() for [('a3441235-2c87-4705-8e5e-070086c01f1c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:57:22.462732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:57:22.463479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:57:22.463986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:57:22.464565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:57:22.465062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:57:22.489342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:22.489881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:22.490751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:22.491290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:22.523876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:57:22.534296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:57:22.549104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:57:22.552265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:57:22.621129 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46d5dc00-a59a-4ff5-a6b5-0fcd0db35a7a tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.943883 Jul 28 11:57:22.626032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2639/5267] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:57:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:57:22.644732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2d3ae39-9b66-45b5-b05b-59ba8c577dc9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:22.647545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2d3ae39-9b66-45b5-b05b-59ba8c577dc9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:22.725450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2d3ae39-9b66-45b5-b05b-59ba8c577dc9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:22.734004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2d3ae39-9b66-45b5-b05b-59ba8c577dc9 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1240 microversion: 2.1 time: 0.101050 Jul 28 11:57:22.736594 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2629/5268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:22 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:23.757938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:23.767639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:23.776717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:23.777177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:23.778045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:23.778496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:23.784286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:23.852858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:23.862456 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c0a3b06a-4d67-4816-ab92-7fe151f19401 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1292 microversion: 2.1 time: 0.109510 Jul 28 11:57:23.871162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2640/5269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:23 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1292 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:24.884630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:24.885306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:24.902169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:24.902697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:24.903602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:24.904114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:25.227682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:25.243874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04de8caf-cdb6-47b9-9ab3-8b08d624bbad tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.362851 Jul 28 11:57:25.245456 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2630/5270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:24 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:26.026057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1d2d36a6-6f96-42d5-9544-ccc6b1638528 req-3e768a5a-bd29-4217-8acb-cebeeb8291f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e1ea2d-3a5c-4697-9bc2-74f058e1610e", "tag": "6f08d2b5-5263-439b-81c6-4c2334745007"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:26.063280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1d2d36a6-6f96-42d5-9544-ccc6b1638528 req-3e768a5a-bd29-4217-8acb-cebeeb8291f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:26.064438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1d2d36a6-6f96-42d5-9544-ccc6b1638528 req-3e768a5a-bd29-4217-8acb-cebeeb8291f0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:26.103389 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1d2d36a6-6f96-42d5-9544-ccc6b1638528 req-3e768a5a-bd29-4217-8acb-cebeeb8291f0 service nova] Creating event network-changed:6f08d2b5-5263-439b-81c6-4c2334745007 for instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e on n-h1-851368-1 Jul 28 11:57:26.113731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1d2d36a6-6f96-42d5-9544-ccc6b1638528 req-3e768a5a-bd29-4217-8acb-cebeeb8291f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096001 Jul 28 11:57:26.115607 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2641/5271] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:26.266009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:26.266643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:26.277601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:26.278055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:26.278856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:26.279324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:26.475061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:26.483744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2912fb99-99f5-48fd-a11b-19fb36667c12 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.221542 Jul 28 11:57:26.484344 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2631/5272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:26 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:27.510760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:27.512073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:27.519017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:27.520718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:27.521684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:27.522225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:27.696790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:27.702817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa99a0e5-f768-4277-81c1-f2ceb3ee064b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.199954 Jul 28 11:57:27.709671 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2642/5273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:27 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:28.725041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:28.725488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:28.735591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:28.736037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:28.736829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:28.737273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:29.021455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:29.032087 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2ecbf742-a253-4253-a7e8-434d6a01b27b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.310881 Jul 28 11:57:29.035380 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2632/5274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:28 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:30.056837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:30.058135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:30.067982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:30.070324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:30.071359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:30.071810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:30.409286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:30.428240 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5dcab94-5550-4d75-a43a-171be8164ce5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.375376 Jul 28 11:57:30.441713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2643/5275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:30 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:30.624246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c020220c-e6dc-43d1-b14d-aaccc7aea303 req-a1507cc0-c37a-4baf-992e-476e437f3633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e1ea2d-3a5c-4697-9bc2-74f058e1610e", "name": "network-vif-plugged", "status": "completed", "tag": "6f08d2b5-5263-439b-81c6-4c2334745007"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:30.646571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c020220c-e6dc-43d1-b14d-aaccc7aea303 req-a1507cc0-c37a-4baf-992e-476e437f3633 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:30.650531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c020220c-e6dc-43d1-b14d-aaccc7aea303 req-a1507cc0-c37a-4baf-992e-476e437f3633 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:30.692524 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c020220c-e6dc-43d1-b14d-aaccc7aea303 req-a1507cc0-c37a-4baf-992e-476e437f3633 service nova] Creating event network-vif-plugged:6f08d2b5-5263-439b-81c6-4c2334745007 for instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e on n-h1-851368-1 Jul 28 11:57:30.698223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c020220c-e6dc-43d1-b14d-aaccc7aea303 req-a1507cc0-c37a-4baf-992e-476e437f3633 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079336 Jul 28 11:57:30.699462 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2633/5276] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:31.448279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:31.448916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:31.460044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:31.460493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:31.467453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:31.468154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:31.912781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:31.912781 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d3c1e76a-1f1c-48aa-a3eb-2f66ef866b20 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1365 microversion: 2.1 time: 0.376994 Jul 28 11:57:31.912781 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2644/5277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:31 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:32.857804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:32.858556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:32.867491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:32.885747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:32.886430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:32.888889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:32.890815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:33.182409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:33.193178 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6849af1f-4094-46af-b96c-034b6f312011 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1556 microversion: 2.1 time: 0.349504 Jul 28 11:57:33.194625 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2634/5278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:32 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1556 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:33.216088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:33.216611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:33.225820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:33.226847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:33.229547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:33.230698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:33.231429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:33.232294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:33.335961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2632d5f-4f09-48b6-9ab5-010baef10930 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123673 Jul 28 11:57:33.336785 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2645/5279] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:57:33 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:35.728158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7b7957a8-bd32-4911-81f9-df005295f094 req-ac84cd9e-4f5b-4767-838f-fedb3fcd5cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e1ea2d-3a5c-4697-9bc2-74f058e1610e", "tag": "6f08d2b5-5263-439b-81c6-4c2334745007"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:35.767900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7b7957a8-bd32-4911-81f9-df005295f094 req-ac84cd9e-4f5b-4767-838f-fedb3fcd5cfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:35.768529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7b7957a8-bd32-4911-81f9-df005295f094 req-ac84cd9e-4f5b-4767-838f-fedb3fcd5cfd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:35.805871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7b7957a8-bd32-4911-81f9-df005295f094 req-ac84cd9e-4f5b-4767-838f-fedb3fcd5cfd service nova] Creating event network-changed:6f08d2b5-5263-439b-81c6-4c2334745007 for instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e on n-h1-851368-1 Jul 28 11:57:35.823497 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7b7957a8-bd32-4911-81f9-df005295f094 req-ac84cd9e-4f5b-4767-838f-fedb3fcd5cfd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.423624 Jul 28 11:57:35.827323 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2635/5280] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:44.882249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:44.883418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=28 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:44.890766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:44.900362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:44.909188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:44.910204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:44.910984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:44.911443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:45.027239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lazy-loading 'services' on Instance uuid 36a77195-87dc-4748-8bb5-4b1da6b82da8 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:57:45.131249 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa0e2431-760c-4df9-a900-af85bc0d4569 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8/os-volume_attachments/059a7ef1-68cf-4b44-8e0e-26b98d0149dd" status: 202 len: 0 microversion: 2.1 time: 0.251004 Jul 28 11:57:45.134537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2646/5281] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:57:44 2022] DELETE /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8/os-volume_attachments/059a7ef1-68cf-4b44-8e0e-26b98d0149dd => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:57:51.277310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:51.278077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:57:51.407012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2067348819", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "9ca92afa-d41b-423e-a8cd-8f2ca39b374b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:51.462999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] validate_networks() for [('9ca92afa-d41b-423e-a8cd-8f2ca39b374b', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:57:51.988167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:57:51.988909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:57:51.989653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:57:51.990526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:57:51.991161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:57:52.007417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:52.007887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:52.009057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:52.010094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:52.050673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Getting quotas for project af2f7f56048c4673a96cc783ae867475. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:57:52.053345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Getting quotas for user 90d259fda0b4410087d397661d5a56ea and project af2f7f56048c4673a96cc783ae867475. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:57:52.079871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:57:52.084703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:57:52.146635 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8a0a1c6b-9b1c-475e-9046-2025496a00ee tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870959 Jul 28 11:57:52.147519 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2636/5282] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:57:52.160157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b953252d-7a39-4548-9da0-ec369cab06db tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:52.160927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b953252d-7a39-4548-9da0-ec369cab06db tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:52.286610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b953252d-7a39-4548-9da0-ec369cab06db tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:52.297117 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b953252d-7a39-4548-9da0-ec369cab06db tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1217 microversion: 2.1 time: 0.142346 Jul 28 11:57:52.298098 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2647/5283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:52 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:53.133308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:53.135240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:53.151765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.153300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.155175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.155860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.188235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:57:53.320972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:53.322244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:53.340957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-00c2ce38-8010-4b92-aeb7-f15d374084ac tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 204 len: 0 microversion: 2.1 time: 0.213302 Jul 28 11:57:53.345795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2637/5284] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:57:53 2022] DELETE /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:57:53.354439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:53.355182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:53.362957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.363445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.364289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.364734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.366100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.368488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.372329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:53.375753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:53.503767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:53.515663 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d9f5e732-a08e-4aa4-bd4b-1005ddcfb552 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1269 microversion: 2.1 time: 0.201516 Jul 28 11:57:53.519521 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2648/5285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:53 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1269 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:57:53.644015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:53.653439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-09411a8d-b0cf-4a1c-99bc-88153f781e47 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1514 microversion: 2.1 time: 0.304785 Jul 28 11:57:53.671268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2638/5286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:53 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:54.540597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:54.541509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:54.549889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:54.555711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:54.556331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:54.556927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:54.686288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:54.687704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:54.694148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:54.705386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:54.707024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:54.710250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:54.711566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:54.715882 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-70372153-9dc6-476f-955e-5a1dc6d647b3 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1277 microversion: 2.1 time: 0.179220 Jul 28 11:57:54.718643 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2649/5287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:54 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:54.917744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:54.928779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d350ba6-12a2-4e55-bbf2-cdf45eea79a8 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1514 microversion: 2.1 time: 0.254311 Jul 28 11:57:54.939243 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2639/5288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:54 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:55.739061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:55.739824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:55.756237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:55.760475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:55.761594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:55.762773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:55.951515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:55.952141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:55.974019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:55.974019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:55.974390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:55.974845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:56.580862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5571ef6d92814dbab639da99b0e2c581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4f32a65d424e1693f6d8f3f3bd4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:56.593726 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc6cd06e-478c-4692-b543-dac38eacd86a tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 200 len: 1472 microversion: 2.1 time: 0.646065 Jul 28 11:57:56.613128 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2640/5289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:55 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:56.628937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-346afea5-0c41-4d24-bd93-e88df3e7bac9 req-45cddead-00a3-495f-be85-de5c0119ee96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a77195-87dc-4748-8bb5-4b1da6b82da8", "name": "network-vif-deleted", "tag": "635b4efb-a60c-4617-a8cb-d3951db3ea3c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:56.655150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-346afea5-0c41-4d24-bd93-e88df3e7bac9 req-45cddead-00a3-495f-be85-de5c0119ee96 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:56.655605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-346afea5-0c41-4d24-bd93-e88df3e7bac9 req-45cddead-00a3-495f-be85-de5c0119ee96 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:56.678906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-346afea5-0c41-4d24-bd93-e88df3e7bac9 req-45cddead-00a3-495f-be85-de5c0119ee96 service nova] Creating event network-vif-deleted:635b4efb-a60c-4617-a8cb-d3951db3ea3c for instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 on n-h2-851368-1 Jul 28 11:57:56.693209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-346afea5-0c41-4d24-bd93-e88df3e7bac9 req-45cddead-00a3-495f-be85-de5c0119ee96 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078675 Jul 28 11:57:56.699334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2641/5290] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:56.749041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:56.764898 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62986ac4-65d9-4823-8d74-455def9f83c9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1317 microversion: 2.1 time: 1.030684 Jul 28 11:57:56.772270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2650/5291] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:55 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1317 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:57.068003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-678879ee-b8c3-4aa7-ac02-0acc0db37f27 req-a1f5efb7-82ed-48e3-9c12-9a634011793f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29a8a58-1a92-413e-891e-c5b111b5c494", "tag": "03baebe0-048c-4e2b-875a-6665ece191c5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:57:57.091166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-678879ee-b8c3-4aa7-ac02-0acc0db37f27 req-a1f5efb7-82ed-48e3-9c12-9a634011793f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:57.091821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-678879ee-b8c3-4aa7-ac02-0acc0db37f27 req-a1f5efb7-82ed-48e3-9c12-9a634011793f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:57.131581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-678879ee-b8c3-4aa7-ac02-0acc0db37f27 req-a1f5efb7-82ed-48e3-9c12-9a634011793f service nova] Creating event network-changed:03baebe0-048c-4e2b-875a-6665ece191c5 for instance e29a8a58-1a92-413e-891e-c5b111b5c494 on n-h2-851368-1 Jul 28 11:57:57.143893 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-678879ee-b8c3-4aa7-ac02-0acc0db37f27 req-a1f5efb7-82ed-48e3-9c12-9a634011793f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078926 Jul 28 11:57:57.145385 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2642/5292] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:57:57.618620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:57.619280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] [instance: 36a77195-87dc-4748-8bb5-4b1da6b82da8] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:57.625442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:57.626099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:57.627063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:57.628393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:57.643345 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] HTTP exception thrown: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Request method failure captured: Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 HTTP/1.1 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4ni4bq2rS0VMzkG9uQfsYXjbEklEXERO_beKxCwWj6YT37oxanq--zPokGgtFI18XixU0BY7EFKrCEt9irmjQ5GrmOM8_8b3XV1bWcVv7Q5RozCRyurTtgAu99pBIeVy2dJqywRHBH-LEdXASf9kUOa2s7qtO4U5HWoViBZ6ts1QtDQ Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 3c4f32a65d424e1693f6d8f3f3bd4aba Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3c4f32a65d424e1693f6d8f3f3bd4aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3c4f32a65d424e1693f6d8f3f3bd4aba"}]}] Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 3c4f32a65d424e1693f6d8f3f3bd4aba Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1357915886 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesSnapshotTestJSON-1357915886-project Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 5571ef6d92814dbab639da99b0e2c581 Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesSnapshotTestJSON-1357915886-project Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '36a77195-87dc-4748-8bb5-4b1da6b82da8'} Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:57:57.644910 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. Jul 28 11:57:57.649604 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:57:57.651204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] Returning 404 to user: Instance 36a77195-87dc-4748-8bb5-4b1da6b82da8 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:57:57.652084 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3101b455-5c1e-4787-8637-9f99d60c1ae9 tempest-VolumesSnapshotTestJSON-1357915886 tempest-VolumesSnapshotTestJSON-1357915886-project] 10.222.0.93 "GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8" status: 404 len: 111 microversion: 2.1 time: 0.037423 Jul 28 11:57:57.652656 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2651/5293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:57 2022] GET /compute/v2.1/servers/36a77195-87dc-4748-8bb5-4b1da6b82da8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:57:57.795559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:57.797852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:57.807371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:57.808148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:57.809768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:57.811727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:58.016607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:58.030722 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5f2c94e-7085-42c1-b49b-276589754cf5 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1317 microversion: 2.1 time: 0.238914 Jul 28 11:57:58.031909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2643/5294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:57 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:57:59.070298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:57:59.074048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:57:59.103146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:59.104020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:59.105450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:57:59.106162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:57:59.347156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:57:59.356171 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb2f095c-e22a-40e9-bb09-fc9447b12b2d tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1317 microversion: 2.1 time: 0.305058 Jul 28 11:57:59.357523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2652/5295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:57:59 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:00.378780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:00.379291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:00.396096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:00.397177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:00.400277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:00.400739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:00.642467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:00.652110 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e538c073-f3ba-42de-871e-e428972b29c8 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1317 microversion: 2.1 time: 0.278030 Jul 28 11:58:00.653467 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2644/5296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:00 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:00.985822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-08dd17c4-3ea0-4222-8770-91ce17bdf28c req-dce0aca1-1fb9-40b4-ba2d-b7de0661cd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29a8a58-1a92-413e-891e-c5b111b5c494", "name": "network-vif-plugged", "status": "completed", "tag": "03baebe0-048c-4e2b-875a-6665ece191c5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:01.007717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-08dd17c4-3ea0-4222-8770-91ce17bdf28c req-dce0aca1-1fb9-40b4-ba2d-b7de0661cd89 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:01.008568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-08dd17c4-3ea0-4222-8770-91ce17bdf28c req-dce0aca1-1fb9-40b4-ba2d-b7de0661cd89 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:01.056994 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-08dd17c4-3ea0-4222-8770-91ce17bdf28c req-dce0aca1-1fb9-40b4-ba2d-b7de0661cd89 service nova] Creating event network-vif-plugged:03baebe0-048c-4e2b-875a-6665ece191c5 for instance e29a8a58-1a92-413e-891e-c5b111b5c494 on n-h2-851368-1 Jul 28 11:58:01.064309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-08dd17c4-3ea0-4222-8770-91ce17bdf28c req-dce0aca1-1fb9-40b4-ba2d-b7de0661cd89 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109125 Jul 28 11:58:01.065068 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2653/5297] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:58:01.685612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:01.686821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:01.697067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:01.697766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:01.699122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:01.699729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:01.884346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:01.915382 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c8f4909-561b-492c-b601-8f44921ea3df tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1317 microversion: 2.1 time: 0.232057 Jul 28 11:58:01.931005 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2645/5298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:01 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:02.943467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:02.948373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:02.949092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:02.957440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:02.957987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:02.958699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:02.959174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.161153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:03.170302 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77ed1ee7-de04-4010-be92-6b57422eafe4 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1505 microversion: 2.1 time: 0.236125 Jul 28 11:58:03.177819 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2654/5299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:02 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:03.192938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:03.193438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:03.195480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:03.196163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:03.219105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.219446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.220493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.221765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.260616 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd6ca5cb-b847-4043-aa9e-130c786e755b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips" status: 200 len: 108 microversion: 2.1 time: 0.071689 Jul 28 11:58:03.262231 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2646/5300] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:58:03 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips => generated 108 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:03.275051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:03.275586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:03.283632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.284911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.285718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.286165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.320256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62bcd79e-fd0d-41c9-9672-68a01be53e4b tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips" status: 200 len: 108 microversion: 2.1 time: 0.049458 Jul 28 11:58:03.321433 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2655/5301] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:58:03 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips => generated 108 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:03.338280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:03.338835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:03.347462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.348523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.349495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.350093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.384509 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a91df7c-97bc-4530-85bd-304bfd033279 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips/tempest-ServerAddressesTestJSON-451232861-network" status: 200 len: 93 microversion: 2.1 time: 0.055458 Jul 28 11:58:03.391621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2647/5302] 10.222.0.93 () {58 vars in 1398 bytes} [Thu Jul 28 11:58:03 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494/ips/tempest-ServerAddressesTestJSON-451232861-network => generated 93 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:58:03.397756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:03.398598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:03.405522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.406814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.408095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.408579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.443497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:58:03.561175 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-672bb556-00a7-4352-a6c2-f2a08d58416f tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 204 len: 0 microversion: 2.1 time: 0.167839 Jul 28 11:58:03.562115 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2656/5303] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:58:03 2022] DELETE /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 11:58:03.573004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:03.573876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:03.583174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.583605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.584699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:03.585078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:03.813058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:03.822981 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f74c620-f163-44db-92ff-5b12d8569b61 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1511 microversion: 2.1 time: 0.255926 Jul 28 11:58:03.824174 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2648/5304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:03 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:04.846639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:04.849688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:04.858008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:04.859546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:04.860945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:04.861839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:05.072455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:05.088533 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-23220e4c-7773-4fdf-a4eb-1836ffc9b5e9 tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1511 microversion: 2.1 time: 0.246709 Jul 28 11:58:05.097377 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2657/5305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:04 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:05.629863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-26ed5b12-139b-4643-a049-1a30cdaacaaa req-70daa94c-cab0-4b73-bf5c-bdb4b4d91491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29a8a58-1a92-413e-891e-c5b111b5c494", "name": "network-vif-deleted", "tag": "03baebe0-048c-4e2b-875a-6665ece191c5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:05.668251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-26ed5b12-139b-4643-a049-1a30cdaacaaa req-70daa94c-cab0-4b73-bf5c-bdb4b4d91491 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:05.668702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-26ed5b12-139b-4643-a049-1a30cdaacaaa req-70daa94c-cab0-4b73-bf5c-bdb4b4d91491 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:05.723051 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-26ed5b12-139b-4643-a049-1a30cdaacaaa req-70daa94c-cab0-4b73-bf5c-bdb4b4d91491 service nova] Creating event network-vif-deleted:03baebe0-048c-4e2b-875a-6665ece191c5 for instance e29a8a58-1a92-413e-891e-c5b111b5c494 on n-h2-851368-1 Jul 28 11:58:05.732541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-26ed5b12-139b-4643-a049-1a30cdaacaaa req-70daa94c-cab0-4b73-bf5c-bdb4b4d91491 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110769 Jul 28 11:58:05.733853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2649/5306] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:06.111693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:06.112830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:06.127304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:06.128833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:06.129944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:06.130639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:06.223635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:06.224746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:06.226162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lazy-loading 'fault' on Instance uuid e29a8a58-1a92-413e-891e-c5b111b5c494 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:58:06.331422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d259fda0b4410087d397661d5a56ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af2f7f56048c4673a96cc783ae867475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:06.344655 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86e6cb2f-ce04-4438-acd1-357af21c125e tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 200 len: 1307 microversion: 2.1 time: 0.236838 Jul 28 11:58:06.358929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2658/5307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:06 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:07.369221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:07.369933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] [instance: e29a8a58-1a92-413e-891e-c5b111b5c494] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:07.379459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:07.379920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:07.380720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:07.381156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:07.396612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] HTTP exception thrown: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Request method failure captured: Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 HTTP/1.1 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nm_YOnC1MNPaDK4IY7vE_4oO18d6gT0qBvQCa_LnATSa1uZeYuqyTZwjdMKhSbhtsanaHxbqzzyCQdpcV0vLZZURW-M8nLecVlcosDUXPkak8bKGx2ULdAYIBrNVrVGtVx3BjTLd1juMU2qlBXj-slJsLQbg1674tkY_AHR6r65dhY Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: af2f7f56048c4673a96cc783ae867475 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerAddressesTestJSON-13201597 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/af2f7f56048c4673a96cc783ae867475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/af2f7f56048c4673a96cc783ae867475"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_af2f7f56048c4673a96cc783ae867475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/af2f7f56048c4673a96cc783ae867475"}]}] Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerAddressesTestJSON-13201597 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: af2f7f56048c4673a96cc783ae867475 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerAddressesTestJSON-13201597 Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerAddressesTestJSON-13201597-project Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 90d259fda0b4410087d397661d5a56ea Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerAddressesTestJSON-13201597-project Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e29a8a58-1a92-413e-891e-c5b111b5c494'} Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:07.398306 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] Returning 404 to user: Instance e29a8a58-1a92-413e-891e-c5b111b5c494 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07535630-3005-419c-bcbf-88ae1476cb7a tempest-ServerAddressesTestJSON-13201597 tempest-ServerAddressesTestJSON-13201597-project] 10.222.0.93 "GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494" status: 404 len: 111 microversion: 2.1 time: 0.037729 Jul 28 11:58:07.402720 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2650/5308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:07 2022] GET /compute/v2.1/servers/e29a8a58-1a92-413e-891e-c5b111b5c494 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:58:21.181273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:21.183673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:21.356197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-83490725", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "3628d6b7-2928-4c94-89d3-1568290f6022"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:21.452341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] validate_networks() for [('3628d6b7-2928-4c94-89d3-1568290f6022', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:58:22.058140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:58:22.058573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:58:22.059104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:58:22.059496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:58:22.060120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:58:22.086208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:22.086871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:22.088066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:22.089339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:22.138080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Getting quotas for project 1199b13c4a58423aa76a7a8a40fc1bb8. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:58:22.150859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Getting quotas for user 2a289ebbf9d2474e8af2a5ae0c2b7d5b and project 1199b13c4a58423aa76a7a8a40fc1bb8. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:58:22.188820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:58:22.192764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:58:22.262641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0da7a4af-a54c-44de-b7db-3358176800f7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087516 Jul 28 11:58:22.264021 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2659/5309] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 11:58:22.275401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a62b7238-2837-457f-b632-e40f342b027e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:22.277517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a62b7238-2837-457f-b632-e40f342b027e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:22.298783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:22.303478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:22.404681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a62b7238-2837-457f-b632-e40f342b027e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:22.419009 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a62b7238-2837-457f-b632-e40f342b027e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1223 microversion: 2.1 time: 0.147540 Jul 28 11:58:22.419983 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2651/5310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:22 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:23.456224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:23.458066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:23.484485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:23.485316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:23.486286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:23.486930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:23.606323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:23.614722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45b1e86d-54ab-4192-aade-c7e6acf43168 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1275 microversion: 2.1 time: 0.174056 Jul 28 11:58:23.615954 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2660/5311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:23 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:24.636202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:24.636848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:24.649737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:24.650330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:24.651151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:24.651600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:24.789133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:24.803731 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-123fc6b7-eeee-4856-96b9-655114245cf7 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1281 microversion: 2.1 time: 0.165207 Jul 28 11:58:24.815096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2652/5312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:24 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:25.827975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:25.831044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:25.841252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:25.844793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:25.847394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:25.850727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:26.212014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:26.234796 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dba340b1-3ae7-452c-b7b8-1a522b48d41b tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.412206 Jul 28 11:58:26.244877 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2661/5313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:25 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:27.267777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:27.284658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:27.302107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:27.309757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:27.311401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:27.314292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:27.599554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:27.610324 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f35189a9-e97a-41ce-9f51-4e56a5a6c92e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.357604 Jul 28 11:58:27.613060 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2653/5314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:27 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:27.645072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b71ac657-7f16-483e-8810-04859e37bfa0 req-e20175ba-4145-4237-98a9-20c02dbdd85d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91a45b-bf3f-4646-b162-8f76f47a7b50", "tag": "43f21567-8200-453d-b5c7-cf4879f473f9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:27.673013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b71ac657-7f16-483e-8810-04859e37bfa0 req-e20175ba-4145-4237-98a9-20c02dbdd85d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:27.673520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b71ac657-7f16-483e-8810-04859e37bfa0 req-e20175ba-4145-4237-98a9-20c02dbdd85d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:27.689011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b71ac657-7f16-483e-8810-04859e37bfa0 req-e20175ba-4145-4237-98a9-20c02dbdd85d service nova] Creating event network-changed:43f21567-8200-453d-b5c7-cf4879f473f9 for instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 on n-h2-851368-1 Jul 28 11:58:27.721245 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b71ac657-7f16-483e-8810-04859e37bfa0 req-e20175ba-4145-4237-98a9-20c02dbdd85d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080673 Jul 28 11:58:27.723774 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2662/5315] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:58:28.634036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:28.635361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:28.647250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:28.647955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:28.648966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:28.650139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:28.850410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:28.878180 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b07e250-e9c6-4598-8f9f-e83752716e81 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.248319 Jul 28 11:58:28.878916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2654/5316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:28 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:29.909809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:29.911363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:29.931234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:29.931712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:29.932926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:29.935848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:30.259628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:30.278700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f2dd8909-ac95-470f-abb0-c16be71be7cf tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.373526 Jul 28 11:58:30.281440 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2663/5317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:29 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:31.303270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:31.303795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:31.311780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:31.312545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:31.313849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:31.314872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:31.516263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:31.526266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5101cf7-4ccb-4bd1-9da7-0ff669afa940 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.227819 Jul 28 11:58:31.528728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2655/5318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:31 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:32.551089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:32.552297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:32.563539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:32.565497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:32.568710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:32.570639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:32.571699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:32.572365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:32.784473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:32.794373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae2d0e8b-f444-415c-b5c9-c19ea65c1716 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.246483 Jul 28 11:58:32.795238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2664/5319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:32 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:33.817660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:33.818912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:33.827115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:33.830470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:33.831429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:33.832501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:33.833176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:34.024343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:34.034512 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26a62774-a374-426b-b128-051f3ecf2020 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.221895 Jul 28 11:58:34.035675 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2656/5320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:33 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:34.861449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7758beb6-105e-430d-8449-be7936b91864 req-e9873a6e-f27f-4219-ad3d-aa81a29297ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91a45b-bf3f-4646-b162-8f76f47a7b50", "name": "network-vif-plugged", "status": "completed", "tag": "43f21567-8200-453d-b5c7-cf4879f473f9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:34.887467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7758beb6-105e-430d-8449-be7936b91864 req-e9873a6e-f27f-4219-ad3d-aa81a29297ae service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:34.887857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7758beb6-105e-430d-8449-be7936b91864 req-e9873a6e-f27f-4219-ad3d-aa81a29297ae service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:34.904868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7758beb6-105e-430d-8449-be7936b91864 req-e9873a6e-f27f-4219-ad3d-aa81a29297ae service nova] Creating event network-vif-plugged:43f21567-8200-453d-b5c7-cf4879f473f9 for instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 on n-h2-851368-1 Jul 28 11:58:34.911048 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7758beb6-105e-430d-8449-be7936b91864 req-e9873a6e-f27f-4219-ad3d-aa81a29297ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054149 Jul 28 11:58:34.912311 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2665/5321] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:35.082141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:35.082770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:35.091642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:35.092918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:35.094422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:35.095314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:35.296233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:35.305772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6fa63da7-c5bd-46b0-8288-8578c9e62350 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1323 microversion: 2.1 time: 0.227271 Jul 28 11:58:35.306875 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2657/5322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:35 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:36.329195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:36.330516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:36.347403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.347960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.348922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.349581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.529488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:36.537838 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-230f07e8-55a7-4bf9-bb43-94cb835262b9 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1519 microversion: 2.1 time: 0.214301 Jul 28 11:58:36.538496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2666/5323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:36 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:36.559902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:36.560480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:36.568805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.569540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.570527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.571200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.597132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] HTTP exception thrown: Instance is not a member of specified network Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Request method failure captured: Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50/ips/invalid HTTP/1.1 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nncf9eiXw-yF2fGZUxMyf44C46KGGcBQEAYarGU1zvOGdF2nyszEhwgAi9_SzAJwD5kE9GKQBSLvZDeP3-V19OLhlRW6Y15n8WAAzxE3nLB2Ya6UPhWJQkRBSE3M0rDLp9dJjNbrwwviI3CbWJhbDj_DmicU5NYVVuvPbkwGTal750 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}] Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 2a289ebbf9d2474e8af2a5ae0c2b7d5b Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance is not a member of specified network Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': 'fa91a45b-bf3f-4646-b162-8f76f47a7b50', 'id': 'invalid'} Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 28 11:58:36.607150 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.615715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:58:36.615715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-475f1dfc-6013-444c-9938-81d00f44b20f tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.053521 Jul 28 11:58:36.615715 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2658/5324] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:58:36 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50/ips/invalid => generated 91 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:58:36.618913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:36.619443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Failed to fetch instance by id 999 {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2929}} Jul 28 11:58:36.619965 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] HTTP exception thrown: Instance 999 could not be found. Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Request method failure captured: Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nncf9eiXw-yF2fGZUxMyf44C46KGGcBQEAYarGU1zvOGdF2nyszEhwgAi9_SzAJwD5kE9GKQBSLvZDeP3-V19OLhlRW6Y15n8WAAzxE3nLB2Ya6UPhWJQkRBSE3M0rDLp9dJjNbrwwviI3CbWJhbDj_DmicU5NYVVuvPbkwGTal750 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}] Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2a289ebbf9d2474e8af2a5ae0c2b7d5b Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 999 could not be found. Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '999'} Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2930, in get Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 28 11:58:36.621719 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:58:36.626178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:58:36.626178 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35339c7d-b6c7-4d91-a795-fb22dd67f477 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008151 Jul 28 11:58:36.626178 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2667/5325] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Jul 28 11:58:36 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 11:58:36.641001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:36.641788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:36.650148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.650871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.651901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.652510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.700340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:58:36.875811 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e7abbb83-c196-46b1-acde-e071fc5ddbff tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 204 len: 0 microversion: 2.1 time: 0.243057 Jul 28 11:58:36.879182 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2659/5326] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:58:36 2022] DELETE /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:58:36.894192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:36.895031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:36.904295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.904906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:36.905721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:36.906329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:37.073417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:37.082221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0ed22a05-f244-4a36-a902-55a8feffb78e tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1525 microversion: 2.1 time: 0.199396 Jul 28 11:58:37.083139 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2668/5327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:36 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:38.104473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:38.105796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:38.112875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:38.113318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:38.114269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:38.114706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:38.316619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:38.325482 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcd53996-d896-46de-ab56-0a7382c7eb76 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1525 microversion: 2.1 time: 0.225225 Jul 28 11:58:38.326537 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2660/5328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:38 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1525 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:38.958429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-aa3e630f-57ca-4a8c-b795-028673c715e8 req-a44651a2-5be4-4a8f-850c-257c70914a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91a45b-bf3f-4646-b162-8f76f47a7b50", "name": "network-vif-deleted", "tag": "43f21567-8200-453d-b5c7-cf4879f473f9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:38.977760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-aa3e630f-57ca-4a8c-b795-028673c715e8 req-a44651a2-5be4-4a8f-850c-257c70914a93 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:38.978709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-aa3e630f-57ca-4a8c-b795-028673c715e8 req-a44651a2-5be4-4a8f-850c-257c70914a93 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.004343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-aa3e630f-57ca-4a8c-b795-028673c715e8 req-a44651a2-5be4-4a8f-850c-257c70914a93 service nova] Creating event network-vif-deleted:43f21567-8200-453d-b5c7-cf4879f473f9 for instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 on n-h2-851368-1 Jul 28 11:58:39.012086 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-aa3e630f-57ca-4a8c-b795-028673c715e8 req-a44651a2-5be4-4a8f-850c-257c70914a93 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064122 Jul 28 11:58:39.013213 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2669/5329] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:39.235199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:39.235692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:39.242601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:39.243418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.244934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:39.245778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.278699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07d2860a-244b-4191-8037-7e66b3c4d876 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/ips" status: 200 len: 151 microversion: 2.1 time: 0.200507 Jul 28 11:58:39.280109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2661/5330] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 11:58:39 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/ips => generated 151 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:39.356808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:39.370713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:39.393919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:39.394683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.395683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:39.396318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.515421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:39.516190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:39.518161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lazy-loading 'fault' on Instance uuid fa91a45b-bf3f-4646-b162-8f76f47a7b50 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:58:39.666004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a289ebbf9d2474e8af2a5ae0c2b7d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199b13c4a58423aa76a7a8a40fc1bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:39.692275 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8df3a8b-2166-4362-af21-48151df52d1c tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 200 len: 1313 microversion: 2.1 time: 0.344858 Jul 28 11:58:39.693051 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2670/5331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:39 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:40.714874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:40.716266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] [instance: fa91a45b-bf3f-4646-b162-8f76f47a7b50] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:40.735743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:40.736706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:40.737676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:40.738228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:40.763924 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] HTTP exception thrown: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Request method failure captured: Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 HTTP/1.1 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nncf9eiXw-yF2fGZUxMyf44C46KGGcBQEAYarGU1zvOGdF2nyszEhwgAi9_SzAJwD5kE9GKQBSLvZDeP3-V19OLhlRW6Y15n8WAAzxE3nLB2Ya6UPhWJQkRBSE3M0rDLp9dJjNbrwwviI3CbWJhbDj_DmicU5NYVVuvPbkwGTal750 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1199b13c4a58423aa76a7a8a40fc1bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1199b13c4a58423aa76a7a8a40fc1bb8"}]}] Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1199b13c4a58423aa76a7a8a40fc1bb8 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2038450232 Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 2a289ebbf9d2474e8af2a5ae0c2b7d5b Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2038450232-project Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'fa91a45b-bf3f-4646-b162-8f76f47a7b50'} Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:40.765967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. Jul 28 11:58:40.770924 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:40.772896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] Returning 404 to user: Instance fa91a45b-bf3f-4646-b162-8f76f47a7b50 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:58:40.774011 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-99b80b42-3bd3-4306-b9fd-7a6acc2fafe5 tempest-ServerAddressesNegativeTestJSON-2038450232 tempest-ServerAddressesNegativeTestJSON-2038450232-project] 10.222.0.93 "GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50" status: 404 len: 111 microversion: 2.1 time: 0.064243 Jul 28 11:58:40.774830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2662/5332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:40 2022] GET /compute/v2.1/servers/fa91a45b-bf3f-4646-b162-8f76f47a7b50 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 11:58:42.092732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c509f9b-6409-41ad-bd93-861c6159c542"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:42.095041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:42.115292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:42.116348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:42.118535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:42.119626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:42.555592 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddae1420-7f6e-471a-88a0-047c2d363c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467123 Jul 28 11:58:42.556621 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2671/5333] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:58:42 2022] POST /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:58:56.400122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:56.401385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:56.622363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1161847070", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:56.709641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] validate_networks() for [('ef699de6-4c9c-4018-8fce-3ceaf4680adb', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:58:57.447634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:58:57.448772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:58:57.449511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:58:57.451114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:58:57.452103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:58:57.473065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:57.484407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:57.485744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:57.487168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:57.511948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Getting quotas for project 22740b6e0ea944b797bc2d4999f7630b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:58:57.541786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Getting quotas for user 2647d1878da84b3ca79dc9da87f3ad9c and project 22740b6e0ea944b797bc2d4999f7630b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:58:57.560789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:58:57.563825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:58:57.630540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c30267b8-7026-4da4-bc24-1036aaec6ce8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.236081 Jul 28 11:58:57.632012 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2663/5334] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:58:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:58:57.643552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-572d78c8-1d25-4781-9f25-17beaff84f1f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:57.645207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-572d78c8-1d25-4781-9f25-17beaff84f1f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:57.653452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:57.654506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:58:57.780597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-572d78c8-1d25-4781-9f25-17beaff84f1f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:57.790531 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-572d78c8-1d25-4781-9f25-17beaff84f1f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1223 microversion: 2.1 time: 0.151774 Jul 28 11:58:57.797576 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2672/5335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:57 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:58:58.540183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c509f9b-6409-41ad-bd93-861c6159c542"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:58:58.554926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:58.570861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.571370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:58.572187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.572621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:58.715713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments HTTP/1.1 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 74 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: {"volumeAttachment": {"volumeId": "8c509f9b-6409-41ad-bd93-861c6159c542"}} Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '84e1ea2d-3a5c-4697-9bc2-74f058e1610e', 'body': {'volumeAttachment': {'volumeId': '8c509f9b-6409-41ad-bd93-861c6159c542'}}} Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:58:58.717218 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e Jul 28 11:58:58.725060 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 11:58:58.730677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 400 to user: Invalid volume: volume 8c509f9b-6409-41ad-bd93-861c6159c542 is already attached to instances: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:58:58.740692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ba0d7ef5-9afa-4b07-ae67-3f0a89ee6186 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206250 Jul 28 11:58:58.741902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2664/5336] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 11:58:58 2022] POST /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 11:58:58.817139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:58.817766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:58.839227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.839625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:58.843157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.843624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:58.902132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:58.902633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:58.917888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.918625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:58.920306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:58.924818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:59.012363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:58:59.025310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8fa3fe7b-bc39-4da7-9e20-60c1eb043e4e tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1219 microversion: 2.1 time: 0.211980 Jul 28 11:58:59.025824 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2673/5337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:58:58 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:58:59.131843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'services' on Instance uuid 84e1ea2d-3a5c-4697-9bc2-74f058e1610e {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:58:59.253978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e487ddcf-04a1-4d87-afff-ea68e8178104 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments/8c509f9b-6409-41ad-bd93-861c6159c542" status: 202 len: 0 microversion: 2.1 time: 0.355956 Jul 28 11:58:59.257878 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2665/5338] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 11:58:58 2022] DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments/8c509f9b-6409-41ad-bd93-861c6159c542 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:58:59.265044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:58:59.271315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:58:59.305399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:59.306105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:59.309087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:58:59.309558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:58:59.394413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e71a1501-c69a-487b-93b7-eb3df0596810 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134079 Jul 28 11:58:59.399929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2674/5339] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:58:59 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:00.053469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:00.054734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:00.072844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:00.075531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:00.076632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:00.077248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:00.199430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:00.209880 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d3b2b14-3c38-479d-b919-47c69cb83369 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1281 microversion: 2.1 time: 0.164124 Jul 28 11:59:00.224657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2666/5340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:00 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:00.406635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:00.409567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:00.427816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:00.428491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:00.432026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:00.432499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:00.510042 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-644f6d84-7776-4ce6-9391-b9ca78127293 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107891 Jul 28 11:59:00.512593 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2675/5341] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:00 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:01.232660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:01.233884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:01.258037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:01.259137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:01.260538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:01.261049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:01.428229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:01.436831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3916f52-01b7-4612-81d0-879bbca4652d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.208217 Jul 28 11:59:01.450091 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2667/5342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:01 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:01.523939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:01.526176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:01.540457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:01.542880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:01.544999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:01.545711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:01.603791 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58ccbecc-1c0b-4b34-a880-11ce9dac025e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082349 Jul 28 11:59:01.608405 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2676/5343] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:01 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:02.152741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ffe18380-a465-4646-8f03-c29cba67add2 req-fbf94da0-e5de-4bac-803b-54b1d95114ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:02.176094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ffe18380-a465-4646-8f03-c29cba67add2 req-fbf94da0-e5de-4bac-803b-54b1d95114ec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:02.176557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ffe18380-a465-4646-8f03-c29cba67add2 req-fbf94da0-e5de-4bac-803b-54b1d95114ec service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:02.231612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ffe18380-a465-4646-8f03-c29cba67add2 req-fbf94da0-e5de-4bac-803b-54b1d95114ec service nova] Creating event network-changed:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:02.245444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ffe18380-a465-4646-8f03-c29cba67add2 req-fbf94da0-e5de-4bac-803b-54b1d95114ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096166 Jul 28 11:59:02.248255 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2668/5344] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:02.457017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:02.457744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:02.476229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:02.477000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:02.478027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:02.478652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:02.617077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:02.620321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:02.649508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:02.654196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:02.662317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:02.664485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:02.687559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:02.696413 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d617a691-fe38-49fd-afbb-f87b63257e54 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.243473 Jul 28 11:59:02.708154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2677/5345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:02 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:02.739620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c9fa0cf5-c6c5-42db-952f-0fd092dab2de tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126775 Jul 28 11:59:02.740474 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2669/5346] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:02 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:03.720899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:03.722089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:03.750960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:03.757141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:03.760372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:03.763454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:03.764862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:03.765338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:03.809577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:03.818977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:03.824002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:03.824636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:03.881963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fab24bb8-fc71-430d-9883-f98667bbff9f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129343 Jul 28 11:59:03.895838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2670/5347] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:03 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:04.074218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:04.086011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c66bc76b-dd08-4003-aad6-f786d9f3ed8c tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.370459 Jul 28 11:59:04.086679 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2678/5348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:03 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:04.907939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:04.907939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:04.908498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:04.908498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:04.909232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:04.909934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:04.948027 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c1983c5d-ce2c-4ecf-9838-9733ad14dc22 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054123 Jul 28 11:59:04.953007 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2671/5349] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:04 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:05.108339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:05.109261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:05.117847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:05.118420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:05.119421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:05.122171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:05.292606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:05.302185 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e3df2a9-de1c-4b1f-8ceb-8f0687b962bc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.198431 Jul 28 11:59:05.305400 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2679/5350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:05 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:05.988036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:05.990329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:06.003277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:06.004095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:06.005422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:06.006094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:06.052188 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5a151b8-9758-43d9-b68b-446f342e6b30 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089129 Jul 28 11:59:06.054644 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2672/5351] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:05 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:06.326337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:06.327713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:06.340826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:06.343198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:06.344065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:06.344521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:06.523826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:06.531504 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c905e59-c207-40ae-b3af-f1ab8c5d34b5 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.209405 Jul 28 11:59:06.540281 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2680/5352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:06 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:07.065788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:07.069443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:07.081285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:07.082159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:07.083589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:07.084188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:07.142610 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-23caa424-c9df-4519-86ce-da3a609826a5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082882 Jul 28 11:59:07.149403 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2673/5353] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:07 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:07.554976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:07.557069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:07.564733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:07.565199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:07.565977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:07.566420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:07.724603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:07.733335 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d906eb78-8697-4c2e-aeaf-84b3f7cf9bfd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.182170 Jul 28 11:59:07.733908 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2681/5354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:07 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:08.155960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:08.158189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:08.160247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:08.161132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:08.177575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.178031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.178827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.179296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.237370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a640ba7-7080-4268-b60c-d2bad9b3bcd7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084268 Jul 28 11:59:08.257333 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2674/5355] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 11:59:08 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:59:08.336248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:08.337012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:08.340836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:08.347326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.347958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.349124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.349862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.387499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:59:08.520940 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f0765a3-5b4c-4dc7-bbad-8cdfe3c65a77 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 204 len: 0 microversion: 2.1 time: 0.188403 Jul 28 11:59:08.522798 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2682/5356] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:59:08 2022] DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:59:08.533261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:08.534199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:08.540990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.542384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.543693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.544433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.696631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:08.709718 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c553641d-9744-4d75-bbcf-61f089c85db7 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1681 microversion: 2.1 time: 0.182565 Jul 28 11:59:08.710666 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2675/5357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:08 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:08.757321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:08.758052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:08.765039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.765791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.767357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:08.767993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:08.933450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:08.942675 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6068b69-dafb-494b-afba-d94ec5bf6894 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.190415 Jul 28 11:59:08.944375 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2683/5358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:08 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:09.272604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fa9cf7c2-ffe0-4213-8092-4984ba857a75 req-2d5fa0c4-4cec-4de6-bb97-0bc98d2ce6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "name": "network-vif-plugged", "status": "completed", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:09.294551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa9cf7c2-ffe0-4213-8092-4984ba857a75 req-2d5fa0c4-4cec-4de6-bb97-0bc98d2ce6eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:09.295007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fa9cf7c2-ffe0-4213-8092-4984ba857a75 req-2d5fa0c4-4cec-4de6-bb97-0bc98d2ce6eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:09.320670 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fa9cf7c2-ffe0-4213-8092-4984ba857a75 req-2d5fa0c4-4cec-4de6-bb97-0bc98d2ce6eb service nova] Creating event network-vif-plugged:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:09.332378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fa9cf7c2-ffe0-4213-8092-4984ba857a75 req-2d5fa0c4-4cec-4de6-bb97-0bc98d2ce6eb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063706 Jul 28 11:59:09.332997 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2676/5359] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:09.734771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:09.735628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:09.744212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:09.745038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:09.746404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:09.747968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:09.925917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:09.934664 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7a1ec2a-aacb-4eaa-8a6f-3a3dff2a15d2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1681 microversion: 2.1 time: 0.204221 Jul 28 11:59:09.945133 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2684/5360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:09 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:09.968333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:09.972095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:09.985487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:09.985867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:09.987437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:09.988117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:10.143363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:10.151486 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d48841b5-30a8-4954-aa12-5cbaa1424635 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1323 microversion: 2.1 time: 0.190436 Jul 28 11:59:10.166492 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2677/5361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:09 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1323 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:10.966465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:10.970681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:10.993138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:10.993891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:10.997516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:10.998402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.173443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:11.175200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:11.190938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:11.191701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.192749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:11.193503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.340287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:11.355527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f7186b0-f815-4532-a3c2-20e0e07aaa46 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1614 microversion: 2.1 time: 0.396478 Jul 28 11:59:11.359675 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2685/5362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:10 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1614 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:11.644741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:11.653739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c1ebea0f-711d-426b-a7de-7b78fbc2affb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1519 microversion: 2.1 time: 0.484632 Jul 28 11:59:11.659770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2678/5363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:11 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1519 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:11.685906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:11.699206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:11.722700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:11.723835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.724785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:11.727420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.803955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lazy-loading 'flavor' on Instance uuid cccc18f0-7865-4f90-92b4-1babcce6a2f6 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:59:11.890066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:11.965581 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8043a7eb-cf86-40fc-9c74-aeb9f3e86718 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action" status: 200 len: 32 microversion: 2.1 time: 0.283515 Jul 28 11:59:11.971099 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2686/5364] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:59:11 2022] POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 11:59:11.987688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:11.988373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:11.997381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:11.998096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:11.999787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:12.000390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:12.310062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:12.322459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-175070e9-46af-4bc3-949b-ba8a787f5add tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.346573 Jul 28 11:59:12.325010 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2679/5365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:11 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:12.383116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:12.384178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:12.398759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:12.405810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:12.406832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:12.409815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:12.417048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f887f4ee-a4fe-460a-abac-136c1086ba39 req-47ebc9de-1eb2-4219-b6a0-27a329550b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e1ea2d-3a5c-4697-9bc2-74f058e1610e", "name": "network-vif-deleted", "tag": "6f08d2b5-5263-439b-81c6-4c2334745007"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:12.442607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f887f4ee-a4fe-460a-abac-136c1086ba39 req-47ebc9de-1eb2-4219-b6a0-27a329550b8b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:12.443062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f887f4ee-a4fe-460a-abac-136c1086ba39 req-47ebc9de-1eb2-4219-b6a0-27a329550b8b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:12.482760 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f887f4ee-a4fe-460a-abac-136c1086ba39 req-47ebc9de-1eb2-4219-b6a0-27a329550b8b service nova] Creating event network-vif-deleted:6f08d2b5-5263-439b-81c6-4c2334745007 for instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e on n-h1-851368-1 Jul 28 11:59:12.492312 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f887f4ee-a4fe-460a-abac-136c1086ba39 req-47ebc9de-1eb2-4219-b6a0-27a329550b8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079370 Jul 28 11:59:12.501273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2680/5366] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:12.542975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:12.552656 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7441e5fa-e931-405b-8349-db78264a8e67 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 200 len: 1614 microversion: 2.1 time: 0.175136 Jul 28 11:59:12.554219 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2687/5367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:12 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 1614 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:13.353380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:13.354554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:13.373263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:13.374774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:13.380410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:13.380984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:13.446196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:13.576303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:13.577647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:13.593233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:13.596924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:13.598337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:13.600711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:13.635876 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e HTTP/1.1 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '84e1ea2d-3a5c-4697-9bc2-74f058e1610e'} Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 11:59:13.638695 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 11:59:13.644442 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 11:59:13.649863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 11:59:13.651803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bbb8241-2c2e-4bbd-8cef-14033e8ce23f tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 404 len: 111 microversion: 2.1 time: 0.079306 Jul 28 11:59:13.661162 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2688/5368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:13 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 11:59:13.666822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b5a781b-a03e-45d8-99c4-fd444fb337d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '.version_select at 0x7f2eb27e5820>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:13.717957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b5a781b-a03e-45d8-99c4-fd444fb337d5 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597232638" status: 202 len: 0 microversion: 2.1 time: 0.055313 Jul 28 11:59:13.718755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2689/5369] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 11:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597232638 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:59:13.844190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:13.853402 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cef6db57-ac90-4015-87a5-158c08a68c51 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.505425 Jul 28 11:59:13.858046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2681/5370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:13 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:14.883529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:14.885976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:14.907844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:14.909246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:14.910270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:14.911626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:14.923675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f1e4ed3-61df-465a-a5cc-43cccf422f51 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: .version_select at 0x7f2eb27f1f70>, body: {"keypair": {"name": "tempest-keypair-656171979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZxY9ePi9yvx5UXjRBIKPK9CE4zydlMC9E2lXKuYCeqUec5pWUMh+lnnrKeojp8JVXCcvRZSORJRkOCdrjghUD+XVgWiUoLruHfzZKYQPxpy91UBJHQrzVh02kBV5bXJg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:14.942147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7f1e4ed3-61df-465a-a5cc-43cccf422f51 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:59:14.951844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-7f1e4ed3-61df-465a-a5cc-43cccf422f51 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:59:15.037390 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f1e4ed3-61df-465a-a5cc-43cccf422f51 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117828 Jul 28 11:59:15.038753 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2682/5371] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:59:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:15.116960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:15.130718 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba9970e6-242f-4e6a-8fd3-9406d2531a27 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.253479 Jul 28 11:59:15.131387 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2690/5372] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:14 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:16.151637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:16.152416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:16.169953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:16.170522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:16.171426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:16.171944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:16.421914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:16.433460 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cdfc43b5-32e5-4dee-bbb5-4e7dd4f2aff8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.285761 Jul 28 11:59:16.434416 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2683/5373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:16 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:17.382653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871419948", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3441235-2c87-4705-8e5e-070086c01f1c"}], "security_groups": [{"name": "tempest-securitygroup--2032327464"}], "key_name": "tempest-keypair-656171979", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:17.456342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:17.457216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:17.465988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:17.467402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:17.468560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:17.469260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:18.136383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] validate_networks() for [('a3441235-2c87-4705-8e5e-070086c01f1c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:59:18.286837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:18.301418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2b8e84c3-1d1a-4a20-9868-d708c9844782 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.849402 Jul 28 11:59:18.304568 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2684/5374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:17 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:19.254606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:59:19.255765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:59:19.256466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:59:19.257083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:59:19.258278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:59:19.271786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:19.272759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:19.273826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:19.274642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:19.296408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:59:19.303187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Getting quotas for user 7ec09f0d9e214bd4bdb812fbe6cfc73b and project edcb8a61482d4f91aed7dcb02a3c1962. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:59:19.318661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:59:19.321536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:59:19.328311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:19.330386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:19.338960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:19.341951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:19.343142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:19.343801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:19.456625 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9df08264-a826-483d-9b57-2fdab93edfd3 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.078674 Jul 28 11:59:19.460359 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2691/5375] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:59:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:59:19.495122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24770439-889f-42e1-bcf2-613e0db0c9af tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:19.498397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24770439-889f-42e1-bcf2-613e0db0c9af tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:19.632452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24770439-889f-42e1-bcf2-613e0db0c9af tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:19.647493 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24770439-889f-42e1-bcf2-613e0db0c9af tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1240 microversion: 2.1 time: 0.171005 Jul 28 11:59:19.648544 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2692/5376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:19 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:19.670593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:19.679968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7af52209-c3f1-4837-bb3d-ee594071711f tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.357569 Jul 28 11:59:19.681131 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2685/5377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:19 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:20.669034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:20.669662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:20.681918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:20.682386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:20.683211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:20.683653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:20.702761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:20.705952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:20.719721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:20.721338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:20.723279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:20.723907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:20.935287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:20.949861 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56727fde-1b59-478b-80ce-68986d6c225b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1236 microversion: 2.1 time: 0.280938 Jul 28 11:59:20.953238 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2693/5378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:20 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1236 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:21.029715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:21.042090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4e7b4f6-b975-4f7e-b7e0-1ebd18395ba1 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.344374 Jul 28 11:59:21.043496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2686/5379] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:20 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:21.974982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:21.975683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:21.992482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:21.993602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:21.995029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:21.997198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:22.064800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:22.065426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:22.096785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:22.098170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:22.099156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:22.099620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:22.249855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:22.263951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f091c9f1-630e-4862-893d-326578e82ab0 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1300 microversion: 2.1 time: 0.293359 Jul 28 11:59:22.267116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2694/5380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:21 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:22.663519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:22.671774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-18ca2890-a93a-4bbc-a1ed-02741657b2dd tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.611450 Jul 28 11:59:22.679115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2687/5381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:22 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:23.285800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:23.286417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:23.317050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:23.317514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:23.318319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:23.318759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:23.706712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:23.709003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:23.720859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:23.727646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:23.734662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:23.736253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:23.772868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:23.790223 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e39fa566-264f-44eb-94d7-3cdbc5e85c33 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.506841 Jul 28 11:59:23.806262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2695/5382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:23 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:24.816995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:24.818397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:24.853141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:24.854229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:24.855312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:24.856649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:24.860358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:24.881804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6d2e0dca-0632-48d7-b4ef-32e0ccaae6b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 1.179565 Jul 28 11:59:24.907931 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2688/5383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:23 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:25.360097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9eb3c7ef-d0ca-4a1c-b8e1-134694a50d69 req-512e50c2-3221-424a-ba22-ebcb5f8173dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59694965-d6c2-4f07-9b65-cffc5236c1ff", "tag": "1e56f1bf-248f-4a2a-8f99-8deca8ae15e8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:25.374513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:25.378344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9eb3c7ef-d0ca-4a1c-b8e1-134694a50d69 req-512e50c2-3221-424a-ba22-ebcb5f8173dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:25.379492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9eb3c7ef-d0ca-4a1c-b8e1-134694a50d69 req-512e50c2-3221-424a-ba22-ebcb5f8173dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:25.411515 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9eb3c7ef-d0ca-4a1c-b8e1-134694a50d69 req-512e50c2-3221-424a-ba22-ebcb5f8173dc service nova] Creating event network-changed:1e56f1bf-248f-4a2a-8f99-8deca8ae15e8 for instance 59694965-d6c2-4f07-9b65-cffc5236c1ff on n-h1-851368-1 Jul 28 11:59:25.426385 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9eb3c7ef-d0ca-4a1c-b8e1-134694a50d69 req-512e50c2-3221-424a-ba22-ebcb5f8173dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072110 Jul 28 11:59:25.428780 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2689/5384] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:25.603439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:25.620953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f3cf6ce-8bb1-4089-81a2-f648be7cc375 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.808134 Jul 28 11:59:25.637239 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2696/5385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:24 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:25.911514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:25.912362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:25.929229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:25.929229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:25.929229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:25.929229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:26.361969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:26.374242 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-330602ef-4797-48a6-a725-41ece31df904 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.468625 Jul 28 11:59:26.377459 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2690/5386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:25 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:26.658545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:26.660093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:26.673972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:26.677535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:26.678705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:26.679352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:26.952358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:26.964788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5e4fc48-958a-46ff-a738-b12f399333c2 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.310778 Jul 28 11:59:26.971249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2697/5387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:26 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:27.412062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:27.415374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:27.424718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:27.429012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:27.429804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:27.431843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:27.434382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:27.637110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d657d65-5827-484b-b307-0d70e398c10d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: .version_select at 0x7f2ebbed49d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1617729382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5hrtsDmYczjtWbzU7+CL7GFULEVHOYe3MV55MbJEzYtn1ybZaRGt+UH5YYkijuJYYoYQcqy9P+N64s8YgWU8Zyf/DB0voR0NBZAtHe/Z4aI74qp4Ew0bVIzf2p2nVr5A=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:27.643254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:27.657779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37071f17-ca45-43b6-a161-798e02abdbbc tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.263202 Jul 28 11:59:27.658372 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2691/5388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:27 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:27.669130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0d657d65-5827-484b-b307-0d70e398c10d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:59:27.676681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0d657d65-5827-484b-b307-0d70e398c10d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:59:27.686857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:27.707586 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d657d65-5827-484b-b307-0d70e398c10d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.077482 Jul 28 11:59:27.709454 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2698/5389] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:59:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:27.989432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:27.990053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:28.001997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:28.002498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:28.003395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:28.003861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:28.256588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:28.266478 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08d0ff47-8ce9-4ec2-b2d7-3575f8aa0297 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.280845 Jul 28 11:59:28.270899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2692/5390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:27 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:28.689102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:28.691038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:28.732951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:28.735788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:28.737246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:28.741590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:29.018266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:29.029258 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b32b897d-6a76-4dd7-ba40-0aacc0f42996 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.350289 Jul 28 11:59:29.044084 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2699/5391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:28 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:29.293142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:29.293782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:29.308658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:29.309126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:29.310011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:29.310518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:29.570747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:29.591779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6f320220-0db8-422e-94c7-efd0d5c65f10 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.306442 Jul 28 11:59:29.592388 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2693/5392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:29 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:29.751760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-378167433", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "2f25acd5-691c-4476-9d59-159ecfc0fafe"}], "key_name": "tempest-TestNetworkBasicOps-1617729382", "security_groups": [{"name": "tempest-secgroup-smoke-343247762"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:29.763240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:29.906270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] validate_networks() for [('2f25acd5-691c-4476-9d59-159ecfc0fafe', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:59:30.053919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:30.057564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:30.069770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.075143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.076123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.076597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.449694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:30.466588 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a971eb7e-135d-4a74-8b63-c82a089bdc43 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.418987 Jul 28 11:59:30.467786 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2694/5393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:30 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:30.614205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:30.615166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:30.626709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.627214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.628021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.628465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.671007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 11:59:30.671869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 11:59:30.673078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 11:59:30.673809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 11:59:30.674470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 11:59:30.705237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.705618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.706465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:30.711782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:30.782645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:59:30.795970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:59:30.810560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 11:59:30.812974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 11:59:30.848141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:30.862720 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7deca77-749e-49db-a030-6b14ecb7458d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.250655 Jul 28 11:59:30.864348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2695/5394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:30 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:30.952260 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05e3e9be-4a0d-49cd-a825-736311407c64 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.205059 Jul 28 11:59:30.954177 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2700/5395] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:59:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 11:59:30.968489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83eddd62-0daa-42de-9506-97ac668f1dd6 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:30.970463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-83eddd62-0daa-42de-9506-97ac668f1dd6 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:31.112608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83eddd62-0daa-42de-9506-97ac668f1dd6 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:31.120740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83eddd62-0daa-42de-9506-97ac668f1dd6 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1248 microversion: 2.1 time: 0.158860 Jul 28 11:59:31.121407 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2696/5396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:30 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1248 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:31.491411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:31.492795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:31.502478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:31.503694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:31.505352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:31.506169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:31.707157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:31.716929 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3dbd011b-664a-45ed-9746-9e960b083a29 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.230242 Jul 28 11:59:31.732481 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2701/5397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:31 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:31.884917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:31.886643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:31.897078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:31.897698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:31.898616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:31.900736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:32.117390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:32.126070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fdc2237-9f1a-4842-8048-8e87baab2582 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.245304 Jul 28 11:59:32.127058 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2697/5398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:31 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:32.147480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:32.148125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:32.160716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:32.161174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:32.162073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:32.162385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:32.244456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:32.253511 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-471c07a0-527b-458a-bc4a-9f295d4bc02c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1300 microversion: 2.1 time: 0.115597 Jul 28 11:59:32.254569 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2702/5399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:32 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:32.739225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:32.740178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:32.748782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:32.749256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:32.750037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:32.751016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:32.897116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:32.923475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7030ef6-ede6-4571-b7f1-a0b1e840d031 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.184489 Jul 28 11:59:32.924483 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2698/5400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:32 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:33.148234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-b32e484e-d843-48d1-b8e0-3dcb06032702 req-a1c26256-2bb3-4e23-b601-b0f46683738c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59694965-d6c2-4f07-9b65-cffc5236c1ff", "name": "network-vif-plugged", "status": "completed", "tag": "1e56f1bf-248f-4a2a-8f99-8deca8ae15e8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:33.151863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:33.161638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:33.165501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b32e484e-d843-48d1-b8e0-3dcb06032702 req-a1c26256-2bb3-4e23-b601-b0f46683738c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.165961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-b32e484e-d843-48d1-b8e0-3dcb06032702 req-a1c26256-2bb3-4e23-b601-b0f46683738c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.175333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.178888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.179409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-b32e484e-d843-48d1-b8e0-3dcb06032702 req-a1c26256-2bb3-4e23-b601-b0f46683738c service nova] Creating event network-vif-plugged:1e56f1bf-248f-4a2a-8f99-8deca8ae15e8 for instance 59694965-d6c2-4f07-9b65-cffc5236c1ff on n-h1-851368-1 Jul 28 11:59:33.184393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.185187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.186092 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-b32e484e-d843-48d1-b8e0-3dcb06032702 req-a1c26256-2bb3-4e23-b601-b0f46683738c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041941 Jul 28 11:59:33.187170 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2703/5401] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:33.280945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:33.282350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:33.298900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.299385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.300181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.300625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.554628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:33.574951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89deb348-26dc-4bce-8c37-54bca8603c23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.430140 Jul 28 11:59:33.595163 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2699/5402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:33 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:33.609906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:33.619553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a9b7fed6-a5f9-4702-83fc-50ccbeb04b81 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.341353 Jul 28 11:59:33.622881 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2704/5403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:33 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:33.944735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:33.946008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:33.955223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.956008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:33.957070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:33.957779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.123771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:34.130689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:34.138693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-256934a2-f451-41d9-b5bf-7effc3192d15 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.197903 Jul 28 11:59:34.144606 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2700/5404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:33 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:34.416543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-09ef45f7-7786-46b1-bd6a-692bafb16af1 req-05470350-ae2b-4bc8-83c0-ed6942684a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e4589f-6f59-4c4c-9e1f-6fd2200fca37", "tag": "f3c5a806-d575-423b-90c4-a4c63c718ea6"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:34.432991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-09ef45f7-7786-46b1-bd6a-692bafb16af1 req-05470350-ae2b-4bc8-83c0-ed6942684a00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:34.433788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-09ef45f7-7786-46b1-bd6a-692bafb16af1 req-05470350-ae2b-4bc8-83c0-ed6942684a00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.450125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-09ef45f7-7786-46b1-bd6a-692bafb16af1 req-05470350-ae2b-4bc8-83c0-ed6942684a00 service nova] Creating event network-changed:f3c5a806-d575-423b-90c4-a4c63c718ea6 for instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 on n-h1-851368-1 Jul 28 11:59:34.480599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-09ef45f7-7786-46b1-bd6a-692bafb16af1 req-05470350-ae2b-4bc8-83c0-ed6942684a00 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067951 Jul 28 11:59:34.481196 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2705/5405] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:34.604014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:34.605093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:34.620567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:34.621730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.622810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:34.623669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.644804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:34.645520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:34.660027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:34.660492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.661292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:34.661739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:34.998607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:35.008288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3037997-219d-4ede-afc2-36856537e630 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.368075 Jul 28 11:59:35.025170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:35.034206 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2706/5406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:34 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:35.037159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c0cf7d9-2a73-4d18-80c1-1051fee24921 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1366 microversion: 2.1 time: 0.438565 Jul 28 11:59:35.037766 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2701/5407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:34 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:35.168139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:35.168869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:35.177349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:35.178555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:35.184285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:35.184799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:35.378223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:35.387812 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-48889b87-7723-4329-ba17-e903488b6672 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.223467 Jul 28 11:59:35.403039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2707/5408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:35 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:36.058727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:36.059775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:36.060422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:36.065235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:36.068968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.070262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.071964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.072599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.090941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.091356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.092157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.092604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.376808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:36.385966 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f01f7d7c-3268-47d0-b991-34ec3f9c0fe7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.335526 Jul 28 11:59:36.392647 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2702/5409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:36 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:36.400134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:36.403619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:36.410482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:36.411140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:36.420239 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf3b2518-6f10-4f74-9fe4-b08caae6ecd4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1556 microversion: 2.1 time: 0.364943 Jul 28 11:59:36.420451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.420904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.421698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.422912 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2708/5410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:36 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1556 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:36.426308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.444096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:36.445270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:36.456201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.456667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.459912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:36.460600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:36.638900 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc14227a-a694-4490-834f-be61fd50de57 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199080 Jul 28 11:59:36.640117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2709/5411] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 11:59:36 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:36.726206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:36.735197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-729ad3e9-fc7d-4c30-8269-5d8a28b38e49 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.328639 Jul 28 11:59:36.735835 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2703/5412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:36 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:37.417039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:37.418461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:37.426516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:37.427424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:37.428716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:37.429574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:37.645549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:37.653948 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff3cbb03-5b56-45d1-8811-aeb5ffddad5a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.244681 Jul 28 11:59:37.654912 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2710/5413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:37 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:37.756905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:37.757614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:37.764701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:37.765296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:37.766835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:37.767408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:37.926921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:37.935888 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d55e25b5-8478-4f58-8a04-e83dca9833a0 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.183040 Jul 28 11:59:37.936784 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2704/5414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:37 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:38.090337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-45f0035c-b857-44fa-b3b1-f64b412af6fb req-d2acdc70-2534-41be-a7e7-a6c2be5bf8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59694965-d6c2-4f07-9b65-cffc5236c1ff", "tag": "1e56f1bf-248f-4a2a-8f99-8deca8ae15e8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:38.101988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-45f0035c-b857-44fa-b3b1-f64b412af6fb req-d2acdc70-2534-41be-a7e7-a6c2be5bf8fe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:38.102842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-45f0035c-b857-44fa-b3b1-f64b412af6fb req-d2acdc70-2534-41be-a7e7-a6c2be5bf8fe service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:38.116848 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-45f0035c-b857-44fa-b3b1-f64b412af6fb req-d2acdc70-2534-41be-a7e7-a6c2be5bf8fe service nova] Creating event network-changed:1e56f1bf-248f-4a2a-8f99-8deca8ae15e8 for instance 59694965-d6c2-4f07-9b65-cffc5236c1ff on n-h1-851368-1 Jul 28 11:59:38.123054 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-45f0035c-b857-44fa-b3b1-f64b412af6fb req-d2acdc70-2534-41be-a7e7-a6c2be5bf8fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038325 Jul 28 11:59:38.124271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2711/5415] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:38.680014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:38.680687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:38.695219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:38.695572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:38.701881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:38.702694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:38.904691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:38.916902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8af6578a-e905-4056-b198-85807091438c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.240355 Jul 28 11:59:38.919987 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2705/5416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:38 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:38.958149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:38.959486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:38.976946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:38.977420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:38.978249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:38.978676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:39.235222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:39.246273 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-08804378-ed07-40bf-8a73-d95aacb9db20 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.292546 Jul 28 11:59:39.247554 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2712/5417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:38 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:39.941499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:39.942385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:39.949821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:39.950656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:39.951700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:39.952524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:40.114026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:40.122221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6258c14d-5ae0-4742-939b-8f8483ac8aa5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.185227 Jul 28 11:59:40.122801 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2706/5418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:39 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:40.279842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:40.281855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:40.293249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:40.293962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:40.295239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:40.295991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:40.475269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:40.491009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89843183-6379-4f87-82c5-3f36fb034a13 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1525 microversion: 2.1 time: 0.221955 Jul 28 11:59:40.492107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2713/5419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:40 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1525 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:41.148833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:41.150065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:41.154404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:41.165472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.166305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:41.168754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.169291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:41.331493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:41.339061 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-756e78d7-3c92-453e-8e1e-d2eba389b959 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.199709 Jul 28 11:59:41.339667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2707/5420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:41 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:41.512821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:41.513434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:41.516008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:41.516884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=18 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:41.528648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.529151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:41.529893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.530339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:41.683227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:41.692178 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d3e80a01-d4aa-4f14-99a5-4ac0d11a7428 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1505 microversion: 2.1 time: 0.183203 Jul 28 11:59:41.692759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2714/5421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:41 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:41.713128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06d6c4a2-04e5-4021-aee2-0d23e64a8008 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'create', calling method: .version_select at 0x7f2eb29b4550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-4192566", "description": "tempest-description-205999882"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:41.887123 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06d6c4a2-04e5-4021-aee2-0d23e64a8008 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.177722 Jul 28 11:59:41.901180 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2708/5422] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Jul 28 11:59:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:41.903351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-4192566"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:41.904008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:41.911666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.912481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:41.914113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:41.915007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.090891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.network.security_group_api [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Adding security group a3a2d44e-d7e4-4af9-9609-2c75675ee98b to port 41605a18-2a41-44f8-881f-73ceea143e7c Jul 28 11:59:42.362711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:42.364230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:42.371355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:42.372185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.373401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:42.374003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.737760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:42.749444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0b964cfc-8c27-4946-befd-f1ef1de3cae8 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.391662 Jul 28 11:59:42.764315 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2709/5423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:42 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:42.799391 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c255bd82-8b74-44f4-b82f-29eccf0af060 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.901598 Jul 28 11:59:42.800658 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2715/5424] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:59:41 2022] POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:59:42.817225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-becf8afa-0681-40a6-a640-d58861f33632 req-e77ad5fc-7f01-414f-af5c-06e5deb0398c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:42.829958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-4192566"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:42.835992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:42.850766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:42.851667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.852662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:42.853313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.857317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-becf8afa-0681-40a6-a640-d58861f33632 req-e77ad5fc-7f01-414f-af5c-06e5deb0398c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:42.861142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-becf8afa-0681-40a6-a640-d58861f33632 req-e77ad5fc-7f01-414f-af5c-06e5deb0398c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:42.889483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-becf8afa-0681-40a6-a640-d58861f33632 req-e77ad5fc-7f01-414f-af5c-06e5deb0398c service nova] Creating event network-changed:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:42.897089 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-becf8afa-0681-40a6-a640-d58861f33632 req-e77ad5fc-7f01-414f-af5c-06e5deb0398c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087274 Jul 28 11:59:42.898926 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2716/5425] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:43.084202 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Removing security group a3a2d44e-d7e4-4af9-9609-2c75675ee98b from port 41605a18-2a41-44f8-881f-73ceea143e7c Jul 28 11:59:43.632701 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be10fb52-8dfe-4cab-8ff4-9fd4e8f977fb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.813240 Jul 28 11:59:43.637460 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2710/5426] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:59:42 2022] POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:59:43.645581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af435ca3-4b8b-415a-81a4-653596fb08b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'create', calling method: .version_select at 0x7f2eb30b3e50>, body: {"pool": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:43.774762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:43.775917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:43.790280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:43.791810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:43.792961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:43.794213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:44.167610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:44.176181 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8925e3be-6158-43d8-8fb3-8c1e7c2a931e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.406863 Jul 28 11:59:44.176847 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2711/5427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:43 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:44.183833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6333dc39-d1d0-4be5-a03f-02abcb8c9c28 req-7185f17e-dae2-4867-a779-b8b9befc7573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e4589f-6f59-4c4c-9e1f-6fd2200fca37", "name": "network-vif-plugged", "status": "completed", "tag": "f3c5a806-d575-423b-90c4-a4c63c718ea6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:44.195342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6333dc39-d1d0-4be5-a03f-02abcb8c9c28 req-7185f17e-dae2-4867-a779-b8b9befc7573 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:44.195956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6333dc39-d1d0-4be5-a03f-02abcb8c9c28 req-7185f17e-dae2-4867-a779-b8b9befc7573 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:44.212056 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6333dc39-d1d0-4be5-a03f-02abcb8c9c28 req-7185f17e-dae2-4867-a779-b8b9befc7573 service nova] Creating event network-vif-plugged:f3c5a806-d575-423b-90c4-a4c63c718ea6 for instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 on n-h1-851368-1 Jul 28 11:59:44.217782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6333dc39-d1d0-4be5-a03f-02abcb8c9c28 req-7185f17e-dae2-4867-a779-b8b9befc7573 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039553 Jul 28 11:59:44.219604 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2712/5428] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:44.916385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3908bf99-1ff4-412a-897b-daa87b360f78 req-679e2355-0efd-45a0-967c-7c0e12e5bc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:44.932672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3908bf99-1ff4-412a-897b-daa87b360f78 req-679e2355-0efd-45a0-967c-7c0e12e5bc2d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:44.934452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3908bf99-1ff4-412a-897b-daa87b360f78 req-679e2355-0efd-45a0-967c-7c0e12e5bc2d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:44.949780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3908bf99-1ff4-412a-897b-daa87b360f78 req-679e2355-0efd-45a0-967c-7c0e12e5bc2d service nova] Creating event network-changed:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:44.958799 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3908bf99-1ff4-412a-897b-daa87b360f78 req-679e2355-0efd-45a0-967c-7c0e12e5bc2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045810 Jul 28 11:59:44.959833 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2713/5429] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:45.198099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:45.198953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:45.219584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:45.221538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:45.227281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:45.228079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:45.478762 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af435ca3-4b8b-415a-81a4-653596fb08b8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.839005 Jul 28 11:59:45.480085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2717/5430] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Jul 28 11:59:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:45.493411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.219"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:45.496510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:45.529879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:45.533911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:45.535149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:45.535284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:45.558201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:45.568086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-505a8612-aef7-41f8-bf03-e63e0976a5e1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1373 microversion: 2.1 time: 0.374315 Jul 28 11:59:45.572417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2714/5431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:45 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1373 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:45.607368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Acquired lock "refresh_cache-cccc18f0-7865-4f90-92b4-1babcce6a2f6" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:59:46.592793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:46.593413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:46.606974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:46.607489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:46.608315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:46.613385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:47.201367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:47.214510 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cced3b49-ce72-48c0-a9b9-0ea780c69ca1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1544 microversion: 2.1 time: 0.625275 Jul 28 11:59:47.215426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2715/5432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:46 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1544 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:47.239619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:47.239619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:47.256231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:47.256682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:47.258364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:47.258997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:47.500719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:47.513478 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12812664-dfce-4164-bd1d-8bc58d121259 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1544 microversion: 2.1 time: 0.280697 Jul 28 11:59:47.514905 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2716/5433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:47 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:47.696887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Building network info cache for instance {{(pid=119235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:59:47.721702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-171ff4c6-6786-4299-930b-e0cd72c5b25d req-6c1a34a4-91dc-406f-8e72-cf324e3f1454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:47.757804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-171ff4c6-6786-4299-930b-e0cd72c5b25d req-6c1a34a4-91dc-406f-8e72-cf324e3f1454 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:47.758782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-171ff4c6-6786-4299-930b-e0cd72c5b25d req-6c1a34a4-91dc-406f-8e72-cf324e3f1454 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:47.783866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-171ff4c6-6786-4299-930b-e0cd72c5b25d req-6c1a34a4-91dc-406f-8e72-cf324e3f1454 service nova] Creating event network-changed:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:47.791820 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-171ff4c6-6786-4299-930b-e0cd72c5b25d req-6c1a34a4-91dc-406f-8e72-cf324e3f1454 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073625 Jul 28 11:59:47.793071 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2717/5434] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:48.651719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1660eb25-e5c3-4ebf-8300-1543744acc0c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: .version_select at 0x7f2eb2480a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1113755113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2DjzWVRe38Jh/kCYLszhSlV7TINPpIWn5iisgPaIs/4gwCIBd1ThPF26JUuns5v0fdKLGwpea6QyTq4M7F0hb54UX/OPqgtd05ey1Njs0SAHm6rlIckRUAyv9s9gVcLg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:48.694134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1660eb25-e5c3-4ebf-8300-1543744acc0c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 11:59:48.704732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1660eb25-e5c3-4ebf-8300-1543744acc0c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 11:59:48.748877 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1660eb25-e5c3-4ebf-8300-1543744acc0c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.384743 Jul 28 11:59:48.751387 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2718/5435] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 11:59:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:48.946978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Updating instance_info_cache with network_info: [{"id": "41605a18-2a41-44f8-881f-73ceea143e7c", "address": "fa:16:3e:3d:2c:39", "network": {"id": "ef699de6-4c9c-4018-8fce-3ceaf4680adb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2012209779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "22740b6e0ea944b797bc2d4999f7630b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap41605a18-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:59:48.971503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Releasing lock "refresh_cache-cccc18f0-7865-4f90-92b4-1babcce6a2f6" {{(pid=119235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:59:48.973866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-255d499e-28df-4c4b-9b35-d3cff79b2409 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action" status: 202 len: 0 microversion: 2.1 time: 3.484986 Jul 28 11:59:48.976566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2718/5436] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:59:45 2022] POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action => generated 0 bytes in 3489 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 28 11:59:48.987402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.219"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:49.227706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:49.236005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:49.236533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:49.237680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:49.238127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:49.573965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Acquired lock "refresh_cache-cccc18f0-7865-4f90-92b4-1babcce6a2f6" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 11:59:50.569457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Building network info cache for instance {{(pid=119236) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 11:59:50.576002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1ece5723-6059-4ec0-8db2-15f687e76d7b req-c6d1ae4f-bc06-448e-bb13-f7da322f85cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:50.592153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1ece5723-6059-4ec0-8db2-15f687e76d7b req-c6d1ae4f-bc06-448e-bb13-f7da322f85cb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:50.593023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1ece5723-6059-4ec0-8db2-15f687e76d7b req-c6d1ae4f-bc06-448e-bb13-f7da322f85cb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:50.605249 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1ece5723-6059-4ec0-8db2-15f687e76d7b req-c6d1ae4f-bc06-448e-bb13-f7da322f85cb service nova] Creating event network-changed:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:50.611791 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1ece5723-6059-4ec0-8db2-15f687e76d7b req-c6d1ae4f-bc06-448e-bb13-f7da322f85cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039695 Jul 28 11:59:50.613031 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2719/5437] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 11:59:50.797768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f38aae2e-59af-4031-8808-2e19cb970cba req-7ecf3942-73a0-48b9-8530-a3bf4dfdaa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e4589f-6f59-4c4c-9e1f-6fd2200fca37", "tag": "f3c5a806-d575-423b-90c4-a4c63c718ea6"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:50.819005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f38aae2e-59af-4031-8808-2e19cb970cba req-7ecf3942-73a0-48b9-8530-a3bf4dfdaa2b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:50.821229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f38aae2e-59af-4031-8808-2e19cb970cba req-7ecf3942-73a0-48b9-8530-a3bf4dfdaa2b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:50.852313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f38aae2e-59af-4031-8808-2e19cb970cba req-7ecf3942-73a0-48b9-8530-a3bf4dfdaa2b service nova] Creating event network-changed:f3c5a806-d575-423b-90c4-a4c63c718ea6 for instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 on n-h1-851368-1 Jul 28 11:59:50.865005 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f38aae2e-59af-4031-8808-2e19cb970cba req-7ecf3942-73a0-48b9-8530-a3bf4dfdaa2b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071442 Jul 28 11:59:50.866309 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2720/5438] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:52.107001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Updating instance_info_cache with network_info: [{"id": "41605a18-2a41-44f8-881f-73ceea143e7c", "address": "fa:16:3e:3d:2c:39", "network": {"id": "ef699de6-4c9c-4018-8fce-3ceaf4680adb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2012209779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "22740b6e0ea944b797bc2d4999f7630b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap41605a18-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119236) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 11:59:52.127780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Releasing lock "refresh_cache-cccc18f0-7865-4f90-92b4-1babcce6a2f6" {{(pid=119236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 11:59:52.128689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb4d4622-9200-47b5-babe-5fa396ec55bb tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action" status: 202 len: 0 microversion: 2.1 time: 3.147859 Jul 28 11:59:52.129309 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2719/5439] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 11:59:48 2022] POST /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6/action => generated 0 bytes in 3149 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 11:59:52.142236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-99dc2752-3beb-4408-acf8-dd4d663ee90d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '.version_select at 0x7f2ebbfe91f0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:53.354852 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-99dc2752-3beb-4408-acf8-dd4d663ee90d tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/600eeac9-3803-457a-a56f-e670d3d71dee" status: 202 len: 0 microversion: 2.1 time: 1.218423 Jul 28 11:59:53.356780 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2721/5440] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Jul 28 11:59:52 2022] DELETE /compute/v2.1/os-floating-ips/600eeac9-3803-457a-a56f-e670d3d71dee => generated 0 bytes in 1222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:59:53.365786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b960d953-2d94-407c-8a5c-c4c4e6de8111 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '.version_select at 0x7f2eb2479820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:53.595113 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b960d953-2d94-407c-8a5c-c4c4e6de8111 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/a3a2d44e-d7e4-4af9-9609-2c75675ee98b" status: 202 len: 0 microversion: 2.1 time: 0.233550 Jul 28 11:59:53.596862 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2720/5441] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 11:59:53 2022] DELETE /compute/v2.1/os-security-groups/a3a2d44e-d7e4-4af9-9609-2c75675ee98b => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 11:59:53.604595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:53.605860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:53.619331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:53.619766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:53.620776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:53.621228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:53.658689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 11:59:53.743034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43747029-4ed5-4ff6-9b06-223eff83cca8 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 204 len: 0 microversion: 2.1 time: 0.141829 Jul 28 11:59:53.747175 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2722/5442] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 11:59:53 2022] DELETE /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 11:59:53.754415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:53.755033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:53.761634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:53.762311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:53.763762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:53.764385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:53.925096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:53.933337 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9b7f30b6-c240-4fac-9c2d-9bea1d657370 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1511 microversion: 2.1 time: 0.185200 Jul 28 11:59:53.954619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2721/5443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:53 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 11:59:54.955469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:54.957520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:54.966085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:54.966854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:54.967783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:54.968799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:55.143027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:55.151586 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e37f3d4-2340-4aeb-956e-6842f879679a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1511 microversion: 2.1 time: 0.200403 Jul 28 11:59:55.152266 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2723/5444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:54 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:56.178208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:56.183309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:56.194840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:56.197486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:56.200418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:56.201465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:56.253836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:56.419338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:56.428567 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-50703c71-5f8a-46c6-9819-83f8795c4892 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1511 microversion: 2.1 time: 0.254639 Jul 28 11:59:56.429523 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2722/5445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:56 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:57.451262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:57.452527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:57.469426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:57.470192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:57.472256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:57.472917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:57.696490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:57.705356 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cce88fc5-4cd0-4dc0-9b53-fdcdf8f6a43b tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1511 microversion: 2.1 time: 0.258338 Jul 28 11:59:57.705940 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2724/5446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:57 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:57.931757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-87b8f7dd-7f9d-41aa-8039-3982de1a18b5 req-0fd52498-0c73-4c94-8c51-310082ec3b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccc18f0-7865-4f90-92b4-1babcce6a2f6", "name": "network-vif-deleted", "tag": "41605a18-2a41-44f8-881f-73ceea143e7c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:57.943798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:57.960856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-87b8f7dd-7f9d-41aa-8039-3982de1a18b5 req-0fd52498-0c73-4c94-8c51-310082ec3b5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:57.961301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-87b8f7dd-7f9d-41aa-8039-3982de1a18b5 req-0fd52498-0c73-4c94-8c51-310082ec3b5a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:57.993804 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-87b8f7dd-7f9d-41aa-8039-3982de1a18b5 req-0fd52498-0c73-4c94-8c51-310082ec3b5a service nova] Creating event network-vif-deleted:41605a18-2a41-44f8-881f-73ceea143e7c for instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 on n-h2-851368-1 Jul 28 11:59:58.002567 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-87b8f7dd-7f9d-41aa-8039-3982de1a18b5 req-0fd52498-0c73-4c94-8c51-310082ec3b5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074411 Jul 28 11:59:58.010624 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2723/5447] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 11:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 11:59:58.726440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 11:59:58.727951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 11:59:58.736597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:58.737479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:58.738356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:58.738953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:58.792681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 11:59:58.793412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 11:59:58.794384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lazy-loading 'fault' on Instance uuid cccc18f0-7865-4f90-92b4-1babcce6a2f6 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 11:59:58.844599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2647d1878da84b3ca79dc9da87f3ad9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22740b6e0ea944b797bc2d4999f7630b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 11:59:58.854078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0add041c-1ccc-4fe6-a240-51f456384e3a tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 200 len: 1313 microversion: 2.1 time: 0.131584 Jul 28 11:59:58.854923 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2725/5448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 11:59:58 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 1313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 11:59:59.822866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:59.853716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1729291781", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "58798c31-ed7d-46d1-b794-c2ff63e329c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1113755113", "security_groups": [{"name": "tempest-secgroup-smoke-412082655"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 11:59:59.867512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:59:59.981663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] validate_networks() for [('58798c31-ed7d-46d1-b794-c2ff63e329c2', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 11:59:59.989464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1224367965", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "bd966669-6e78-423d-83e9-aa09fd4aaa16"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:00.051443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] validate_networks() for [('bd966669-6e78-423d-83e9-aa09fd4aaa16', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:00:00.684400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:00:00.684896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:00:00.685312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:00:00.685726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:00:00.686174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:00:00.693700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:00:00.694127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:00:00.695014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:00:00.695014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:00:00.695493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:00:00.703852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.704115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.707593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.710552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.720495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.721494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.723986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.731139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.734149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:00.741732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:00.756665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:00:00.758924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:00:00.761792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Getting quotas for project 072df4c1b58c457796ff371ae9fc651d. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:00.773192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Getting quotas for user d42991c946aa47f4b393871645404f20 and project 072df4c1b58c457796ff371ae9fc651d. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:00.787247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:00:00.789680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:00:00.811247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-728a3604-427e-4656-9d7b-b4ee8257ae3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.962568 Jul 28 12:00:00.812606 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2726/5449] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:59:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 12:00:00.818421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:00.819707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] [instance: cccc18f0-7865-4f90-92b4-1babcce6a2f6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:00.829166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.830060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.831046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:00.831858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:00.849861 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] HTTP exception thrown: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Request method failure captured: Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 HTTP/1.1 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4noAYc2wU5T7Z6tXyJzlh63K2HNfvvA3RhElKgFG-FGGFw8tsKiEFtbwue0FxzaG8PbGbRfYdfJCj0IMZG3xTLLi-VUiiewbcxcKVAS2Sc1D7ncwHvGPjeqmkJlodYASOcY6oEUI0WqaYyS2UAtdvBcQKHQ5qlVGPdo0ngD1bEYO-nU Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 22740b6e0ea944b797bc2d4999f7630b Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1655589769 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22740b6e0ea944b797bc2d4999f7630b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22740b6e0ea944b797bc2d4999f7630b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22740b6e0ea944b797bc2d4999f7630b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22740b6e0ea944b797bc2d4999f7630b"}]}] Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1655589769 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 22740b6e0ea944b797bc2d4999f7630b Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1655589769 Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerRescueTestJSONUnderV235-1655589769-project Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 2647d1878da84b3ca79dc9da87f3ad9c Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1655589769-project Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'cccc18f0-7865-4f90-92b4-1babcce6a2f6'} Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:00:00.851659 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] Returning 404 to user: Instance cccc18f0-7865-4f90-92b4-1babcce6a2f6 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:00:00.856776 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-97f58608-dd1f-4ed9-9dc7-371587796670 tempest-ServerRescueTestJSONUnderV235-1655589769 tempest-ServerRescueTestJSONUnderV235-1655589769-project] 10.222.0.93 "GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6" status: 404 len: 111 microversion: 2.1 time: 0.039015 Jul 28 12:00:00.858301 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2727/5450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:00 2022] GET /compute/v2.1/servers/cccc18f0-7865-4f90-92b4-1babcce6a2f6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:00:00.862828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c844d10-09f3-4cb7-811b-756924f1f8bc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:00.863484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c844d10-09f3-4cb7-811b-756924f1f8bc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:00.922789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ab921f5d-73ca-4884-a2bf-33852503d8d3 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106042 Jul 28 12:00:00.923786 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2724/5451] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 11:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:00:00.934353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8628171-c83b-4ece-9ce0-a281f0ec1ba0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:00.935292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8628171-c83b-4ece-9ce0-a281f0ec1ba0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:00.940087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c844d10-09f3-4cb7-811b-756924f1f8bc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:00.963741 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c844d10-09f3-4cb7-811b-756924f1f8bc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1267 microversion: 2.1 time: 0.102033 Jul 28 12:00:00.975837 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2728/5452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:00 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:01.039811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8628171-c83b-4ece-9ce0-a281f0ec1ba0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:01.046931 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8628171-c83b-4ece-9ce0-a281f0ec1ba0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1215 microversion: 2.1 time: 0.116421 Jul 28 12:00:01.051630 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2725/5453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:00 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:01.997894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:01.999703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:02.021456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:02.026924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:02.028325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:02.028461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:02.076227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:02.083055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:02.105197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:02.108004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:02.112685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:02.113395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:02.154815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:02.165623 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8d2ecc1-632c-49aa-84a1-8ff82dcec4d5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1319 microversion: 2.1 time: 0.173005 Jul 28 12:00:02.166672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2729/5454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:01 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:02.212601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:02.224108 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88112e81-cb49-472c-a427-19a4c92cbe4f tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1267 microversion: 2.1 time: 0.154737 Jul 28 12:00:02.225013 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2726/5455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:02 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:03.187105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:03.187896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:03.195735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:03.196054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:03.196855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:03.197302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:03.247797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:03.248406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:03.253796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:03.268132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:03.268594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:03.269404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:03.269845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:03.333927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:03.347016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-255cb247-feb8-48d6-9a8f-10c42e514ee5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1325 microversion: 2.1 time: 0.162513 Jul 28 12:00:03.348271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2730/5456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:03 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:03.518950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:03.532462 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4e9cd86-dde2-4a66-9fe3-c3de3a0d3ed0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1273 microversion: 2.1 time: 0.288891 Jul 28 12:00:03.533616 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2727/5457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:03 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:04.368489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:04.369127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:04.382143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:04.382936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:04.385207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:04.386706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:04.554515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:04.555175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:04.563972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:04.564549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:04.565406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:04.565918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:04.885733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:04.892037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:04.903269 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-03f8cafa-0840-41b4-8f28-cf11e0de5548 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.538519 Jul 28 12:00:04.904553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9c08a4b9-e0e9-403d-b801-bb5bc7f11b8d tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.353394 Jul 28 12:00:04.905643 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2728/5459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:04 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:04.905897 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2731/5459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:04 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:05.033448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d782f757-407b-4431-a51f-300837fb86a4 req-3f2c4740-b4c0-46da-90fc-f7e7cb1f8ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff32f52-7fce-477e-aafe-37f2fbdbcd10", "tag": "f0d73361-e4ba-4714-bda3-ef3a88067ad8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:05.045198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d782f757-407b-4431-a51f-300837fb86a4 req-3f2c4740-b4c0-46da-90fc-f7e7cb1f8ff2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.045923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d782f757-407b-4431-a51f-300837fb86a4 req-3f2c4740-b4c0-46da-90fc-f7e7cb1f8ff2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:05.062956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d782f757-407b-4431-a51f-300837fb86a4 req-3f2c4740-b4c0-46da-90fc-f7e7cb1f8ff2 service nova] Creating event network-changed:f0d73361-e4ba-4714-bda3-ef3a88067ad8 for instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 on n-h2-851368-1 Jul 28 12:00:05.068251 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d782f757-407b-4431-a51f-300837fb86a4 req-3f2c4740-b4c0-46da-90fc-f7e7cb1f8ff2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038598 Jul 28 12:00:05.069473 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2729/5460] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:05.734952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-69e5e693-ad65-4ce1-ad27-40326f4a3fd2 req-f91e441f-fe39-4cdd-b5bc-7204f6d4e9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:05.755887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-69e5e693-ad65-4ce1-ad27-40326f4a3fd2 req-f91e441f-fe39-4cdd-b5bc-7204f6d4e9e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.756404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-69e5e693-ad65-4ce1-ad27-40326f4a3fd2 req-f91e441f-fe39-4cdd-b5bc-7204f6d4e9e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:05.771798 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-69e5e693-ad65-4ce1-ad27-40326f4a3fd2 req-f91e441f-fe39-4cdd-b5bc-7204f6d4e9e1 service nova] Creating event network-changed:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h2-851368-1 Jul 28 12:00:05.778572 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-69e5e693-ad65-4ce1-ad27-40326f4a3fd2 req-f91e441f-fe39-4cdd-b5bc-7204f6d4e9e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Jul 28 12:00:05.779522 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2732/5461] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:05.926602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:05.927711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:05.927859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:05.928568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:05.935494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.936085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:05.936203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.936658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:05.937201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.937611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:05.937840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:05.938058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:06.167685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:06.170734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:06.177896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-beb897cc-ab07-45be-9a19-14e2ac316eb6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.255994 Jul 28 12:00:06.178726 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2733/5462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:05 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:06.178977 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c1e70de-684b-474d-ae27-ab522e897b1c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.257855 Jul 28 12:00:06.179853 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2730/5463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:05 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:06.992614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-151632247", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": "none"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:07.062862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:00:07.063317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:00:07.063791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:00:07.064207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:00:07.064619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:00:07.073542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.073989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.074787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.075260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.092100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Getting quotas for project 9ac50d72e055482db146ee3fcbb447ae. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:07.098183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Getting quotas for user 57704df3fabd4ccebb86a06aba7ebbb2 and project 9ac50d72e055482db146ee3fcbb447ae. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:07.111004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:00:07.113296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:00:07.156342 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8617e4a0-70fd-47a4-a9de-c85d92629463 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.300729 Jul 28 12:00:07.157074 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2734/5464] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 12:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 12:00:07.168071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:07.168816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:07.200962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:07.201691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:07.208349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.209168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.210019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.210535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.243655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:07.256995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:07.258520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:07.260064 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fcc329e8-01e1-4f4b-93a5-7ed5103222fd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1277 microversion: 2.54 time: 0.096014 Jul 28 12:00:07.266349 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2731/5465] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:07 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:07.268666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:07.269456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:07.276579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.277137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.278080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:07.278615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:07.495680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:07.504302 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-063759f7-4193-441d-8e0f-d4c3f58d7b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.307361 Jul 28 12:00:07.505550 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2735/5466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:07 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:07.508611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:07.517525 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-61e936b2-0a44-41e9-bc30-3e6c8fcd9da9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.255437 Jul 28 12:00:07.518304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2732/5467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:07 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:08.284239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:08.284844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:08.292147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.292610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.293971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.294429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.361685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:08.369756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:08.371306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:08.372446 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d34112d2-3c64-4fff-8ce8-b5e18e8073ca tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1347 microversion: 2.54 time: 0.092821 Jul 28 12:00:08.373005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2736/5468] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:08 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1347 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:08.528281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:08.528901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:08.536967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.537374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.538150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.538597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.540409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:08.541033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:08.547675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.548135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.548940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:08.549382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:08.725633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:08.733157 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3bf42aea-5867-4f36-8203-74b47393b468 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.208801 Jul 28 12:00:08.734278 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2733/5469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:08 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:08.738952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:08.746444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85b2513c-b82c-4394-a531-a5f2073c24a6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.209872 Jul 28 12:00:08.747005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2737/5470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:08 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:09.396682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:09.397420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:09.403441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.403885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.404648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.405082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.468921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:09.477127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:09.478629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:09.479776 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf15db4c-299d-4d50-b16d-4c2db54ff151 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1335 microversion: 2.54 time: 0.087081 Jul 28 12:00:09.480338 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2734/5471] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:09 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1335 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:09.755711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:09.756329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:09.763531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.763988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.764953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.765412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.767581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:09.768258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:09.775488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.776402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.777210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:09.777659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:09.931899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:09.939680 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9098501c-c979-4243-8b43-779b05ff04a9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.176471 Jul 28 12:00:09.940267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2735/5472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:09 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:10.016641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:10.024073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-48d6379c-e9f3-455f-8a97-f8a3690c1069 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.272287 Jul 28 12:00:10.024636 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2738/5473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:09 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:10.509214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:10.509907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:10.516585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:10.517046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:10.517820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:10.518268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:10.585035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:10.595530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:10.597306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:10.598445 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43b5ca0f-7639-4f9a-967e-d179c6ce33ff tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1335 microversion: 2.54 time: 0.094059 Jul 28 12:00:10.599016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2736/5474] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:10 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:10.960572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:10.961188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:10.968399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:10.968855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:10.969641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:10.970086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.045323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:11.045938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:11.048495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:11.054448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:11.054896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.055731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:11.056170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.115963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:11.123526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4174cd16-2afb-48dd-8565-cc860a478d9b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.166903 Jul 28 12:00:11.124857 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2739/5475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:10 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:11.198920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:11.206481 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39edfc96-15f8-46c5-9f76-85cb4b1ba0f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.165076 Jul 28 12:00:11.207117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2737/5476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:11 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:11.528254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5e4dc5a6-2b7e-44d9-9afc-828d7b4c31a1 req-8f2db313-9708-41f8-b492-9a632d7d6c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff32f52-7fce-477e-aafe-37f2fbdbcd10", "name": "network-vif-plugged", "status": "completed", "tag": "f0d73361-e4ba-4714-bda3-ef3a88067ad8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:11.543573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5e4dc5a6-2b7e-44d9-9afc-828d7b4c31a1 req-8f2db313-9708-41f8-b492-9a632d7d6c6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:11.544272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5e4dc5a6-2b7e-44d9-9afc-828d7b4c31a1 req-8f2db313-9708-41f8-b492-9a632d7d6c6f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.566017 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5e4dc5a6-2b7e-44d9-9afc-828d7b4c31a1 req-8f2db313-9708-41f8-b492-9a632d7d6c6f service nova] Creating event network-vif-plugged:f0d73361-e4ba-4714-bda3-ef3a88067ad8 for instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 on n-h2-851368-1 Jul 28 12:00:11.573166 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5e4dc5a6-2b7e-44d9-9afc-828d7b4c31a1 req-8f2db313-9708-41f8-b492-9a632d7d6c6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049339 Jul 28 12:00:11.574057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2740/5477] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:11.622646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:11.623311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:11.629810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:11.630269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.631100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:11.631872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:11.722412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:11.731448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:11.733167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:11.734987 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca2067f9-03b5-4e3d-b36f-314fe33e605c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1335 microversion: 2.54 time: 0.116936 Jul 28 12:00:11.735595 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2738/5478] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:11 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:12.146015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:12.146725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:12.153010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.153481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.154255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.154698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.228141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:12.228853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:12.237573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.238232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.239891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.240538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.332411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:12.340332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89c1255b-6072-44ce-807a-a471f5a2924d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.199431 Jul 28 12:00:12.340913 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2741/5479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:12 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:12.394948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:12.403667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de5b4940-130c-43be-9605-be9a2368e95c tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1315 microversion: 2.1 time: 0.179549 Jul 28 12:00:12.404254 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2739/5480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:12 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:12.758201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:12.758961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:12.765335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.765787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.766563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.767008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.830245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:12.838446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:12.840001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:12.841179 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52d4da98-2828-4e28-9826-47c8459d2ced tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1356 microversion: 2.54 time: 0.087018 Jul 28 12:00:12.841749 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2742/5481] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:12 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1356 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:12.866830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b27578c3-bba5-441d-aedc-34f8d0756a0b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Action: 'create', calling method: .version_select at 0x7f2eb1b5b8b0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-799511902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoQm2M0PWp3nnAvv5SjQZtDSwckWAkPBvAelrHM07iqB6xTsmby5NgVPcU/cyELVQjFsk46ulAxZmOkqjti4JtWE8qG7jNl2j2udMZQEISJZeEW815v0U0veoRXPrDYHQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:12.882922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b27578c3-bba5-441d-aedc-34f8d0756a0b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Getting quotas for project 9ac50d72e055482db146ee3fcbb447ae. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:12.888081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b27578c3-bba5-441d-aedc-34f8d0756a0b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Getting quotas for user 57704df3fabd4ccebb86a06aba7ebbb2 and project 9ac50d72e055482db146ee3fcbb447ae. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:12.912345 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b27578c3-bba5-441d-aedc-34f8d0756a0b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.049248 Jul 28 12:00:12.917856 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2740/5482] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 12:00:12 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 12:00:12.925243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-799511902", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:12.928409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:12.935449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.935909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:12.936830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:12.937300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.026420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:00:13.026851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:00:13.027360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:00:13.027777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:00:13.028199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:00:13.101324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.108037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.108561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.109846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.110288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.136952 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e30c523-5d5d-417d-b4e0-1b66a4fb7f1a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "POST /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2/action" status: 202 len: 1138 microversion: 2.54 time: 0.216694 Jul 28 12:00:13.137587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2743/5483] 10.222.0.93 () {62 vars in 1320 bytes} [Thu Jul 28 12:00:12 2022] POST /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2/action => generated 1138 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 28 12:00:13.158120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:13.159081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.166267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.166731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.167570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.168016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.241948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.257326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.260466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.262273 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-472b10a6-851c-4a7d-9ab7-426ba9089af8 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.108506 Jul 28 12:00:13.263173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2741/5484] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:13 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:00:13.361259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:13.361874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.369611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.370063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.370836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.371299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.431748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:13.435123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.442674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.443310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.444708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.445252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.566007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.573827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57492704-db07-4d68-ac48-623c2715abff tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.216486 Jul 28 12:00:13.574530 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2744/5485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:13 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:13.589197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-57c1fff3-19b6-41ff-84d9-5c603793a5aa req-f61ef445-3982-46f9-b4af-a134d9d0b901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "name": "network-vif-plugged", "status": "completed", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:13.600215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-57c1fff3-19b6-41ff-84d9-5c603793a5aa req-f61ef445-3982-46f9-b4af-a134d9d0b901 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.600715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-57c1fff3-19b6-41ff-84d9-5c603793a5aa req-f61ef445-3982-46f9-b4af-a134d9d0b901 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.613415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.614624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-57c1fff3-19b6-41ff-84d9-5c603793a5aa req-f61ef445-3982-46f9-b4af-a134d9d0b901 service nova] Creating event network-vif-plugged:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h2-851368-1 Jul 28 12:00:13.619622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-57c1fff3-19b6-41ff-84d9-5c603793a5aa req-f61ef445-3982-46f9-b4af-a134d9d0b901 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034964 Jul 28 12:00:13.620441 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2745/5486] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:00:13.621263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4adc0f77-426d-4286-9d2a-a2736888d7a7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1503 microversion: 2.1 time: 0.199300 Jul 28 12:00:13.621996 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2742/5487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:13 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:13.642122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:13.642815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.648979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.649432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.650213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.650648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.846532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:13.854073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c8a54924-e920-4549-96dc-67c0ee2d092b tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1503 microversion: 2.1 time: 0.216571 Jul 28 12:00:13.854642 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2746/5488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:13 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:13.874573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:13.875143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.881108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.881558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.882321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.882760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.905049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lazy-loading 'flavor' on Instance uuid eff32f52-7fce-477e-aafe-37f2fbdbcd10 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:00:13.908486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:13.975757 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0fe08e71-bdb8-4e8c-bfaf-b638d9c30b10 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action" status: 202 len: 0 microversion: 2.1 time: 0.105352 Jul 28 12:00:13.976388 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2743/5489] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:13 2022] POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:00:13.984352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:13.984962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:13.991008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.991489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:13.992241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:13.992677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:14.007989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:14.123334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:14.131515 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfe0fcaf-3096-4325-8830-9b9c1be954f9 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1511 microversion: 2.1 time: 0.150996 Jul 28 12:00:14.132096 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2747/5490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:13 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:14.288114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:14.288809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:14.295003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:14.295481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:14.296729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:14.297160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:14.363755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:14.371686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:14.373125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:14.374904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f8efedf-3126-4828-b99f-3711b1116aba tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.091405 Jul 28 12:00:14.375512 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2744/5491] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:14 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:14.596368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:14.597008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:14.604037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:14.604500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:14.605275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:14.605719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:14.749537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:14.758144 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-277161c9-7ac1-4ca5-9b06-f7e899018c03 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1392 microversion: 2.1 time: 0.166335 Jul 28 12:00:14.765587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2748/5492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:14 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:15.153063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:15.153681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:15.160968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.161418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.162184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.162646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.398238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:15.398866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:15.405401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.405863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.406661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.407128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.626248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:15.634513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:15.636061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:15.637244 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-526585b6-a922-46f2-b749-794c520a2b28 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.243187 Jul 28 12:00:15.638000 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2749/5493] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:15 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:00:15.692283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:15.699972 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ace16073-9933-45d2-9364-6f89316ff259 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1494 microversion: 2.1 time: 0.551154 Jul 28 12:00:15.700647 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2745/5494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:15 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:15.720454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:15.721054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:15.727399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.727854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.728615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.729054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.779766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:15.780379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:15.786584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.787037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.787848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.788281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.798872 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b883ef5d-a711-409d-9900-34192a18bd32 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action" status: 202 len: 0 microversion: 2.1 time: 0.082192 Jul 28 12:00:15.803013 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2750/5495] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:15 2022] POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 12:00:15.809085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:15.810279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:15.818437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.819172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:15.820294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:15.820735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:16.093475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.101258 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f842560e-c992-41a5-b208-d32c714d41e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1563 microversion: 2.1 time: 0.325509 Jul 28 12:00:16.102046 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2746/5496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:15 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1563 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:16.121668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:16.122409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:16.128545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:16.129008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:16.129517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.129792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:16.130237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:16.138056 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b1ea68c-65f7-49e0-a634-c2fae54c8cc7 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1500 microversion: 2.1 time: 0.333752 Jul 28 12:00:16.138942 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2751/5497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:15 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1500 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:16.375291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.382747 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47d2bc4c-a8f2-4173-883e-fcea5c7d7302 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1563 microversion: 2.1 time: 0.264943 Jul 28 12:00:16.383348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2747/5498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:16 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:16.661571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:16.662217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:16.669353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:16.669868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:16.670745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:16.671246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:16.735463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.743451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.744980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:16.746153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-473debb7-f4da-4874-8682-fd08c75bb98d tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.088992 Jul 28 12:00:16.746717 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2752/5499] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:16 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:17.160153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:17.161023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:17.167279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:17.167740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:17.168525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:17.169093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:17.312319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:17.321308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4088f495-f5bf-4cff-a964-8c9e89161a23 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1500 microversion: 2.1 time: 0.165784 Jul 28 12:00:17.322216 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2748/5500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:17 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:17.770351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:17.771098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:17.773185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:17.773850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=14 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:17.780003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:17.780380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:17.781193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:17.781637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:17.850605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:17.859549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:17.861084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:17.862287 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b20c6aa-ab6c-44c6-9672-0d19196d7e37 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.095912 Jul 28 12:00:17.862860 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2753/5501] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:17 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:18.310461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:18.311239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:18.312316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d6479a5e-43fc-408a-8dc7-5e283a10be6f req-646af124-f6e3-46a8-a80a-1617f52f6fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:18.318742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.319314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.320179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.320799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.324037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d6479a5e-43fc-408a-8dc7-5e283a10be6f req-646af124-f6e3-46a8-a80a-1617f52f6fbb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.324614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d6479a5e-43fc-408a-8dc7-5e283a10be6f req-646af124-f6e3-46a8-a80a-1617f52f6fbb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.336667 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d6479a5e-43fc-408a-8dc7-5e283a10be6f req-646af124-f6e3-46a8-a80a-1617f52f6fbb service nova] Creating event network-changed:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h2-851368-1 Jul 28 12:00:18.344528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d6479a5e-43fc-408a-8dc7-5e283a10be6f req-646af124-f6e3-46a8-a80a-1617f52f6fbb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036005 Jul 28 12:00:18.345794 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2754/5502] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:00:18.351842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:18.352618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:18.359494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.360036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.360875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.361377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.661052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:18.666553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:18.676393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4e5d4fe-8bcf-4b0f-9d79-6556b37497a6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1503 microversion: 2.1 time: 0.329189 Jul 28 12:00:18.676543 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a938ff25-a226-4cb7-b3c4-ab2bc28ba32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1563 microversion: 2.1 time: 0.370260 Jul 28 12:00:18.676987 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2755/5503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:18 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:18.677906 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2749/5504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:18 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1563 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:18.700452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:18.701114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:18.710403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.710941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.711848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.712350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.740864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lazy-loading 'flavor' on Instance uuid eff32f52-7fce-477e-aafe-37f2fbdbcd10 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:00:18.830350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6eecbfb-3e95-487c-b43a-b3ded6442726 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action" status: 202 len: 0 microversion: 2.1 time: 0.134609 Jul 28 12:00:18.831512 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2756/5505] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:18 2022] POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:00:18.840342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:18.841228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:18.850390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.851464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.852422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.853054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.886326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:18.887030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:18.889279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:18.896339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.896787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:18.897715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:18.898158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:19.017172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:19.025580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:19.027315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:19.028630 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f35164d-d275-4e90-a623-a672387e269f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.146567 Jul 28 12:00:19.029502 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2757/5506] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:18 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:00:19.089494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:19.097608 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a0533a7-e0eb-450e-89fb-088a7a6dc3c8 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1511 microversion: 2.1 time: 0.261630 Jul 28 12:00:19.111004 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2750/5507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:18 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:20.051956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:20.052576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:20.059454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.059905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.060664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.061099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.117668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:20.118290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:20.125346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.125807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.126587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.127035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.131790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:20.140375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:20.141974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:20.143358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff9e7915-d0c2-4773-8469-0320f9dd6022 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.095220 Jul 28 12:00:20.148758 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2758/5508] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:20 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:20.259640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:20.267802 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a7c295e-fe12-41d7-a96b-c238ca762f49 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1494 microversion: 2.1 time: 0.153985 Jul 28 12:00:20.268389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2751/5509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:20 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:00:20.289022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:20.289485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:20.295583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.296032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.296799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.297241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.368155 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b33c1561-5baf-4aa9-a0d5-0550ebc20504 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action" status: 202 len: 0 microversion: 2.1 time: 0.082865 Jul 28 12:00:20.368805 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2759/5510] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:20 2022] POST /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:00:20.377408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:20.378059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:20.384546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.385060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.385876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:20.386452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:20.567498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:20.575130 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-309117e2-8944-49f9-ba02-699db9d4cc85 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1500 microversion: 2.1 time: 0.201627 Jul 28 12:00:20.575714 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2752/5511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:20 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:21.167807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:21.168551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:21.176597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:21.177062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:21.177845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:21.178353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:21.247668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:21.255702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:21.257206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:21.258376 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d56282c0-f243-49b4-bf04-dd2e8bd6d0cb tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.095037 Jul 28 12:00:21.258931 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2760/5512] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:21 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:21.598895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:21.599578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:21.607588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:21.607937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:21.608793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:21.609327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:21.746718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:21.754356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a01ed643-2ee1-4c1a-ba84-a70de0234326 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1500 microversion: 2.1 time: 0.161453 Jul 28 12:00:21.754927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2753/5513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:21 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:22.281142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:22.281776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:22.288733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.289184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.289948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.290415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.294520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:22.355689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:22.364201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:22.365724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:22.366926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af78a135-c282-42c8-888d-06a07f44dd30 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.089827 Jul 28 12:00:22.367503 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2761/5514] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:22 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:22.776103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:22.776713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:22.783625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.784069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.784823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.785259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.895526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:22.915610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:22.922986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ecc09b10-7e86-49f2-a132-ae8757ea99f0 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1503 microversion: 2.1 time: 0.150781 Jul 28 12:00:22.923639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2754/5515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:22 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:22.943483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:22.943989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:22.950212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.950662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.951461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:22.951906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:22.977959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:00:23.061223 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1109fc5-7725-4948-bc64-942b2144e931 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 204 len: 0 microversion: 2.1 time: 0.120953 Jul 28 12:00:23.062980 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2762/5516] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:00:22 2022] DELETE /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:00:23.071546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:23.072161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:23.078154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.078608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.079405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.079848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.212987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:23.220849 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d03243d2-00c2-4ee3-9ce7-aaf9cb6f8015 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1509 microversion: 2.1 time: 0.153592 Jul 28 12:00:23.221690 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2755/5517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:23 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:23.391186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:23.391948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:23.399184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.399890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.400740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.401189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.466725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:23.475835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:23.477350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:23.478530 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7199692a-51db-40da-8b99-221f7494459b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.091797 Jul 28 12:00:23.479116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2763/5518] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:23 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:23.565706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:23.568058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:23.574224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.574624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.575440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:23.575887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:23.656683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38bf5847-5094-42ce-a37c-6e1e1014ba85 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37/action" status: 200 len: 24567 microversion: 2.1 time: 0.094762 Jul 28 12:00:23.657532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2756/5519] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:23 2022] POST /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37/action => generated 24567 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:00:24.242877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:24.243520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:24.251697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:24.252449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:24.253638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:24.254092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:24.390300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:24.399726 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-651b8892-0a32-4797-aaf3-59f0b426e9c6 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1509 microversion: 2.1 time: 0.160883 Jul 28 12:00:24.400341 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2764/5520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:24 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:24.502995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:24.503651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:24.511461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:24.511916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:24.512683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:24.513127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:24.586669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:24.594701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:24.596497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:24.597673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2724ac3c-84d3-4dcd-9bef-7b869fbb9a6a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.099658 Jul 28 12:00:24.598247 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2757/5521] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:24 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:25.422263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:25.423382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:25.431879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:25.432346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:25.433129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:25.433568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:25.540918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42991c946aa47f4b393871645404f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072df4c1b58c457796ff371ae9fc651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:25.549528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d545d62-67af-41a7-9fb9-8014c466bca5 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 200 len: 1467 microversion: 2.1 time: 0.131524 Jul 28 12:00:25.550581 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2765/5522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:25 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 1467 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:25.553611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ca8a0cee-844a-411d-a05d-7b26e6cf1e96 req-55e250e8-41bb-4892-b307-1cd8c571d10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff32f52-7fce-477e-aafe-37f2fbdbcd10", "name": "network-vif-deleted", "tag": "f0d73361-e4ba-4714-bda3-ef3a88067ad8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:25.565271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ca8a0cee-844a-411d-a05d-7b26e6cf1e96 req-55e250e8-41bb-4892-b307-1cd8c571d10c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:25.565724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ca8a0cee-844a-411d-a05d-7b26e6cf1e96 req-55e250e8-41bb-4892-b307-1cd8c571d10c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:25.577553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ca8a0cee-844a-411d-a05d-7b26e6cf1e96 req-55e250e8-41bb-4892-b307-1cd8c571d10c service nova] Creating event network-vif-deleted:f0d73361-e4ba-4714-bda3-ef3a88067ad8 for instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 on n-h2-851368-1 Jul 28 12:00:25.583156 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ca8a0cee-844a-411d-a05d-7b26e6cf1e96 req-55e250e8-41bb-4892-b307-1cd8c571d10c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Jul 28 12:00:25.583769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2758/5523] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:25.621919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:25.622524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:25.629577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:25.630036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:25.630914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:25.631390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:25.700071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:25.708981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:25.710479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:25.711687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cafddd7c-2884-4ace-a88d-e84fd18786de tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.093732 Jul 28 12:00:25.712245 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2766/5524] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:25 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:26.571257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:26.571962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] [instance: eff32f52-7fce-477e-aafe-37f2fbdbcd10] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:26.573913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:26.580366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:26.580818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:26.581588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:26.582027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:26.596116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] HTTP exception thrown: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Request method failure captured: Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 HTTP/1.1 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4no9s6Ks8NUrA5osG9j7oWH_3sySwAn4aObnZBGWYJT8Ta7mvbxjQtA0AaRsF4325Nk4d_jZ5Pq8cnrlpdHN3_hZYsB7q0dhYXR6T0c6zEgzdKZxig5QFNVR8K0Jihc8mivGBogwy1spAZWAy4Hw97SJjWKYdX_LoV2Xk57C-khPvZM Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 072df4c1b58c457796ff371ae9fc651d Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestServerAdvancedOps-1262756080 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/072df4c1b58c457796ff371ae9fc651d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/072df4c1b58c457796ff371ae9fc651d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_072df4c1b58c457796ff371ae9fc651d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/072df4c1b58c457796ff371ae9fc651d"}]}] Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestServerAdvancedOps-1262756080 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 072df4c1b58c457796ff371ae9fc651d Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestServerAdvancedOps-1262756080 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestServerAdvancedOps-1262756080-project Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d42991c946aa47f4b393871645404f20 Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestServerAdvancedOps-1262756080-project Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'eff32f52-7fce-477e-aafe-37f2fbdbcd10'} Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:26.598002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] Returning 404 to user: Instance eff32f52-7fce-477e-aafe-37f2fbdbcd10 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2631a42-a346-4b65-b3be-9364dae53572 tempest-TestServerAdvancedOps-1262756080 tempest-TestServerAdvancedOps-1262756080-project] 10.222.0.93 "GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10" status: 404 len: 111 microversion: 2.1 time: 0.033384 Jul 28 12:00:26.603520 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2759/5525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:26 2022] GET /compute/v2.1/servers/eff32f52-7fce-477e-aafe-37f2fbdbcd10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:00:26.735674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:26.736351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:26.743090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:26.743565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:26.744345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:26.744790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:26.808728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:26.817805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:26.819500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:26.820729 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3253714e-4127-4743-b97b-11a04e3da172 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.088966 Jul 28 12:00:26.821640 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2767/5526] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:26 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:27.845534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:27.846150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:27.853576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:27.854258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:27.855101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:27.855860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:27.872649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:27.929708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:27.938854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:27.940417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:27.941603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7149414b-3eed-48d6-ac75-b9c7c88c1e1b tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.100699 Jul 28 12:00:27.942232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2760/5527] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:27 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:28.965668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:28.966293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:28.974870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:28.975354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:28.976151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:28.976595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:29.046207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:29.055957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:29.058038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:29.059293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d34012f5-a15d-4d0e-bc42-16812d25459a tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.097646 Jul 28 12:00:29.059880 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2768/5528] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:28 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:30.082315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:30.082927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:30.089967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:30.090413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:30.091204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:30.091631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:30.154403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:30.163240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:30.164753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:30.165920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ef20d22-671a-4728-99d4-4f5fd0b0d885 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.087525 Jul 28 12:00:30.166488 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2761/5529] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:30 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:31.190411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:31.191035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:31.198083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:31.198542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:31.199337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:31.199785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:31.265409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:31.273368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:31.274870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:31.276079 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88438db2-356f-4064-8aa2-788e569dc502 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.090194 Jul 28 12:00:31.276645 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2769/5530] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:31 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:32.299639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:32.300220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:32.306880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:32.307352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:32.308161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:32.308599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:32.580041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:32.588114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:32.589629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:32.590800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfb843ea-79ad-4b41-b9a3-4d1deef7cb34 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.295696 Jul 28 12:00:32.591391 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2762/5531] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:32 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:33.614304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:33.614905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:33.621956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:33.622400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:33.623186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:33.623621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:33.689974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:33.697925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:33.699460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:33.700653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5514866-796e-462f-abcd-8eb810f1a666 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.090312 Jul 28 12:00:33.701215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2770/5532] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:33 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:34.723172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:34.723718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:34.730741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:34.731235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:34.732006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:34.732450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:34.794568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:34.802569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:34.804118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:34.805294 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-850b4eae-76a2-4099-b546-ab082fd26df2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.086465 Jul 28 12:00:34.805866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2763/5533] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:34 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:35.828809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:35.829427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:35.836451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:35.836905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:35.837663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:35.838099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:35.901422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:35.910203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:35.911848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:35.913018 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-840d8de1-b099-476d-bbc5-84a73c21903e tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.088245 Jul 28 12:00:35.913575 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2771/5534] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:35 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:36.937695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:36.938285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:36.945336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:36.945794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:36.946478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:36.946909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:37.024168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:37.032715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:37.034228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:37.035427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34234fab-0c9a-495b-ab9a-4be0758ca1bf tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.102082 Jul 28 12:00:37.036010 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2764/5535] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:36 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:38.059406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:38.060029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:38.069663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:38.070120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:38.070905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:38.071384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:38.135881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:38.143854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:38.145387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:38.146567 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db400fa1-f10a-4f9e-8149-d5e36799f6c0 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.091160 Jul 28 12:00:38.147170 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2772/5536] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:38 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:39.169586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:39.170231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:39.177168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:39.177619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:39.178373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:39.178806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:39.241584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:39.249972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:39.251639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:39.252799 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c489f931-55ce-4acf-b500-7360e9ac92b2 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1407 microversion: 2.54 time: 0.087146 Jul 28 12:00:39.253352 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2765/5537] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:39 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:39.936611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:39.938828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:39.945717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:39.946184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:39.946983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:39.947483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:40.011241 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3edb47d2-ecf5-4618-8a69-eda7566ece5f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action" status: 200 len: 24564 microversion: 2.1 time: 0.078983 Jul 28 12:00:40.012275 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2773/5538] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:39 2022] POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action => generated 24564 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:00:40.276543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:40.277244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:40.284937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:40.285439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:40.286445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:40.287041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:40.351703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:40.360117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:40.361629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:40.362797 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30cf6d3b-557e-45d3-9d55-002cb1ef46c5 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1413 microversion: 2.54 time: 0.090322 Jul 28 12:00:40.363401 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2766/5539] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:40 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:41.388002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:41.388634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:41.397473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:41.397923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:41.398706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:41.399182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:41.466918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:41.476167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:41.477677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:41.478846 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-81a9dfd4-69e2-47e3-8714-4383685ca6c7 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1413 microversion: 2.54 time: 0.095818 Jul 28 12:00:41.479444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2774/5540] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:41 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:42.501869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:42.502494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:42.509964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:42.510406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:42.511219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:42.511674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:42.575392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:42.583890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:42.585390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:42.586551 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e25dfd7a-b050-497b-825b-3fc56512f88f tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1413 microversion: 2.54 time: 0.088673 Jul 28 12:00:42.587126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2767/5541] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:42 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:43.610293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:43.610905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:43.617833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:43.618278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:43.619037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:43.619496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:43.682641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:43.691054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:43.692581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:43.693743 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96d3dd04-ac0a-4128-bedd-99268cd5c9a6 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1413 microversion: 2.54 time: 0.087478 Jul 28 12:00:43.694304 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2775/5542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:43 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:44.717751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:44.718367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:44.725665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.726117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:44.726882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.727351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:44.794519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:44.802464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:44.804003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:44.805173 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-228c8261-8f3d-430a-a141-747adc2b5120 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1398 microversion: 2.54 time: 0.091901 Jul 28 12:00:44.805743 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2768/5543] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:44 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1398 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:44.827861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ad3a132-2864-452e-96d1-0ae2dbab3b05 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '.version_select at 0x7f2eb27c5430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:44.847871 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ad3a132-2864-452e-96d1-0ae2dbab3b05 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-799511902" status: 204 len: 0 microversion: 2.54 time: 0.024536 Jul 28 12:00:44.848432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2776/5544] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 12:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-799511902 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:00:44.862091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:44.862605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:44.868709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.869167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:44.869934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.870380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:44.894998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:00:44.977348 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e22f60d2-43cf-4ad3-8b96-a41a58a26582 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 204 len: 0 microversion: 2.54 time: 0.118810 Jul 28 12:00:44.977951 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2769/5545] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 12:00:44 2022] DELETE /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:00:44.986047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:44.986669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:44.993660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.994115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:44.994888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:44.995358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:45.010262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:45.064682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:45.072895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:45.074414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:45.075622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6401eac2-88bb-482e-9246-140e5f6b978c tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1404 microversion: 2.54 time: 0.093632 Jul 28 12:00:45.076192 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2777/5546] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:44 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:46.100080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:46.100704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:46.108410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:46.108859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:46.109618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:46.110047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:46.178137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:46.186367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:46.187917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:46.189091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-56fff39f-cd48-4ddb-9079-d7ec5ff175fc tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1404 microversion: 2.54 time: 0.093631 Jul 28 12:00:46.190175 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2770/5547] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:46 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:47.212376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:47.213001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:47.222001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:47.222490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:47.223306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:47.223751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:47.261246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:47.261689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:47.262146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lazy-loading 'fault' on Instance uuid 4b9e6e85-652f-4c31-bb0c-76e96037add2 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:00:47.307310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:47.314728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:47.316279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57704df3fabd4ccebb86a06aba7ebbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac50d72e055482db146ee3fcbb447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:47.317526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4bf32c96-d336-4eb7-a224-e827ef15f4bd tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 200 len: 1409 microversion: 2.54 time: 0.109102 Jul 28 12:00:47.318092 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2778/5548] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:47 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 1409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:00:48.340722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:48.341346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] [instance: 4b9e6e85-652f-4c31-bb0c-76e96037add2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:48.348624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:48.349075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:48.349841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:48.350307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:48.363875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] HTTP exception thrown: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Request method failure captured: Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 HTTP/1.1 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4npGKBMIprpkEHBHbz8yaGn4uaRcSB2QFwflqICrzY_6Y1lLxow4VCgFh-rIKtaNuGNG2LvX7l9T_eRuE0rb-MpO1VE_9Y2jZPZiUuhY6NBx7Hk7sbZuw9L8kieofFIuAmW5eHhSq6wBFlcrQ9enlaW80oE3yqOZNOy4-58gNyAuoC4 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.54 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 9ac50d72e055482db146ee3fcbb447ae Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerShowV254Test-1525075524 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9ac50d72e055482db146ee3fcbb447ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9ac50d72e055482db146ee3fcbb447ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9ac50d72e055482db146ee3fcbb447ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9ac50d72e055482db146ee3fcbb447ae"}]}] Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerShowV254Test-1525075524 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 9ac50d72e055482db146ee3fcbb447ae Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerShowV254Test-1525075524 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerShowV254Test-1525075524-project Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 57704df3fabd4ccebb86a06aba7ebbb2 Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerShowV254Test-1525075524-project Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '4b9e6e85-652f-4c31-bb0c-76e96037add2'} Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:00:48.365508 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] Returning 404 to user: Instance 4b9e6e85-652f-4c31-bb0c-76e96037add2 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-812f8ce3-7dd7-4eac-b5ab-d883d1968ee3 tempest-ServerShowV254Test-1525075524 tempest-ServerShowV254Test-1525075524-project] 10.222.0.93 "GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2" status: 404 len: 111 microversion: 2.54 time: 0.030191 Jul 28 12:00:48.371887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2771/5549] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:48 2022] GET /compute/v2.1/servers/4b9e6e85-652f-4c31-bb0c-76e96037add2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:00:51.064860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:51.065511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:51.068377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:51.074179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:51.074886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:51.075768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:51.076208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:51.354831 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57648d48-0dd5-499d-9087-9ce59719f927 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1833 microversion: 2.1 time: 0.293579 Jul 28 12:00:51.355582 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2779/5550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:51 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1833 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:51.375569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:51.376179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:51.383231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:51.383690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:51.384467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:51.384906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:51.891002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:51.898821 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a97898d5-4870-41d9-a59d-b105fe8ddddd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1682 microversion: 2.1 time: 0.527597 Jul 28 12:00:51.899446 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2772/5551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:51 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1682 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:52.007371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:52.010179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:52.017616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.018475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:52.019556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.020236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:52.097251 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58d5ad8e-cc5f-410e-9ea0-3b69a958a0f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action" status: 200 len: 32635 microversion: 2.1 time: 0.087607 Jul 28 12:00:52.103125 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2780/5552] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:52 2022] POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action => generated 32635 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:00:52.282537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:52.283309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:52.290332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.290795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:52.292202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.292892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:52.397282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bb6f1e7d1bda44af9307424a9e53252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85253390475b44458af04916bbc9f027', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:52.398189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] flavor_id is None. Assuming migration. {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4145}} Jul 28 12:00:52.398870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:00:52.873325 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73bf9b31-b0ba-434d-9ebe-bb8951907902 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action" status: 202 len: 0 microversion: 2.1 time: 0.595598 Jul 28 12:00:52.877619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2773/5553] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:00:52 2022] POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:00:52.882921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:52.884112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:52.892953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.893681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:52.894712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:52.895424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:53.067574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:53.076190 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8332cc6e-d3b6-429c-8422-b0872272e049 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1691 microversion: 2.1 time: 0.197442 Jul 28 12:00:53.077642 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2781/5554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:52 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:53.509076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:53.510411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:53.524558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:53.525387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:53.526382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:53.527003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:53.557934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:53.565535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbdab2d3-e93d-4a44-80f0-17049f44f463 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/ips" status: 200 len: 150 microversion: 2.1 time: 0.061485 Jul 28 12:00:53.566467 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2774/5555] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 12:00:53 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:54.098708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:54.099567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:54.111274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:54.111745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:54.112537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:54.112983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:54.366139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:54.377576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34b163f3-b85f-41ec-839e-50b8ce0859c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1691 microversion: 2.1 time: 0.283373 Jul 28 12:00:54.395465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2782/5556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:54 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1691 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:54.739482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c4fb244-1d55-43ac-a756-43a56a1333be tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: .version_select at 0x7f2eb2518f70>, body: {"keypair": {"name": "tempest-keypair-1393490221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Fov/FnOYDrHdrwPPZjHYs17G2Xfs6v/o3WKndbx2NKN3SNh81fbTw0d+OiUB6zFtMvWCnFScPJjONkAWDOUu+tFLufjd6Wowl+GH9gfR2rg9z+5d4HsTeoS938FQlww=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:54.758855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1c4fb244-1d55-43ac-a756-43a56a1333be tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:54.767465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1c4fb244-1d55-43ac-a756-43a56a1333be tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for user 226bb250399d41b89d0a048ddb2d18d6 and project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:54.793301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c4fb244-1d55-43ac-a756-43a56a1333be tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.127133 Jul 28 12:00:54.800246 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2775/5557] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 12:00:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 12:00:55.401288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:55.402496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:55.410748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:55.411511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:55.412867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:55.413477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:55.649090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:55.663416 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6c1b5b9-0a22-4210-81a6-51ded9344fce tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1691 microversion: 2.1 time: 0.264892 Jul 28 12:00:55.664702 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2783/5558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:55 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:56.154072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ecf79d-5499-4d6e-b094-6472ca98277a"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:56.164883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:56.182953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.185317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.186694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.189422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.253653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-80018170", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59dcd80a-d319-41fe-a072-78c4b7d984de"}], "security_groups": [{"name": "tempest-securitygroup--1219715160"}], "key_name": "tempest-keypair-1393490221", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:00:56.383349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] validate_networks() for [('59dcd80a-d319-41fe-a072-78c4b7d984de', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:00:56.496461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de198606-8b27-4961-a6dc-7884dbce5a38 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "POST /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346256 Jul 28 12:00:56.497175 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2776/5559] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:00:56 2022] POST /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:00:56.687170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:56.687884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:56.695512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:00:56.699445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.699912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.700701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.701152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.865440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:00:56.865988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:00:56.866350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:00:56.866769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:00:56.867221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:00:56.879659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.880644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.881915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:56.882540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:56.900932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:56.907301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:00:56.913654 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7bea4098-c207-493f-91fc-e584bc06da37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.230898 Jul 28 12:00:56.914933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2777/5560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:56 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:56.917563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for user 226bb250399d41b89d0a048ddb2d18d6 and project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:00:56.934501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:00:56.937586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:00:56.995966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d0e33ea6-5c8a-48e2-96a4-4be61b3fa8fe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.747781 Jul 28 12:00:57.002711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2784/5561] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 12:00:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 12:00:57.008415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:57.009183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:57.067919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:57.075839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:57.077388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:57.080017 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f1c3b4e-de10-4a65-aee7-95e13cb7b219 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1280 microversion: 2.20 time: 0.075755 Jul 28 12:00:57.081542 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2778/5562] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:57 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:00:57.940059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:57.940872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:57.962816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:57.965686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:57.966643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:57.968013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:58.103870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:58.104401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:58.129348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:58.129820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:58.130624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:58.136162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:58.422555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:58.435552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:58.440313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:58.441836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:58.442970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd0e34f5-b8f9-4b22-bafe-ceb583eddd42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1332 microversion: 2.20 time: 0.343357 Jul 28 12:00:58.446774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-30c27dfe-944a-4182-a7c1-815cfd1a5c6c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.514399 Jul 28 12:00:58.449744 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2785/5563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:57 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:58.459514 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2779/5564] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:58 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1332 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:00:59.467749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:59.467749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:59.473257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:00:59.473956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:00:59.476798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:59.477473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:59.478452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:59.479257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:59.489268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:59.492905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:59.493935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:00:59.496791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:00:59.786574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:59.795421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7b9054fc-9ae3-45fd-a33c-fbcc627c27e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.325693 Jul 28 12:00:59.796268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2780/5565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:00:59 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:00:59.854314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:59.863456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:59.866357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:00:59.867548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf171e69-2ba8-44fa-818d-9aa1fd72d14e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.405728 Jul 28 12:00:59.868119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2786/5566] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:00:59 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:00.303641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b59b5db1-92ea-43b0-b271-a101ebc55cae req-ea325e47-5438-4870-b3b9-f0a8b90d95ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:00.332278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b59b5db1-92ea-43b0-b271-a101ebc55cae req-ea325e47-5438-4870-b3b9-f0a8b90d95ee service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:00.333777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b59b5db1-92ea-43b0-b271-a101ebc55cae req-ea325e47-5438-4870-b3b9-f0a8b90d95ee service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:00.366911 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b59b5db1-92ea-43b0-b271-a101ebc55cae req-ea325e47-5438-4870-b3b9-f0a8b90d95ee service nova] Creating event network-changed:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:01:00.381062 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b59b5db1-92ea-43b0-b271-a101ebc55cae req-ea325e47-5438-4870-b3b9-f0a8b90d95ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102182 Jul 28 12:01:00.384373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2781/5567] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:00.816793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:00.817422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:00.824689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:00.825151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:00.825968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:00.826961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:00.892471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:00.894041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:00.901945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:00.902789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:00.903627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:00.904089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:01.021887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:01.030159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51431002-a930-4a3f-acd7-43172ab6aa9f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.217238 Jul 28 12:01:01.030738 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2787/5568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:00 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:01.068209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:01.076574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:01.078179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:01.079461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c8a2ea91-6283-4164-9d16-9a08e0788afe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.191997 Jul 28 12:01:01.080125 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2782/5569] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:00 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:01:02.052053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:02.052676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:02.059947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:02.060457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:02.061239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:02.061679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:02.102208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:02.102819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:02.110050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:02.110506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:02.111308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:02.111752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:02.281814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:02.289807 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3db5951f-7b10-4c8a-83df-1f2921b18047 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.241566 Jul 28 12:01:02.290399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2788/5570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:02 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:02.312076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:02.320181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:02.321687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:02.322805 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f135483-60a9-44a0-95c0-bd00b2c93ff2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.224718 Jul 28 12:01:02.323414 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2783/5571] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:02 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:01:03.311555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:03.312204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:03.319268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:03.319727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:03.320499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:03.320940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:03.344559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:03.345204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:03.352530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:03.352978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:03.353771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:03.354211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:03.508989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:03.517536 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e81b14a-0658-4fab-9124-f6fac1117646 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.209977 Jul 28 12:01:03.518508 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2789/5572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:03 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:03.541916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:03.549924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:03.551468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:03.552586 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73123de6-d8d7-4411-b3e9-18c08f62f839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.212668 Jul 28 12:01:03.553163 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2784/5573] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:03 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:01:04.538037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:04.538695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:04.546324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:04.546793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:04.547602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:04.548048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:04.575156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:04.576098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:04.583036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:04.583707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:04.584506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:04.584960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:04.739694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:04.748016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-65675c49-f419-48dd-b2c8-d02f4169b58f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.213813 Jul 28 12:01:04.748714 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2790/5574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:04 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:04.766510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:04.774781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:04.776367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:04.777531 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4229ca54-9f01-4ea1-84c7-dc7df9ed19d6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.206306 Jul 28 12:01:04.778092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2785/5575] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:04 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:01:05.629014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-505829e1-26d5-40a4-8902-b08d06fcbf8d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: .version_select at 0x7f2eb30b3700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1142694619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhaW3MtW/L4N95tr88anKShOZjggrFSfZN6+dDuGGkVmnJSRdTdrrggB/xdOlLo63EELo+eWNc39z3yW+rrRCyymqwxe7zpAn3+AtJxZGqDfuRQCr9/L4cgC1bEJkppjQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:05.645396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-505829e1-26d5-40a4-8902-b08d06fcbf8d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:01:05.654881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-505829e1-26d5-40a4-8902-b08d06fcbf8d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:01:05.664140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bd78b5b4-4e7a-40fa-bbd8-915707c7c712 req-2e6a7464-56d2-40e9-8da0-7609e32a6297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "name": "network-vif-plugged", "status": "completed", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:05.676744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd78b5b4-4e7a-40fa-bbd8-915707c7c712 req-2e6a7464-56d2-40e9-8da0-7609e32a6297 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:05.677226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd78b5b4-4e7a-40fa-bbd8-915707c7c712 req-2e6a7464-56d2-40e9-8da0-7609e32a6297 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:05.684137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-505829e1-26d5-40a4-8902-b08d06fcbf8d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.058978 Jul 28 12:01:05.690808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bd78b5b4-4e7a-40fa-bbd8-915707c7c712 req-2e6a7464-56d2-40e9-8da0-7609e32a6297 service nova] Creating event network-vif-plugged:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:01:05.692124 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2791/5576] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:01:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:05.696448 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bd78b5b4-4e7a-40fa-bbd8-915707c7c712 req-2e6a7464-56d2-40e9-8da0-7609e32a6297 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Jul 28 12:01:05.697338 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2786/5577] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:01:05.771061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:05.771742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:05.784180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:05.785458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:05.786500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:05.790384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:05.801100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:05.801811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:05.810762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:05.811486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:05.812654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:05.814198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:06.465224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:06.469652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:06.477787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b2760076-28b0-4a64-8c57-baf368838610 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.711418 Jul 28 12:01:06.479550 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2792/5578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:05 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:06.481123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:06.487027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:06.489149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-59e693d3-2b10-45bc-8806-16f0f81c58e5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1406 microversion: 2.20 time: 0.691977 Jul 28 12:01:06.490389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2787/5579] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:05 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1406 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:07.275400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-982987742", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "bf784718-8920-42f5-8f9f-973d6e39a27b"}], "key_name": "tempest-TestNetworkBasicOps-1142694619", "security_groups": [{"name": "tempest-secgroup-smoke-1497404336"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:07.285486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:07.391899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] validate_networks() for [('bf784718-8920-42f5-8f9f-973d6e39a27b', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:01:07.501604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:07.503522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:07.513031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:07.516088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.516486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:07.517284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.518183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:07.805623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:07.816782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-039c6f2d-9d90-4b92-b9a0-3af06fd3bd58 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.319830 Jul 28 12:01:07.821147 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2788/5580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:07 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:07.828210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:07.828826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:07.843720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.845093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:07.846117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.847031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:07.986192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:01:07.986625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:01:07.987204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:01:07.987626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:01:07.988048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:01:07.996969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.997424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:07.998272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:07.998713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.016183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:01:08.021370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:01:08.032407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:08.035302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:01:08.037473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:01:08.041500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:08.043178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:08.044457 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-75fa8106-8cfd-4836-9b79-ff2110e56516 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1598 microversion: 2.20 time: 0.222249 Jul 28 12:01:08.045165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2789/5581] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:07 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1598 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:08.067288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:08.067930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:08.074341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.074883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.075772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.076893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.101936 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-857bf165-8c8e-4602-8efb-13f6e1807f03 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.830925 Jul 28 12:01:08.105338 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2793/5582] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:01:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:01:08.118086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-119c2674-4e0c-466d-a938-bf6660a18126 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:08.118716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-119c2674-4e0c-466d-a938-bf6660a18126 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:08.191552 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-459c7bb9-d69b-4cb7-bc7d-1467a0891865 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128151 Jul 28 12:01:08.197313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-119c2674-4e0c-466d-a938-bf6660a18126 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:08.197686 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2790/5583] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 12:01:08 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 12:01:08.212258 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-119c2674-4e0c-466d-a938-bf6660a18126 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1248 microversion: 2.1 time: 0.093574 Jul 28 12:01:08.213389 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2794/5584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:08 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1248 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:08.472597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:08.473214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:08.480366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.480831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.481624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.482842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.573042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'services' on Instance uuid 59694965-d6c2-4f07-9b65-cffc5236c1ff {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:01:08.648664 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcbbff6b-0794-4db1-afb0-1e0618b06640 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments/20ecf79d-5499-4d6e-b094-6472ca98277a" status: 202 len: 0 microversion: 2.1 time: 0.180510 Jul 28 12:01:08.649588 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2791/5585] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:01:08 2022] DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments/20ecf79d-5499-4d6e-b094-6472ca98277a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:01:08.660333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:08.662780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:08.678796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.679328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.682118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.683384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.724362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5f9fdff-91c4-4ca5-b914-347a0105bf59 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070026 Jul 28 12:01:08.725218 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2795/5586] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:08 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:08.838227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:08.839227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:08.847920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.848640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.849608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:08.850208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:08.987322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:08.995030 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed892f2a-a39f-4d77-9bad-0109829cae93 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.160910 Jul 28 12:01:08.995632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2792/5587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:08 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:09.238043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:09.239208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:09.248510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:09.249041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:09.249885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:09.250502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:09.256945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:09.308589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0f93219b-a8ed-4319-ab0a-a88811428a8c req-feb53b6c-af03-45f3-aa9f-46a0f458164f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:09.318849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0f93219b-a8ed-4319-ab0a-a88811428a8c req-feb53b6c-af03-45f3-aa9f-46a0f458164f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:09.319582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0f93219b-a8ed-4319-ab0a-a88811428a8c req-feb53b6c-af03-45f3-aa9f-46a0f458164f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:09.320158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:09.327881 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fc4ac03-f734-44d8-8ae4-3456900d8368 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1300 microversion: 2.1 time: 0.093679 Jul 28 12:01:09.328480 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2793/5588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:09 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:09.332282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0f93219b-a8ed-4319-ab0a-a88811428a8c req-feb53b6c-af03-45f3-aa9f-46a0f458164f service nova] Creating event network-changed:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:01:09.343611 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0f93219b-a8ed-4319-ab0a-a88811428a8c req-feb53b6c-af03-45f3-aa9f-46a0f458164f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118826 Jul 28 12:01:09.344221 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2796/5589] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:09.743667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:09.751810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:09.764087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:09.768548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:09.770244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:09.770702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:09.815770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d51b88c-e525-419b-9ef9-7c03cf3abadc tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081674 Jul 28 12:01:09.816635 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2794/5590] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:09 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:10.020596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:10.022024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:10.034310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.038666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.040157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.041318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.251905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:10.260756 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3faa6655-4787-48fd-b75c-438d47703881 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.247609 Jul 28 12:01:10.276081 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2797/5591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:10 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:10.352637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:10.353277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:10.360683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.361448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.362726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.363919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.446791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:10.460238 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41913400-935f-442b-b16f-519f6ed0abe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1306 microversion: 2.1 time: 0.115106 Jul 28 12:01:10.461938 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2795/5592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:10 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:10.828857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:10.831204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:10.838325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.839044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.840028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:10.840628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:10.844562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:10.885514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0cd852ed-aa04-420e-803c-3e7b12afff6b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061293 Jul 28 12:01:10.886161 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2798/5593] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:10 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:11.283590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:11.285151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:11.292868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.299543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.300783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.301453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.466644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:11.479162 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e80a77de-e79c-4058-ad83-0100d1669f76 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.199004 Jul 28 12:01:11.480513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2796/5594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:11 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:11.481820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:11.482998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:11.490109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.490565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.499623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.500453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.549138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-273df633-41e4-47a2-9558-5a750d498bce req-48b5220a-ef40-4a71-b196-3131f3c437d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48391170-9f91-44a0-b424-dbf2323d3f2f", "tag": "827ecc7a-d70d-41aa-b0db-aa24734a7390"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:11.570379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-273df633-41e4-47a2-9558-5a750d498bce req-48b5220a-ef40-4a71-b196-3131f3c437d5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.571643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-273df633-41e4-47a2-9558-5a750d498bce req-48b5220a-ef40-4a71-b196-3131f3c437d5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.587799 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-273df633-41e4-47a2-9558-5a750d498bce req-48b5220a-ef40-4a71-b196-3131f3c437d5 service nova] Creating event network-changed:827ecc7a-d70d-41aa-b0db-aa24734a7390 for instance 48391170-9f91-44a0-b424-dbf2323d3f2f on n-h1-851368-1 Jul 28 12:01:11.594382 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-273df633-41e4-47a2-9558-5a750d498bce req-48b5220a-ef40-4a71-b196-3131f3c437d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050858 Jul 28 12:01:11.596226 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2797/5595] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:11.691236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:11.699485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-309a92ae-68dd-4b5a-935b-84f59af4636d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.221442 Jul 28 12:01:11.700587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2799/5596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:11 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:11.906513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:11.913562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:11.922918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.923460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.924239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:11.924672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:11.958799 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36c8962f-98f6-47eb-9e6f-ae8e5bf71f23 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064278 Jul 28 12:01:11.959433 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2798/5597] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:11 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:12.507520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:12.508059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:12.515570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.516082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:12.516863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.517314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:12.654309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:12.661981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6e4dcc56-dc58-4729-a39c-9cc3203e1b79 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1696 microversion: 2.1 time: 0.159181 Jul 28 12:01:12.662562 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2800/5598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:12 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:12.720662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:12.721407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:12.728549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.729005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:12.729770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.730215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:12.869082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:12.877686 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-681e3376-2e6c-47ac-a138-8ba29b511e24 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.161036 Jul 28 12:01:12.878568 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2799/5599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:12 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:12.971608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:12.974508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:12.981147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.981610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:12.982913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:12.983392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:13.016885 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ecf71081-e323-4f46-b54f-bd874cfd745d tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Jul 28 12:01:13.020448 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2801/5600] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:12 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:13.683382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:13.684033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:13.691511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:13.691962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:13.692735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:13.693173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:13.830242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:13.838248 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-459730bc-7d5f-4b66-a731-90cfa57af87b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1695 microversion: 2.1 time: 0.158705 Jul 28 12:01:13.838854 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2800/5601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:13 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:01:13.899309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:13.899942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:13.907088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:13.907556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:13.908341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:13.908782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.030506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:14.032990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:14.039062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:14.039618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.040459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:14.040970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.049555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:14.057107 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb1a92d3-63cd-45ea-8961-10479a6ef62a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.161792 Jul 28 12:01:14.057697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2802/5602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:13 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:14.071372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-671972cd-1d1f-4bc6-8a50-580b6c827c53 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Jul 28 12:01:14.071944 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2801/5603] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:14 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:01:14.860186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:14.860811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:14.867005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:14.867493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.868278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:14.868722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.960083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "name": "network-vif-unplugged", "status": "completed", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:14.970554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:14.972166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:14.985451 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] Creating event network-vif-unplugged:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h1-851368-1 Jul 28 12:01:14.992398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:01:15.005612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a48bf510-dec5-42d2-a27f-0d58ab168627 req-4902a994-65df-4042-98b6-526c9e812103 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048317 Jul 28 12:01:15.006394 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2802/5604] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:01:15.022653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:15.031397 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a037da23-b052-4e8b-a9eb-55dde7e79bd0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1695 microversion: 2.1 time: 0.175072 Jul 28 12:01:15.032552 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2803/5605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:14 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:15.079471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:15.080441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:15.084330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:15.086834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:15.087848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.088498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.089458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.090074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.106495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.107437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.109753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.110478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.161267 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb4d35e4-2902-41b2-9c96-58d92aeccc07 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081633 Jul 28 12:01:15.164221 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2804/5606] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:01:15 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 12:01:15.244857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:15.245547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:15.255983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.257786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.259354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.260009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.296930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:01:15.326547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:15.335580 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0859de2f-ef28-422c-8fee-06f0428036ea tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.261225 Jul 28 12:01:15.353028 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2803/5607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:15 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:15.407647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:15.426118 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e765fcbe-79b5-44c0-8203-206b4be4db3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 204 len: 0 microversion: 2.1 time: 0.183492 Jul 28 12:01:15.427437 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2805/5608] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:01:15 2022] DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 12:01:15.437688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:15.438433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:15.450538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.451214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.453055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:15.453729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:15.691180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:15.699235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4fddc04c-a4f8-49c8-9b99-6913a9a7e729 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1681 microversion: 2.1 time: 0.267603 Jul 28 12:01:15.702558 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2804/5609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:15 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:01:16.053443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:16.054160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:16.061064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.061519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.062298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.062742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.201172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:16.208796 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b3863ae-707f-48fa-9e66-51d8ad42350f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1695 microversion: 2.1 time: 0.159610 Jul 28 12:01:16.209368 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2806/5610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:16 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:16.360005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:16.360623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:16.367653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.368107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.368880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.369322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.501951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:16.509492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f51e58d-acd1-4541-99ee-2e39d5cb55d9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.153389 Jul 28 12:01:16.510074 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2805/5611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:16 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:16.720936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:16.721493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:16.727914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.728371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.729142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:16.729588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:16.866678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:16.875205 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04a781bc-587b-4078-a567-33ed10de95cb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1681 microversion: 2.1 time: 0.158209 Jul 28 12:01:16.875789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2807/5612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:16 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:17.030780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:17.040064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.040503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.052283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] Creating event network-changed:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h1-851368-1 Jul 28 12:01:17.057444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:01:17.068454 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2b9a720b-2662-4e9b-8038-b4c8bc521e42 req-7a2af015-fd69-458e-a126-ae3822f8849b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042930 Jul 28 12:01:17.069053 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2806/5613] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:17.231712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:17.233799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:17.243151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.244327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.245616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.246378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.398849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-edd86187-ca1f-44d4-9950-a4512ad64bb1 req-502997e0-6254-404c-b03e-9f3eff70c627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48391170-9f91-44a0-b424-dbf2323d3f2f", "name": "network-vif-plugged", "status": "completed", "tag": "827ecc7a-d70d-41aa-b0db-aa24734a7390"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:17.410835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-edd86187-ca1f-44d4-9950-a4512ad64bb1 req-502997e0-6254-404c-b03e-9f3eff70c627 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.411613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-edd86187-ca1f-44d4-9950-a4512ad64bb1 req-502997e0-6254-404c-b03e-9f3eff70c627 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.425446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-edd86187-ca1f-44d4-9950-a4512ad64bb1 req-502997e0-6254-404c-b03e-9f3eff70c627 service nova] Creating event network-vif-plugged:827ecc7a-d70d-41aa-b0db-aa24734a7390 for instance 48391170-9f91-44a0-b424-dbf2323d3f2f on n-h1-851368-1 Jul 28 12:01:17.430939 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-edd86187-ca1f-44d4-9950-a4512ad64bb1 req-502997e0-6254-404c-b03e-9f3eff70c627 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035920 Jul 28 12:01:17.431760 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2807/5614] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:01:17.483753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:17.502676 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b3352d1d-c430-4da0-ac09-a939fd778224 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1695 microversion: 2.1 time: 0.275208 Jul 28 12:01:17.518792 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2808/5615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:17 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:17.533363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:17.534575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:17.541886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.542343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.543161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.544044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.790918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:17.800885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb14229e-766e-46c5-b5ba-a117b8053ae2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.272517 Jul 28 12:01:17.801614 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2808/5616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:17 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:17.896730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:17.897386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:17.903802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.904255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:17.905040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:17.905488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:18.006031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:18.037858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:18.045604 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46f0d858-9896-43c5-b123-226f82af0274 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1681 microversion: 2.1 time: 0.152876 Jul 28 12:01:18.046278 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2809/5617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:17 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:18.530364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:18.531057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:18.538813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:18.539456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:18.540351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:18.540908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:18.690166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:18.698476 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0feac3c-8196-4f45-8358-02cfd9e8da0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1693 microversion: 2.1 time: 0.176957 Jul 28 12:01:18.699027 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2809/5618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:18 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:18.821947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:18.822699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:18.824650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=18 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:18.830849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:18.831407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:18.832200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:18.832631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:18.978144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:18.986079 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f0981f23-beda-4f67-9f23-8c43e28863c1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.168016 Jul 28 12:01:18.986681 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2810/5619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:18 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:19.067395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:19.068007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:19.074082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:19.074529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:19.075329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:19.076296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:19.084139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-bbc3e891-fd0a-42e3-9818-1cf6e7958ec6 req-31dbcef3-c6bf-4b66-b334-9615950d61b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59694965-d6c2-4f07-9b65-cffc5236c1ff", "name": "network-vif-deleted", "tag": "1e56f1bf-248f-4a2a-8f99-8deca8ae15e8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:19.094534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bbc3e891-fd0a-42e3-9818-1cf6e7958ec6 req-31dbcef3-c6bf-4b66-b334-9615950d61b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:19.094986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-bbc3e891-fd0a-42e3-9818-1cf6e7958ec6 req-31dbcef3-c6bf-4b66-b334-9615950d61b4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:19.106733 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-bbc3e891-fd0a-42e3-9818-1cf6e7958ec6 req-31dbcef3-c6bf-4b66-b334-9615950d61b4 service nova] Creating event network-vif-deleted:1e56f1bf-248f-4a2a-8f99-8deca8ae15e8 for instance 59694965-d6c2-4f07-9b65-cffc5236c1ff on n-h1-851368-1 Jul 28 12:01:19.112428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-bbc3e891-fd0a-42e3-9818-1cf6e7958ec6 req-31dbcef3-c6bf-4b66-b334-9615950d61b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Jul 28 12:01:19.113395 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2811/5620] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:01:19.140729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:19.148544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f45ec9d8-8fec-4465-99d6-930531be4e7b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1613 microversion: 2.1 time: 0.084889 Jul 28 12:01:19.149313 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2810/5621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:19 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:19.720220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:19.720921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:19.727575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:19.728025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:19.728786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:19.729223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:19.863338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:19.870829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d6d19f5-ea1f-4302-8f81-95513c7b3c32 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1693 microversion: 2.1 time: 0.154881 Jul 28 12:01:19.871424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2812/5622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:19 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:20.006311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:20.006930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:20.013865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.014316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:20.015094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.015541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:20.144893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:20.147289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:20.153593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5f7e156-3047-4379-85a2-41e50c033ff4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.151156 Jul 28 12:01:20.154657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2811/5623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:20 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:20.171580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:20.172201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:20.178278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.178742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:20.179642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.179998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:20.241941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:20.244380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:20.251190 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a04cc41f-6757-4554-bf20-5408686c2877 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1613 microversion: 2.1 time: 0.084198 Jul 28 12:01:20.251765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2813/5624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:20 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:20.892793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:20.893320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:20.899609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.900055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:20.900836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:20.901270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.033902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:21.041286 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d803ed5-cad3-43b7-85ed-bd825834b1e7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1693 microversion: 2.1 time: 0.153099 Jul 28 12:01:21.041852 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2812/5625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:20 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:21.175107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:21.175733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:21.183741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:21.184193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.185008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:21.185973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.273553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:21.274476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:21.282478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:21.283181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.284152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:21.284778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.320601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:21.321058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:21.321520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lazy-loading 'fault' on Instance uuid 59694965-d6c2-4f07-9b65-cffc5236c1ff {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:01:21.380708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec09f0d9e214bd4bdb812fbe6cfc73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcb8a61482d4f91aed7dcb02a3c1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:21.386232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:21.388822 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0046323f-0264-4c2d-a6b4-be21019c7e60 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 200 len: 1330 microversion: 2.1 time: 0.119479 Jul 28 12:01:21.389404 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2813/5626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:21 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:01:21.396073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53804748-5279-4d7e-a91c-78bf29f7fc30 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1374 microversion: 2.1 time: 0.224813 Jul 28 12:01:21.396826 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2814/5627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:21 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:22.061870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.062588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.069652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.070461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.071376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.071899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.217807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:22.225649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2bb14f5c-6c40-43b2-a1ea-a4b4d0b90f37 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1690 microversion: 2.1 time: 0.167631 Jul 28 12:01:22.226228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2814/5628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:22 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:01:22.246219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:22.246784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.253622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.254076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.254842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.255316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.313743 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-50acf2aa-eed8-46c8-b547-a23635f38e35 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action" status: 204 len: 0 microversion: 2.1 time: 0.071568 Jul 28 12:01:22.314419 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2815/5629] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:01:22 2022] POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:01:22.322489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.323135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.330077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.330582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.331543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.331991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.411037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.411938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.418736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.419308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.420115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.420564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.434540 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff HTTP/1.1 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '59694965-d6c2-4f07-9b65-cffc5236c1ff'} Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:22.436761 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f621ab7-56e5-4b5c-9486-9bcfd1157d56 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 404 len: 111 microversion: 2.1 time: 0.031663 Jul 28 12:01:22.441791 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2816/5630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:22 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:01:22.443112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.443734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.449733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.450191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.451565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.452012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.643467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:22.651318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e6031c4-7a0e-4b69-84bb-a287502ca050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1690 microversion: 2.1 time: 0.332574 Jul 28 12:01:22.652419 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2815/5631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:22 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1690 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:22.656498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-706c6301-b4f6-4f2f-9752-cbf19a7aa118 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '.version_select at 0x7f2ebbed0700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.679801 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-706c6301-b4f6-4f2f-9752-cbf19a7aa118 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656171979" status: 202 len: 0 microversion: 2.1 time: 0.026715 Jul 28 12:01:22.680389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2816/5632] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Jul 28 12:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656171979 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:01:22.681709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:22.690209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b880d4cf-6cad-4b09-8fa7-8b2dc7744d5f tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1546 microversion: 2.1 time: 0.250502 Jul 28 12:01:22.690968 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2817/5633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:22 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:22.717110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:22.718062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:22.724915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.725604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:22.726538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:22.727188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:23.301978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:23.312838 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22ef2e4b-9bbc-41e0-b5af-f9cb696ff532 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1546 microversion: 2.1 time: 0.599533 Jul 28 12:01:23.328671 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2817/5634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:22 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1546 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:23.421683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "name": "network-vif-plugged", "status": "completed", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:23.433395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:23.433979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:23.448284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] Creating event network-vif-plugged:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h1-851368-1 Jul 28 12:01:23.468483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:01:23.494100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-90064250-55a5-4806-b454-1da353356ffa req-e8dc9f43-abf1-4aa3-a8c0-cff738b4c2eb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076605 Jul 28 12:01:23.504369 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2818/5635] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:01:23.675620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:23.676609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:23.683003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:23.683634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:23.684760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:23.685910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:23.836133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:23.852239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19cc0731-c6f0-4d26-8649-1932cc736786 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1690 microversion: 2.1 time: 0.181176 Jul 28 12:01:23.853244 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2818/5636] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:23 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:24.876240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:24.877564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:24.884131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:24.884588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:24.885373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:24.885815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:25.040506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:25.049097 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d83d3c73-09a9-4b94-9a81-0b2c5f3b72c2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1682 microversion: 2.1 time: 0.178877 Jul 28 12:01:25.049693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2819/5637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:24 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:01:27.186450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:27.187630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:27.194581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:27.197824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:27.198500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:27.199526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:27.200161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:27.218257 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff HTTP/1.1 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '59694965-d6c2-4f07-9b65-cffc5236c1ff'} Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:27.220212 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e95b6cb-a384-4f49-97cb-0f5362607778 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 404 len: 111 microversion: 2.1 time: 0.039178 Jul 28 12:01:27.226123 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2819/5638] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:01:27 2022] DELETE /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:27.230618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:27.231231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 59694965-d6c2-4f07-9b65-cffc5236c1ff] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:27.238716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:27.239189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:27.239963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:27.240807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:27.255886 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff HTTP/1.1 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '59694965-d6c2-4f07-9b65-cffc5236c1ff'} Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:27.257560 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 59694965-d6c2-4f07-9b65-cffc5236c1ff could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aede5152-b25a-4140-aaa8-89c292741e0b tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff" status: 404 len: 111 microversion: 2.1 time: 0.032194 Jul 28 12:01:27.262498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2820/5639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:27 2022] GET /compute/v2.1/servers/59694965-d6c2-4f07-9b65-cffc5236c1ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:30.544730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:30.545240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:30.552321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.552780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.553553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.553998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.569053 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e HTTP/1.1 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '84e1ea2d-3a5c-4697-9bc2-74f058e1610e'} Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:30.570622 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4ce5485-a5de-43d5-b1b9-acfd45033cdb tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 404 len: 111 microversion: 2.1 time: 0.031398 Jul 28 12:01:30.576290 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2820/5640] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:01:30 2022] DELETE /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:30.581331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:30.581958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 84e1ea2d-3a5c-4697-9bc2-74f058e1610e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:30.589135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.589597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.590376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.590824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.604426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e HTTP/1.1 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '84e1ea2d-3a5c-4697-9bc2-74f058e1610e'} Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.605996 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 84e1ea2d-3a5c-4697-9bc2-74f058e1610e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74f55b70-4712-4cac-a696-916aae0b3845 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e" status: 404 len: 111 microversion: 2.1 time: 0.030253 Jul 28 12:01:30.612326 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2821/5641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:30 2022] GET /compute/v2.1/servers/84e1ea2d-3a5c-4697-9bc2-74f058e1610e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:01:30.616168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:30.616678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:30.623523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.623977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.624749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.625193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.639266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 HTTP/1.1 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '11d27f0a-da4c-4d4b-aa70-b32fadf8f299'} Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:30.640802 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3246d4eb-08e7-444b-a11f-16eeee649f3e tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 404 len: 111 microversion: 2.1 time: 0.029854 Jul 28 12:01:30.645404 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2821/5642] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:01:30 2022] DELETE /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:01:30.650537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:30.651203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: 11d27f0a-da4c-4d4b-aa70-b32fadf8f299] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:30.657667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.658123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.658910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:30.659385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:30.673369 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 HTTP/1.1 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '11d27f0a-da4c-4d4b-aa70-b32fadf8f299'} Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:30.674923 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance 11d27f0a-da4c-4d4b-aa70-b32fadf8f299 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7a2a89e-1160-4883-87ab-190191ab31e4 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299" status: 404 len: 111 microversion: 2.1 time: 0.029686 Jul 28 12:01:30.679884 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2822/5643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:30 2022] GET /compute/v2.1/servers/11d27f0a-da4c-4d4b-aa70-b32fadf8f299 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:33.932101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:33.932640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:33.939557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:33.940011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:33.940789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:33.941227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:33.958954 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea HTTP/1.1 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c0f3d970-c95b-4126-8ae5-511cf410c7ea'} Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:33.960632 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea36864d-2bb9-4043-b58d-bc1374601bbe tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 404 len: 111 microversion: 2.1 time: 0.033879 Jul 28 12:01:33.966607 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2822/5644] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:01:33 2022] DELETE /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:33.975217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:33.975916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] [instance: c0f3d970-c95b-4126-8ae5-511cf410c7ea] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:33.983135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:33.983582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:33.984373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:33.984822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:33.998442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] HTTP exception thrown: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Request method failure captured: Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea HTTP/1.1 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4niuNcncMgYMBAZfnBN5tIvpuHtNs6Nrcm43AZPUFDte1O_xToI9Qb4d1n_5o5pvtwKUGvOjENTpSzFfg5BH-DuB621DM1zVAqYdI6GBOgEmWEpEoP3izx5JcqUIanlvs5_AaLUwICYeEO0mU0g8v22w0TM5kffMDEd4ptP8HeRdOJc Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_edcb8a61482d4f91aed7dcb02a3c1962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/edcb8a61482d4f91aed7dcb02a3c1962"}]}] Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: edcb8a61482d4f91aed7dcb02a3c1962 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1985875122 Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 7ec09f0d9e214bd4bdb812fbe6cfc73b Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeNegativeTest-1985875122-project Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c0f3d970-c95b-4126-8ae5-511cf410c7ea'} Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:34.000070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] Returning 404 to user: Instance c0f3d970-c95b-4126-8ae5-511cf410c7ea could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7d6a29af-767f-4bf8-96e9-39ba274448b6 tempest-AttachVolumeNegativeTest-1985875122 tempest-AttachVolumeNegativeTest-1985875122-project] 10.222.0.93 "GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea" status: 404 len: 111 microversion: 2.1 time: 0.030556 Jul 28 12:01:34.005588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2823/5645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:01:33 2022] GET /compute/v2.1/servers/c0f3d970-c95b-4126-8ae5-511cf410c7ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:38.445497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a9ac9d4-d8fc-4d56-b6e7-610b72afc188 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Action: 'create', calling method: .version_select at 0x7f2eb197df70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-709746896", "metadata": {"Type": "work"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a9ac9d4-d8fc-4d56-b6e7-610b72afc188 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 121 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-709746896", "metadata": {"Type": "work"}}} Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-709746896', 'metadata': {'Type': 'work'}}}} Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 12:01:38.449645 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a9ac9d4-d8fc-4d56-b6e7-610b72afc188 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a9ac9d4-d8fc-4d56-b6e7-610b72afc188 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125811 Jul 28 12:01:38.458872 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2823/5646] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Jul 28 12:01:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:01:38.461272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-042db302-ca8f-4594-8b74-0e1583bfb78a tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Action: 'create', calling method: .version_select at 0x7f2eb237fd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2116481926", "metadata": {"Type": "work"}}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-042db302-ca8f-4594-8b74-0e1583bfb78a tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 120 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2116481926", "metadata": {"Type": "work"}}} Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2116481926', 'metadata': {'Type': 'work'}}}} Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi '0' Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 12:01:38.465208 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-042db302-ca8f-4594-8b74-0e1583bfb78a tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-042db302-ca8f-4594-8b74-0e1583bfb78a tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009235 Jul 28 12:01:38.473141 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2824/5647] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Jul 28 12:01:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:01:38.477245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c36333a5-f392-429a-b48f-96ba78c398fd tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Action: 'create', calling method: .version_select at 0x7f2eb22fb550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-556255464", "metadata": {"Type": "work"}}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c36333a5-f392-429a-b48f-96ba78c398fd tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 118 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-556255464", "metadata": {"Type": "work"}}} Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-556255464', 'metadata': {'Type': 'work'}}}} Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise error Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi '' Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 12:01:38.481999 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c36333a5-f392-429a-b48f-96ba78c398fd tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c36333a5-f392-429a-b48f-96ba78c398fd tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010587 Jul 28 12:01:38.487206 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2824/5648] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Jul 28 12:01:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:01:38.493030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-edd31b4b-5fc2-4deb-9c34-61a8027dd3f6 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Calling method '.version_select at 0x7f2eb1b5df70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:38.522195 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-edd31b4b-5fc2-4deb-9c34-61a8027dd3f6 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] HTTP exception thrown: Volume tempest-invalid-459047485 could not be found. Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-edd31b4b-5fc2-4deb-9c34-61a8027dd3f6 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-459047485 HTTP/1.1 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: exception: Volume tempest-invalid-459047485 could not be found. Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'tempest-invalid-459047485'} Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-459047485 could not be found. (HTTP 404) (Request-ID: req-32c770b0-1c6a-4324-bc8f-6baeb3ed8f7e) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.527437 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-459047485 could not be found. Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-459047485 could not be found. Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-459047485 could not be found. Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-edd31b4b-5fc2-4deb-9c34-61a8027dd3f6 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 404 to user: Volume tempest-invalid-459047485 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-edd31b4b-5fc2-4deb-9c34-61a8027dd3f6 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-459047485" status: 404 len: 98 microversion: 2.1 time: 0.040122 Jul 28 12:01:38.533613 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2825/5649] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Jul 28 12:01:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-459047485 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 12:01:38.538808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9df65c9f-a2db-45c1-a10c-c254564b2a32 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003790 Jul 28 12:01:38.539329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2825/5650] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Jul 28 12:01:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 12:01:38.547655 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ff1fe88-cb03-42e3-b81c-01239cd30476 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003752 Jul 28 12:01:38.548140 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2826/5651] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Jul 28 12:01:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 12:01:38.556297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1f88f33-edd5-44d0-8409-5a8e31fee19e tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Calling method '.version_select at 0x7f2eb196e940>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:38.587908 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e1f88f33-edd5-44d0-8409-5a8e31fee19e tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] HTTP exception thrown: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1f88f33-edd5-44d0-8409-5a8e31fee19e tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/os-volumes/408328ae-18b3-4b20-8b08-0068bed352ab HTTP/1.1 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: method: Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: exception: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '408328ae-18b3-4b20-8b08-0068bed352ab'} Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. (HTTP 404) (Request-ID: req-49eebf36-c194-4b67-8fc1-17b68a55a2ca) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 12:01:38.589848 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1f88f33-edd5-44d0-8409-5a8e31fee19e tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 404 to user: Volume 408328ae-18b3-4b20-8b08-0068bed352ab could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1f88f33-edd5-44d0-8409-5a8e31fee19e tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/408328ae-18b3-4b20-8b08-0068bed352ab" status: 404 len: 109 microversion: 2.1 time: 0.038934 Jul 28 12:01:38.596213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2826/5652] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Jul 28 12:01:38 2022] DELETE /compute/v2.1/os-volumes/408328ae-18b3-4b20-8b08-0068bed352ab => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:01:38.602140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-492edcef-53ff-4a50-ad92-79554b28c625 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Calling method '.version_select at 0x7f2eb243cca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:38.629515 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-492edcef-53ff-4a50-ad92-79554b28c625 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] HTTP exception thrown: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-492edcef-53ff-4a50-ad92-79554b28c625 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Request method failure captured: Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/os-volumes/f4b91618-d6d0-4a61-8f23-8204ba470f2b HTTP/1.1 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nqib03lIyIYDI1g1LUeGAyU0wRpPd0ibtCPsUuLxjwiCUcuBPull7WNLW-VyHRivKwzKsgO85GBOEcnNLS26WCkefkAd_-3qXgV2ineE9LK9GNhuYz61kqxZJgaJkr4Atx4s21awNwdRtbBhZOVBwGupemuFgcxqQqrPyS2hHEEBNI Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc78203dbca4ea4aea9a777d2e71a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc78203dbca4ea4aea9a777d2e71a10"}]}] Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bc78203dbca4ea4aea9a777d2e71a10 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesNegativeTest-714028906 Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ce9ea85b9b544f45a7322725ea89654d Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesNegativeTest-714028906-project Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: method: Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: exception: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f4b91618-d6d0-4a61-8f23-8204ba470f2b'} Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. (HTTP 404) (Request-ID: req-ee336ebc-faf7-4c2a-a44f-db7897b32d30) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 12:01:38.631481 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-492edcef-53ff-4a50-ad92-79554b28c625 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] Returning 404 to user: Volume f4b91618-d6d0-4a61-8f23-8204ba470f2b could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-492edcef-53ff-4a50-ad92-79554b28c625 tempest-VolumesNegativeTest-714028906 tempest-VolumesNegativeTest-714028906-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f4b91618-d6d0-4a61-8f23-8204ba470f2b" status: 404 len: 109 microversion: 2.1 time: 0.034633 Jul 28 12:01:38.636986 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2827/5653] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Jul 28 12:01:38 2022] GET /compute/v2.1/os-volumes/f4b91618-d6d0-4a61-8f23-8204ba470f2b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:01:45.642912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=7 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:45.644172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=47 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:45.649286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:45.649782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:45.656973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:45.657419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:45.658439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:45.659116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:45.682478 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5802be1a-c735-4c1a-be7b-a67df41db25a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/ips" status: 200 len: 152 microversion: 2.20 time: 0.041160 Jul 28 12:01:45.683106 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2827/5654] 10.222.0.93 () {60 vars in 1289 bytes} [Thu Jul 28 12:01:45 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:01:47.536843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:47.537679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:01:47.541738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:47.542290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:47.550286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:47.550745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:47.551553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:47.552001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:47.576623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lazy-loading 'flavor' on Instance uuid 74c8c84f-f851-434c-8489-badf527de660 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:01:47.756281 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7cca1ee-63fa-48c2-8d47-dad16d6085a2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/action" status: 202 len: 0 microversion: 2.20 time: 0.223830 Jul 28 12:01:47.760410 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2828/5655] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 12:01:47 2022] POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:01:47.766789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:47.767458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:47.775728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:47.776411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:47.777397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:47.778111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:47.913871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:47.922673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:47.924261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:47.925506 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c4fcc06b-d239-4f49-8a5b-f8258c4b5ede tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.163241 Jul 28 12:01:47.925998 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2828/5656] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:47 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:48.950288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:48.951552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:48.959035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:48.959535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:48.960326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:48.960780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:49.108795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:49.118151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:49.119846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:49.121034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5928bed4-e1fc-4f33-a08c-3f260572d474 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.176162 Jul 28 12:01:49.121604 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2829/5657] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:48 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:50.144760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:50.145397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:50.152236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:50.152683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:50.153525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:50.154841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:50.297265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:50.308993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:50.310579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:50.311790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4af77dc7-da2b-4b24-a78e-d9b3c1717003 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.170951 Jul 28 12:01:50.312348 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2829/5658] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:50 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:51.333788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:51.334410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:51.341295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:51.341748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:51.342518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:51.342961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:51.473002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:51.481160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:51.483214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:51.484393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d0a531a-5fe4-4cd8-af29-d4d3d39168e0 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.154553 Jul 28 12:01:51.485154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2830/5659] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:51 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:52.507960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:52.508564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:52.516592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:52.517110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:52.517995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:52.518498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:52.657010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:52.665458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:52.666948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:52.668169 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c25e0ce9-93e1-4e92-a8e9-c1e69a568fd8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.164135 Jul 28 12:01:52.668730 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2830/5660] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:52 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:53.691346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:53.691968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:53.699004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:53.699484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:53.700249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:53.700681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:53.833798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:53.842148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:53.844232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:53.845432 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-579b3d70-6c36-4ad7-bb13-c3f667d425b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.158196 Jul 28 12:01:53.845998 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2831/5661] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:53 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:54.868448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:54.869145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:54.877589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:54.878765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:54.878971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:54.879393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:55.028508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:55.039020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:55.040594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:55.041905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fc66a0e6-7532-442c-be35-2328ee03ecfe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.177256 Jul 28 12:01:55.042490 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2831/5662] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:54 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:56.065438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:56.066050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:56.072640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:56.073095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:56.073872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:56.074327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:56.217221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:56.226026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:56.227573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:56.228756 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e957651-437d-4f64-bbd0-21bd19a7cd12 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.167602 Jul 28 12:01:56.229500 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2832/5663] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:56 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:57.252958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:57.253665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:57.261485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:57.261976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:57.262751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:57.263728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:57.282638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:01:57.285080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:57.292443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:57.293033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:57.293923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:57.294470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:57.367043 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41a722d7-8612-4a56-81f2-61300efbe4d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action" status: 200 len: 24580 microversion: 2.1 time: 0.089833 Jul 28 12:01:57.367908 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2833/5664] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:01:57 2022] POST /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4/action => generated 24580 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 12:01:57.407652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:57.415958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:57.417565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:57.418780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-041c4e66-f841-4a9f-aaa6-30429ed2cafc tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.169756 Jul 28 12:01:57.419401 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2832/5665] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:57 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:58.442826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:58.443581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:58.451788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:58.452241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:58.453012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:58.453443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:58.586171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:58.594689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:58.596219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:58.597643 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aac57b00-aaff-43d8-babf-c478f3641eb5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1744 microversion: 2.20 time: 0.159147 Jul 28 12:01:58.598209 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2834/5666] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:58 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:01:59.627601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:01:59.628334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:01:59.635694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:59.636156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:59.637578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:01:59.638030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:01:59.785823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:59.797026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:59.799151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:01:59.801078 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91641c40-517e-4114-bf86-c7acb0d3a2c9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1744 microversion: 2.20 time: 0.177784 Jul 28 12:01:59.808034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2833/5667] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:01:59 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:00.827045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:00.828995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:00.837699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:00.838923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:00.840137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:00.840757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:01.123515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:01.137018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:01.139644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:01.141049 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3110acf-4459-42bd-9ce1-0c99188fa030 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.320284 Jul 28 12:02:01.142098 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2835/5668] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:00 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:02.169483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:02.170881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:02.188576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:02.202865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:02.204595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:02.205279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:02.373041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-00fe52a2-da92-4750-b243-e4f2e53d170a req-e22b02c6-4925-4d7a-bed4-e747f34eec2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "name": "network-vif-plugged", "status": "completed", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:02.401345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-00fe52a2-da92-4750-b243-e4f2e53d170a req-e22b02c6-4925-4d7a-bed4-e747f34eec2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:02.402056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-00fe52a2-da92-4750-b243-e4f2e53d170a req-e22b02c6-4925-4d7a-bed4-e747f34eec2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:02.421268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-00fe52a2-da92-4750-b243-e4f2e53d170a req-e22b02c6-4925-4d7a-bed4-e747f34eec2e service nova] Creating event network-vif-plugged:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:02:02.428435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-00fe52a2-da92-4750-b243-e4f2e53d170a req-e22b02c6-4925-4d7a-bed4-e747f34eec2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382155 Jul 28 12:02:02.429505 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2834/5669] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:02.972620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:02.982932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:02.989985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:02.996779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b403cab-a68f-48d9-9c6f-6f2a05882a91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.826296 Jul 28 12:02:02.997794 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2836/5670] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:02 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:04.021365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:04.022077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:04.031964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.033297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.036790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.037538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.059027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:04.059582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:04.069714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.070048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.070845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.071334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.152052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:02:04.380238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:04.381945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-725f4189-9f55-4299-8da2-ad1568d568b2 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 204 len: 0 microversion: 2.1 time: 0.326624 Jul 28 12:02:04.382954 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2837/5671] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:02:04 2022] DELETE /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:02:04.398016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:04.398287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:04.399103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:04.403718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:04.405451 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d55deb7f-f485-4a87-8d36-1c5b4c906ec4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.388608 Jul 28 12:02:04.406990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.407884 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2835/5672] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:04 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:04.411331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.412280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:04.412739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:04.682381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:04.693158 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a504f06-93f5-4509-864c-b4ac31f24cf3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1552 microversion: 2.1 time: 0.305168 Jul 28 12:02:04.694175 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2838/5673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:04 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1552 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:05.431473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:05.432287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:05.441791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:05.442396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:05.444311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:05.445109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:05.659889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:05.669569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:05.671333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:05.672782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b15f5ddc-b6df-4a0c-bb2f-38a4dc245535 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.246724 Jul 28 12:02:05.673650 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2836/5674] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:05 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:05.719982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:05.721558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:05.734361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:05.736296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:05.737342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:05.738279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:06.029305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:06.039434 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-202c0d87-27b4-4d5a-b1d4-15ff06f014df tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1552 microversion: 2.1 time: 0.323799 Jul 28 12:02:06.043152 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2839/5675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:05 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1552 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:06.698221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:06.699239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:06.709826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:06.710595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:06.711811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:06.712419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:06.808315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8e147783-3973-46ed-8c61-ec9b3fe22495 req-61e10497-8c86-40ac-92d7-c335093aa452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48391170-9f91-44a0-b424-dbf2323d3f2f", "name": "network-vif-deleted", "tag": "827ecc7a-d70d-41aa-b0db-aa24734a7390"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:06.834814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8e147783-3973-46ed-8c61-ec9b3fe22495 req-61e10497-8c86-40ac-92d7-c335093aa452 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:06.835430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8e147783-3973-46ed-8c61-ec9b3fe22495 req-61e10497-8c86-40ac-92d7-c335093aa452 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:06.867284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8e147783-3973-46ed-8c61-ec9b3fe22495 req-61e10497-8c86-40ac-92d7-c335093aa452 service nova] Creating event network-vif-deleted:827ecc7a-d70d-41aa-b0db-aa24734a7390 for instance 48391170-9f91-44a0-b424-dbf2323d3f2f on n-h1-851368-1 Jul 28 12:02:06.891096 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8e147783-3973-46ed-8c61-ec9b3fe22495 req-61e10497-8c86-40ac-92d7-c335093aa452 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069583 Jul 28 12:02:06.892197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2840/5676] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:02:06.916899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:06.930051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:06.931946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:06.937504 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22f35adb-6550-4a16-aca8-64d785572756 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.243651 Jul 28 12:02:06.938317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2837/5677] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:06 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:07.066143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:07.067510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:07.077132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:07.080830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:07.082021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:07.082461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:07.118367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:07.119612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:07.120315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lazy-loading 'fault' on Instance uuid 48391170-9f91-44a0-b424-dbf2323d3f2f {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:02:07.123892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:07.184825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:07.193732 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c22ccc15-407a-4871-98ee-54976ddba7e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 200 len: 1338 microversion: 2.1 time: 0.135500 Jul 28 12:02:07.194683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2841/5678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:07 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:07.967460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:07.968667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:07.977552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:07.978277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:07.979305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:07.979797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:08.162589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:08.172483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:08.176996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:08.178488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6816af00-4cc4-4bd1-aae0-fcc78c9aef9b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.215521 Jul 28 12:02:08.179308 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2838/5679] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:07 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:08.222835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:08.223604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 48391170-9f91-44a0-b424-dbf2323d3f2f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:08.231108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:08.231726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:08.232622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:08.233144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:08.252596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] HTTP exception thrown: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Request method failure captured: Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f HTTP/1.1 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4noT11Bid-V4ODAt19g3sYOXmpfXjCLhg82GUGcWYq8mRIlCCksEdfnIvHZjUtCb8qcOT9ZFakjXwToZekZS3ETnBzlxKbiSSzvLyqb4HV9-OM6oSZ4957pp9slI-apVB9TYMrQGypZinbCoTqx0Dlq3CFI4VGOAMWvX_iy8OdO6FFw Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1bf57d80eda444068a9aefb807633862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1bf57d80eda444068a9aefb807633862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}] Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 63f981bef3004c739abdb3f4b56aa035 Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '48391170-9f91-44a0-b424-dbf2323d3f2f'} Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:08.254754 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. Jul 28 12:02:08.259565 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:08.261990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Returning 404 to user: Instance 48391170-9f91-44a0-b424-dbf2323d3f2f could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:02:08.263697 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-591488a1-a3c0-4a7c-9cb2-850c5eadce6a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f" status: 404 len: 111 microversion: 2.1 time: 0.045783 Jul 28 12:02:08.264769 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2842/5680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:08 2022] GET /compute/v2.1/servers/48391170-9f91-44a0-b424-dbf2323d3f2f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:02:08.482723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae6d54f1-e4a6-450f-9d00-0bd883e87851 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '.version_select at 0x7f2eb1a5d310>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:08.522683 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae6d54f1-e4a6-450f-9d00-0bd883e87851 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1142694619" status: 202 len: 0 microversion: 2.1 time: 0.043721 Jul 28 12:02:08.524446 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2839/5681] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 12:02:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1142694619 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:02:09.206523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:09.207180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:09.224879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:09.228843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:09.229641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:09.233286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:09.594787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:09.610434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:09.611990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:09.620593 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6949a96b-604a-41eb-a65d-64dff3783e39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.421135 Jul 28 12:02:09.621509 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2843/5682] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:09 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:10.648312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:10.649659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:10.663020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:10.663905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:10.665417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:10.666110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:10.936881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:10.945258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:10.947154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:10.948533 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fcaa476a-b248-4f4a-951d-57278eabd4e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.307594 Jul 28 12:02:10.964121 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2840/5683] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:10 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:11.312089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:11.312908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1647d974-3249-4ef3-bbf6-34c615d5187f req-676afe89-c47e-432b-90a2-bc68dffb3c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e4589f-6f59-4c4c-9e1f-6fd2200fca37", "tag": "f3c5a806-d575-423b-90c4-a4c63c718ea6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:11.314452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:11.338732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.339593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.340612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.342325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.342983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1647d974-3249-4ef3-bbf6-34c615d5187f req-676afe89-c47e-432b-90a2-bc68dffb3c3f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.348228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1647d974-3249-4ef3-bbf6-34c615d5187f req-676afe89-c47e-432b-90a2-bc68dffb3c3f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.389107 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1647d974-3249-4ef3-bbf6-34c615d5187f req-676afe89-c47e-432b-90a2-bc68dffb3c3f service nova] Creating event network-changed:f3c5a806-d575-423b-90c4-a4c63c718ea6 for instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 on n-h1-851368-1 Jul 28 12:02:11.408461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1647d974-3249-4ef3-bbf6-34c615d5187f req-676afe89-c47e-432b-90a2-bc68dffb3c3f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100780 Jul 28 12:02:11.409268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2841/5684] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:02:11.427353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:02:11.626857 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8c98b25-f601-4736-9d1e-10ab6cb24bb7 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 204 len: 0 microversion: 2.1 time: 0.323969 Jul 28 12:02:11.627654 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2844/5685] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:02:11 2022] DELETE /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:02:11.637197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:11.638300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:11.652724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.653949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.656995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.657655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.876006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:11.889661 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12f9642e-5e20-4c51-80b2-692135571bd5 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1668 microversion: 2.1 time: 0.256921 Jul 28 12:02:11.890880 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2842/5686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:11 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1668 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:11.976864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:11.977742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:11.992939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.993548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:11.994450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:11.994992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:12.226813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:12.240102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:12.242069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:12.244912 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-83ab4c8f-d809-4eac-a752-d890ac67cff5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.271390 Jul 28 12:02:12.264070 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2845/5687] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:11 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:12.911268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:12.912639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:12.923368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:12.924202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:12.925193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:12.925865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:13.125203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:13.133405 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d68b08b6-8e22-499c-9fbd-c2366492bbe4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1668 microversion: 2.1 time: 0.225930 Jul 28 12:02:13.134556 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2843/5688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:12 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:13.272263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:13.272877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:13.284349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:13.285154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:13.286161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:13.287059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:13.446644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:13.457984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:13.460170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:13.461386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c627e4cc-1ae4-4bb4-a755-40f0a67754f3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1739 microversion: 2.20 time: 0.194440 Jul 28 12:02:13.462071 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2846/5689] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:13 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:14.064731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-565bf09b-0a96-4656-8e61-030295826c45 req-9fb038df-8731-4142-b4e3-949c883fb230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e4589f-6f59-4c4c-9e1f-6fd2200fca37", "name": "network-vif-deleted", "tag": "f3c5a806-d575-423b-90c4-a4c63c718ea6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:14.075871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-565bf09b-0a96-4656-8e61-030295826c45 req-9fb038df-8731-4142-b4e3-949c883fb230 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.076341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-565bf09b-0a96-4656-8e61-030295826c45 req-9fb038df-8731-4142-b4e3-949c883fb230 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.088548 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-565bf09b-0a96-4656-8e61-030295826c45 req-9fb038df-8731-4142-b4e3-949c883fb230 service nova] Creating event network-vif-deleted:f3c5a806-d575-423b-90c4-a4c63c718ea6 for instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 on n-h1-851368-1 Jul 28 12:02:14.094621 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-565bf09b-0a96-4656-8e61-030295826c45 req-9fb038df-8731-4142-b4e3-949c883fb230 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Jul 28 12:02:14.095456 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2844/5690] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:02:14.158021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:14.158957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:14.165240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.165709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.167179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.167630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.202505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.202971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.203481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lazy-loading 'fault' on Instance uuid 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:02:14.250010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:14.258290 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-484c34ef-a5ba-45cd-8a2b-e4b51b348209 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 200 len: 1338 microversion: 2.1 time: 0.105794 Jul 28 12:02:14.258879 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2847/5691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:14 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:14.486842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:14.487655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:14.502639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.503479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.504988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:14.505662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:14.743951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:14.753555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:14.755509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:14.756889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8422d094-7c22-49e7-8e3c-bf22c3bc6615 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1721 microversion: 2.20 time: 0.274833 Jul 28 12:02:14.757633 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2845/5692] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:14 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:15.280673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:15.282183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 89e4589f-6f59-4c4c-9e1f-6fd2200fca37] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:15.289997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:15.290534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:15.291425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:15.291972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:15.306617 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] HTTP exception thrown: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Request method failure captured: Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 HTTP/1.1 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4noT11Bid-V4ODAt19g3sYOXmpfXjCLhg82GUGcWYq8mRIlCCksEdfnIvHZjUtCb8qcOT9ZFakjXwToZekZS3ETnBzlxKbiSSzvLyqb4HV9-OM6oSZ4957pp9slI-apVB9TYMrQGypZinbCoTqx0Dlq3CFI4VGOAMWvX_iy8OdO6FFw Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1bf57d80eda444068a9aefb807633862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1bf57d80eda444068a9aefb807633862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}] Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 63f981bef3004c739abdb3f4b56aa035 Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '89e4589f-6f59-4c4c-9e1f-6fd2200fca37'} Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:15.308323 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Returning 404 to user: Instance 89e4589f-6f59-4c4c-9e1f-6fd2200fca37 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0a82649-df50-4b56-b4a2-88a78ed47cfd tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37" status: 404 len: 111 microversion: 2.1 time: 0.033228 Jul 28 12:02:15.317958 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2848/5693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:15 2022] GET /compute/v2.1/servers/89e4589f-6f59-4c4c-9e1f-6fd2200fca37 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:02:15.476663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-96fd22d5-b53e-45a5-a8f3-c9b920f8add1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '.version_select at 0x7f2eb1944700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:15.498318 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-96fd22d5-b53e-45a5-a8f3-c9b920f8add1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1617729382" status: 202 len: 0 microversion: 2.1 time: 0.026970 Jul 28 12:02:15.499257 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2846/5694] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 12:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1617729382 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:02:15.780057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:15.780963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:15.787476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:15.787936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:15.788735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:15.789184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:16.056064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:16.064187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:16.065691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:16.066916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abf3f9db-0321-475b-9924-2ff1d46a4236 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1721 microversion: 2.20 time: 0.291411 Jul 28 12:02:16.067644 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2849/5695] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:15 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:17.090738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:17.092137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:17.098609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:17.100907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.101716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.102726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.103458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.107146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:17.406820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:17.420401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:17.422310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:17.423831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-079eb25e-edb2-416c-a457-d61aa0ae0b4f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1664 microversion: 2.20 time: 0.337879 Jul 28 12:02:17.443975 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2847/5696] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:17 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1664 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:17.453732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12745709-8700-41f6-bd50-3d5b40d0efa6"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:17.456876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:17.464948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.465569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.466406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.467047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.799828 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dee5a320-2652-4f81-a1a2-1252c9dfb93b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353379 Jul 28 12:02:17.800731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2850/5697] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Jul 28 12:02:17 2022] POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:02:17.943812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:17.944783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:17.945700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f73658bf-51fb-4c76-9c2f-31646adec81c req-bd6b7f54-0c67-4b3a-8d42-7473694cfd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "name": "network-vif-unplugged", "status": "completed", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:17.950849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:17.952893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.953349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.954508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.955153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.970860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f73658bf-51fb-4c76-9c2f-31646adec81c req-bd6b7f54-0c67-4b3a-8d42-7473694cfd04 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:17.971671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f73658bf-51fb-4c76-9c2f-31646adec81c req-bd6b7f54-0c67-4b3a-8d42-7473694cfd04 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:17.998497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.compute.server_external_events [req-f73658bf-51fb-4c76-9c2f-31646adec81c req-bd6b7f54-0c67-4b3a-8d42-7473694cfd04 service nova] Unable to find a host for instance 74c8c84f-f851-434c-8489-badf527de660. Dropping event network-vif-unplugged {{(pid=119236) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 12:02:18.000590 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f73658bf-51fb-4c76-9c2f-31646adec81c req-bd6b7f54-0c67-4b3a-8d42-7473694cfd04 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062764 Jul 28 12:02:18.007810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2848/5698] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 12:02:18.026768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119235) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 12:02:18.145994 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-241ca0e4-794e-44aa-b66f-7c2bd321e44f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/action" status: 202 len: 0 microversion: 2.20 time: 0.206864 Jul 28 12:02:18.151895 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2851/5699] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 12:02:17 2022] POST /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 12:02:18.163200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:18.163823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:18.174020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:18.176620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:18.178141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:18.180407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:18.402437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:18.413093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:18.415010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:18.416676 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c60460cd-2e48-4a0d-8fb2-068239f7604e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1750 microversion: 2.20 time: 0.260125 Jul 28 12:02:18.417581 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2849/5700] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:18 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:19.441945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:19.443372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:19.451022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:19.455701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:19.456723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:19.457326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:19.811401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:19.826885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:19.832979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:19.844120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21d4d994-cb31-4cf4-8992-dfb342200b30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.396350 Jul 28 12:02:19.845035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2852/5701] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:19 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:20.543332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:20.545733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:20.557102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:20.557562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:20.558350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:20.559729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:20.867663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:20.869078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:20.876503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:20.877346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:20.878400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:20.879167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:21.145639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:21.151440 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a821990-430b-495a-93e8-6f923e46c839 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1833 microversion: 2.1 time: 0.612634 Jul 28 12:02:21.152601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:21.152781 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2850/5702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:20 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1833 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:21.157413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:21.159369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:21.160681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-752fc386-cd1d-495a-aa65-6339bc89ed5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.297012 Jul 28 12:02:21.161862 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2853/5703] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:20 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:22.186004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:22.186641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:22.190535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:22.191152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:22.199577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.200557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.201364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.201808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.205692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.210278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.211332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.212204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.276155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:02:22.421013 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d40ae7c2-2977-405d-a982-6af4a1fd420d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 204 len: 0 microversion: 2.1 time: 0.235401 Jul 28 12:02:22.423507 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2854/5704] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:02:22 2022] DELETE /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 12:02:22.435401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3598c4aa-6852-4e05-82fb-ba6fffed04d5 req-49026b8f-9613-45ac-aea2-cb0f14362efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:22.464758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3598c4aa-6852-4e05-82fb-ba6fffed04d5 req-49026b8f-9613-45ac-aea2-cb0f14362efb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.468336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3598c4aa-6852-4e05-82fb-ba6fffed04d5 req-49026b8f-9613-45ac-aea2-cb0f14362efb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.471380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:22.480383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:22.487104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:22.490557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9384a107-9094-4944-83d6-3dafd4693592 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.308710 Jul 28 12:02:22.491404 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2851/5705] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:22 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:22.503306 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3598c4aa-6852-4e05-82fb-ba6fffed04d5 req-49026b8f-9613-45ac-aea2-cb0f14362efb service nova] Creating event network-changed:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h1-851368-1 Jul 28 12:02:22.510181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3598c4aa-6852-4e05-82fb-ba6fffed04d5 req-49026b8f-9613-45ac-aea2-cb0f14362efb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085152 Jul 28 12:02:22.510967 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2855/5706] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:22.522088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:22.523108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:22.531158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.531936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.532936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:22.533547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:22.735844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:22.743482 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-02ccef70-a4da-4079-912f-20627f4701b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1688 microversion: 2.1 time: 0.234419 Jul 28 12:02:22.755274 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2852/5707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:22 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:23.516500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:23.517353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:23.531057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:23.531546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:23.532328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:23.532772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:23.769506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:23.770754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:23.783262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:23.788180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:23.789468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:23.790188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:24.237103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:24.277487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:24.283216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:24.285759 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d883ab0-6275-43e3-a621-9c4a0ffb3fa4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.774330 Jul 28 12:02:24.292220 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2856/5708] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:23 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:24.337068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:24.351150 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97decf97-623c-412f-bdd4-2fa6f86342a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1688 microversion: 2.1 time: 0.587269 Jul 28 12:02:24.354139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2853/5709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:23 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1688 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:02:25.334933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:25.335607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:25.364627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:25.365092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:25.380042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:25.380780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:25.393903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:25.394558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:25.410819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:25.419992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:25.422656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:25.423339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:25.802256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:25.802827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:25.811153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e13b02f-d61d-482b-a363-8c536ebad050 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1688 microversion: 2.1 time: 0.421286 Jul 28 12:02:25.814219 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2854/5710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:25 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1688 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:25.831876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:25.836053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:25.837293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88cefb84-76af-4810-bef2-8e366f871557 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.507730 Jul 28 12:02:25.837863 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2857/5711] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:25 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:26.663028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dd52d23c-3b33-4315-b440-70fdb0e3feb7 req-c5136330-d545-493d-b0eb-554bb5518eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7de48b0-33f0-4438-b5dd-aabc641049f4", "name": "network-vif-deleted", "tag": "2e41ca1c-6f6b-4827-a2d9-32717c6a1fff"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:26.678249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dd52d23c-3b33-4315-b440-70fdb0e3feb7 req-c5136330-d545-493d-b0eb-554bb5518eca service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.678702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dd52d23c-3b33-4315-b440-70fdb0e3feb7 req-c5136330-d545-493d-b0eb-554bb5518eca service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.737607 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-dd52d23c-3b33-4315-b440-70fdb0e3feb7 req-c5136330-d545-493d-b0eb-554bb5518eca service nova] Creating event network-vif-deleted:2e41ca1c-6f6b-4827-a2d9-32717c6a1fff for instance e7de48b0-33f0-4438-b5dd-aabc641049f4 on n-h1-851368-1 Jul 28 12:02:26.749586 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dd52d23c-3b33-4315-b440-70fdb0e3feb7 req-c5136330-d545-493d-b0eb-554bb5518eca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089976 Jul 28 12:02:26.752859 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2855/5712] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:26.848634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:26.849591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:26.867809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:26.871291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:26.875765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.876368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.880263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.880864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.892867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.893549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.906808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.909676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.945793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:26.946523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:26.947314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lazy-loading 'fault' on Instance uuid e7de48b0-33f0-4438-b5dd-aabc641049f4 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:02:27.083669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:27.094272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-23403173-837f-4d7b-ab16-d7a14a2ba1b0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 200 len: 1357 microversion: 2.1 time: 0.258203 Jul 28 12:02:27.096399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2858/5713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:26 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:27.349837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:27.370083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:27.379732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:27.381284 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a4e0d2c-6469-4e91-8e2d-70c206a15851 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1752 microversion: 2.20 time: 0.520607 Jul 28 12:02:27.382221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2856/5714] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:26 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1752 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:28.119981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:28.120853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: e7de48b0-33f0-4438-b5dd-aabc641049f4] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:28.131564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:28.132140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:28.133079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:28.133522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:28.156483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] HTTP exception thrown: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Request method failure captured: Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 HTTP/1.1 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nozoHNvSRavIkmD8AajooQaWwNnmMbGdCZ4di285oby44AJzbKAYneiequjHATCTb5eKctYzuptKNmfANbi25s6SPH1xtfH8wUfnPCq739fqsKLpM-fJGBYq-nvo4vTfKz8gNFWsmKyi1YQfHanxAJGiqsL7o98Ri0E2-SKBgmv3-c Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}] Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ad897d5445224ba48dc242fb71a77480 Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e7de48b0-33f0-4438-b5dd-aabc641049f4'} Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:28.159289 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Returning 404 to user: Instance e7de48b0-33f0-4438-b5dd-aabc641049f4 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:02:28.164064 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d3d21b0a-f796-4831-afb7-929fda1f21ea tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4" status: 404 len: 111 microversion: 2.1 time: 0.047164 Jul 28 12:02:28.167392 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2859/5715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:28 2022] GET /compute/v2.1/servers/e7de48b0-33f0-4438-b5dd-aabc641049f4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:02:28.406302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:28.407308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:28.418061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:28.419593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:28.421190 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:28.421841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:28.897658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:28.912383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:28.914022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:28.915419 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-561958a2-c883-4496-b650-6d92b513be91 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.514215 Jul 28 12:02:28.918532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2857/5716] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:28 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:29.943253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:29.943996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:29.981847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:29.987517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:29.988504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:29.993251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:30.350314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8e68470-da71-4848-93ec-0c6e4f2b55fc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: .version_select at 0x7f2eb19de160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1026243261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzIwiwLmfs6WrN40apR/MCS8eK2RbDK9NdyUq37wWYKUE/dcFu/lnSmobn9reuH+HPELYufOyGFhhG47L7pX27w8woP5V2duRfCwGgGPPO8JZw8qSsDm+WvKbO1O+p2eQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:30.392034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a8e68470-da71-4848-93ec-0c6e4f2b55fc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:02:30.410623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a8e68470-da71-4848-93ec-0c6e4f2b55fc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:02:30.473812 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8e68470-da71-4848-93ec-0c6e4f2b55fc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.129350 Jul 28 12:02:30.477232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2858/5717] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:02:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:30.487779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:30.501612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:30.503232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:30.504526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f01beba-eaa5-42e3-8cf9-7566a71347a7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.567935 Jul 28 12:02:30.505104 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2860/5718] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:29 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:31.542348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:31.543349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:31.567088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:31.567687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:31.568856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:31.568856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:32.835627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:32.879006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:32.880982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:32.882976 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ad1819c-bb3d-4ecb-84f6-36d334cd57ea tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 1.348722 Jul 28 12:02:32.898812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2859/5719] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:31 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:33.928714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:33.930261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:33.951374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:33.952863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:33.962013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:33.962880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:34.309248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-884876144", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "fa082bf1-8e3a-4c8f-b5d3-03f6f76d546d"}], "key_name": "tempest-TestNetworkBasicOps-1026243261", "security_groups": [{"name": "tempest-secgroup-smoke-625101224"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:34.359737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:34.373166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:34.394759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:34.397231 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abe92af3-b205-449c-84a9-8dcc5a7297f8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.475812 Jul 28 12:02:34.398339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2861/5720] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:33 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:34.535803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] validate_networks() for [('fa082bf1-8e3a-4c8f-b5d3-03f6f76d546d', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:02:35.422583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:35.430513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:02:35.431057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:02:35.431674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:02:35.432094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:02:35.432590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:02:35.436072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:35.462965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:35.463450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:35.464248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:35.464691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:35.470016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:35.470659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:35.471581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:35.472096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:35.524057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:02:35.561574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Getting quotas for user 63f981bef3004c739abdb3f4b56aa035 and project 1bf57d80eda444068a9aefb807633862. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:02:35.606823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:02:35.613528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:02:35.728634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b5ef68a-83db-409b-9225-9ad6ee020f8c tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.432069 Jul 28 12:02:35.733209 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2860/5721] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:02:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:02:35.753781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45a1878f-7d8c-40b1-8a9c-4dce5ab67e6e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:35.756453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45a1878f-7d8c-40b1-8a9c-4dce5ab67e6e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:35.841370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:35.856873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:35.861226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:35.867549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec1568f3-98ff-42f1-a467-88598a9fa194 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.448713 Jul 28 12:02:35.868695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2862/5722] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:35 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:35.980201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45a1878f-7d8c-40b1-8a9c-4dce5ab67e6e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:35.992141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45a1878f-7d8c-40b1-8a9c-4dce5ab67e6e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1248 microversion: 2.1 time: 0.252360 Jul 28 12:02:35.995321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2861/5723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:35 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1248 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:36.275223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76e60836-7be7-4f8e-a2b8-09ab537d9666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '.version_select at 0x7f2eb23eff70>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:36.311597 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76e60836-7be7-4f8e-a2b8-09ab537d9666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1113755113" status: 202 len: 0 microversion: 2.1 time: 0.040457 Jul 28 12:02:36.319480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2863/5724] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:02:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1113755113 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:02:36.356465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4638959d-0e2f-479f-a2b8-25d0ded6f762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: .version_select at 0x7f2eb1a57820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2005553506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjujqA0WOUGrrm8EWBvZwfFqSEL3GmT0eIPYYJEDWPI+d9VP0IQupAsc1Binufhy2BxW/5RTExYPfu9On4kKeT9GadnAbDyKQaAQBMeqq3W55IOaH3yYzz2yazetJ6kpw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:36.391603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-4638959d-0e2f-479f-a2b8-25d0ded6f762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:02:36.398493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-4638959d-0e2f-479f-a2b8-25d0ded6f762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:02:36.440031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4638959d-0e2f-479f-a2b8-25d0ded6f762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.088089 Jul 28 12:02:36.449086 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2862/5725] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:02:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:36.899124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:36.901915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:36.955018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:36.957643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:36.961338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:36.963498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:37.028719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:37.037619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:37.079439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:37.081019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:37.084041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:37.086931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:37.366892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:37.390090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c1c75a7-2eed-4fab-83ac-5fe6e6c92235 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1300 microversion: 2.1 time: 0.370758 Jul 28 12:02:37.391611 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2863/5726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:37 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1300 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:37.413528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:37.429162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:37.431898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:37.433965 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d34de63-cba9-4ff4-af0e-3639b7e5c9de tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.542963 Jul 28 12:02:37.440729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2864/5727] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:36 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:38.414967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:38.416327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:38.429874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:38.430346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:38.431931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:38.432386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:38.464628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:38.466748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:38.475867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:38.478664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:38.480890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:38.482263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:38.582518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:38.596620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0d1aa9f-f202-41d4-98b5-39f0366eac35 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1306 microversion: 2.1 time: 0.188341 Jul 28 12:02:38.600470 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2864/5728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:38 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:38.719772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:38.732903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:38.741023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:38.742639 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9017951-6b2c-472f-b405-247aac13b1ef tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.284436 Jul 28 12:02:38.743919 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2865/5729] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:38 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:39.624776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:39.625633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:39.633550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:39.634066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:39.634924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:39.635399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:39.770049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:39.770734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:39.780720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:39.781213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:39.782023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:39.782413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:39.809668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:39.820526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-225b8614-7086-4986-a346-323d4e5be7b1 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.199655 Jul 28 12:02:39.835228 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2865/5730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:39 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:39.947844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:39.961727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:39.963263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:39.964657 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bdf3398-60a6-46c6-8dbd-a09b7b78fdfa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.198598 Jul 28 12:02:39.966092 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2866/5731] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:39 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:40.842422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:40.843040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:40.850708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:40.851211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:40.852194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:40.852633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:40.988875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:40.990786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:40.998853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:40.999345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:41.000173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:41.000921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:41.067447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:41.077393 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2cb1092a-02ec-4a1a-8421-d663657fb806 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.239513 Jul 28 12:02:41.078408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2866/5732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:40 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:41.181571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:41.192523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:41.195377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:41.197564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0a6d2a12-636d-47d4-8269-6288043cef72 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.212455 Jul 28 12:02:41.220653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-de0d87d2-8d94-4cf9-bee5-759036fc6989 req-5a218c92-b960-4d35-9446-de15030f2eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35c569-c03a-457c-af2e-e610008a6832", "tag": "bd721b15-e0ae-4296-ad22-a5b86fef26a3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:41.224521 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2867/5733] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:40 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:02:41.238194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-de0d87d2-8d94-4cf9-bee5-759036fc6989 req-5a218c92-b960-4d35-9446-de15030f2eed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:41.238988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-de0d87d2-8d94-4cf9-bee5-759036fc6989 req-5a218c92-b960-4d35-9446-de15030f2eed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:41.261960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-de0d87d2-8d94-4cf9-bee5-759036fc6989 req-5a218c92-b960-4d35-9446-de15030f2eed service nova] Creating event network-changed:bd721b15-e0ae-4296-ad22-a5b86fef26a3 for instance 9d35c569-c03a-457c-af2e-e610008a6832 on n-h1-851368-1 Jul 28 12:02:41.279715 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-de0d87d2-8d94-4cf9-bee5-759036fc6989 req-5a218c92-b960-4d35-9446-de15030f2eed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065813 Jul 28 12:02:41.284198 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2867/5734] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:02:42.098708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:42.099371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:42.109317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:42.109821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:42.110668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:42.113246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:42.230346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:42.231157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:42.243333 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:42.245102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:42.249029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:42.249686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:42.416528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:42.439007 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e193b8df-ecef-4294-89ae-763b9f6c157e tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.344568 Jul 28 12:02:42.445266 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2868/5735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:42 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:42.455646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:42.464745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:42.466616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:42.467920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-329a8bb1-a106-4922-8af6-c7818577fb7c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.243040 Jul 28 12:02:42.484096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2868/5736] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:42 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:43.460185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:43.460887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:43.470006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:43.470466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:43.471849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:43.472298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:43.495767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:43.496584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:43.509644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:43.510104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:43.510900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:43.511372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:43.558739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:43.714442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:43.726044 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7947374a-1f11-4f46-a38f-e5a9853147e3 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.269649 Jul 28 12:02:43.727855 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2869/5737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:43 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:43.746844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:43.755604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:43.757118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:43.758301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7cceb7b7-9508-4f66-be34-1a43949f4ce9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.267002 Jul 28 12:02:43.758866 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2869/5738] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:43 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:44.763196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:44.765515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:44.782475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:44.783551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:44.783754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:44.784364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:44.785440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:44.797645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:44.816056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:44.816749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:44.817712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:44.818313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:45.184503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:45.190213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:45.204585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:45.221620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:45.224873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:45.226049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2c9e2142-7ac0-4612-b648-55b52cdedccd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.447767 Jul 28 12:02:45.231961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec7d613e-5508-48f9-9a18-2e4935fbccf4 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.478334 Jul 28 12:02:45.244354 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2870/5739] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:44 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:45.248029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2870/5740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:44 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:46.261284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:46.262657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:46.264181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:46.265111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:46.270606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:46.280394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:46.284685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:46.285619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:46.286623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:46.287811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:46.288528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:46.289588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:46.293040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:46.409159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:46.630153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:46.649681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:46.656630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:46.659340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7321aede-0299-4a7b-8eb5-56fc45c952d1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.407309 Jul 28 12:02:46.663531 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2871/5741] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:46 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:46.746787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:46.760135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b88cf960-a58d-4455-a595-7f7a5148d531 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.509826 Jul 28 12:02:46.765025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2871/5742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:46 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:47.252720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-538156026", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "5564076b-73a2-41d3-8b14-4540db2a6a44"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2005553506", "security_groups": [{"name": "tempest-secgroup-smoke-191630682"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:47.469912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] validate_networks() for [('5564076b-73a2-41d3-8b14-4540db2a6a44', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:02:47.686074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:47.687295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:47.690586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:47.701280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:47.701733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:47.702602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:47.706814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:47.952678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:47.969941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:47.975649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:47.981593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f4eba36-b52d-462e-8479-3516dc9e8d7e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.299152 Jul 28 12:02:47.982717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2872/5743] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:47 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:47.988982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:47.989831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:47.999010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:47.999590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:48.000606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:48.002044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:48.238566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:02:48.239001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:02:48.239696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:02:48.240266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:02:48.240850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:02:48.246065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:48.260028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:48.260719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:48.261937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:48.262644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:48.265207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:48.274640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7c3b86f0-a836-4b69-9739-1faa3d5ce09a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.290483 Jul 28 12:02:48.290124 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2873/5744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:47 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:48.290483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:02:48.299228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:02:48.329750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:02:48.332981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:02:48.436028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0a7f1076-5b60-4857-bf35-b19c97a5b17d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.187633 Jul 28 12:02:48.444670 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2872/5745] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:02:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:02:48.452010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-07ad6c2c-3913-4cfe-b170-724d8d042ec3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:48.454687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-07ad6c2c-3913-4cfe-b170-724d8d042ec3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:48.570680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-07ad6c2c-3913-4cfe-b170-724d8d042ec3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:48.598142 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-07ad6c2c-3913-4cfe-b170-724d8d042ec3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1266 microversion: 2.1 time: 0.141522 Jul 28 12:02:48.600588 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2874/5746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:48 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:02:49.005883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:49.007003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:49.023629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.024326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:49.025318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.025946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:49.298970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:49.306231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:49.315888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.316569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:49.317586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.318238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:49.870731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:49.884354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:49.890431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:49.893718 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87a18a6d-ff99-45f9-a81e-62bc2d8ab509 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.599256 Jul 28 12:02:49.896559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:49.898507 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-568f61f2-7837-4d00-b759-9e5db5b13d43 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.896649 Jul 28 12:02:49.900712 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2873/5747] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:49 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:49.916583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:49.917346 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2875/5748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:49 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:49.919641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:49.931779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.932401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:49.933298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:49.934771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:50.048129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:50.059950 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dfc0b26f-44d5-4c42-b550-833095c4e666 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1318 microversion: 2.1 time: 0.157522 Jul 28 12:02:50.060549 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2874/5749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:49 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:50.466208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8389598e-016f-455c-8a20-13b83cf36fe9 req-8ad2ba82-a9be-49fc-a4d7-9a4f103b037a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d35c569-c03a-457c-af2e-e610008a6832", "name": "network-vif-plugged", "status": "completed", "tag": "bd721b15-e0ae-4296-ad22-a5b86fef26a3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:50.479008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8389598e-016f-455c-8a20-13b83cf36fe9 req-8ad2ba82-a9be-49fc-a4d7-9a4f103b037a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:50.479938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8389598e-016f-455c-8a20-13b83cf36fe9 req-8ad2ba82-a9be-49fc-a4d7-9a4f103b037a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:50.499184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8389598e-016f-455c-8a20-13b83cf36fe9 req-8ad2ba82-a9be-49fc-a4d7-9a4f103b037a service nova] Creating event network-vif-plugged:bd721b15-e0ae-4296-ad22-a5b86fef26a3 for instance 9d35c569-c03a-457c-af2e-e610008a6832 on n-h1-851368-1 Jul 28 12:02:50.513634 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8389598e-016f-455c-8a20-13b83cf36fe9 req-8ad2ba82-a9be-49fc-a4d7-9a4f103b037a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053338 Jul 28 12:02:50.516092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2876/5750] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:50.917295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:50.918274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:50.924976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:50.925960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:50.940827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:50.941559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:50.941986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:50.942770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:50.943690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:50.944653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:50.945269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:50.945903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:51.262653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:51.274244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:51.276905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:51.280088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb24fd27-0fe4-4e90-b210-310d2eb1c0a5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.358577 Jul 28 12:02:51.297529 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2877/5751] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:50 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:51.308496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:51.310693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:51.319805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:51.320604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:51.321609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:51.322297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:51.366478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:51.377488 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-36ea9893-d881-4d80-8393-f0202b28cd00 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1373 microversion: 2.1 time: 0.464226 Jul 28 12:02:51.382066 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2875/5752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:50 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1373 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:02:51.565149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:51.574602 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbf4981f-503e-4fa3-930c-a68e85187ac5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.275505 Jul 28 12:02:51.575433 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2878/5753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:51 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:52.304724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:52.305617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:52.313530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.314247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.315244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.315820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.403010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:52.404234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:52.410797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.411327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.412272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.412885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.747027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:52.757369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:52.759023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:52.760332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5981868e-bdcf-4c26-ad15-d076d2383e30 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.460115 Jul 28 12:02:52.761461 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2876/5754] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:52 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:52.804401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:52.819177 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2af2f194-b4d2-46c7-a3f7-fc93fdf2c5b0 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1544 microversion: 2.1 time: 0.420584 Jul 28 12:02:52.820378 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2879/5755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:52 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1544 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:02:52.825870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-30779ea0-4383-4f51-9f95-0548c1c51440 req-47097c3d-ed47-4b9b-800a-842efcec1b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "name": "network-vif-plugged", "status": "completed", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:52.835876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-30779ea0-4383-4f51-9f95-0548c1c51440 req-47097c3d-ed47-4b9b-800a-842efcec1b45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.836592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-30779ea0-4383-4f51-9f95-0548c1c51440 req-47097c3d-ed47-4b9b-800a-842efcec1b45 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.851633 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-30779ea0-4383-4f51-9f95-0548c1c51440 req-47097c3d-ed47-4b9b-800a-842efcec1b45 service nova] Creating event network-vif-plugged:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:02:52.856773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-30779ea0-4383-4f51-9f95-0548c1c51440 req-47097c3d-ed47-4b9b-800a-842efcec1b45 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035118 Jul 28 12:02:52.857495 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2880/5756] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:52.862866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:52.863772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:52.870391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.871047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.872046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.872643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:52.975491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5934cd70-0983-4fd9-96fd-8310f93e16fc req-76497c00-4801-400f-935f-90cd273788f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:52.987519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5934cd70-0983-4fd9-96fd-8310f93e16fc req-76497c00-4801-400f-935f-90cd273788f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:52.988123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5934cd70-0983-4fd9-96fd-8310f93e16fc req-76497c00-4801-400f-935f-90cd273788f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:53.001333 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5934cd70-0983-4fd9-96fd-8310f93e16fc req-76497c00-4801-400f-935f-90cd273788f7 service nova] Creating event network-changed:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:02:53.006944 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5934cd70-0983-4fd9-96fd-8310f93e16fc req-76497c00-4801-400f-935f-90cd273788f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243506 Jul 28 12:02:53.008182 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2877/5757] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:53.015351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:53.016594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:53.023807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:53.024663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:53.025468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:53.025914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:53.239127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:53.247787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd6b4af7-2b83-4132-8c58-e4ffb50c5b20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.389060 Jul 28 12:02:53.248835 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2881/5758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:52 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:53.312081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:53.320509 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-03dadf89-c66d-4616-92c2-0bfbe666d98a tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1544 microversion: 2.1 time: 0.310997 Jul 28 12:02:53.321111 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2878/5759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:53 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:53.787499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:53.788377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:53.798569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:53.799205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:53.800077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:53.800523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:54.124140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:54.158219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:54.161414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:54.164261 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-78cb5e52-a361-4c66-b3ea-13bec4bb17ce tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.382574 Jul 28 12:02:54.165072 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2882/5760] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:53 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:54.270287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:54.270817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:54.279824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:54.280638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:54.281756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:54.282340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:54.504717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:54.514551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-603fccb4-0bb5-40c3-9200-e35ffb3823bf tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.249242 Jul 28 12:02:54.515659 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2879/5761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:54 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:55.188838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:55.189989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:55.209140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:55.211522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:55.212576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:55.213217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:55.535538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:55.536739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:55.544092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:55.544750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:55.545764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:55.546398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:55.699491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:55.708432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:55.710283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:55.711749 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51bbaccf-0b05-4746-a37c-cd531d5c2f34 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1808 microversion: 2.20 time: 0.527951 Jul 28 12:02:55.712339 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2883/5762] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:55 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:55.902000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:55.941053 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ff56f9a-2a03-4ff6-bb9b-8aed13897939 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.409197 Jul 28 12:02:55.945391 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2880/5763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:55 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:02:56.253880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d587b274-df38-4cd4-a732-6c619aa763b3 req-de597036-73bf-4ca7-8d95-15ff4e9bc40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35c569-c03a-457c-af2e-e610008a6832", "tag": "bd721b15-e0ae-4296-ad22-a5b86fef26a3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:56.267534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d587b274-df38-4cd4-a732-6c619aa763b3 req-de597036-73bf-4ca7-8d95-15ff4e9bc40f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:56.268051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d587b274-df38-4cd4-a732-6c619aa763b3 req-de597036-73bf-4ca7-8d95-15ff4e9bc40f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:56.287008 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d587b274-df38-4cd4-a732-6c619aa763b3 req-de597036-73bf-4ca7-8d95-15ff4e9bc40f service nova] Creating event network-changed:bd721b15-e0ae-4296-ad22-a5b86fef26a3 for instance 9d35c569-c03a-457c-af2e-e610008a6832 on n-h1-851368-1 Jul 28 12:02:56.293902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d587b274-df38-4cd4-a732-6c619aa763b3 req-de597036-73bf-4ca7-8d95-15ff4e9bc40f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043870 Jul 28 12:02:56.300055 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2884/5764] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:02:56.735861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:56.737033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:56.744437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:56.745153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:56.746696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:56.747164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:56.912031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:56.922373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:56.924049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:56.925258 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b7e6c0b-bba8-418c-9da2-50cc2b03faa1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1795 microversion: 2.20 time: 0.193321 Jul 28 12:02:56.939605 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2881/5765] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:02:56 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1795 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:02:56.966750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:56.967925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:56.975383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:56.976068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:56.976909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:56.977554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:57.128908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:57.138675 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee779453-80d1-495f-9356-4e717a7e8a7e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.176533 Jul 28 12:02:57.139317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2885/5766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:56 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:58.098554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8bb5c619-827c-442c-aaa9-c1296e63a8ce req-ae59209c-6638-4cd2-b17e-4d70d6dc295c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-plugged", "status": "completed", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:02:58.113692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8bb5c619-827c-442c-aaa9-c1296e63a8ce req-ae59209c-6638-4cd2-b17e-4d70d6dc295c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:58.114144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8bb5c619-827c-442c-aaa9-c1296e63a8ce req-ae59209c-6638-4cd2-b17e-4d70d6dc295c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:58.125983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8bb5c619-827c-442c-aaa9-c1296e63a8ce req-ae59209c-6638-4cd2-b17e-4d70d6dc295c service nova] Creating event network-vif-plugged:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:02:58.130981 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8bb5c619-827c-442c-aaa9-c1296e63a8ce req-ae59209c-6638-4cd2-b17e-4d70d6dc295c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039388 Jul 28 12:02:58.131635 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2882/5767] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:02:58.172713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:58.173133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:58.179733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:58.180188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:58.181025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:58.181674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:58.392285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:58.399987 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f51e9b78-91f1-464e-a889-a8e7f9c4a65d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.232152 Jul 28 12:02:58.400561 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2886/5768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:58 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:02:59.418954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:59.420371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:02:59.425305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:02:59.426043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:02:59.434587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:59.435042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:59.435838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:02:59.436279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:02:59.593683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:02:59.603501 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7067024-aa10-4a32-b826-ad4b8bb0fc68 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1391 microversion: 2.1 time: 0.185747 Jul 28 12:02:59.604038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2883/5769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:02:59 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:00.626195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:00.626959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:00.630232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:00.635316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:00.635762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:00.636539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:00.637588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:00.779460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:00.787101 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1aa5a0e4-6ebc-4d3a-83e8-e5451bfb66c6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1562 microversion: 2.1 time: 0.165839 Jul 28 12:03:00.787717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2887/5770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:00 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:00.807249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:00.807985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:00.815497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:00.816015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:00.816951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:00.817387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:00.954475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:00.962609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e14d965-f5bf-477a-97fc-30294485545e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1562 microversion: 2.1 time: 0.159493 Jul 28 12:03:00.963324 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2884/5771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:00 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:02.630748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:02.631663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d5162be5-7050-486a-baf4-c2e0138208ea req-91e5ca98-7cf0-4c76-a0a7-cf29dbf81475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:02.632504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:02.644159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d5162be5-7050-486a-baf4-c2e0138208ea req-91e5ca98-7cf0-4c76-a0a7-cf29dbf81475 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:02.645142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:02.645438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d5162be5-7050-486a-baf4-c2e0138208ea req-91e5ca98-7cf0-4c76-a0a7-cf29dbf81475 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:02.646062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:02.646996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:02.649189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:02.658687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d5162be5-7050-486a-baf4-c2e0138208ea req-91e5ca98-7cf0-4c76-a0a7-cf29dbf81475 service nova] Creating event network-changed:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:03:02.664431 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d5162be5-7050-486a-baf4-c2e0138208ea req-91e5ca98-7cf0-4c76-a0a7-cf29dbf81475 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036365 Jul 28 12:03:02.669033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2885/5772] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:03:02.897134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:02.909661 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6df4e0d-cbca-4afd-8027-702da10eba0e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1562 microversion: 2.1 time: 0.283541 Jul 28 12:03:02.922378 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2888/5773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:02 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1562 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:26.215047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:26.218759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:26.223012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:26.230003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=74 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:26.241708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:26.242396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:26.243811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:26.244370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:26.323238 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-148eb87f-783b-4e6e-aa0d-0dabf1b7eb3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action" status: 200 len: 24566 microversion: 2.1 time: 0.112995 Jul 28 12:03:26.324545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2886/5774] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:03:26 2022] POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action => generated 24566 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:26.613071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:26.615581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:26.618726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=35 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:26.619574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:26.627356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:26.628022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:26.628881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:26.629401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:26.692058 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad28e204-a683-4b30-b665-c7a69e3beb98 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832/action" status: 200 len: 24570 microversion: 2.1 time: 0.082669 Jul 28 12:03:26.695593 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2889/5775] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:03:26 2022] POST /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832/action => generated 24570 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:30.411229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:30.411832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:30.419731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.420211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.420985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.421437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.451721 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae9d8320-7680-4c75-b1c2-7f44ed826681 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments/12745709-8700-41f6-bd50-3d5b40d0efa6" status: 200 len: 194 microversion: 2.20 time: 0.044856 Jul 28 12:03:30.452321 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2887/5776] 10.222.0.93 () {60 vars in 1454 bytes} [Thu Jul 28 12:03:30 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments/12745709-8700-41f6-bd50-3d5b40d0efa6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:30.521278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:30.521862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:30.529996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.530444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.531244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.531679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.614281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lazy-loading 'services' on Instance uuid 74c8c84f-f851-434c-8489-badf527de660 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:03:30.686221 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2675b4d5-5046-4227-a36f-68a2e7cddf5f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments/12745709-8700-41f6-bd50-3d5b40d0efa6" status: 202 len: 0 microversion: 2.20 time: 0.169404 Jul 28 12:03:30.686816 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2890/5777] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Jul 28 12:03:30 2022] DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments/12745709-8700-41f6-bd50-3d5b40d0efa6 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:03:30.695330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:30.697566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:30.704240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.704701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.705479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:30.705920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:30.736803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b30001e-eed1-4567-a4c5-8ae954854cb9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045549 Jul 28 12:03:30.737597 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2888/5778] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:30 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:31.749391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:31.752183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:31.760401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:31.761378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:31.762304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:31.762744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:31.793487 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5818707b-3b72-476b-a3aa-f73170425ac7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048295 Jul 28 12:03:31.793973 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2891/5779] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:31 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:32.806088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:32.809038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:32.816695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:32.817207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:32.818376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:32.818827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:32.853826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3dffe6fd-3ced-4d9d-a8cb-159f707d9f42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051829 Jul 28 12:03:32.858858 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2889/5780] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:32 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:33.866160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:33.868353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:33.875641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:33.876116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:33.876901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:33.877347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:33.911220 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f2e6c11-f1bd-4cc3-9f5a-e355b2c1555c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049140 Jul 28 12:03:33.912082 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2892/5781] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:33 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:34.925091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:34.927397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:34.934926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:34.935402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:34.936864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:34.937309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:34.973585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-245204a7-0ca0-4754-8971-bb4ffb466527 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051797 Jul 28 12:03:34.974268 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2890/5782] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:34 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:35.986752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:35.988947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:35.995958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:35.996494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:35.997334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:35.997867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:36.027186 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05f016a6-c105-4370-9adc-194b404b8a42 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043937 Jul 28 12:03:36.027843 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2893/5783] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:03:35 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:36.091327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:36.092001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:36.099577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:36.100041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:36.100841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:36.101288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:36.129793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:03:36.211928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52ce318e-d227-47c2-94be-df224de763cd tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 204 len: 0 microversion: 2.20 time: 0.125239 Jul 28 12:03:36.212989 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2891/5784] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 12:03:36 2022] DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:03:36.221855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:36.222590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:36.229201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:36.229664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:36.230457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:36.230903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:36.365710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:36.374224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:36.375880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:36.377503 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-57ef8991-9c3a-410b-a02f-db48c814ec1e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.159616 Jul 28 12:03:36.378209 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2894/5785] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:36 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:37.316237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:37.316941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:37.324563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.325015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.325793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.326231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.402044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:37.402767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:37.412217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.412743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.413607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.414118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.477879 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57041213-9b4a-433b-af14-b5a010b62769 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1832 microversion: 2.1 time: 0.165562 Jul 28 12:03:37.478801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2892/5786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:37 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1832 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:37.501512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:37.502506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:37.516428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.516935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.517722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.518164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.571876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:37.582930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:37.586060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:37.590334 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea87416a-b3e0-427b-913b-a52652a5d831 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.190359 Jul 28 12:03:37.591928 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2895/5787] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:37 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:03:37.671210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:37.679020 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac5f5af5-8fa1-49bf-b5c1-391b863823db tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1681 microversion: 2.1 time: 0.181370 Jul 28 12:03:37.679840 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2893/5788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:37 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:37.775983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:37.778829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:37.785032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.785544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.786317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:37.786758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:37.847973 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f0e17e0-0526-4eed-a895-ba614d131c19 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action" status: 200 len: 32639 microversion: 2.1 time: 0.075665 Jul 28 12:03:37.849954 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2896/5789] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:03:37 2022] POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action => generated 32639 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:38.037100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:38.037710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:38.044235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.044692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.045479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.045951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.090848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bb6f1e7d1bda44af9307424a9e53252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85253390475b44458af04916bbc9f027', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:38.091522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] flavor_id is None. Assuming migration. {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4145}} Jul 28 12:03:38.091974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:03:38.355159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0e09230a-aef7-4e81-a6c7-eee44403b8e7 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action" status: 202 len: 0 microversion: 2.1 time: 0.321155 Jul 28 12:03:38.356461 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2894/5790] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:03:38 2022] POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:03:38.372191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:38.373107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:38.380806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.381414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.382382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.383006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.622329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:38.624305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:38.624939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:38.631858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06cef49d-98f6-485b-b6d6-0445ce7db677 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1690 microversion: 2.1 time: 0.269914 Jul 28 12:03:38.633064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2897/5791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:38 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1690 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:38.634600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.635057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.636581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:38.637026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:38.909718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:38.918829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:38.920464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:38.921897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46633d62-41e1-47f0-ac23-c453d3785ecf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 200 len: 1723 microversion: 2.20 time: 0.304615 Jul 28 12:03:38.922560 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2895/5792] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:38 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:39.216098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b0e9faab-5d67-47ef-89fc-8a0b54d0122b req-4e73eb67-607e-4277-a13b-2be03e445e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8c84f-f851-434c-8489-badf527de660", "name": "network-vif-deleted", "tag": "8204484c-425f-46ec-9ada-d1d485737769"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:39.236075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b0e9faab-5d67-47ef-89fc-8a0b54d0122b req-4e73eb67-607e-4277-a13b-2be03e445e6a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:39.236526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b0e9faab-5d67-47ef-89fc-8a0b54d0122b req-4e73eb67-607e-4277-a13b-2be03e445e6a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:39.254775 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b0e9faab-5d67-47ef-89fc-8a0b54d0122b req-4e73eb67-607e-4277-a13b-2be03e445e6a service nova] Creating event network-vif-deleted:8204484c-425f-46ec-9ada-d1d485737769 for instance 74c8c84f-f851-434c-8489-badf527de660 on n-h2-851368-1 Jul 28 12:03:39.284925 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b0e9faab-5d67-47ef-89fc-8a0b54d0122b req-4e73eb67-607e-4277-a13b-2be03e445e6a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073588 Jul 28 12:03:39.285552 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2898/5793] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:03:39.659546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:39.660873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:39.669478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:39.669980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:39.670792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:39.671266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:39.882463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:39.891580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45697265-5ae1-421f-b780-d1bff5d63cad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1690 microversion: 2.1 time: 0.235928 Jul 28 12:03:39.895100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2896/5794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:39 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:39.947240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:39.949110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:39.957930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:39.958383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:39.959182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:39.959620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:39.976636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 HTTP/1.1 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74c8c84f-f851-434c-8489-badf527de660'} Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:03:39.978345 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d041c97e-fe74-423f-a3ba-20fd0fb0aaf2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 404 len: 111 microversion: 2.20 time: 0.038340 Jul 28 12:03:39.984241 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2899/5795] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:39 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 12:03:39.991623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78e8938d-4141-456c-8929-e815da7c2439 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '.version_select at 0x7f2eb1b69b80>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:40.013686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78e8938d-4141-456c-8929-e815da7c2439 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393490221" status: 204 len: 0 microversion: 2.20 time: 0.026162 Jul 28 12:03:40.015197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2897/5796] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 12:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393490221 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:03:40.913119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:40.913779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:40.921073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:40.921534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:40.922319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:40.922765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:41.202815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:41.217557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55ec747c-aac5-45ba-8ce8-e234724445cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1690 microversion: 2.1 time: 0.308224 Jul 28 12:03:41.218264 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2900/5797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:40 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1690 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:41.241023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd8ebc4e-133e-4145-b643-85d376f7a497 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: .version_select at 0x7f2ebbe828b0>, body: {"keypair": {"name": "tempest-keypair-1484933349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4Rpr/bcou3jEHCamw7+2+2I6VWPCGn0tPQ2DlasdU/D63gzyRGfgYbnfpgLcWM0FvNCh9qd+iyv3RnZAR35QFkyt7ZI4O20QTixSyP13DmqoijdlJvh3IjEAfbe5cNqA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:41.257643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fd8ebc4e-133e-4145-b643-85d376f7a497 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:03:41.262784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fd8ebc4e-133e-4145-b643-85d376f7a497 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for user 226bb250399d41b89d0a048ddb2d18d6 and project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:03:41.294331 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd8ebc4e-133e-4145-b643-85d376f7a497 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058045 Jul 28 12:03:41.295291 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2898/5798] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Jul 28 12:03:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 28 12:03:42.241362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:42.241998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:42.248898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:42.249358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:42.250297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:42.250748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:42.415660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:42.424988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12c0b7a2-78ff-49fd-8d37-c17720506e83 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.187846 Jul 28 12:03:42.426077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2901/5799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:42 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:42.653331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-534106985", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59dcd80a-d319-41fe-a072-78c4b7d984de"}], "security_groups": [{"name": "tempest-securitygroup--1837195949"}], "key_name": "tempest-keypair-1484933349", "user_data": "}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:42.760132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] validate_networks() for [('59dcd80a-d319-41fe-a072-78c4b7d984de', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:03:43.136225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:03:43.136734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:03:43.137316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:03:43.137805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:03:43.138232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:03:43.147397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:43.147852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:43.148695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:43.149141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:43.168011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:03:43.173674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Getting quotas for user 226bb250399d41b89d0a048ddb2d18d6 and project cb2dc02f7ae948c99791992b50ef3a76. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:03:43.187215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:03:43.189534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:03:43.242002 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c80c3f8c-35d9-4d4f-8eee-10160199bb5b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.593724 Jul 28 12:03:43.242990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2899/5800] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Jul 28 12:03:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 12:03:43.254323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:43.255586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:43.314258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:43.321807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:43.323365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:43.324857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3d55e2d9-42ec-4766-aca5-062c80884e95 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1281 microversion: 2.20 time: 0.074575 Jul 28 12:03:43.325425 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2902/5801] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:43 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:43.448234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:43.448856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:43.455459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:43.455917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:43.456695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:43.457139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:43.627804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:43.636388 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-357c93f3-7c7b-4fcd-a93f-1ef99f3a3173 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.191159 Jul 28 12:03:43.648856 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2900/5802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:43 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:44.347681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:44.349251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:44.358979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:44.359460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:44.360232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:44.360839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:44.451373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:44.472203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:44.474041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:44.475454 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c65b823-54ef-46b0-9db5-78813eb4241c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1341 microversion: 2.20 time: 0.131690 Jul 28 12:03:44.476216 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2903/5803] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:44 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1341 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:44.668850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:44.669656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:44.676719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:44.677250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:44.678175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:44.678684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:44.907175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:44.915881 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3ed73e7f-3524-44e6-bae0-5bd2e43e19ee tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.251100 Jul 28 12:03:44.916772 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2901/5804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:44 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:45.501024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:45.501782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:45.509240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:45.509691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:45.510529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:45.510971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:45.792837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:45.807492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:45.811589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:45.813767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0a1b401-b5f0-4e12-b7c2-1fceb13fecc5 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.316389 Jul 28 12:03:45.815029 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2904/5805] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:45 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:03:45.937743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:45.938362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:45.945910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:45.946610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:45.947603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:45.950292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:45.975430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:46.181807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:46.193313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c3d60f0-7778-465d-8466-0a093acdf0d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.259427 Jul 28 12:03:46.194627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2902/5806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:45 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:46.571062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9256c054-c551-4e85-8ca0-a6673d743f6b req-6270f200-ddf3-4fb4-89f5-d75677d980e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:46.582130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9256c054-c551-4e85-8ca0-a6673d743f6b req-6270f200-ddf3-4fb4-89f5-d75677d980e8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:46.582574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9256c054-c551-4e85-8ca0-a6673d743f6b req-6270f200-ddf3-4fb4-89f5-d75677d980e8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:46.609248 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9256c054-c551-4e85-8ca0-a6673d743f6b req-6270f200-ddf3-4fb4-89f5-d75677d980e8 service nova] Creating event network-changed:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h2-851368-1 Jul 28 12:03:46.614886 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9256c054-c551-4e85-8ca0-a6673d743f6b req-6270f200-ddf3-4fb4-89f5-d75677d980e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047652 Jul 28 12:03:46.627544 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2905/5807] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:03:46.837503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:46.838158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:46.844975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:46.845656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:46.846602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:46.847234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:47.063440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:47.071664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:47.073301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:47.074761 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5686170d-5081-40de-ac50-88b4e61cb943 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.241268 Jul 28 12:03:47.075464 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2903/5808] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:46 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:47.214714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:47.215442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:47.221709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:47.222155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:47.222917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:47.223380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:47.363614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:47.372172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b172e05d-0b53-4f6e-b406-e6694982f71f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.162122 Jul 28 12:03:47.372770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2906/5809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:47 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:48.097993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:48.098775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:48.106644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:48.107111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:48.107900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:48.108331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:48.342663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:48.351437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:48.352900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:48.354087 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f2c55023-8347-4026-b5f4-aec59670d76e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.260237 Jul 28 12:03:48.355198 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2904/5810] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:48 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:48.393763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:48.394376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:48.402152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:48.402600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:48.404173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:48.404774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:48.616800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:48.624964 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8107f11d-6b54-4580-952c-e8339cdd815e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.235050 Jul 28 12:03:48.625641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2907/5811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:48 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:49.376138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:49.376859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:49.384151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:49.384599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:49.385375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:49.385806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:49.519753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:49.528292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:49.529799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:49.530928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7a857f3-a5b1-4eb8-b10b-0b488c9b39a4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.158868 Jul 28 12:03:49.531525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2905/5812] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:49 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:49.647589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:49.648161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:49.656118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:49.656576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:49.657351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:49.657793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:49.678329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:49.798372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:49.806052 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c664ec46-01c4-470b-8d09-87540f4f1785 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.162605 Jul 28 12:03:49.806621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2908/5813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:49 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:50.553764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:50.554308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:50.561948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:50.562404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:50.563239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:50.563683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:50.694113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:50.702228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:50.703791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:50.704906 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b132c920-b0e5-43b6-9429-db8c2ed5c713 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.155272 Jul 28 12:03:50.705468 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2906/5814] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:50 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:50.827976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:50.828600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:50.835695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:50.836150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:50.836927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:50.837369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:50.976594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:50.985724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ccf0c93e-527f-4fc0-8bef-e42b210e273e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.161757 Jul 28 12:03:50.986293 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2909/5815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:50 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:51.727251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:51.727868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:51.735713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:51.736163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:51.737107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:51.737539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:51.872389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:51.880900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:51.882767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:51.884042 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff123e0b-24ee-436c-85d5-c4bbf3a27839 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.160893 Jul 28 12:03:51.884683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2907/5816] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:51 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:52.006659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:52.007373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:52.015147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:52.015602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:52.016381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:52.016825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:52.169495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:52.178244 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86ebab77-4a86-4c3e-9770-4d1dabe25e65 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.175279 Jul 28 12:03:52.178871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2910/5817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:52 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:52.300840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dbfd5640-e9b1-4ac2-83a7-7ffeb623df7b req-b9c365e5-ab0a-4c20-b02f-a3f21b17066a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "name": "network-vif-plugged", "status": "completed", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:52.311461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dbfd5640-e9b1-4ac2-83a7-7ffeb623df7b req-b9c365e5-ab0a-4c20-b02f-a3f21b17066a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:52.311915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dbfd5640-e9b1-4ac2-83a7-7ffeb623df7b req-b9c365e5-ab0a-4c20-b02f-a3f21b17066a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:52.324543 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dbfd5640-e9b1-4ac2-83a7-7ffeb623df7b req-b9c365e5-ab0a-4c20-b02f-a3f21b17066a service nova] Creating event network-vif-plugged:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h2-851368-1 Jul 28 12:03:52.329660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dbfd5640-e9b1-4ac2-83a7-7ffeb623df7b req-b9c365e5-ab0a-4c20-b02f-a3f21b17066a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Jul 28 12:03:52.330672 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2908/5818] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:03:52.906919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:52.907586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:52.913937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:52.914241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:52.915014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:52.915489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:53.052353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:53.066399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:53.069627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:53.069627 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12b260b1-797c-4324-a778-5a25f5d7ea01 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1407 microversion: 2.20 time: 0.166547 Jul 28 12:03:53.070304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2911/5819] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:52 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:53.198878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:53.199675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:53.204823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:53.205529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:53.213997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:53.214299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:53.215098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:53.215844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:53.358970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:53.366751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3a73e20-e339-47f7-aa11-5df7ea8a91d3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.169641 Jul 28 12:03:53.367662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2909/5820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:53 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:03:54.093369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:54.093974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:54.095890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:54.102847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.103372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.104769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.105238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.243703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:54.252339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:54.254202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:54.255658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bce5d4b8-32d5-4a59-b8f9-fadd87bc242a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1599 microversion: 2.20 time: 0.166210 Jul 28 12:03:54.267328 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2912/5821] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:03:54 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:03:54.279416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:54.279948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:54.288972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.289431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.290249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.290696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.369367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac1e8120-b825-4bc7-b0b1-338ff0e17f87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094952 Jul 28 12:03:54.370560 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2910/5822] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Jul 28 12:03:54 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:54.388647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:54.389269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:54.395490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.395945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.396725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:54.397177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:54.561967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:54.569439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf627c2a-b981-4583-86c4-a73b8985bccd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.184874 Jul 28 12:03:54.570945 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2913/5823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:54 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:55.591470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:55.591992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:55.598063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:55.598771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:55.599581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:55.600024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:55.656697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-12aa351f-be08-4ec1-8926-cc086cb8abe9 req-8def260e-8a0e-4b53-a99f-ce4889408d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:55.669112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-12aa351f-be08-4ec1-8926-cc086cb8abe9 req-8def260e-8a0e-4b53-a99f-ce4889408d20 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:55.669112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-12aa351f-be08-4ec1-8926-cc086cb8abe9 req-8def260e-8a0e-4b53-a99f-ce4889408d20 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:55.684836 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-12aa351f-be08-4ec1-8926-cc086cb8abe9 req-8def260e-8a0e-4b53-a99f-ce4889408d20 service nova] Creating event network-changed:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h2-851368-1 Jul 28 12:03:55.692573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-12aa351f-be08-4ec1-8926-cc086cb8abe9 req-8def260e-8a0e-4b53-a99f-ce4889408d20 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039531 Jul 28 12:03:55.693181 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2914/5824] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:03:55.785441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:55.800736 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7fcdd9fe-57ff-4f9d-a4df-8904b71a452f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.214103 Jul 28 12:03:55.802490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2911/5825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:55 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:56.825415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:56.826127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:56.828985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=55 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:56.834744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:56.835227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:56.836008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:56.836452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:56.982673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:56.990571 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7e0fb7e-12b8-4fef-84fb-d362ca60f6e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.170097 Jul 28 12:03:56.991180 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2915/5826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:56 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:57.191832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:57.194122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:57.197056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:03:57.203479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:57.203938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:57.204710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:57.205152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:57.277880 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6a2d24c-36b6-4198-8310-0ecb1f44b846 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "POST /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832/action" status: 200 len: 32640 microversion: 2.1 time: 0.089634 Jul 28 12:03:57.278686 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2912/5827] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:03:57 2022] POST /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832/action => generated 32640 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:03:58.015541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:58.017209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:58.028276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.029313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.030342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.048898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.287697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:58.301611 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c03ee7bf-0789-4141-996d-3ba2568b556f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1695 microversion: 2.1 time: 0.292633 Jul 28 12:03:58.303141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2916/5828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:58 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:58.398416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:58.399698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:58.401478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-301cd3e2-e506-460f-a813-9c92b1f1d593 req-56010bdf-b99d-423f-bf07-8b817241725d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35c569-c03a-457c-af2e-e610008a6832", "tag": "bd721b15-e0ae-4296-ad22-a5b86fef26a3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:03:58.410324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.411008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.411980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.412608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.414419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-301cd3e2-e506-460f-a813-9c92b1f1d593 req-56010bdf-b99d-423f-bf07-8b817241725d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.415246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-301cd3e2-e506-460f-a813-9c92b1f1d593 req-56010bdf-b99d-423f-bf07-8b817241725d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.430989 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-301cd3e2-e506-460f-a813-9c92b1f1d593 req-56010bdf-b99d-423f-bf07-8b817241725d service nova] Creating event network-changed:bd721b15-e0ae-4296-ad22-a5b86fef26a3 for instance 9d35c569-c03a-457c-af2e-e610008a6832 on n-h1-851368-1 Jul 28 12:03:58.437985 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-301cd3e2-e506-460f-a813-9c92b1f1d593 req-56010bdf-b99d-423f-bf07-8b817241725d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041846 Jul 28 12:03:58.438798 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2917/5829] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:03:58.451134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:03:58.567140 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22ca4148-9744-4121-a310-8ecc8a966980 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 204 len: 0 microversion: 2.1 time: 0.175376 Jul 28 12:03:58.568496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2913/5830] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:03:58 2022] DELETE /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:03:58.579019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:58.580033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:58.589153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.589844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.590839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:58.591497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:58.769536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:58.777428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-288164db-4dd6-4e45-80c1-f15e091dbc55 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1669 microversion: 2.1 time: 0.204310 Jul 28 12:03:58.778018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2918/5831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:58 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:03:59.328698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:59.329688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:59.335979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:59.336439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:59.337230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:59.337680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:59.517586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:03:59.528141 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19150128-2874-42e1-9ada-9c420ff9c32d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1694 microversion: 2.1 time: 0.204269 Jul 28 12:03:59.528680 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2914/5832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:59 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:03:59.806300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:03:59.807610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:03:59.819040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:59.819712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:03:59.820502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:03:59.820974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:00.013339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:00.022080 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9644c10f-8b93-4fec-b00b-6c4cfcf17bbc tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1669 microversion: 2.1 time: 0.225257 Jul 28 12:04:00.022672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2919/5833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:03:59 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1669 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:00.471490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-unplugged", "status": "completed", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}, {"name": "network-changed", "server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:00.485074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:00.485535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:00.500076 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Creating event network-vif-unplugged:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h1-851368-1 Jul 28 12:04:00.500600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Creating event network-changed:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h1-851368-1 Jul 28 12:04:00.506920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] Instance 1139260e-008f-4124-bc20-dba3886ff26e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:04:00.520110 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fa17b234-6879-489f-930f-00c98fd723cd req-9bb27d64-b943-4c0e-ac02-6adfac323b07 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053021 Jul 28 12:04:00.521086 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2915/5834] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:04:00.548999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:00.549616 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:00.561554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:00.562526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:00.563141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:00.563619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:00.827923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:00.843050 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6308001c-c1b9-4e22-b02c-8fb890555fd8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1694 microversion: 2.1 time: 0.297751 Jul 28 12:04:00.844010 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2920/5835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:00 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:01.053365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:01.054534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:01.065083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:01.066631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:01.068135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:01.068809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:01.168407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:01.179957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f1ebd3c-f767-4367-b6ef-5c39a182e998 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1483 microversion: 2.1 time: 0.139399 Jul 28 12:04:01.181123 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2916/5836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:01 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1483 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:01.865831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:01.866474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:01.873407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:01.874110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:01.876045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:01.876668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:02.033792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:02.041867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f450ad39-8fc8-47ec-a751-5f972c40149f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1692 microversion: 2.1 time: 0.179995 Jul 28 12:04:02.042530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2921/5837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:01 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:02.202399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:02.203738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:02.211174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:02.211635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:02.212412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:02.212854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:02.279618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:02.291035 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b62fbffa-3cb6-446d-95e1-3a51c7ea3e59 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1483 microversion: 2.1 time: 0.092995 Jul 28 12:04:02.291690 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2917/5838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:02 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1483 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:02.551981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-035a5f5c-5afd-4e4c-8e6f-995d65fc40de req-39d3fda1-f411-44d2-b0cb-4e4ad2ed42f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d35c569-c03a-457c-af2e-e610008a6832", "name": "network-vif-deleted", "tag": "bd721b15-e0ae-4296-ad22-a5b86fef26a3"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:02.562092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-035a5f5c-5afd-4e4c-8e6f-995d65fc40de req-39d3fda1-f411-44d2-b0cb-4e4ad2ed42f4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:02.562631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-035a5f5c-5afd-4e4c-8e6f-995d65fc40de req-39d3fda1-f411-44d2-b0cb-4e4ad2ed42f4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:02.573424 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-035a5f5c-5afd-4e4c-8e6f-995d65fc40de req-39d3fda1-f411-44d2-b0cb-4e4ad2ed42f4 service nova] Creating event network-vif-deleted:bd721b15-e0ae-4296-ad22-a5b86fef26a3 for instance 9d35c569-c03a-457c-af2e-e610008a6832 on n-h1-851368-1 Jul 28 12:04:02.578500 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-035a5f5c-5afd-4e4c-8e6f-995d65fc40de req-39d3fda1-f411-44d2-b0cb-4e4ad2ed42f4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 Jul 28 12:04:02.579108 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2922/5839] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:02.639036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1139019619", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:02.702050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:04:02.997666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:04:02.998087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:04:02.998559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:04:02.998998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:04:02.999487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:04:03.013310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.013764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.014567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.015009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.032511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Getting quotas for project ee25a4f93d4c456cb1fa4b05d6c84417. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:04:03.037787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Getting quotas for user fa8c45dfba804819b27b7de8d81a06f0 and project ee25a4f93d4c456cb1fa4b05d6c84417. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:04:03.050619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:04:03.052914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:04:03.066408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:03.067173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:03.075619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.076185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.077065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.077571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.097789 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4065399e-84b9-4dba-8e79-8dc3cf4b3c34 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465016 Jul 28 12:04:03.098906 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2918/5840] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:04:03.109864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-234f5c41-ced5-409e-b1c5-619723012312 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:03.110487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-234f5c41-ced5-409e-b1c5-619723012312 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:03.193576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-234f5c41-ced5-409e-b1c5-619723012312 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:03.201498 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-234f5c41-ced5-409e-b1c5-619723012312 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1215 microversion: 2.1 time: 0.095267 Jul 28 12:04:03.202082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2919/5841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:03 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:03.313305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:03.314040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:03.323807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.324281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.325278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:03.325761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:03.351941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:03.640257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:03.648230 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-25ba1056-3507-43ff-8a7b-657b714a93b8 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1692 microversion: 2.1 time: 0.586096 Jul 28 12:04:03.648904 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2923/5842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:03 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1692 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:03.657019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f981bef3004c739abdb3f4b56aa035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf57d80eda444068a9aefb807633862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:03.665890 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1094ede7-79ff-4dfa-83ca-1e7562624abf tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 200 len: 1483 microversion: 2.1 time: 0.357022 Jul 28 12:04:03.666717 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2920/5843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:03 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 1483 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:04.223215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:04.224089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:04.233895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.234548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.235475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.235926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.304545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:04.312835 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-040e4774-5665-411f-8de2-b08ff9e2835d tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1267 microversion: 2.1 time: 0.093528 Jul 28 12:04:04.313588 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2924/5844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:04 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:04.670944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:04.672295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:04.680947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.681716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.691846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:04.692811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] [instance: 9d35c569-c03a-457c-af2e-e610008a6832] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:04.699740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.700713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.704675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.707985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.708867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.709525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.745518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] HTTP exception thrown: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Request method failure captured: Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 HTTP/1.1 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4noT11Bid-V4ODAt19g3sYOXmpfXjCLhg82GUGcWYq8mRIlCCksEdfnIvHZjUtCb8qcOT9ZFakjXwToZekZS3ETnBzlxKbiSSzvLyqb4HV9-OM6oSZ4957pp9slI-apVB9TYMrQGypZinbCoTqx0Dlq3CFI4VGOAMWvX_iy8OdO6FFw Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1bf57d80eda444068a9aefb807633862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1bf57d80eda444068a9aefb807633862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1bf57d80eda444068a9aefb807633862"}]}] Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestNetworkBasicOps-887476797 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 1bf57d80eda444068a9aefb807633862 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestNetworkBasicOps-887476797 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 63f981bef3004c739abdb3f4b56aa035 Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestNetworkBasicOps-887476797-project Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '9d35c569-c03a-457c-af2e-e610008a6832'} Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:04.756969 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. Jul 28 12:04:04.761891 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:04:04.763320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Returning 404 to user: Instance 9d35c569-c03a-457c-af2e-e610008a6832 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:04:04.764275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88a6e8f3-58ef-4f22-a9de-ef664fcf66e9 tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832" status: 404 len: 111 microversion: 2.1 time: 0.077908 Jul 28 12:04:04.764937 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2925/5845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:04 2022] GET /compute/v2.1/servers/9d35c569-c03a-457c-af2e-e610008a6832 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:04:04.957253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:04.966470 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be80cd1b-ba40-4f0a-b18b-41870080f7aa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1689 microversion: 2.1 time: 0.299382 Jul 28 12:04:04.967254 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2921/5846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:04 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1689 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:04.988414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:04.989359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:04.997121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.997659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:04.998591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:04.999147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:05.023090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4595d25d-5557-404a-92e3-6c01538f2a2d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] Calling method '.version_select at 0x7f2eb2344550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:05.061265 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4595d25d-5557-404a-92e3-6c01538f2a2d tempest-TestNetworkBasicOps-887476797 tempest-TestNetworkBasicOps-887476797-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1026243261" status: 202 len: 0 microversion: 2.1 time: 0.041869 Jul 28 12:04:05.061866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2922/5847] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 12:04:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1026243261 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:04:05.110614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:05.157068 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5422c05a-2758-4a3c-ac46-38d21ce5f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action" status: 202 len: 0 microversion: 2.1 time: 0.173150 Jul 28 12:04:05.157980 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2926/5848] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:04:04 2022] POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:04:05.166982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:05.167862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:05.176511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:05.177687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:05.178966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:05.179568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:05.335215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:05.336677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:05.344684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:05.345327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:05.346241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:05.346923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:05.452242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:05.459146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:05.461347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-20e1d23b-5f2d-4e6c-afd2-c9c3aff129fa tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1273 microversion: 2.1 time: 0.131135 Jul 28 12:04:05.462481 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2927/5849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:05 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:05.482702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-380d33df-7418-40ef-9076-32168f21464b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.320168 Jul 28 12:04:05.495093 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2923/5850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:05 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:06.264830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-plugged", "status": "completed", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:06.284468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:06.285407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:06.307529 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] Creating event network-vif-plugged:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h1-851368-1 Jul 28 12:04:06.323799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] Instance 1139260e-008f-4124-bc20-dba3886ff26e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:04:06.341184 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-af53ccb5-b002-4033-a92e-da4fab5587db req-a60149fb-39d9-432a-9137-7a71ed5b5c00 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079855 Jul 28 12:04:06.343528 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2928/5851] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:06.482801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:06.484092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:06.492407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:06.493210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:06.499345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:06.500390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:06.505668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:06.506483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:06.514653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:06.515122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:06.515900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:06.516334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:07.145777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:07.154119 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ccec969-4cdb-4bea-ba50-cc0401fbc7cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.675176 Jul 28 12:04:07.155095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2924/5852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:06 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:07.164568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dd77e71a-bae7-4524-a697-a0abb0f8e727 req-27a9075f-fe3a-400d-bf4c-113538fb3522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8737976-40b4-415f-8aab-03755e809aaf", "tag": "af2ed957-428d-46f0-a7d6-53b704276655"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:07.178471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dd77e71a-bae7-4524-a697-a0abb0f8e727 req-27a9075f-fe3a-400d-bf4c-113538fb3522 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:07.178922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dd77e71a-bae7-4524-a697-a0abb0f8e727 req-27a9075f-fe3a-400d-bf4c-113538fb3522 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:07.191627 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dd77e71a-bae7-4524-a697-a0abb0f8e727 req-27a9075f-fe3a-400d-bf4c-113538fb3522 service nova] Creating event network-changed:af2ed957-428d-46f0-a7d6-53b704276655 for instance a8737976-40b4-415f-8aab-03755e809aaf on n-h1-851368-1 Jul 28 12:04:07.198367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dd77e71a-bae7-4524-a697-a0abb0f8e727 req-27a9075f-fe3a-400d-bf4c-113538fb3522 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041564 Jul 28 12:04:07.199353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2925/5853] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:07.206259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:07.215595 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5f5ca25-e2ad-4a5d-9e46-42adce75e07b tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.714014 Jul 28 12:04:07.216697 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2929/5854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:06 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:08.180965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:08.181699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:08.188518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:08.189170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:08.190124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:08.190572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:08.237648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:08.239235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:08.246761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:08.247391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:08.248416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:08.249094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:08.406070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:08.414147 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1f033640-0c41-4aa9-ad3b-4da6f8ca46a5 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.238258 Jul 28 12:04:08.415588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2926/5855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:08 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:08.489286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:08.497422 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6c91d79-3a31-4928-b8fd-734920cd4c5a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.263612 Jul 28 12:04:08.498486 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2930/5856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:08 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:09.265260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-unplugged", "status": "completed", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:09.278871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:09.279423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:09.295902 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] Creating event network-vif-unplugged:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:04:09.303766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] Instance 1139260e-008f-4124-bc20-dba3886ff26e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:04:09.315960 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e65824ba-6641-4066-bfed-a4b81047cbf6 req-14ededd8-e29c-4aa5-865b-280f23d979dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054346 Jul 28 12:04:09.317136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2927/5857] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:09.435583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:09.436206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:09.443444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:09.443908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:09.444710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:09.445152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:09.523375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:09.524100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:09.531514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:09.532211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:09.533162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:09.533871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:09.830145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:09.845173 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-142e0b00-3116-4eae-ac24-7da22d5ed9cb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.413466 Jul 28 12:04:09.845298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:09.846423 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2931/5858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:09 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:09.855195 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00e7cf16-4090-4352-a43d-37a2b2fb2a3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.338390 Jul 28 12:04:09.855783 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2928/5859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:09 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:10.876393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:10.878699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:10.879351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:10.883167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:10.891716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:10.892176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:10.893027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:10.893440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:10.899088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:10.899935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:10.900362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:10.900824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:11.155412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:11.164252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-068b0e37-f38c-4b49-9a47-6c058c14397f tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.291625 Jul 28 12:04:11.164836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2929/5860] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:10 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:11.173971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:11.181955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a86bc59a-6198-4938-8a25-98047fb93ee6 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.314085 Jul 28 12:04:11.189584 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2932/5861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:10 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:11.355481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:11.364796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:11.365246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:11.377129 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] Creating event network-changed:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:04:11.382529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] Instance 1139260e-008f-4124-bc20-dba3886ff26e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:04:11.393755 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9c43002d-e0ae-4866-8007-9367ee531819 req-6d901922-a794-4f43-9125-9427233e388a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 Jul 28 12:04:11.394364 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2930/5862] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:12.187062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:12.189272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:12.197915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:12.198772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:12.199748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:12.200339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:12.205167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:12.205898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:12.224470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:12.224933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:12.225777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:12.226294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:12.810811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:12.819838 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32e45caa-aa67-448c-9bf1-1fa1b2bec2eb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.619515 Jul 28 12:04:12.820645 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2931/5863] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:12 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:12.848105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:12.856056 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcec6e32-2916-44d8-b62f-82197271e258 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1688 microversion: 2.1 time: 0.674060 Jul 28 12:04:12.856637 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2933/5864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:12 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1688 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:13.848992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:13.851381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:13.855558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:13.856900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:13.864962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:13.865630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:13.866695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:13.867427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:13.877634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:13.878253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:13.887673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:13.888239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:13.889292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:13.890020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:14.118840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:14.144753 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-514a0c2d-448f-41c3-a0c5-cebf7ec220fb tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.306304 Jul 28 12:04:14.148718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2932/5865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:13 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:14.427480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:14.437903 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7fda4b3e-acb6-4e2e-abfc-8141c4d0a7b6 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1681 microversion: 2.1 time: 0.563922 Jul 28 12:04:14.443967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2934/5866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:13 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1681 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:14.538165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-272bc8c7-5d9d-4e89-b509-c551b51a5a4e req-7201c996-1ddd-4d27-acd5-7214b8a34cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8737976-40b4-415f-8aab-03755e809aaf", "name": "network-vif-plugged", "status": "completed", "tag": "af2ed957-428d-46f0-a7d6-53b704276655"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:14.551761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-272bc8c7-5d9d-4e89-b509-c551b51a5a4e req-7201c996-1ddd-4d27-acd5-7214b8a34cf7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:14.552419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-272bc8c7-5d9d-4e89-b509-c551b51a5a4e req-7201c996-1ddd-4d27-acd5-7214b8a34cf7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:14.580042 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-272bc8c7-5d9d-4e89-b509-c551b51a5a4e req-7201c996-1ddd-4d27-acd5-7214b8a34cf7 service nova] Creating event network-vif-plugged:af2ed957-428d-46f0-a7d6-53b704276655 for instance a8737976-40b4-415f-8aab-03755e809aaf on n-h1-851368-1 Jul 28 12:04:14.585374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-272bc8c7-5d9d-4e89-b509-c551b51a5a4e req-7201c996-1ddd-4d27-acd5-7214b8a34cf7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052901 Jul 28 12:04:14.586518 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2933/5867] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:15.169371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:15.170905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:15.185668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:15.186400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:15.191290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:15.193397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:15.399607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:15.409112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8dae213c-2c2c-456b-b7c7-5423d9965895 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1315 microversion: 2.1 time: 0.243989 Jul 28 12:04:15.414193 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2935/5868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:15 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:16.434820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:16.435656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:16.446792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.448637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.453882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.454551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.605599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8168a320-e143-4960-9b7f-375174ff4a57 req-b594797f-0672-43c2-b8da-094ac1a6e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-plugged", "status": "completed", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:16.622495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8168a320-e143-4960-9b7f-375174ff4a57 req-b594797f-0672-43c2-b8da-094ac1a6e5e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.622940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8168a320-e143-4960-9b7f-375174ff4a57 req-b594797f-0672-43c2-b8da-094ac1a6e5e7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.635906 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8168a320-e143-4960-9b7f-375174ff4a57 req-b594797f-0672-43c2-b8da-094ac1a6e5e7 service nova] Creating event network-vif-plugged:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:04:16.641839 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8168a320-e143-4960-9b7f-375174ff4a57 req-b594797f-0672-43c2-b8da-094ac1a6e5e7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040507 Jul 28 12:04:16.643029 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2936/5869] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:04:16.678142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:16.686414 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d57ab6f-bbb4-407a-9e9b-ea33ae366a08 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1465 microversion: 2.1 time: 0.256214 Jul 28 12:04:16.686994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2934/5870] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:16 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:16.736872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:16.737468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:16.744507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.744953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.745724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.746164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.773594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:04:16.874492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed8e063e-831a-4998-a2ce-4abe27e8291c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 204 len: 0 microversion: 2.1 time: 0.141505 Jul 28 12:04:16.875981 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2937/5871] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:04:16 2022] DELETE /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:04:16.888691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:16.889481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:16.896065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.896622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:16.897491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:16.898009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:17.060407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:17.068503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-677d9875-8718-4c0c-a370-96de7675a523 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1471 microversion: 2.1 time: 0.187863 Jul 28 12:04:17.069428 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2935/5872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:16 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:18.093385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:18.094078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:18.101685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:18.102424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:18.103242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:18.104455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:18.290459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:18.300530 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62236e40-6a0b-41f9-a6ac-0eb2f1647a2c tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1471 microversion: 2.1 time: 0.214001 Jul 28 12:04:18.301112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2938/5873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:18 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:19.179992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4b4794f6-dea6-4e38-8542-2bddd5fa36ac req-7939d13c-c126-4354-b994-39e3b5e2204b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8737976-40b4-415f-8aab-03755e809aaf", "name": "network-vif-deleted", "tag": "af2ed957-428d-46f0-a7d6-53b704276655"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:19.199670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4b4794f6-dea6-4e38-8542-2bddd5fa36ac req-7939d13c-c126-4354-b994-39e3b5e2204b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:19.200575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4b4794f6-dea6-4e38-8542-2bddd5fa36ac req-7939d13c-c126-4354-b994-39e3b5e2204b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:19.252398 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4b4794f6-dea6-4e38-8542-2bddd5fa36ac req-7939d13c-c126-4354-b994-39e3b5e2204b service nova] Creating event network-vif-deleted:af2ed957-428d-46f0-a7d6-53b704276655 for instance a8737976-40b4-415f-8aab-03755e809aaf on n-h1-851368-1 Jul 28 12:04:19.261900 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4b4794f6-dea6-4e38-8542-2bddd5fa36ac req-7939d13c-c126-4354-b994-39e3b5e2204b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089774 Jul 28 12:04:19.263353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2936/5874] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:19.326380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:19.327008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:19.343254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:19.344490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:19.345489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:19.346138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:19.389733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:19.390183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:19.390635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lazy-loading 'fault' on Instance uuid a8737976-40b4-415f-8aab-03755e809aaf {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:04:19.476999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8c45dfba804819b27b7de8d81a06f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee25a4f93d4c456cb1fa4b05d6c84417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:19.484818 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84d7e194-a9e4-4a58-b09e-a55174b7f3fc tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 200 len: 1305 microversion: 2.1 time: 0.163872 Jul 28 12:04:19.485680 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2939/5875] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:19 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:20.507282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:20.508011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] [instance: a8737976-40b4-415f-8aab-03755e809aaf] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:20.516853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:20.517505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:20.518459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:20.519035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:20.537047 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] HTTP exception thrown: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Request method failure captured: Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf HTTP/1.1 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nswV9VV5W_YGZQa80Dux2rPxzqF_odCop2Ut_F5hn-PYbsENNRwyDS62h90dM4bX1_4BuWFmco9jMsqn7LPcol628UKv_GNdiJt40oo95KIurakoJbXk8dk69bzR1ADuxYOme4R0ceX-wug-eHGKp84WyzO6Tyad4KSOVUvXwzim_c Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: ee25a4f93d4c456cb1fa4b05d6c84417 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-VolumesNegativeTest-1314028055 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee25a4f93d4c456cb1fa4b05d6c84417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ee25a4f93d4c456cb1fa4b05d6c84417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ee25a4f93d4c456cb1fa4b05d6c84417"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ee25a4f93d4c456cb1fa4b05d6c84417"}]}] Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-VolumesNegativeTest-1314028055 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: ee25a4f93d4c456cb1fa4b05d6c84417 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-VolumesNegativeTest-1314028055 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-VolumesNegativeTest-1314028055-project Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: fa8c45dfba804819b27b7de8d81a06f0 Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-VolumesNegativeTest-1314028055-project Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'a8737976-40b4-415f-8aab-03755e809aaf'} Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:20.539689 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. Jul 28 12:04:20.543969 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:20.545192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] Returning 404 to user: Instance a8737976-40b4-415f-8aab-03755e809aaf could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:04:20.546088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-816d4891-9aa3-4b3c-919a-3c8c37f18541 tempest-VolumesNegativeTest-1314028055 tempest-VolumesNegativeTest-1314028055-project] 10.222.0.93 "GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf" status: 404 len: 111 microversion: 2.1 time: 0.043495 Jul 28 12:04:20.546657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2937/5876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:20 2022] GET /compute/v2.1/servers/a8737976-40b4-415f-8aab-03755e809aaf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:04:31.619941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:31.621479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:31.624347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:31.625028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:31.632965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:31.633483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:31.634938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:31.635411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:31.663930 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aeca854f-0d66-4a82-8820-90155cc14e0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/ips" status: 200 len: 152 microversion: 2.20 time: 0.049993 Jul 28 12:04:31.664913 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2940/5877] 10.222.0.93 () {60 vars in 1289 bytes} [Thu Jul 28 12:04:31 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:04:34.959121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:34.960394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:34.964554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:34.965317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=78 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:34.971185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:34.971724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:34.973645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:34.974353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:35.003375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lazy-loading 'flavor' on Instance uuid f8fdd6a4-dc1d-421f-850e-c679829a96d6 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:04:35.252079 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bbfe1d70-34ec-4284-ba70-019e164015b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/action" status: 202 len: 0 microversion: 2.20 time: 0.297154 Jul 28 12:04:35.253212 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2938/5878] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 12:04:34 2022] POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:04:35.271127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:35.273100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:35.290280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:35.290695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:35.291519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:35.291961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:35.531784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:35.546185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:35.549149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:35.553947 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53a0145b-5d71-4c71-b197-8fa54b35da44 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.295035 Jul 28 12:04:35.557632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2941/5879] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:35 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:36.583221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:36.584550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:36.591966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:36.592716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:36.593620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:36.594211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:36.754911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:36.765229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:36.768009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:36.769412 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-696ef258-f821-411b-9ff9-8f0f3c30e529 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.191328 Jul 28 12:04:36.783102 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2939/5880] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:36 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:37.793910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:37.794527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:37.806480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:37.806937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:37.807941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:37.808706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:37.980302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:37.994443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:37.997594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:37.998842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-82e24bd5-7c15-4787-9265-bf38d347b3ed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.209491 Jul 28 12:04:38.003059 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2942/5881] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:37 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:39.026145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:39.026772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:39.038409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:39.038897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:39.040423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:39.044001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:39.350714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:39.364486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:39.366376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:39.367896 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39663040-da54-4c1f-bd58-30e79f19c2f4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.345945 Jul 28 12:04:39.369826 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2940/5882] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:39 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:40.392972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:40.394380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:40.410464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.411277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.412305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.412891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.660624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:40.676480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:40.692798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:40.694289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c7f18bb-962d-41d6-9352-4299fb27b0ec tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.306226 Jul 28 12:04:40.696321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2943/5883] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:40 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:40.711809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:40.718002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:40.738866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.739606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.740759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.753564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.846216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:40.847166 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 12:04:40.847166 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 12:04:40.848419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.848859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.849952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:40.850382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:40.863591 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-245cc0a4-e488-40cc-97a6-04bbcad3f3d2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action" status: 200 len: 63198 microversion: 2.1 time: 0.163399 Jul 28 12:04:40.872728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2944/5884] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:04:40 2022] POST /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e/action => generated 63198 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:04:40.913449 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd861d6a-fc14-4ffe-8099-8a50bef575be tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.377775 Jul 28 12:04:40.914037 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2941/5885] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Jul 28 12:04:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:41.067212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-252158245", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "availability_zone": "nova:n-h2-851368-1", "networks": [{"uuid": "07f8ec2b-c4d8-4ec7-adde-5e78ceed37be"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:41.148655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] validate_networks() for [('07f8ec2b-c4d8-4ec7-adde-5e78ceed37be', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:04:41.647968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:04:41.655790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:04:41.656467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:04:41.656905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:04:41.657512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:04:41.678650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:41.679926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:41.680748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:41.681806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:41.702486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Getting quotas for project 310ac2eb73c84fd48de2bcb853834b99. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:04:41.709033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Getting quotas for user ff3229a57d734d53ae7380a31d2621d2 and project 310ac2eb73c84fd48de2bcb853834b99. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:04:41.723753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:04:41.726704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:04:41.730657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:41.731301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:41.743969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:41.744841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:41.746607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:41.747563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:41.778960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a3177d5-695e-4350-bcb6-c2dc41fda24b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716209 Jul 28 12:04:41.779996 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2945/5886] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:04:41.790488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19eef2df-a274-4434-b46b-b87bd2dd8d37 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:41.791389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19eef2df-a274-4434-b46b-b87bd2dd8d37 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:41.880786 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19eef2df-a274-4434-b46b-b87bd2dd8d37 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1328 microversion: 2.1 time: 0.093874 Jul 28 12:04:41.895107 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2946/5887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:41 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:41.963163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:41.980655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:41.982907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:41.987774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71d8d901-d043-451a-b6d7-ac4a78413d0f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.264359 Jul 28 12:04:41.988331 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2942/5888] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:41 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:42.902524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:42.903204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:42.910914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:42.911478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:42.912514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:42.913039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:43.013648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:43.014267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:43.021315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:43.021947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:43.022874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:43.023480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:43.034699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3dfbba4-93ce-44b5-befc-da3cf7ea7b43 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1415 microversion: 2.1 time: 0.136447 Jul 28 12:04:43.043212 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2947/5889] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:42 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1415 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:43.244617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:43.252930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:43.254672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:43.261970 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04460e9c-5c81-4d15-a7e3-944dfc58b9e3 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.252717 Jul 28 12:04:43.262766 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2943/5890] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:43 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:44.063850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:44.065322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:44.079114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:44.080126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:44.081805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:44.082548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:44.286879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:44.289130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:44.298615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:44.301063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:44.302877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:44.304897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:44.519245 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54b70906-386d-4b80-9bf6-f80d860fa203 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.459774 Jul 28 12:04:44.521434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2948/5891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:44 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:44.678899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:44.698454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:44.703864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:44.705770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5700ba22-356b-4db5-a97d-56f9bb445b65 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.423256 Jul 28 12:04:44.706880 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2944/5892] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:44 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:45.055086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0a77d5f5-2d9e-407b-a311-8fddf78aa11f req-4f57f1da-e04d-4581-bc0b-b9e1a14aad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef95d8a-2b61-4b6d-ae05-de9c480bca28", "tag": "5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:45.108335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0a77d5f5-2d9e-407b-a311-8fddf78aa11f req-4f57f1da-e04d-4581-bc0b-b9e1a14aad59 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:45.109427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0a77d5f5-2d9e-407b-a311-8fddf78aa11f req-4f57f1da-e04d-4581-bc0b-b9e1a14aad59 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:45.138630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0a77d5f5-2d9e-407b-a311-8fddf78aa11f req-4f57f1da-e04d-4581-bc0b-b9e1a14aad59 service nova] Creating event network-changed:5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba for instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 on n-h2-851368-1 Jul 28 12:04:45.145322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0a77d5f5-2d9e-407b-a311-8fddf78aa11f req-4f57f1da-e04d-4581-bc0b-b9e1a14aad59 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095240 Jul 28 12:04:45.157199 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2949/5893] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:45.546504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:45.547778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:45.558848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:45.560269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:45.562820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:45.565083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:45.731632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:45.732346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:45.743690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:45.744151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:45.744946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:45.745396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:45.871153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a88c5b2-9eb2-47e6-9485-1774dadcea5d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.332989 Jul 28 12:04:45.874280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2945/5894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:45 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:45.979343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:45.988409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:45.989934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:45.991332 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a0faa14-f939-466f-b8ee-be8adf49bdbe tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.264824 Jul 28 12:04:45.992173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2950/5895] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:45 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:46.894998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:46.899749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:46.906884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:46.907388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:46.908189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:46.908636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:47.014544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:47.015762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:47.024865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:47.025337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:47.026134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:47.026579 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:47.194358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-45c4cc2d-edfb-4d8e-929f-1d9c93f0517a tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.303113 Jul 28 12:04:47.195153 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2946/5896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:46 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:47.296941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:47.297227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:47.297958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:47.304208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:47.304658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:47.305381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:47.305492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:47.305850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:47.306936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:47.308152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea1903f6-d249-4ea1-8e0b-cdd7f9c05ba7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.297872 Jul 28 12:04:47.308901 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2951/5897] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:47 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:47.769514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1258afd2-3045-477b-9bff-aa03aeab52c5 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1832 microversion: 2.1 time: 0.476187 Jul 28 12:04:47.770102 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2947/5898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:47 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1832 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:48.215492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:48.216314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:48.223931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:48.224819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:48.225720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:48.226259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:48.331244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:48.332584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:48.340625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:48.341073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:48.342184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:48.342773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:48.388287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f7745af-3220-488a-a5bc-7c65f75730ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.176680 Jul 28 12:04:48.388873 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2952/5899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:48 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:48.505448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:48.521425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:48.523846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:48.525620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-889efd4b-080f-4024-a611-1801d4867a1c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.199050 Jul 28 12:04:48.526525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2948/5900] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:48 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:48.973590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a2eaf3ae-be59-4704-9413-d58bda3a0aba req-d6e21866-a872-4665-b27e-8d5bfc8154e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:48.984211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a2eaf3ae-be59-4704-9413-d58bda3a0aba req-d6e21866-a872-4665-b27e-8d5bfc8154e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:48.985035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a2eaf3ae-be59-4704-9413-d58bda3a0aba req-d6e21866-a872-4665-b27e-8d5bfc8154e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:48.997543 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a2eaf3ae-be59-4704-9413-d58bda3a0aba req-d6e21866-a872-4665-b27e-8d5bfc8154e1 service nova] Creating event network-changed:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:04:49.003696 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a2eaf3ae-be59-4704-9413-d58bda3a0aba req-d6e21866-a872-4665-b27e-8d5bfc8154e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 Jul 28 12:04:49.005031 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2949/5901] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:49.112919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:49.113436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:49.121127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.121588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.122640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.123337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.154908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:04:49.288829 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-399fbef9-f6de-41dc-b6bf-659f082783b4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 204 len: 0 microversion: 2.1 time: 0.337986 Jul 28 12:04:49.294868 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2953/5902] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:04:48 2022] DELETE /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:04:49.301639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:49.302581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:49.315323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.316048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.317733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.318353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.414562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:49.415577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:49.424041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.424713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.425678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.426126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.474933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:49.485648 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6be0d4d-477b-4622-a2f3-450b28a00ce7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1687 microversion: 2.1 time: 0.187100 Jul 28 12:04:49.486506 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2950/5903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:49 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:49.549958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:49.550908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:49.558927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.559644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.560725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:49.561450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:49.601921 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3bdc0c3d-32e7-47da-a7f3-e512a1cfefcb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.195628 Jul 28 12:04:49.615108 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2954/5904] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:49 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:49.699483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:49.707617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:49.709489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:49.710842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b86163f6-2267-4003-8f82-25c1f88140d4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.164809 Jul 28 12:04:49.712136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2951/5905] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:49 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:50.512003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:50.512901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:50.520417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.521184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.522076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.522656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.580212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-dfec5ec3-ec60-4ce8-b0bc-e354ce524cca req-6f2239c2-fb64-424a-b25f-3dc842f41551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef95d8a-2b61-4b6d-ae05-de9c480bca28", "name": "network-vif-plugged", "status": "completed", "tag": "5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:50.591198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dfec5ec3-ec60-4ce8-b0bc-e354ce524cca req-6f2239c2-fb64-424a-b25f-3dc842f41551 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.592191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-dfec5ec3-ec60-4ce8-b0bc-e354ce524cca req-6f2239c2-fb64-424a-b25f-3dc842f41551 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.608087 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-dfec5ec3-ec60-4ce8-b0bc-e354ce524cca req-6f2239c2-fb64-424a-b25f-3dc842f41551 service nova] Creating event network-vif-plugged:5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba for instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 on n-h2-851368-1 Jul 28 12:04:50.614327 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-dfec5ec3-ec60-4ce8-b0bc-e354ce524cca req-6f2239c2-fb64-424a-b25f-3dc842f41551 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039032 Jul 28 12:04:50.615484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2952/5906] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:50.628204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:50.629068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:50.637725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.638185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.638972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.639440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.778549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:50.787328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-66b6d33a-59e7-4ed3-95e5-827c685cf442 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1687 microversion: 2.1 time: 0.279650 Jul 28 12:04:50.788292 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2955/5907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:50 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1687 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:50.793323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:50.794132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:50.801309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.801943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.804179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:50.804633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:50.860325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:50.913136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fbf168f8-5d44-4d34-b94b-eec0c1bb6064 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.290427 Jul 28 12:04:50.914327 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2953/5908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:50 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:51.127348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:51.141058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:51.142602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:51.143978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-470ad1ea-486a-4218-8814-2b29dcbe46a9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.354516 Jul 28 12:04:51.163186 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2956/5909] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:50 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:51.451446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-68f523ed-99d8-440a-93ff-5e9c77063ec9 req-53ffe1f7-c06f-4e61-b9c7-943e04071f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1139260e-008f-4124-bc20-dba3886ff26e", "name": "network-vif-deleted", "tag": "c805f66a-384d-42c7-8708-aff5d711b0f8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:51.470659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-68f523ed-99d8-440a-93ff-5e9c77063ec9 req-53ffe1f7-c06f-4e61-b9c7-943e04071f72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:51.471243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-68f523ed-99d8-440a-93ff-5e9c77063ec9 req-53ffe1f7-c06f-4e61-b9c7-943e04071f72 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:51.485137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-68f523ed-99d8-440a-93ff-5e9c77063ec9 req-53ffe1f7-c06f-4e61-b9c7-943e04071f72 service nova] Creating event network-vif-deleted:c805f66a-384d-42c7-8708-aff5d711b0f8 for instance 1139260e-008f-4124-bc20-dba3886ff26e on n-h2-851368-1 Jul 28 12:04:51.490316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-68f523ed-99d8-440a-93ff-5e9c77063ec9 req-53ffe1f7-c06f-4e61-b9c7-943e04071f72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042550 Jul 28 12:04:51.490993 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2954/5910] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:51.813351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:51.813891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:51.816723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:51.825044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:51.825527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:51.826323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:51.826772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:51.874730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:51.904456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:51.911700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:51.916899 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f762e08c-84b6-4a6d-aeed-f49b015fa32a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 200 len: 1351 microversion: 2.1 time: 0.107659 Jul 28 12:04:51.917749 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2957/5911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:51 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:51.936512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:51.938289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:51.952135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:51.952606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:51.953392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:51.953842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:51.958408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:04:52.110909 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e3ebd2d-3ad9-401b-b2e5-e6e542a53a1d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1463 microversion: 2.1 time: 0.180498 Jul 28 12:04:52.112113 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2955/5912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:51 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:52.168732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:52.169453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:52.177104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:52.177646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:52.178502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:52.179021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:52.319284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:52.328100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:52.329645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:52.330831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3919357a-f6ea-4edc-b5a9-b4cecc673ec8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1745 microversion: 2.20 time: 0.166530 Jul 28 12:04:52.331496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2958/5913] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:52 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:52.939386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:52.940019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 1139260e-008f-4124-bc20-dba3886ff26e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:52.958303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:52.958759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:52.963060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:52.972656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.002790 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] HTTP exception thrown: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Request method failure captured: Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e HTTP/1.1 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nozoHNvSRavIkmD8AajooQaWwNnmMbGdCZ4di285oby44AJzbKAYneiequjHATCTb5eKctYzuptKNmfANbi25s6SPH1xtfH8wUfnPCq739fqsKLpM-fJGBYq-nvo4vTfKz8gNFWsmKyi1YQfHanxAJGiqsL7o98Ri0E2-SKBgmv3-c Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}] Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ad897d5445224ba48dc242fb71a77480 Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1139260e-008f-4124-bc20-dba3886ff26e'} Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:53.004963 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. Jul 28 12:04:53.009530 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:04:53.010739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Returning 404 to user: Instance 1139260e-008f-4124-bc20-dba3886ff26e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:04:53.013373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f01c1e5f-4725-411e-98f8-68c9106e46e2 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e" status: 404 len: 111 microversion: 2.1 time: 0.079265 Jul 28 12:04:53.018412 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2956/5914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:52 2022] GET /compute/v2.1/servers/1139260e-008f-4124-bc20-dba3886ff26e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:04:53.132826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:53.133489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:53.146492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.146984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.150626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.150626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.348356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79080fb2-9473-4a75-9351-0b92d54674ee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1647 microversion: 2.1 time: 0.219619 Jul 28 12:04:53.348356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2959/5915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:53 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1647 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:53.355901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:53.356736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:53.364178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.364842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.365896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.371648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.375329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:53.376206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:53.383029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.384105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.385012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.385537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.601882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:53.613264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:53.614428 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f57f1eff-7f79-4eb5-b717-53a1f5374e1f tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1647 microversion: 2.1 time: 0.247163 Jul 28 12:04:53.615238 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2960/5916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:53 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1647 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:53.616019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:53.627938 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d229523b-130c-4b3f-8778-35682d5b8a5a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.276372 Jul 28 12:04:53.630826 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2957/5917] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:53 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:53.636069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:53.636724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:53.654642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.656020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.658546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:53.659170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:53.842194 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01584e4d-d829-4aed-893a-4cec4883e48b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1647 microversion: 2.1 time: 0.210225 Jul 28 12:04:53.860237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2961/5918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:53 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1647 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:04:53.925699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2026492747", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "availability_zone": "nova:n-h1-851368-1", "networks": [{"uuid": "07f8ec2b-c4d8-4ec7-adde-5e78ceed37be"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:54.004164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] validate_networks() for [('07f8ec2b-c4d8-4ec7-adde-5e78ceed37be', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:04:54.655348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:54.656980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:54.679060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:54.682297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:54.686186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:54.688942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:54.929036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:04:54.929475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:04:54.929961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:04:54.930381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:04:54.931096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:04:54.960344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:54.960805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:54.972249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:54.972865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:55.047730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Getting quotas for project 310ac2eb73c84fd48de2bcb853834b99. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:04:55.064512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Getting quotas for user ff3229a57d734d53ae7380a31d2621d2 and project 310ac2eb73c84fd48de2bcb853834b99. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:04:55.101092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:04:55.107875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:04:55.150964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:55.163515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:55.165812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:55.167303 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2245da13-6081-4cee-a305-0f2550ef4f41 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.516890 Jul 28 12:04:55.168351 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2962/5919] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:54 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:04:55.172914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-75ac921b-e03e-4663-a1aa-cb67a93f4b51 req-44054a18-851c-4698-b762-9af687a02edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "name": "network-vif-plugged", "status": "completed", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:55.183316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-75ac921b-e03e-4663-a1aa-cb67a93f4b51 req-44054a18-851c-4698-b762-9af687a02edc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:55.183772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-75ac921b-e03e-4663-a1aa-cb67a93f4b51 req-44054a18-851c-4698-b762-9af687a02edc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:55.194912 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-435aea72-afe5-4d4c-8087-3248079d8fdb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273115 Jul 28 12:04:55.221845 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2958/5920] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 12:04:55.227251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b676deb6-cea6-424f-872f-ff8066314477 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:55.239257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b676deb6-cea6-424f-872f-ff8066314477 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:55.243901 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-75ac921b-e03e-4663-a1aa-cb67a93f4b51 req-44054a18-851c-4698-b762-9af687a02edc service nova] Creating event network-vif-plugged:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h2-851368-1 Jul 28 12:04:55.261905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-75ac921b-e03e-4663-a1aa-cb67a93f4b51 req-44054a18-851c-4698-b762-9af687a02edc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091555 Jul 28 12:04:55.264537 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2963/5921] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:55.325490 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b676deb6-cea6-424f-872f-ff8066314477 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1329 microversion: 2.1 time: 0.102165 Jul 28 12:04:55.326076 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2959/5922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:55 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:56.195331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:56.196192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:56.217821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:56.218309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:56.219451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:56.219992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:56.359721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:56.361074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:56.386373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:56.387390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:56.388986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:56.389829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:56.632517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:56.646146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:56.651302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:56.655320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aa3c30ee-176a-4edd-af2f-2d316933d42a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.464948 Jul 28 12:04:56.659268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2964/5923] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:56 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:56.665484 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c6f6937-ffcc-4e8a-800c-c64ecbe7f5e1 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1338 microversion: 2.1 time: 0.309645 Jul 28 12:04:56.666067 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2960/5924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:56 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1338 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:57.681780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:57.683022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:57.690033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:57.690703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:57.694247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:57.694950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:57.696259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:57.696930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:57.705891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:57.706437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:57.707263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:57.707709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:57.948272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f395e7f-7063-44ab-8c50-9a728f04f022 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1422 microversion: 2.1 time: 0.264304 Jul 28 12:04:57.949442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2961/5925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:57 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1422 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:58.132751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:58.147940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:58.151537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:58.153468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c53c50b3-0c75-4a03-89bf-3eeba1f3345c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.476194 Jul 28 12:04:58.154762 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2965/5926] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:57 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:58.973155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:58.973937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:58.994966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:58.995430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:58.999379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:59.002579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:59.022193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-90de59a3-bd5e-4fff-b5ad-74e412596bdd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '.version_select at 0x7f2eb1a63820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:59.098659 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-90de59a3-bd5e-4fff-b5ad-74e412596bdd tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2005553506" status: 202 len: 0 microversion: 2.1 time: 0.076856 Jul 28 12:04:59.107092 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2966/5927] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2005553506 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:04:59.156218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aef467db-01f6-43fb-8a2e-41e9c5853fb0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: .version_select at 0x7f2eb197dca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1879413919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKKNU3xbg23Nx13wScoCaI6gEb5EkNhz8S6b/9mLHELTtNEYEvI/iIEduY/N1wrXBM+W405QxPVUPYWgAtTZxH+xJMlL1syZT0My7VFUSVgUYlizHqd6Dv6vQY3MwG3gA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:59.195814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-aef467db-01f6-43fb-8a2e-41e9c5853fb0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:04:59.202898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-aef467db-01f6-43fb-8a2e-41e9c5853fb0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:04:59.246034 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aef467db-01f6-43fb-8a2e-41e9c5853fb0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.105549 Jul 28 12:04:59.253912 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2967/5928] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:04:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:04:59.268856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:04:59.269485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:04:59.293936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:59.294387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:59.295207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:59.295651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:59.382801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4aab2dd6-5a13-49f2-b5eb-617c45e30d33 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.416522 Jul 28 12:04:59.400341 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2962/5929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:04:58 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:04:59.533591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:59.544137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:59.547312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:04:59.552293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3566a5d8-f0e8-458e-b685-bc16a0a4974d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.297191 Jul 28 12:04:59.557820 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2968/5930] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:04:59 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:04:59.661952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-516c7bf4-2dba-42c7-b4ee-3bddc8c84077 req-5687d8fa-4814-48f0-b622-923ce260b204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c64ad61-a228-40c5-aa77-658515de5d2c", "tag": "e030faf7-92b8-4173-84a6-88198029b459"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:04:59.679963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-516c7bf4-2dba-42c7-b4ee-3bddc8c84077 req-5687d8fa-4814-48f0-b622-923ce260b204 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:04:59.682038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-516c7bf4-2dba-42c7-b4ee-3bddc8c84077 req-5687d8fa-4814-48f0-b622-923ce260b204 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:04:59.719362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-516c7bf4-2dba-42c7-b4ee-3bddc8c84077 req-5687d8fa-4814-48f0-b622-923ce260b204 service nova] Creating event network-changed:e030faf7-92b8-4173-84a6-88198029b459 for instance 8c64ad61-a228-40c5-aa77-658515de5d2c on n-h1-851368-1 Jul 28 12:04:59.730312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-516c7bf4-2dba-42c7-b4ee-3bddc8c84077 req-5687d8fa-4814-48f0-b622-923ce260b204 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079976 Jul 28 12:04:59.731692 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2963/5931] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:00.407589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:00.408843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:00.429003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:00.429460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:00.430255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:00.431352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:00.580608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:00.581659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:00.600372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:00.601637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:00.608137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:00.608609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:00.657759 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1f38dec-4627-47e6-bbdb-92181c6a47e5 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.252813 Jul 28 12:05:00.660636 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2969/5932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:00 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:00.827480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:00.840501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:00.842617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:00.843943 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d93cca8-6977-4de7-9886-ad5c725d29c4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.268320 Jul 28 12:05:00.844923 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2964/5933] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:00 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:01.683496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:01.684770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:01.688426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:01.702310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:01.703318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:01.704308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:01.704946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:01.868641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:01.869247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:01.884372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:01.884977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:01.886378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:01.886836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:01.926026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16d0819d-fc50-4ecc-a27f-7cb82d5e7283 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.248683 Jul 28 12:05:01.934281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2970/5934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:01 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:02.126734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:02.136326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:02.138476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:02.139912 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37b4fa3b-4d4a-4a69-8b64-20d0729bd706 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.275927 Jul 28 12:05:02.158679 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2965/5935] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:01 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:02.953843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:02.954457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:02.975304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:02.975804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:02.976601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:02.977039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:03.174970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:03.178135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:03.204028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:03.207449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:03.211108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:03.211712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:03.213056 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f99e3b12-f9fe-4dcc-b684-d1fd6be6bd64 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.262880 Jul 28 12:05:03.223841 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2971/5936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:02 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:03.379783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:03.401522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:03.403408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:03.404826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-073c1f91-9a4c-46ac-905f-a0f4f93f0b35 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.238734 Jul 28 12:05:03.405874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2966/5937] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:03 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:04.238168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:04.244641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:04.260905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:04.263282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:04.264260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:04.266241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:04.429041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:04.430256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:04.442677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:04.443810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:04.444748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:04.449098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:04.609796 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5d84cec-fd86-4228-b6f3-da906e252b7d tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.375599 Jul 28 12:05:04.632524 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2972/5938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:04 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:04.722290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:04.739050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:04.743295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:04.745549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9551fa9c-8dc2-4ab4-ad18-b7283a2c19c1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.320136 Jul 28 12:05:04.746890 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2967/5939] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:04 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:05:05.643501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:05.646343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:05.672957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:05.675965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:05.677798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:05.683376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:05.769938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:05.770569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:05.772710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:05.773411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:05.782935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:05.803232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:05.803691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:05.804494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:05.804944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:06.132267 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37ffc9f1-8f5d-47c3-9bdd-249c5e982e0c tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.485038 Jul 28 12:05:06.149356 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2973/5940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:05 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:06.577329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:06.589972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:06.594986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:06.604673 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1559a8ff-c200-444d-b55c-d766635d6373 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.838559 Jul 28 12:05:06.605755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2968/5941] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:05 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:07.154117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:07.154725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:07.161576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:07.166742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:07.167846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:07.172290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:07.301701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ddedfc94-03a2-4c0d-9fe3-c64ba3174610 req-a4263ea9-45d6-430a-9021-aca830cd88af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c64ad61-a228-40c5-aa77-658515de5d2c", "name": "network-vif-plugged", "status": "completed", "tag": "e030faf7-92b8-4173-84a6-88198029b459"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:07.330433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ddedfc94-03a2-4c0d-9fe3-c64ba3174610 req-a4263ea9-45d6-430a-9021-aca830cd88af service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:07.331308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ddedfc94-03a2-4c0d-9fe3-c64ba3174610 req-a4263ea9-45d6-430a-9021-aca830cd88af service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:07.377231 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ddedfc94-03a2-4c0d-9fe3-c64ba3174610 req-a4263ea9-45d6-430a-9021-aca830cd88af service nova] Creating event network-vif-plugged:e030faf7-92b8-4173-84a6-88198029b459 for instance 8c64ad61-a228-40c5-aa77-658515de5d2c on n-h1-851368-1 Jul 28 12:05:07.403564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ddedfc94-03a2-4c0d-9fe3-c64ba3174610 req-a4263ea9-45d6-430a-9021-aca830cd88af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105445 Jul 28 12:05:07.404903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2969/5942] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:05:07.629328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:07.630581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:07.657219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:07.657967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:07.658948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:07.663029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:07.735377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f11fdd8e-801c-41f6-b53c-112bcc3703f8 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.585176 Jul 28 12:05:07.736260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2974/5943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:07 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:07.938353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:07.978762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:07.986640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:07.987928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad499973-0642-4269-8b7c-19e735c75798 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.363935 Jul 28 12:05:07.998474 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2970/5944] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:07 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:08.766013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:08.769906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:08.791116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:08.791116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:08.791116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:08.791116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:09.017410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:09.018752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:09.027951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:09.030639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:09.033672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:09.035317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:09.213119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:09.238589 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd706105-879d-4e17-866e-98e0cdc72b96 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1464 microversion: 2.1 time: 0.485505 Jul 28 12:05:09.241220 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2975/5945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:08 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1464 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:09.445220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:09.463044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:09.476326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:09.477779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22d79805-ff6c-4544-896c-f95b49197d8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.465021 Jul 28 12:05:09.479447 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2971/5946] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:09 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:05:10.206267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1861922482", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "d545548b-4f70-42e5-b22c-4f88e0bbe2aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1879413919", "security_groups": [{"name": "tempest-secgroup-smoke-505617217"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:10.261519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:10.262291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:10.272659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:10.276249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:10.278013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:10.280179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:10.423391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] validate_networks() for [('d545548b-4f70-42e5-b22c-4f88e0bbe2aa', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:05:10.782115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49510c9c-af73-4e30-9569-8655753f9b1e tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1648 microversion: 2.1 time: 0.524429 Jul 28 12:05:10.782836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2972/5947] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:10 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1648 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:10.787822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:10.788567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:10.795426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:10.796141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:10.797169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:10.797820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.074818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:11.087327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:11.095608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:11.096966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7c48751-2960-48cc-bdad-a534c607693e tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1740 microversion: 2.20 time: 0.312847 Jul 28 12:05:11.097653 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2973/5948] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:10 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:11.107234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:11.110380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:11.120710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.121079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.122414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.122858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.376275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:05:11.377328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:05:11.377946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:05:11.378529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:05:11.379135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:05:11.409667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.411434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.412466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.414351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.464252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:05:11.468636 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c2de3f7-74ab-4465-a644-58df8c28735b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1648 microversion: 2.1 time: 0.365517 Jul 28 12:05:11.470406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:05:11.480264 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2974/5949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:11 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1648 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:11.490741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:05:11.502245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:11.503138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:11.513672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.514317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.515503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:11.515717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:05:11.516103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:11.539992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:11.615524 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f987185f-b05a-4858-87d3-706d3ec683d4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.413870 Jul 28 12:05:11.616770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2976/5950] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:05:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:05:11.635674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd00544a-e45b-4db0-b529-a0ab8da3b193 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:11.636527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd00544a-e45b-4db0-b529-a0ab8da3b193 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:12.335527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd00544a-e45b-4db0-b529-a0ab8da3b193 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:12.345217 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd00544a-e45b-4db0-b529-a0ab8da3b193 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1267 microversion: 2.1 time: 0.720893 Jul 28 12:05:12.348794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2977/5951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:11 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1267 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:12.368255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:12.371363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:12.386435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.391389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.392597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.392786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.426494 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5984a653-1790-42f1-b098-253250f15345 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1648 microversion: 2.1 time: 0.928949 Jul 28 12:05:12.429718 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2975/5952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:11 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1648 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:12.448714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:12.449574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:12.459550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.462356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.463466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.464574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.506946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:05:12.679053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:12.682772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=100 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:12.694666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:12.696370 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6927600-c468-4c51-abb6-ee977fc8a202 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 204 len: 0 microversion: 2.1 time: 0.251416 Jul 28 12:05:12.696497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:12.697598 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0300e530-05ad-404c-a6a3-d22396aca96b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1722 microversion: 2.20 time: 0.344659 Jul 28 12:05:12.697728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2976/5953] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:05:12 2022] DELETE /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:05:12.698496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2978/5954] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:12 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:12.714687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:12.721081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:12.750433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.756867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.758113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:12.758987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:12.950819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b29beb2-6abe-4ecf-951d-850db0074fec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1654 microversion: 2.1 time: 0.241582 Jul 28 12:05:12.951510 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2977/5955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:12 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1654 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:13.374596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:13.375336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:13.382518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.383113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:13.383979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.384646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:13.458774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:13.467332 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-94473f13-5128-44ab-91ba-51506f90f0a0 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1263 microversion: 2.1 time: 0.097536 Jul 28 12:05:13.468350 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2979/5956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:13 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:13.721635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:13.722245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:13.739772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.740153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:13.740946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.741382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:13.920617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:13.929435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:13.931650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:13.932824 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b7394b4-c9c3-47f2-b034-0f178ea38727 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1722 microversion: 2.20 time: 0.215175 Jul 28 12:05:13.933388 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2978/5957] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:13 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:13.972408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:13.973490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:13.981245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.981704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:13.982637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:13.983108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:14.111677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-feefdbc0-1a95-4fa7-9718-3ee7d73076e6 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1654 microversion: 2.1 time: 0.144350 Jul 28 12:05:14.112279 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2980/5958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:13 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:14.488512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:14.489228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:14.497634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:14.498092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:14.498958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:14.499658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:14.629196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:14.637353 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67d8c497-402e-4766-b299-0b5d3a75f0b1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1327 microversion: 2.1 time: 0.152747 Jul 28 12:05:14.638152 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2979/5959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:14 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:14.733099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-19905ad9-343e-4460-9c5d-e3701a8d6f99 req-edf6b85e-2d39-4a06-b216-86f8c57c8da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "name": "network-vif-unplugged", "status": "completed", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:14.757344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-19905ad9-343e-4460-9c5d-e3701a8d6f99 req-edf6b85e-2d39-4a06-b216-86f8c57c8da7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:14.757795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-19905ad9-343e-4460-9c5d-e3701a8d6f99 req-edf6b85e-2d39-4a06-b216-86f8c57c8da7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:14.770689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-19905ad9-343e-4460-9c5d-e3701a8d6f99 req-edf6b85e-2d39-4a06-b216-86f8c57c8da7 service nova] Creating event network-vif-unplugged:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h2-851368-1 Jul 28 12:05:14.781096 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-19905ad9-343e-4460-9c5d-e3701a8d6f99 req-edf6b85e-2d39-4a06-b216-86f8c57c8da7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051686 Jul 28 12:05:14.782222 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2981/5960] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:14.959011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:14.960692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:14.970913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:14.971910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:14.972927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:14.973581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.135124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:15.136782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:15.137660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:15.145146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.146029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.147449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.148723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.150735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:15.152454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:15.153715 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-116d4f10-9d10-43f0-ad6b-61956d517c59 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1725 microversion: 2.20 time: 0.201881 Jul 28 12:05:15.154715 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2980/5961] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:14 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:15.178628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b38a16e-8bc9-489e-9dd5-fdd7e18dad57"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:15.181573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:15.189147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.189824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.190771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.191391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.263443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-265ca392-28ae-46d4-9105-1063c2d449bf tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 200 len: 1612 microversion: 2.1 time: 0.133209 Jul 28 12:05:15.265499 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2982/5962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:15 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 1612 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:15.469100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d6888a75-eba6-432d-9d3a-90c1a88f24a6 req-376883b9-8432-4902-b0d7-9e64a6226739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c64ad61-a228-40c5-aa77-658515de5d2c", "name": "network-vif-deleted", "tag": "e030faf7-92b8-4173-84a6-88198029b459"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:15.510636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6888a75-eba6-432d-9d3a-90c1a88f24a6 req-376883b9-8432-4902-b0d7-9e64a6226739 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.511599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6888a75-eba6-432d-9d3a-90c1a88f24a6 req-376883b9-8432-4902-b0d7-9e64a6226739 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.564858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d6888a75-eba6-432d-9d3a-90c1a88f24a6 req-376883b9-8432-4902-b0d7-9e64a6226739 service nova] Creating event network-vif-deleted:e030faf7-92b8-4173-84a6-88198029b459 for instance 8c64ad61-a228-40c5-aa77-658515de5d2c on n-h1-851368-1 Jul 28 12:05:15.579239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d6888a75-eba6-432d-9d3a-90c1a88f24a6 req-376883b9-8432-4902-b0d7-9e64a6226739 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115087 Jul 28 12:05:15.582368 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2983/5963] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:15.658947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:15.659924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:15.666873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a042bc36-6365-44b7-8096-220f1062ed68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.492118 Jul 28 12:05:15.667985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.669036 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2981/5964] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Jul 28 12:05:15 2022] POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments => generated 188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:05:15.669271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.670069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.670509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.769321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:15.779975 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30477f02-d55d-4092-99ae-20330d4baab1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1325 microversion: 2.1 time: 0.125176 Jul 28 12:05:15.780931 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2984/5965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:15 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1325 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:15.813917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:15.814522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:15.821473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.821996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:15.822996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:15.823511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.182334 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-07a46c61-4c1c-4345-bb45-33ca1b4ca2b7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments/9b38a16e-8bc9-489e-9dd5-fdd7e18dad57" status: 202 len: 0 microversion: 2.20 time: 0.372798 Jul 28 12:05:16.199768 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2982/5966] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Jul 28 12:05:15 2022] DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments/9b38a16e-8bc9-489e-9dd5-fdd7e18dad57 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:05:16.247393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:16.248394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.255421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.256060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.257000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.257919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.285120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:16.286700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: 8c64ad61-a228-40c5-aa77-658515de5d2c] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.296527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.296981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.297776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.298221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.320537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] HTTP exception thrown: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Request method failure captured: Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c HTTP/1.1 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4ntYk_19sNJCnVCCU7CaW1WDKiNlId-qBkn3d4TPN3MIiWmFWszq5P6d7XO_BX9xMMKcrkCsDSx7SNWGNrk6A_MzPN4HuTJY7dTwysExAHwQg-EPrhH7d0rpYOO8U0dcTltc7hjiPtRpMAYdG6IXmsl15HfKQwiOgYpQ8jTx25SVOnY Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 310ac2eb73c84fd48de2bcb853834b99 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestServerMultinode-197786579 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/310ac2eb73c84fd48de2bcb853834b99"}]}] Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestServerMultinode-197786579 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 310ac2eb73c84fd48de2bcb853834b99 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestServerMultinode-197786579 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestServerMultinode-197786579-project-admin Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ff3229a57d734d53ae7380a31d2621d2 Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestServerMultinode-197786579-project-admin Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '8c64ad61-a228-40c5-aa77-658515de5d2c'} Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:05:16.323005 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Returning 404 to user: Instance 8c64ad61-a228-40c5-aa77-658515de5d2c could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4753bda-d3e4-48fb-960a-a0a8fc4ac3c4 tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c" status: 404 len: 111 microversion: 2.1 time: 0.043498 Jul 28 12:05:16.326805 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2983/5967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:16 2022] GET /compute/v2.1/servers/8c64ad61-a228-40c5-aa77-658515de5d2c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:05:16.328392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119236) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 12:05:16.339845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:16.340561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.350826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.351576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.352890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.353633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.391090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:05:16.410937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-524e5b3e-fe56-4493-9d69-ee06e78f9563 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/action" status: 202 len: 0 microversion: 2.20 time: 0.167719 Jul 28 12:05:16.415196 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2985/5968] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Jul 28 12:05:16 2022] POST /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:05:16.423773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:16.428434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.438739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.439540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.440514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.441282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.511574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:16.574083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b077c6e6-e275-4f36-8212-e9e40641cc5b tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 204 len: 0 microversion: 2.1 time: 0.241804 Jul 28 12:05:16.578417 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2984/5969] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:05:16 2022] DELETE /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:05:16.598235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:16.598963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.618076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.619053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.624025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:16.629656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.630130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.637534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:16.639464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:16.640933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-85d0fc9e-2943-44ce-8746-13d9a96daf11 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1673 microversion: 2.20 time: 0.224432 Jul 28 12:05:16.642141 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2986/5970] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:16 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:16.809888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:16.811508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:16.812128 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba131c95-2706-4354-a7cc-e6a3934764aa tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1653 microversion: 2.1 time: 0.231962 Jul 28 12:05:16.814093 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2985/5971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:16 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1653 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:16.822928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.823419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:16.824798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:16.825311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.076854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:17.085378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ee10fdd0-5cff-47de-884b-b94b8e0fd5ae tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.280080 Jul 28 12:05:17.088187 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2987/5972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:16 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:17.605418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-469851bb-7116-47ae-8937-7b4086fb88ad req-fd83204a-2845-4a41-93a9-5e887a08f6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:17.625135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-469851bb-7116-47ae-8937-7b4086fb88ad req-fd83204a-2845-4a41-93a9-5e887a08f6db service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:17.625587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-469851bb-7116-47ae-8937-7b4086fb88ad req-fd83204a-2845-4a41-93a9-5e887a08f6db service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.652711 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-469851bb-7116-47ae-8937-7b4086fb88ad req-fd83204a-2845-4a41-93a9-5e887a08f6db service nova] Creating event network-changed:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:05:17.657645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-469851bb-7116-47ae-8937-7b4086fb88ad req-fd83204a-2845-4a41-93a9-5e887a08f6db service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056396 Jul 28 12:05:17.658315 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2986/5973] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:17.666993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:17.667645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:17.673803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:17.674450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.675260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:17.675761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.812853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:17.822075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:17.823615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:17.824790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4da62569-e556-4467-b655-6be92de88d39 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1675 microversion: 2.20 time: 0.161862 Jul 28 12:05:17.825354 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2988/5974] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:17 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:17.834415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:17.835141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:17.841505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:17.841949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.842706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:17.843180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:17.976523 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bb14034d-de3c-40eb-be9d-f23934c25bee tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1653 microversion: 2.1 time: 0.146329 Jul 28 12:05:17.977729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2987/5975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:17 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:18.109380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:18.109926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:18.116272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:18.116933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:18.117723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:18.118162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:18.270381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:18.279222 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-08adc8c1-6eff-4eb6-9f37-6da043a71042 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.173839 Jul 28 12:05:18.280313 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2989/5976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:18 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:18.847943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:18.848681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:18.855929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:18.856447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:18.857275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:18.857777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.002436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:19.003852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:19.004664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:19.013712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:19.015614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:19.016997 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90cc6c23-d35f-4725-87d9-f55a84bb783c tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1675 microversion: 2.20 time: 0.173068 Jul 28 12:05:19.017678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.025720 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2988/5977] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:18 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:19.029674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.031199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.031950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.075134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.075843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.076300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lazy-loading 'fault' on Instance uuid bef95d8a-2b61-4b6d-ae05-de9c480bca28 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:05:19.127562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43d96688-4fcd-4233-a3df-c1659d7327ec tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 200 len: 1453 microversion: 2.1 time: 0.131364 Jul 28 12:05:19.128137 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2990/5978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:18 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:19.301869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:19.302521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:19.308711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.309166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.309937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.310381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.457994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:19.466612 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93611d17-60ac-450f-b928-1ad3f1a4af27 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.168575 Jul 28 12:05:19.467632 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2989/5979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:19 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:19.679051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8da63bf9-80d5-43ba-8a73-831959098044 req-b0e11d82-f763-4a1a-80e6-aded6f89217e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef95d8a-2b61-4b6d-ae05-de9c480bca28", "name": "network-vif-deleted", "tag": "5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:19.690143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8da63bf9-80d5-43ba-8a73-831959098044 req-b0e11d82-f763-4a1a-80e6-aded6f89217e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:19.690817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8da63bf9-80d5-43ba-8a73-831959098044 req-b0e11d82-f763-4a1a-80e6-aded6f89217e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:19.710330 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8da63bf9-80d5-43ba-8a73-831959098044 req-b0e11d82-f763-4a1a-80e6-aded6f89217e service nova] Creating event network-vif-deleted:5a7954c1-5f59-4dd5-9d2d-c5c3546f30ba for instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 on n-h2-851368-1 Jul 28 12:05:19.715878 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8da63bf9-80d5-43ba-8a73-831959098044 req-b0e11d82-f763-4a1a-80e6-aded6f89217e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041477 Jul 28 12:05:19.717159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2991/5980] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:20.040695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:20.041437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:20.048800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.049156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.050198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.050871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.149811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:20.151265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] [instance: bef95d8a-2b61-4b6d-ae05-de9c480bca28] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:20.158877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.159483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.160257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.160701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.174764 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] HTTP exception thrown: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Request method failure captured: Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 HTTP/1.1 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ntYk_19sNJCnVCCU7CaW1WDKiNlId-qBkn3d4TPN3MIiWmFWszq5P6d7XO_BX9xMMKcrkCsDSx7SNWGNrk6A_MzPN4HuTJY7dTwysExAHwQg-EPrhH7d0rpYOO8U0dcTltc7hjiPtRpMAYdG6IXmsl15HfKQwiOgYpQ8jTx25SVOnY Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 310ac2eb73c84fd48de2bcb853834b99 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestServerMultinode-197786579 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_310ac2eb73c84fd48de2bcb853834b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/310ac2eb73c84fd48de2bcb853834b99"}]}] Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestServerMultinode-197786579 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 310ac2eb73c84fd48de2bcb853834b99 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestServerMultinode-197786579 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestServerMultinode-197786579-project-admin Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ff3229a57d734d53ae7380a31d2621d2 Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestServerMultinode-197786579-project-admin Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'bef95d8a-2b61-4b6d-ae05-de9c480bca28'} Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:05:20.176898 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. Jul 28 12:05:20.181818 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:05:20.183158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] Returning 404 to user: Instance bef95d8a-2b61-4b6d-ae05-de9c480bca28 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:05:20.184196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de7a22ba-5cac-4453-aa11-1e931c3d71fb tempest-TestServerMultinode-197786579 tempest-TestServerMultinode-197786579-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28" status: 404 len: 111 microversion: 2.1 time: 0.039701 Jul 28 12:05:20.184928 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2992/5981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:20 2022] GET /compute/v2.1/servers/bef95d8a-2b61-4b6d-ae05-de9c480bca28 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:05:20.207173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:20.233135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:20.234691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:20.244795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a83287f9-2fbb-447a-873a-6006a4204a70 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.207877 Jul 28 12:05:20.246295 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2990/5982] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:20 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:20.490345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:20.492191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:20.503089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.503858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.504883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:20.505488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:20.753055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:20.762033 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4714fe6f-9705-4eaf-8b4d-ab8392b937ab tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.276168 Jul 28 12:05:20.766239 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2993/5983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:20 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:21.271265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:21.271890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:21.285131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:21.286022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:21.287046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:21.290684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:21.592236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:21.600937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:21.602799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:21.605217 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-601149aa-2e3d-4f48-8023-7c14170ea0bf tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.339323 Jul 28 12:05:21.621068 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2991/5984] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:21 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:21.783990 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:21.784617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:21.790323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fd7a0b51-8ab6-4ede-9384-e2ea4be9f32b req-fe66daf2-58d1-4106-9921-770e2e3924de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:21.798043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:21.810293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:21.811055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:21.812099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:21.813575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:21.818385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd7a0b51-8ab6-4ede-9384-e2ea4be9f32b req-fe66daf2-58d1-4106-9921-770e2e3924de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:21.831889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fd7a0b51-8ab6-4ede-9384-e2ea4be9f32b req-fe66daf2-58d1-4106-9921-770e2e3924de service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:21.865105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fd7a0b51-8ab6-4ede-9384-e2ea4be9f32b req-fe66daf2-58d1-4106-9921-770e2e3924de service nova] Creating event network-changed:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h1-851368-1 Jul 28 12:05:21.882380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fd7a0b51-8ab6-4ede-9384-e2ea4be9f32b req-fe66daf2-58d1-4106-9921-770e2e3924de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103899 Jul 28 12:05:21.891155 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2994/5985] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:22.113207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:22.126216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1fd28566-01b4-4e91-a286-916da69a1531 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.341509 Jul 28 12:05:22.127445 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2992/5986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:21 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:22.635788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:22.636970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:22.644314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=8 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:22.647836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:22.648588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:22.649791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:22.650456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:23.155769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:23.157110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:23.192075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:23.193112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:23.202134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:23.202858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:23.430381 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:23.446612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:23.452877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:23.454262 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01a49971-7bf2-4ec2-a4dc-25b505887f63 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.824733 Jul 28 12:05:23.455683 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2995/5987] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:22 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:23.607286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0ef5fe5c-7f95-4179-aac2-ea862218f5ef req-f227f651-6d4f-48d8-ab78-c0ea96487c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "name": "network-vif-plugged", "status": "completed", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:23.637647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0ef5fe5c-7f95-4179-aac2-ea862218f5ef req-f227f651-6d4f-48d8-ab78-c0ea96487c34 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:23.638487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0ef5fe5c-7f95-4179-aac2-ea862218f5ef req-f227f651-6d4f-48d8-ab78-c0ea96487c34 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:23.675443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0ef5fe5c-7f95-4179-aac2-ea862218f5ef req-f227f651-6d4f-48d8-ab78-c0ea96487c34 service nova] Creating event network-vif-plugged:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:05:23.698812 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0ef5fe5c-7f95-4179-aac2-ea862218f5ef req-f227f651-6d4f-48d8-ab78-c0ea96487c34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095196 Jul 28 12:05:23.699847 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2996/5988] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:05:23.755375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:23.767442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6794e447-7d2b-46b8-b8f9-94f8f9554103 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.619756 Jul 28 12:05:23.768836 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2993/5989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:23 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:24.489173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:24.494564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:24.516708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:24.519173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:24.521915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:24.523061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:24.795060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:24.796546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:24.817835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:24.819773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:24.821788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:24.824067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:24.830661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:24.839504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:24.844755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:24.850039 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d464c858-cc3a-45b0-ac62-b6d44be5fa0b tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.369383 Jul 28 12:05:24.863472 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2997/5990] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:24 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:25.094807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:25.113957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7e21300-7e46-48ad-9028-8692fd8fb680 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.325717 Jul 28 12:05:25.114565 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2994/5991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:24 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:05:25.880233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:25.881419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:25.895770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:25.896603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:25.897746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:25.898456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:25.941661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:26.140191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:26.140819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:26.154001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:26.154728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:26.157629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:26.158090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:26.177975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:26.194749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:26.196285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:26.197527 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-909d2d11-62e2-4f4c-b6af-43965c948e4a tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.321923 Jul 28 12:05:26.215254 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2998/5992] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:25 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:26.322207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:26.332866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd82d79b-ff20-4343-ac02-55b48038e806 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.196420 Jul 28 12:05:26.348914 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2995/5993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:26 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:27.221469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:27.222420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:27.239380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:27.240047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:27.242447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:27.244893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:27.357515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:27.358143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:27.379355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:27.379823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:27.380628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:27.381079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:27.824101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:27.845385 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b130d1df-0830-4097-b052-460343a8d8fb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.491436 Jul 28 12:05:27.862422 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2996/5994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:27 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:27.938569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:27.962020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:27.970448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:27.970448 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf8eb3eb-8645-4762-9385-e6e04a46d1a1 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.749447 Jul 28 12:05:27.970448 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 2999/5995] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:27 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:28.870767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:28.871418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:28.881409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:28.882166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:28.883552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:28.884257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:29.002094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:29.003904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:29.024424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:29.025449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:29.028208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:29.028885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:29.334294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:29.344062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-25952200-facd-4ce3-9c6b-3cdebb74156d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.477943 Jul 28 12:05:29.349919 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2997/5996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:28 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:29.474069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:29.485380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:29.498655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:29.504413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b059dfde-e401-4050-8fdc-517f9ff64651 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.503412 Jul 28 12:05:29.505061 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3000/5997] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:28 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:30.380923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:30.381340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:30.395449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:30.397009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:30.403338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:30.403941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:30.532644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:30.533162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:30.542349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:30.549521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:30.550735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:30.551392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:30.939033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:30.964525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77180b23-f2a3-4f4d-ab59-1847e6252762 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1392 microversion: 2.1 time: 0.583115 Jul 28 12:05:30.978223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2998/5998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:30 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:31.061722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:31.085987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:31.092602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:31.094212 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95facc22-156a-4428-8d22-a58d90185638 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.565256 Jul 28 12:05:31.095894 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3001/5999] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:30 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:31.991515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:31.992696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:32.000276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.000731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.001512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.001946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.121755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:32.122689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:32.137224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:32.139606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.140266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.141235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.141831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.160163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:32.170309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d8e8912-4a9e-4f1f-9c96-c7fd98cd2cf3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1565 microversion: 2.1 time: 0.182455 Jul 28 12:05:32.186827 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 2999/6000] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:31 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:32.193108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:32.193931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:32.201832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.202297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.203103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:32.203702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:32.380564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:32.389173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49917ffc-85d9-48e6-b833-ab362234bd18 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1565 microversion: 2.1 time: 0.200846 Jul 28 12:05:32.389855 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3000/6001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:32 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:32.570451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:32.580810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:32.582822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:32.584355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ef3b75a-5336-4cf4-a9f0-760edb150fed tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.469688 Jul 28 12:05:32.585436 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3002/6002] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:32 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:33.606939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:33.607591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:33.614545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:33.615377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:33.616333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:33.617577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:33.848847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:33.855875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:33.865484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:33.867286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:33.868788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49477c37-ddcf-486b-8ac2-298d894d6fd9 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.265728 Jul 28 12:05:33.874359 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3001/6003] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:33 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:34.241080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:34.241740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:34.243306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0183aa65-72bf-4309-bd96-a545bf5fa64c req-438a6a81-bc2c-45df-9313-c9c11987b9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:34.253397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:34.253763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0183aa65-72bf-4309-bd96-a545bf5fa64c req-438a6a81-bc2c-45df-9313-c9c11987b9ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:34.253906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:34.254219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0183aa65-72bf-4309-bd96-a545bf5fa64c req-438a6a81-bc2c-45df-9313-c9c11987b9ed service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:34.254627 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:34.255156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:34.268440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0183aa65-72bf-4309-bd96-a545bf5fa64c req-438a6a81-bc2c-45df-9313-c9c11987b9ed service nova] Creating event network-changed:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:05:34.274173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0183aa65-72bf-4309-bd96-a545bf5fa64c req-438a6a81-bc2c-45df-9313-c9c11987b9ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036750 Jul 28 12:05:34.278107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3002/6004] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:05:34.520168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:34.529066 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73c7b940-23cd-4f0c-a8ec-4e9e335e7f54 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1565 microversion: 2.1 time: 0.292850 Jul 28 12:05:34.530200 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3003/6005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:05:34 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1565 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:05:34.892839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:34.895708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:34.903531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:34.904345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:34.905433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:34.906030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:35.263147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:35.276230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:35.278001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:35.283095 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2804d8ff-f4d5-4ae0-9bae-e8131b43ff87 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.394212 Jul 28 12:05:35.283962 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3003/6006] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:34 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:36.306533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:36.307176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:36.318191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:36.322177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:36.328916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:36.329673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:36.920599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:36.933166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:36.935544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:36.936994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db1636fc-5aa4-4f64-b7b4-46c22965d3ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.635095 Jul 28 12:05:36.958531 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3004/6007] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:36 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:37.966114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:37.967234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:37.970379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:05:37.983283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:37.983739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:37.984529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:37.984965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:38.247063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:38.259056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:38.263339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:38.265758 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-975f17eb-2d7a-4a03-842a-834a2adb5d68 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.303601 Jul 28 12:05:38.268271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3004/6008] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:37 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:39.295931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:39.296619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:39.310285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:39.315662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:39.316726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:39.317478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:39.531149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:39.541628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:39.543528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:39.544902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2232f5e-cfc9-444b-b82d-a6acf6ae4ba8 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.253952 Jul 28 12:05:39.546195 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3005/6009] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:39 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:40.569491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:40.570246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:40.581096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:40.583736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:40.605915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:40.608829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:40.846887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:40.869784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:40.872878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:40.874220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8111c933-bf8a-46ce-afd2-9104cac3a5ab tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.308787 Jul 28 12:05:40.878711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3005/6010] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:40 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:41.289416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f019d497-f123-4224-be56-28f2429a1ee6 req-fa8c7786-9a65-43cf-b4a1-14febf9295c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "name": "network-vif-plugged", "status": "completed", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:05:41.320174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f019d497-f123-4224-be56-28f2429a1ee6 req-fa8c7786-9a65-43cf-b4a1-14febf9295c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:41.320698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f019d497-f123-4224-be56-28f2429a1ee6 req-fa8c7786-9a65-43cf-b4a1-14febf9295c9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:41.344871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f019d497-f123-4224-be56-28f2429a1ee6 req-fa8c7786-9a65-43cf-b4a1-14febf9295c9 service nova] Creating event network-vif-plugged:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h1-851368-1 Jul 28 12:05:41.359022 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f019d497-f123-4224-be56-28f2429a1ee6 req-fa8c7786-9a65-43cf-b4a1-14febf9295c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074519 Jul 28 12:05:41.359721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3006/6011] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:05:41.909433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:41.910101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:41.920018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:41.920474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:41.921912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:41.922419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:42.187265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:42.198417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:42.200131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:42.201505 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-791c0d4b-cead-44b0-80d4-b336f25a0635 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.296811 Jul 28 12:05:42.208133 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3006/6012] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:41 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:43.226728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:43.227569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:43.234411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:43.234999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:43.236022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:43.236561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:43.445119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:43.453762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:43.455315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:43.457871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bbd4ec40-4734-43e1-805f-954d28c2ff8f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1731 microversion: 2.20 time: 0.236179 Jul 28 12:05:43.459117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3007/6013] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:43 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:05:44.487354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:05:44.487983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:05:44.497384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:44.497794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:44.499247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:05:44.499728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:05:44.678865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:44.688478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:44.690414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:05:44.691735 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0bae9b90-706d-4500-84da-32be6538daaa tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1718 microversion: 2.20 time: 0.209748 Jul 28 12:05:44.692361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3007/6014] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:05:44 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1718 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:06:02.960211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:02.962648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:02.965075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=11 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:02.966135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=54 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:02.972466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:02.972917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:02.973704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:02.974145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:03.042646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8f250f7-c66d-4b55-9e3d-5903d2c405c9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action" status: 200 len: 24572 microversion: 2.1 time: 0.086546 Jul 28 12:06:03.043554 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3008/6015] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:06:02 2022] POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action => generated 24572 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:06:33.432973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:33.433591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:33.435964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:33.436819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=33 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:33.442737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.443226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.444506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.444943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.575721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:33.583284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-af544477-1f69-4338-b3f2-d2d27f72c8cc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1684 microversion: 2.1 time: 0.154153 Jul 28 12:06:33.583859 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3008/6016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:33 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:33.686778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:33.689041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:33.691690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:33.692368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:33.699801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.700258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.701067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.701511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.764625 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1430334e-a1a8-49c4-93a4-b75dc50af420 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action" status: 200 len: 32641 microversion: 2.1 time: 0.082331 Jul 28 12:06:33.765275 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3009/6017] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:06:33 2022] POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action => generated 32641 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:06:33.932855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:33.933565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:33.939611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.940064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.940825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:33.941258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:33.970399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0564d13b-ed27-45a9-b9a8-5c6bc7fe8776 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Action: 'create', calling method: .version_select at 0x7f2eb1926af0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1592907955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuIhjr7j9iMqCCaetc7gh7Bf5EzTYuJUCW6oCgWUgxl6oMVX5JnFLxlAh1KQIy08BatM6ARHrGaOKBbgCJJm6o0Cf54b2Q+1jOd0GmwLGHVo8UfDVeNHgOhi7DAZoHDcA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:33.988745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0564d13b-ed27-45a9-b9a8-5c6bc7fe8776 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Getting quotas for project 067a1994957349daa5e36bc922db7ed3. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:06:33.995631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0564d13b-ed27-45a9-b9a8-5c6bc7fe8776 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Getting quotas for user 7da70222a4ee42c18648c364309874d2 and project 067a1994957349daa5e36bc922db7ed3. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:06:34.019105 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0564d13b-ed27-45a9-b9a8-5c6bc7fe8776 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052856 Jul 28 12:06:34.025322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3010/6018] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:06:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:06:34.070267 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-485f6cca-7cb0-4dc0-8e64-d9b6493f9f03 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1835 microversion: 2.1 time: 0.141021 Jul 28 12:06:34.070869 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3009/6019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:33 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1835 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:34.097806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:34.101450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:34.108640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:34.109114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:34.110024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:34.110501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:34.137160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lazy-loading 'flavor' on Instance uuid 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:06:34.149843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Going to try to live migrate instance to another host {{(pid=119236) live_migrate /opt/stack/nova/nova/compute/api.py:5431}} Jul 28 12:06:35.052197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-37633657", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9aaef8d0-361a-4781-ba17-46d6c372cbcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1592907955", "security_groups": [{"name": "tempest-secgroup-smoke-395815301"}], "networks": [{"uuid": "417b593a-8e9f-4f00-ad3c-db8bbccb9fc9"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:35.168408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] validate_networks() for [('417b593a-8e9f-4f00-ad3c-db8bbccb9fc9', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:06:36.004713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:06:36.005148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:06:36.005632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:06:36.006051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:06:36.006471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:06:36.015568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:36.016023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:36.016826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:36.017270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:36.034764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Getting quotas for project 067a1994957349daa5e36bc922db7ed3. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:06:36.040781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Getting quotas for user 7da70222a4ee42c18648c364309874d2 and project 067a1994957349daa5e36bc922db7ed3. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:06:36.106628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:06:36.109542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9aaef8d0-361a-4781-ba17-46d6c372cbcb',volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:06:36.109700 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c85c42b4-641a-466a-bb2c-cb3357a0a150 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action" status: 202 len: 0 microversion: 2.1 time: 2.016063 Jul 28 12:06:36.110383 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3011/6020] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:06:34 2022] POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action => generated 0 bytes in 2018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:06:36.120229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:36.120413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:36.127857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:36.128313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:36.129097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:36.129540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:36.255873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e7e5f62-0046-46b4-829f-cca3fc508a18 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.207601 Jul 28 12:06:36.257080 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3010/6021] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:06:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 12:06:36.267893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c011dcd6-825c-40fc-8059-8dcdb28f53c8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:36.269080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c011dcd6-825c-40fc-8059-8dcdb28f53c8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:36.317621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:36.331271 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6af3c154-4b7b-41ac-96e8-d136efecedbc tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.214864 Jul 28 12:06:36.331810 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3012/6022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:36 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:36.334065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c011dcd6-825c-40fc-8059-8dcdb28f53c8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:36.342916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c011dcd6-825c-40fc-8059-8dcdb28f53c8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1097 microversion: 2.1 time: 0.078887 Jul 28 12:06:36.343835 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3011/6023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:36 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1097 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:37.355810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:37.356440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:37.364088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:37.364630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:37.364752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:37.366334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:37.372772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:37.373563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:37.377363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:37.378140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:37.379173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:37.380404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:37.495384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:37.506597 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6107959f-6b2a-4436-8b4d-8f8ea65eaf95 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1213 microversion: 2.1 time: 0.145555 Jul 28 12:06:37.507453 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3012/6024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:37 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:37.648247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:37.664766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7b03d54-faa2-438e-ae15-4cb47ac15473 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.313981 Jul 28 12:06:37.665778 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3013/6025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:37 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:37.878566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-fd18a2bf-467a-4b41-b543-cec97729be1b req-cc145abf-4d2d-4eb5-8727-b5c2edcd81d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "name": "network-vif-unplugged", "status": "completed", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:37.892216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd18a2bf-467a-4b41-b543-cec97729be1b req-cc145abf-4d2d-4eb5-8727-b5c2edcd81d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:37.893737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-fd18a2bf-467a-4b41-b543-cec97729be1b req-cc145abf-4d2d-4eb5-8727-b5c2edcd81d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:37.906917 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-fd18a2bf-467a-4b41-b543-cec97729be1b req-cc145abf-4d2d-4eb5-8727-b5c2edcd81d1 service nova] Creating event network-vif-unplugged:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:06:37.918916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-fd18a2bf-467a-4b41-b543-cec97729be1b req-cc145abf-4d2d-4eb5-8727-b5c2edcd81d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.236410 Jul 28 12:06:37.920212 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3013/6026] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:06:38.528100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:38.529258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:38.547867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:38.548449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:38.556931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:38.557541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:38.691459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:38.692186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:38.700897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:38.701493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:38.702974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:38.703596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:38.904574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:38.913897 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a652f5f8-ea10-4a6f-8b02-aa03032f7b7f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1280 microversion: 2.1 time: 0.389931 Jul 28 12:06:38.914999 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3014/6027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:38 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:38.997404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:39.005525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae299b6a-4a6c-4ccb-a4f0-5df30dbc49a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.319376 Jul 28 12:06:39.006229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3014/6028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:38 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:39.353364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fccb22ea-0bf5-4be4-9794-e6211aec9f14 req-546371cb-24f7-477a-a8a4-af6acb9f3126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:39.369228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fccb22ea-0bf5-4be4-9794-e6211aec9f14 req-546371cb-24f7-477a-a8a4-af6acb9f3126 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:39.369967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fccb22ea-0bf5-4be4-9794-e6211aec9f14 req-546371cb-24f7-477a-a8a4-af6acb9f3126 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:39.382710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fccb22ea-0bf5-4be4-9794-e6211aec9f14 req-546371cb-24f7-477a-a8a4-af6acb9f3126 service nova] Creating event network-changed:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:06:39.391721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fccb22ea-0bf5-4be4-9794-e6211aec9f14 req-546371cb-24f7-477a-a8a4-af6acb9f3126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045855 Jul 28 12:06:39.395197 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3015/6029] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:39.935482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6c53cdf4-311c-4076-8d73-53f0138c59db req-c415b995-5195-4a72-9a8e-2da8a226e4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:39.940439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:39.942194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:39.951099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:39.951929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:39.954298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6c53cdf4-311c-4076-8d73-53f0138c59db req-c415b995-5195-4a72-9a8e-2da8a226e4ae service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:39.954934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6c53cdf4-311c-4076-8d73-53f0138c59db req-c415b995-5195-4a72-9a8e-2da8a226e4ae service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:39.955853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:39.956621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:39.976106 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6c53cdf4-311c-4076-8d73-53f0138c59db req-c415b995-5195-4a72-9a8e-2da8a226e4ae service nova] Creating event network-changed:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:06:39.983916 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6c53cdf4-311c-4076-8d73-53f0138c59db req-c415b995-5195-4a72-9a8e-2da8a226e4ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050772 Jul 28 12:06:39.985306 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3015/6030] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:40.029708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:40.030633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:40.038433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:40.040159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:40.041238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:40.042032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:40.270339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:40.280585 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10b8f715-130c-4239-951f-9b81bf4d2cc1 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1280 microversion: 2.1 time: 0.346532 Jul 28 12:06:40.281695 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3016/6031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:39 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:40.346989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:40.359476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c71730b4-17bc-48bc-bec3-36454e5a3de9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.335094 Jul 28 12:06:40.360638 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3016/6032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:40 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:41.302042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:41.302701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:41.309704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:41.310176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:41.310953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:41.311445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:41.382531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:41.383062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:41.390440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:41.390977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:41.391716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:41.392164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:41.477584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:41.485473 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fcd6d91-82d2-4148-a372-f8652d233543 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1280 microversion: 2.1 time: 0.187450 Jul 28 12:06:41.486202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3017/6033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:41 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:41.544435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:41.552153 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dae629b3-176f-4a1c-8616-0f13b5db5888 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.174257 Jul 28 12:06:41.552776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3017/6034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:41 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:42.508207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:42.508831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:42.516128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:42.516629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:42.517466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:42.517947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:42.574849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:42.575509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:42.582991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:42.583477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:42.584260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:42.584928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:42.710166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:42.718086 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84fb2005-a75b-4c6c-8801-bd0d05ea56c5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1280 microversion: 2.1 time: 0.214729 Jul 28 12:06:42.718674 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3018/6035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:42 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:42.756635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:42.764127 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f218f0f-6577-4fdd-9801-56ac617caa20 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.193183 Jul 28 12:06:42.764693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3018/6036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:42 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:43.664964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7254761e-a9e2-4ed9-a27e-e41cb766ea6f req-533f24dd-20b5-4f59-8934-7550c0836afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "name": "network-vif-unplugged", "status": "completed", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:43.675950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7254761e-a9e2-4ed9-a27e-e41cb766ea6f req-533f24dd-20b5-4f59-8934-7550c0836afb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:43.676496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7254761e-a9e2-4ed9-a27e-e41cb766ea6f req-533f24dd-20b5-4f59-8934-7550c0836afb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:43.689137 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7254761e-a9e2-4ed9-a27e-e41cb766ea6f req-533f24dd-20b5-4f59-8934-7550c0836afb service nova] Creating event network-vif-unplugged:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h1-851368-1 Jul 28 12:06:43.694911 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7254761e-a9e2-4ed9-a27e-e41cb766ea6f req-533f24dd-20b5-4f59-8934-7550c0836afb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033836 Jul 28 12:06:43.695658 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3019/6037] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:43.739907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:43.741135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:43.748222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:43.748954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:43.749803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:43.750251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:43.785013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:43.785950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:43.792485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:43.793211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:43.794220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:43.794820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:43.982721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:43.992563 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-063fe906-40d0-49be-a3ad-96e8527bdc44 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.256767 Jul 28 12:06:44.002126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:44.003473 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3019/6038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:43 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:44.017241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:44.025355 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f37c23e-3183-4ac2-8460-c12a7fcf8fe3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1694 microversion: 2.1 time: 0.244462 Jul 28 12:06:44.026300 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3020/6039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:43 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:45.015296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:45.015989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:45.023556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.024007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.024779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.025214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.047716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:45.048329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:45.055580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.056251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.057051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.057486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.316322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:45.326525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-984a379e-423c-4eb1-aa10-377eb4ddaf87 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.315031 Jul 28 12:06:45.330926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:45.338753 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3020/6040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:45 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:45.347347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91f7e4a5-a519-4b53-8c8f-c7ff4ebddf6e tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1684 microversion: 2.1 time: 0.304052 Jul 28 12:06:45.348112 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3021/6041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:45 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1684 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:45.368133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:45.368860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:45.375116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.375575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.376342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.376784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.508040 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06506eb2-a71f-481d-a532-7071e9371815 tempest-TestNetworkAdvancedServerOps-886503503 tempest-TestNetworkAdvancedServerOps-886503503-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1835 microversion: 2.1 time: 0.143577 Jul 28 12:06:45.508558 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3021/6042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:45 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1835 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:45.529258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:45.529886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:45.536060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.536518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.537317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.537758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.686147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:45.695413 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3bf7c24c-3e2f-449e-a7bc-b52d7ceea1ad tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1684 microversion: 2.1 time: 0.169875 Jul 28 12:06:45.697099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3022/6043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:45 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:45.810201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:45.812997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:45.821051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.821605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.822602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:45.823274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:45.884073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddee1302-abbb-47d1-aff0-5c1327ce8237 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action" status: 200 len: 38497 microversion: 2.1 time: 0.077709 Jul 28 12:06:45.885109 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3022/6044] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:06:45 2022] POST /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3/action => generated 38497 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:06:46.352448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:46.353255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:46.362169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:46.362777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:46.363729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:46.364851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:46.513947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:46.522173 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-183af6dc-fa93-45c1-8fc3-5b5a67276882 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.175771 Jul 28 12:06:46.522781 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3023/6045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:46 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:46.898020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:46.898615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:46.904476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8acad68f-e3f2-4040-8d96-b0957932205c req-ae3381d7-d90e-4d48-8563-f28bd94c763b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:46.914887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8acad68f-e3f2-4040-8d96-b0957932205c req-ae3381d7-d90e-4d48-8563-f28bd94c763b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:46.915565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8acad68f-e3f2-4040-8d96-b0957932205c req-ae3381d7-d90e-4d48-8563-f28bd94c763b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:46.916204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:46.916902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:46.919943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:46.920585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:46.921561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:46.922003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:46.928673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8acad68f-e3f2-4040-8d96-b0957932205c req-ae3381d7-d90e-4d48-8563-f28bd94c763b service nova] Creating event network-changed:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h2-851368-1 Jul 28 12:06:46.936761 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8acad68f-e3f2-4040-8d96-b0957932205c req-ae3381d7-d90e-4d48-8563-f28bd94c763b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035744 Jul 28 12:06:46.937863 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3024/6046] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:46.952505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:06:47.054731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95714135-5fd5-457a-bf09-48920e891981 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 204 len: 0 microversion: 2.1 time: 0.160475 Jul 28 12:06:47.055540 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3023/6047] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:06:46 2022] DELETE /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:06:47.065046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:47.065902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:47.074015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:47.074605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:47.075607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:47.076054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:47.242956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:47.250747 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54fce7af-8242-4a8c-bf57-507b97be1a7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1690 microversion: 2.1 time: 0.190495 Jul 28 12:06:47.255104 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3025/6048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:47 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:47.543957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:47.544696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:47.550923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:47.551409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:47.552194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:47.553234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:48.110713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:48.122515 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49eae5a9-160a-4805-bc29-845d6b00a63a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.582567 Jul 28 12:06:48.124619 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3024/6049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:47 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:48.274388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:48.275320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:48.282330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:48.282791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:48.283602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:48.284044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:48.347293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:48.355227 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7236a6d-d280-4fe3-8670-a1e1aa99f508 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 200 len: 1504 microversion: 2.1 time: 0.085641 Jul 28 12:06:48.355818 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3026/6050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:48 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 1504 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:48.954299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-caf33ef4-bdb2-4409-a0fe-6b2ab5e5804e req-4a618025-0645-4d0a-9899-07f61d95ed7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5dd1a6-535f-4d3c-9c45-d659f7984fd3", "name": "network-vif-deleted", "tag": "5a5f61b7-7ca3-4ed4-9586-97e388badfb4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:48.973447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-caf33ef4-bdb2-4409-a0fe-6b2ab5e5804e req-4a618025-0645-4d0a-9899-07f61d95ed7b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:48.974894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-caf33ef4-bdb2-4409-a0fe-6b2ab5e5804e req-4a618025-0645-4d0a-9899-07f61d95ed7b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:48.992720 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-caf33ef4-bdb2-4409-a0fe-6b2ab5e5804e req-4a618025-0645-4d0a-9899-07f61d95ed7b service nova] Creating event network-vif-deleted:5a5f61b7-7ca3-4ed4-9586-97e388badfb4 for instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 on n-h2-851368-1 Jul 28 12:06:48.999762 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-caf33ef4-bdb2-4409-a0fe-6b2ab5e5804e req-4a618025-0645-4d0a-9899-07f61d95ed7b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051168 Jul 28 12:06:49.000419 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3025/6051] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:49.145495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:49.146118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:49.154101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.154597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.155484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.155911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.160165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:49.288917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:49.297527 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0840ef4d-b7dd-4be4-94f2-be71562933f4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.156680 Jul 28 12:06:49.298195 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3027/6052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:49 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:06:49.375995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:49.376708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:49.383008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.383496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.384277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.384721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.398470 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] HTTP exception thrown: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Request method failure captured: Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 HTTP/1.1 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nozoHNvSRavIkmD8AajooQaWwNnmMbGdCZ4di285oby44AJzbKAYneiequjHATCTb5eKctYzuptKNmfANbi25s6SPH1xtfH8wUfnPCq739fqsKLpM-fJGBYq-nvo4vTfKz8gNFWsmKyi1YQfHanxAJGiqsL7o98Ri0E2-SKBgmv3-c Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}] Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: ad897d5445224ba48dc242fb71a77480 Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '0b5dd1a6-535f-4d3c-9c45-d659f7984fd3'} Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:49.400045 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Returning 404 to user: Instance 0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8400470a-3c53-45b5-a580-6dba55587a98 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3" status: 404 len: 111 microversion: 2.1 time: 0.029803 Jul 28 12:06:49.404487 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3026/6053] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:49 2022] GET /compute/v2.1/servers/0b5dd1a6-535f-4d3c-9c45-d659f7984fd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:06:49.695395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:49.697596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:49.703655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.704112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.704887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.705349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.734699 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-33bdca2e-fae7-44da-96f1-1dc06ecda859 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043782 Jul 28 12:06:49.735297 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3028/6054] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Jul 28 12:06:49 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:49.796327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:49.796833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:49.802849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.803343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.804112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.804552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.823691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:06:49.832611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:06:49.913214 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6c01006-804b-4847-850d-4bfdbb212778 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 204 len: 0 microversion: 2.20 time: 0.119801 Jul 28 12:06:49.913862 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3027/6055] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 12:06:49 2022] DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:06:49.922620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:49.923309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:49.929998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.930460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:49.931301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:49.931749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:50.161106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:50.169924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:50.171389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:50.172580 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fb90049-be59-4977-a62c-cd78ba8a1d66 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.253998 Jul 28 12:06:50.173150 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3029/6056] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:49 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 12:06:50.318858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:50.319597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:50.327184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:50.327645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:50.328426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:50.328867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:50.618028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:50.625611 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5abebf74-72bb-4edc-9cd5-afdb62c4dfc9 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.311356 Jul 28 12:06:50.626184 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3028/6057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:50 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:51.196312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:51.197509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:51.205608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:51.206688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:51.207521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:51.207969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:51.401798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:51.411060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:51.412932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:51.414612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98c78cbc-523d-4f8a-9495-73a4d12bb1d7 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.222734 Jul 28 12:06:51.415416 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3030/6058] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:51 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:06:51.646218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:51.646865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:51.654561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:51.655306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:51.656311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:51.656781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:51.809237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:51.820951 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-15f52b97-17ea-48b6-bda9-3c41dac7e2a5 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.178582 Jul 28 12:06:51.821775 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3029/6059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:51 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:52.436791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:52.437407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:52.444918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:52.445409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:52.446199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:52.446643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:52.594873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:52.603590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:52.605098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:52.606287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5d143b3-a932-49c9-977e-a0c82ff3ca3f tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1724 microversion: 2.20 time: 0.173465 Jul 28 12:06:52.606857 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3031/6060] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:52 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:06:52.841923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:52.842537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:52.850026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:52.850970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:52.851932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:52.852586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:53.013127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:53.020673 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-084e7100-fecb-4824-85f2-502d1d13484e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.182677 Jul 28 12:06:53.021776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3030/6061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:52 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:53.241103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fb5b0f38-414c-4781-9b55-206d08ebcc87 req-d5ed6313-ce83-41b2-8b6d-8f6df67d2fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "name": "network-vif-plugged", "status": "completed", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:53.253233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fb5b0f38-414c-4781-9b55-206d08ebcc87 req-d5ed6313-ce83-41b2-8b6d-8f6df67d2fc9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:53.253983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fb5b0f38-414c-4781-9b55-206d08ebcc87 req-d5ed6313-ce83-41b2-8b6d-8f6df67d2fc9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:53.266870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fb5b0f38-414c-4781-9b55-206d08ebcc87 req-d5ed6313-ce83-41b2-8b6d-8f6df67d2fc9 service nova] Creating event network-vif-plugged:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:06:53.273529 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fb5b0f38-414c-4781-9b55-206d08ebcc87 req-d5ed6313-ce83-41b2-8b6d-8f6df67d2fc9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036344 Jul 28 12:06:53.274934 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3032/6062] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:06:53.637893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:53.640859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:53.653811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:53.654267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:53.655051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:53.659751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:53.676884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0b3320fe-6a39-446f-8009-4b1aace65e33 req-964455d5-4e6a-4113-861d-6573dcd6aa1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fdd6a4-dc1d-421f-850e-c679829a96d6", "name": "network-vif-deleted", "tag": "a622cc51-f079-41fc-ad6b-27e297ca0600"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:53.704886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0b3320fe-6a39-446f-8009-4b1aace65e33 req-964455d5-4e6a-4113-861d-6573dcd6aa1d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:53.707688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0b3320fe-6a39-446f-8009-4b1aace65e33 req-964455d5-4e6a-4113-861d-6573dcd6aa1d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:53.764536 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0b3320fe-6a39-446f-8009-4b1aace65e33 req-964455d5-4e6a-4113-861d-6573dcd6aa1d service nova] Creating event network-vif-deleted:a622cc51-f079-41fc-ad6b-27e297ca0600 for instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 on n-h1-851368-1 Jul 28 12:06:53.780443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0b3320fe-6a39-446f-8009-4b1aace65e33 req-964455d5-4e6a-4113-861d-6573dcd6aa1d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108921 Jul 28 12:06:53.789780 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3033/6063] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:06:53.798666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dacff78-351c-4849-b1fd-469e17b678fa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '.version_select at 0x7f2eb189c3a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:53.856430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dacff78-351c-4849-b1fd-469e17b678fa tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1879413919" status: 202 len: 0 microversion: 2.1 time: 0.064933 Jul 28 12:06:53.859488 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3034/6064] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1879413919 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:06:53.870668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:53.891561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63a55d34-3d72-4946-96ac-31a63eec4053 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: .version_select at 0x7f2eb19773a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1828900009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIFNz7S6SdMRFH8oC5ilAuj2exOYbKX7Spkxuqf1vILCzOxpfnQrrSqk9L9iKx4FfUHi/tNx6cgfXtIGlifx0XcxXKzo4XYh2ILC0hTxY/TBj62eHF3jk30eYI8WQXNFw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:53.894251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:53.897069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '226bb250399d41b89d0a048ddb2d18d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2dc02f7ae948c99791992b50ef3a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:53.901641 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-334a1d08-585d-48b1-8a6e-d1a129747259 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 200 len: 1656 microversion: 2.20 time: 0.275375 Jul 28 12:06:53.912010 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3031/6065] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:53 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 1656 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 12:06:53.919133 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-63a55d34-3d72-4946-96ac-31a63eec4053 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:06:53.931429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-63a55d34-3d72-4946-96ac-31a63eec4053 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:06:53.962869 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63a55d34-3d72-4946-96ac-31a63eec4053 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.075002 Jul 28 12:06:53.963438 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3035/6066] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:06:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:06:54.044917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:54.046238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:54.054158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:54.054622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:54.055443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:54.055883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:54.293405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:54.304829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bbb25756-108b-46cb-9f8b-c415a86d79d6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1268 microversion: 2.1 time: 0.265266 Jul 28 12:06:54.306052 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3032/6067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:54 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1268 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:54.928037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:54.928792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:54.939184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:54.939644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:54.940540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:54.941128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:54.959989 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 HTTP/1.1 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f8fdd6a4-dc1d-421f-850e-c679829a96d6'} Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:54.961927 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0cb82ec-529a-422c-969f-25e2fcce327d tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 404 len: 111 microversion: 2.20 time: 0.042524 Jul 28 12:06:54.970773 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3036/6068] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:54 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:06:54.977399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e66a1606-8d0f-4c8c-bdad-4373b8a264c2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '.version_select at 0x7f2eb1a375e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:55.000785 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e66a1606-8d0f-4c8c-bdad-4373b8a264c2 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484933349" status: 204 len: 0 microversion: 2.20 time: 0.030649 Jul 28 12:06:55.004625 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3033/6069] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Jul 28 12:06:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484933349 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 12:06:55.325866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:55.326411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:55.333515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:55.334660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:55.336848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:55.337529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:55.598213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:55.606444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ebc23760-4800-403e-8811-947f2d90653e tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1458 microversion: 2.1 time: 0.284486 Jul 28 12:06:55.619918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3037/6070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:55 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1458 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:55.629979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:55.631328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:55.645100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:55.646298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:55.648122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:55.648583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:56.133993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:06:56.142633 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d1e13c9-3e9c-44d5-a7f9-d02a5f17bd4f tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1458 microversion: 2.1 time: 0.517153 Jul 28 12:06:56.143254 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3034/6071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:06:55 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1458 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:06:57.973404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:57.973912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:57.983741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:57.984395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:57.985354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:57.985952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:58.001860 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 HTTP/1.1 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f8fdd6a4-dc1d-421f-850e-c679829a96d6'} Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:06:58.003783 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.008355 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.009907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:06:58.010932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a8b09901-25b5-4577-aab5-8dbd94542e38 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 404 len: 111 microversion: 2.20 time: 0.041697 Jul 28 12:06:58.020317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:06:58.021841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: f8fdd6a4-dc1d-421f-850e-c679829a96d6] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:06:58.027359 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3038/6072] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 12:06:57 2022] DELETE /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:06:58.030624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:58.031376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:58.032357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:58.032959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:58.054313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 HTTP/1.1 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f8fdd6a4-dc1d-421f-850e-c679829a96d6'} Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.056153 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance f8fdd6a4-dc1d-421f-850e-c679829a96d6 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:06:58.061742 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d7cabf6-5ead-4dd2-aed4-2989e1a0cea4 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6" status: 404 len: 111 microversion: 2.20 time: 0.041376 Jul 28 12:06:58.073648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3035/6073] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:06:58 2022] GET /compute/v2.1/servers/f8fdd6a4-dc1d-421f-850e-c679829a96d6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:06:58.876400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d8628865-1010-4c34-a9c9-222eef49edcc req-c271248d-048d-4e59-8661-dac5b98c67d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:06:58.897552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d8628865-1010-4c34-a9c9-222eef49edcc req-c271248d-048d-4e59-8661-dac5b98c67d7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:06:58.898011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d8628865-1010-4c34-a9c9-222eef49edcc req-c271248d-048d-4e59-8661-dac5b98c67d7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:06:58.920430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d8628865-1010-4c34-a9c9-222eef49edcc req-c271248d-048d-4e59-8661-dac5b98c67d7 service nova] Creating event network-changed:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:06:58.928196 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d8628865-1010-4c34-a9c9-222eef49edcc req-c271248d-048d-4e59-8661-dac5b98c67d7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055084 Jul 28 12:06:58.934948 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3039/6074] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:07:01.117954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-855a034f-8036-4507-8ece-42d1837776d8 req-560079a8-29f3-4db4-b357-5311106ae253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:01.141885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-855a034f-8036-4507-8ece-42d1837776d8 req-560079a8-29f3-4db4-b357-5311106ae253 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:01.142334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-855a034f-8036-4507-8ece-42d1837776d8 req-560079a8-29f3-4db4-b357-5311106ae253 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:01.160161 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-855a034f-8036-4507-8ece-42d1837776d8 req-560079a8-29f3-4db4-b357-5311106ae253 service nova] Creating event network-changed:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:07:01.167792 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-855a034f-8036-4507-8ece-42d1837776d8 req-560079a8-29f3-4db4-b357-5311106ae253 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053364 Jul 28 12:07:01.168650 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3036/6075] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:07:02.501198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:02.502491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:02.513874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:02.518500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:02.519684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:02.520353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:02.537512 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 HTTP/1.1 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74c8c84f-f851-434c-8489-badf527de660'} Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:07:02.539789 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.544068 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.546930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:07:02.548082 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c00a0c0-d2b9-46c6-ab9c-d1d322ac17ca tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 404 len: 111 microversion: 2.20 time: 0.053072 Jul 28 12:07:02.561762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:02.563493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] [instance: 74c8c84f-f851-434c-8489-badf527de660] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:02.568795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3040/6076] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Jul 28 12:07:02 2022] DELETE /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:07:02.572074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:02.572961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:02.574003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:02.578354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:02.593974 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] HTTP exception thrown: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Request method failure captured: Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 HTTP/1.1 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4np23XXDWqZomQgFgIUaPcAIHZn2UohkZJ90xrtSwGWzdtNSn3jdwbusZfAU0PO6auMEvsasWZzpyXHHtEIx0JJRgBLjNAF7v-0-0UdM-s2zuYckqbHG-pXXGlQur4Ccd9ojfK4GxCn7u96Iahs_dT8J4Imz2MASNqVF8PB7F5z6maY Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb2dc02f7ae948c99791992b50ef3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb2dc02f7ae948c99791992b50ef3a76"}]}] Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: cb2dc02f7ae948c99791992b50ef3a76 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211989405 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 226bb250399d41b89d0a048ddb2d18d6 Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211989405-project Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74c8c84f-f851-434c-8489-badf527de660'} Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.597318 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. Jul 28 12:07:02.603090 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:07:02.605487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] Returning 404 to user: Instance 74c8c84f-f851-434c-8489-badf527de660 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:07:02.606585 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c5ce5a5-9b2d-477a-9b64-987909d9e6b6 tempest-AttachVolumeShelveTestJSON-211989405 tempest-AttachVolumeShelveTestJSON-211989405-project] 10.222.0.93 "GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660" status: 404 len: 111 microversion: 2.20 time: 0.049787 Jul 28 12:07:02.610910 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3037/6077] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 28 12:07:02 2022] GET /compute/v2.1/servers/74c8c84f-f851-434c-8489-badf527de660 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:07:03.022276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1925087074", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "4c040a7e-83c7-4ecb-a85e-6b9eda34f1b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1828900009", "security_groups": [{"name": "tempest-secgroup-smoke-2131191688"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:03.186705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f88ffc4f-007a-4f27-b06b-6899c802c1e5 req-7cf41b58-0c5a-4f64-a6de-d7dad29101c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:03.210081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f88ffc4f-007a-4f27-b06b-6899c802c1e5 req-7cf41b58-0c5a-4f64-a6de-d7dad29101c0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:03.215354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f88ffc4f-007a-4f27-b06b-6899c802c1e5 req-7cf41b58-0c5a-4f64-a6de-d7dad29101c0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:03.239044 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f88ffc4f-007a-4f27-b06b-6899c802c1e5 req-7cf41b58-0c5a-4f64-a6de-d7dad29101c0 service nova] Creating event network-changed:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:07:03.254784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f88ffc4f-007a-4f27-b06b-6899c802c1e5 req-7cf41b58-0c5a-4f64-a6de-d7dad29101c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065666 Jul 28 12:07:03.256205 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3038/6078] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:07:03.543661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] validate_networks() for [('4c040a7e-83c7-4ecb-a85e-6b9eda34f1b0', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:07:03.943108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:04.487257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:05.113462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:07:05.114659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:07:05.115605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:07:05.116093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:07:05.116587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:07:05.126902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:05.127800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:05.128856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:05.129578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:05.153070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:07:05.160043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Getting quotas for user ad897d5445224ba48dc242fb71a77480 and project 0bd61ccbeb524e1393d665f0fac9f396. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:07:05.175663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:07:05.178248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:07:05.243420 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34e82b19-34ef-4fb8-bba4-2428a695beb1 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.225026 Jul 28 12:07:05.250184 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3041/6079] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:07:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:07:05.258479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a68a2503-08d3-4114-bcbe-71b0ac7760e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:05.260422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a68a2503-08d3-4114-bcbe-71b0ac7760e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:05.271297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:05.340103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a68a2503-08d3-4114-bcbe-71b0ac7760e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:05.350487 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a68a2503-08d3-4114-bcbe-71b0ac7760e5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1267 microversion: 2.1 time: 0.098556 Jul 28 12:07:05.354483 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3039/6080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:05 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:06.376059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:06.377449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:06.386657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:06.387449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:06.388437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:06.389097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:06.483253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:06.501982 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6be1acef-382b-4464-ac25-a1410ec7f002 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1319 microversion: 2.1 time: 0.131644 Jul 28 12:07:06.503524 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3042/6081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:06 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1319 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:07.529395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:07.530102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:07.538304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:07.538755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:07.539559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:07.540117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:07.760311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:07.790032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-00514c98-d8e6-49a9-afa3-bd3b15356137 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.264989 Jul 28 12:07:07.791063 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3040/6082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:07 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:08.177502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ebc90a00-0d94-47fd-8b45-79e70e34d17f req-7c35afab-84f4-4eb5-b538-2a8500a6f470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:08.195804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ebc90a00-0d94-47fd-8b45-79e70e34d17f req-7c35afab-84f4-4eb5-b538-2a8500a6f470 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:08.196272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ebc90a00-0d94-47fd-8b45-79e70e34d17f req-7c35afab-84f4-4eb5-b538-2a8500a6f470 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:08.223810 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ebc90a00-0d94-47fd-8b45-79e70e34d17f req-7c35afab-84f4-4eb5-b538-2a8500a6f470 service nova] Creating event network-changed:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:07:08.232028 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ebc90a00-0d94-47fd-8b45-79e70e34d17f req-7c35afab-84f4-4eb5-b538-2a8500a6f470 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064925 Jul 28 12:07:08.232943 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3043/6083] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:07:08.812241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:08.813142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:08.823052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:08.823052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:08.823052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:08.823052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:08.966474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:08.976353 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76f1380c-88f1-499f-b66c-4eb01cc2458a tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.167797 Jul 28 12:07:08.977122 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3041/6084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:08 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:09.999025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:09.999881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:10.006851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:10.007422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:10.008206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:10.008651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:10.142950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:10.151141 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5780874-7a77-420c-84ce-4cd293b721f7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.157133 Jul 28 12:07:10.151803 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3044/6085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:09 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:11.172269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:11.172890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:11.180375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:11.180844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:11.181617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:11.182062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:11.387321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:11.395998 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4cca1a2f-488c-46d1-8b91-5c0cc4246f82 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.227474 Jul 28 12:07:11.408523 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3042/6086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:11 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:12.417106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:12.418304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:12.425563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:12.426210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:12.427020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:12.427532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:12.570392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:12.580663 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9720a9f0-cb62-439f-a985-2fb0d99a57ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.167393 Jul 28 12:07:12.581493 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3045/6087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:12 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:13.589466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7b1b006e-7e6b-46c0-be65-82a111370e15 req-fca1ab13-04c5-45c9-a823-174ba582ef2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "name": "network-vif-plugged", "status": "completed", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:13.603150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:13.603821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:13.606968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7b1b006e-7e6b-46c0-be65-82a111370e15 req-fca1ab13-04c5-45c9-a823-174ba582ef2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:13.607525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7b1b006e-7e6b-46c0-be65-82a111370e15 req-fca1ab13-04c5-45c9-a823-174ba582ef2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:13.611009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:13.611491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:13.612266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:13.612880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:13.620041 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7b1b006e-7e6b-46c0-be65-82a111370e15 req-fca1ab13-04c5-45c9-a823-174ba582ef2f service nova] Creating event network-vif-plugged:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:07:13.625841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7b1b006e-7e6b-46c0-be65-82a111370e15 req-fca1ab13-04c5-45c9-a823-174ba582ef2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241231 Jul 28 12:07:13.626748 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3043/6088] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:07:13.760842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:13.769597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5863d18-a947-4bc7-b5ce-516d208e00e9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.171271 Jul 28 12:07:13.770184 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3046/6089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:13 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:07:14.793416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:14.794147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:14.801143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:14.801594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:14.802356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:14.802789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:14.942093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:14.951029 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0eb69be4-280a-4ff1-a7a7-cd1e702ebd3d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1393 microversion: 2.1 time: 0.161329 Jul 28 12:07:14.952367 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3044/6090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:14 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:15.974739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:15.975389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:15.978420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:15.979125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:15.984598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:15.985352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:15.986128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:15.986569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:16.128855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:16.136818 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42eb90ef-4cc6-4c97-b42a-3fef3742f961 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1566 microversion: 2.1 time: 0.166880 Jul 28 12:07:16.137553 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3047/6091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:15 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:16.157722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:16.158342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:16.160280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:16.167563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:16.168013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:16.168820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:16.169275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:16.309147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:16.316620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8dff57c8-564d-491f-98a1-5d25f4302580 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1566 microversion: 2.1 time: 0.162814 Jul 28 12:07:16.317197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3045/6092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:16 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:18.068702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:18.069236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:18.076663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:18.077347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:18.077915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-089b6498-e99d-4744-ac17-4ad1c8e36861 req-ec68625f-cf12-47a2-959a-1d2b485a73c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:18.078868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:18.079520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:18.092155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-089b6498-e99d-4744-ac17-4ad1c8e36861 req-ec68625f-cf12-47a2-959a-1d2b485a73c5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:18.092668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-089b6498-e99d-4744-ac17-4ad1c8e36861 req-ec68625f-cf12-47a2-959a-1d2b485a73c5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:18.108934 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-089b6498-e99d-4744-ac17-4ad1c8e36861 req-ec68625f-cf12-47a2-959a-1d2b485a73c5 service nova] Creating event network-changed:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:07:18.114681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-089b6498-e99d-4744-ac17-4ad1c8e36861 req-ec68625f-cf12-47a2-959a-1d2b485a73c5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040286 Jul 28 12:07:18.115657 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3046/6093] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:07:18.262247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:18.277268 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3bedd98-3c6c-4aa8-8831-fb353be0ae7d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1566 microversion: 2.1 time: 0.212613 Jul 28 12:07:18.278642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3048/6094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:18 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:33.269424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:33.270248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:33.288777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e7ce400f-3aa1-4db7-8039-47411e59be30 req-1784daa9-f9a3-40ef-8d45-207682d15599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:33.298918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=17 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:33.299713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:33.308175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:33.310232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:33.310232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:33.311421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:33.311599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:33.314072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=86 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:07:33.319141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e7ce400f-3aa1-4db7-8039-47411e59be30 req-1784daa9-f9a3-40ef-8d45-207682d15599 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:33.319845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e7ce400f-3aa1-4db7-8039-47411e59be30 req-1784daa9-f9a3-40ef-8d45-207682d15599 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:33.347846 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e7ce400f-3aa1-4db7-8039-47411e59be30 req-1784daa9-f9a3-40ef-8d45-207682d15599 service nova] Creating event network-changed:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:07:33.361067 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e7ce400f-3aa1-4db7-8039-47411e59be30 req-1784daa9-f9a3-40ef-8d45-207682d15599 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079013 Jul 28 12:07:33.361723 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3049/6095] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:07:33.375139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:07:33.468088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9fdd8dae-3830-4991-88c9-02cd40434201 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "DELETE /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 204 len: 0 microversion: 2.1 time: 0.204895 Jul 28 12:07:33.469504 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3047/6096] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:07:33 2022] DELETE /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:07:33.480198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:33.481827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:33.491906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:33.492659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:33.493810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:33.494348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:33.647502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:33.656867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-86ca30f9-151d-4081-aecd-d4a8985c67b6 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1583 microversion: 2.1 time: 0.182862 Jul 28 12:07:33.667657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3050/6097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:33 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1583 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:34.680438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:34.681151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:34.688034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:34.688497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:34.689271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:34.689712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:34.894273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:34.902554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3827f76-e26e-47d9-bf77-d482ea342da3 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1583 microversion: 2.1 time: 0.226496 Jul 28 12:07:34.903442 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3048/6098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:34 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1583 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:35.600875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1ba96559-fe1f-4666-9cc0-360470684350 req-0c01de8d-dea7-4ab3-a3cb-6d7a4adb0028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b00f12-d32d-486a-9e10-d1ad9aeb27e3", "name": "network-vif-deleted", "tag": "baa7b584-38b4-44af-8fc9-eb57f6aff7a8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:35.612260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1ba96559-fe1f-4666-9cc0-360470684350 req-0c01de8d-dea7-4ab3-a3cb-6d7a4adb0028 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:35.612712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1ba96559-fe1f-4666-9cc0-360470684350 req-0c01de8d-dea7-4ab3-a3cb-6d7a4adb0028 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:35.625183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1ba96559-fe1f-4666-9cc0-360470684350 req-0c01de8d-dea7-4ab3-a3cb-6d7a4adb0028 service nova] Creating event network-vif-deleted:baa7b584-38b4-44af-8fc9-eb57f6aff7a8 for instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 on n-h2-851368-1 Jul 28 12:07:35.630344 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1ba96559-fe1f-4666-9cc0-360470684350 req-0c01de8d-dea7-4ab3-a3cb-6d7a4adb0028 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033827 Jul 28 12:07:35.631174 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3051/6099] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:07:35.924526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:35.925862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:35.934582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:35.935286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:35.936062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:35.936496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:36.023226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:36.032516 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e5e37276-d320-4f7a-9055-24c550e84f2a tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1228 microversion: 2.1 time: 0.112216 Jul 28 12:07:36.044019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3049/6100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:35 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1228 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:37.057153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:37.058389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:37.065087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:37.065825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:37.066774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:37.067399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:37.152369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:37.164169 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-571c37ea-937d-4043-8712-8c68ee117fc4 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1228 microversion: 2.1 time: 0.112182 Jul 28 12:07:37.165505 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3052/6101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:37 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:38.185596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:38.187238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:38.195371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:38.196140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:38.197419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:38.198266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:38.614766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:38.635845 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb7e15e0-c69a-471f-9d34-ba89e4d62719 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1228 microversion: 2.1 time: 0.454053 Jul 28 12:07:38.649076 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3050/6102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:38 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1228 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:39.657499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:39.658200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:39.674883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:39.675570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:39.676232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:39.676615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:39.758450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:39.777178 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-757d0e4c-e93d-4569-8702-86f1a6b7198d tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1228 microversion: 2.1 time: 0.123798 Jul 28 12:07:39.778154 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3053/6103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:39 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:40.798499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:40.799038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:40.807845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:40.808297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:40.809240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:40.809863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:40.846578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:40.847035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:40.847530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lazy-loading 'fault' on Instance uuid 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:07:40.921820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7da70222a4ee42c18648c364309874d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067a1994957349daa5e36bc922db7ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:07:40.939468 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f63e4dc-0fb7-49b2-9899-95dcfb48c996 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 200 len: 1187 microversion: 2.1 time: 0.136517 Jul 28 12:07:40.940225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3051/6104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:40 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:07:41.986484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:41.987353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] [instance: 52b00f12-d32d-486a-9e10-d1ad9aeb27e3] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:41.994034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:41.994583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:41.995533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:41.996099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:42.016790 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] HTTP exception thrown: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Request method failure captured: Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 HTTP/1.1 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4ntBMJcTN-fBgkwD_ROB3Fq3yrfIqhr5NgWmRBUoKVulh_5ou9629ge1GZmzffe8-70J5AoI2PzlyBnu2a_vDE8FWtJUcpinNtB5cbLiHgyf4F6vNHYuApnxlvlkLJ6VpYp2iQEa_rY604Y2b9qd1fqB3gwaVKssim_1ITiEjkagM8o Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 067a1994957349daa5e36bc922db7ed3 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBackupRestore-1081041656 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/067a1994957349daa5e36bc922db7ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/067a1994957349daa5e36bc922db7ed3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_067a1994957349daa5e36bc922db7ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/067a1994957349daa5e36bc922db7ed3"}]}] Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBackupRestore-1081041656 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 067a1994957349daa5e36bc922db7ed3 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1081041656 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBackupRestore-1081041656-project Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 7da70222a4ee42c18648c364309874d2 Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBackupRestore-1081041656-project Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '52b00f12-d32d-486a-9e10-d1ad9aeb27e3'} Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:07:42.018506 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Returning 404 to user: Instance 52b00f12-d32d-486a-9e10-d1ad9aeb27e3 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8bb41422-df4b-4a1a-bbb0-2e04570594cc tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3" status: 404 len: 111 microversion: 2.1 time: 0.048625 Jul 28 12:07:42.023967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3054/6105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:07:41 2022] GET /compute/v2.1/servers/52b00f12-d32d-486a-9e10-d1ad9aeb27e3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:07:42.332921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b4bde03-ea58-4fa9-a3ef-d6fe9eaa5ca8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] Calling method '.version_select at 0x7f2eb197b310>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:07:42.355347 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b4bde03-ea58-4fa9-a3ef-d6fe9eaa5ca8 tempest-TestVolumeBackupRestore-1081041656 tempest-TestVolumeBackupRestore-1081041656-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1592907955" status: 202 len: 0 microversion: 2.1 time: 0.026129 Jul 28 12:07:42.356282 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3052/6106] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 12:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1592907955 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:07:51.645589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:07:51.650090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:07:51.660711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:51.661456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:51.663517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:07:51.664135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:07:51.763563 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3b63515e-1d51-43c7-b56a-a1211cb4c398 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action" status: 200 len: 24573 microversion: 2.1 time: 0.125199 Jul 28 12:07:51.764345 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3055/6107] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:07:51 2022] POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action => generated 24573 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:08:22.005029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:22.005812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:22.009961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:22.013391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:22.020695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.021199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.022020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.022502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.104344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:08:22.104918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:08:22.105478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:08:22.105974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:08:22.106404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:08:22.170358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:22.176585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.177113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.178539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.179114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.207878 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed89fc76-fec3-453c-933a-cbedeabf9f86 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action" status: 202 len: 1139 microversion: 2.1 time: 0.204728 Jul 28 12:08:22.209440 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3053/6108] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:08:22 2022] POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action => generated 1139 bytes in 207 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 12:08:22.229946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:22.230654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:22.234675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=14 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:22.235653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=28 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:22.243243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.244037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.244936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:22.245413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:22.408844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:22.418311 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f372395c-8605-471c-8314-9e1eb2202364 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.194170 Jul 28 12:08:22.418311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3056/6109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:22 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:08:23.439384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:23.439987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:23.447011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:23.447504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:23.448273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:23.448713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:23.579669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:23.587578 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d942785-6ebe-4888-98a2-0118e6cc08ec tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.152057 Jul 28 12:08:23.588167 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3054/6110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:23 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:24.609459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:24.610080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:24.617508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:24.618059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:24.618981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:24.619471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:24.757290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:24.764885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c12ae09-c151-41a0-9889-a1799e294272 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.159410 Jul 28 12:08:24.765912 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3057/6111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:24 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:25.785781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:25.786433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:25.793479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:25.793938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:25.794711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:25.795183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:25.931820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:25.939411 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c34491a0-b586-4c37-9799-27851d3bb16d tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.157562 Jul 28 12:08:25.939990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3055/6112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:25 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:26.960688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:26.961307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:26.968091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:26.968547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:26.969336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:26.969777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:27.113017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:27.122106 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f63a62f-5864-4d2e-82db-f904e9025f9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.165341 Jul 28 12:08:27.122916 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3058/6113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:26 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:28.143869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:28.144477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:28.153157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:28.153937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:28.154940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:28.155988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:28.300158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:28.309308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19bd8a2e-0029-46c9-9a90-b68b1ef9d5f9 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.169108 Jul 28 12:08:28.310101 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3056/6114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:28 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:29.330680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:29.331429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:29.339189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:29.339640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:29.340420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:29.340862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:29.472778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:29.480621 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a2c59f0-a949-4942-bb33-0e5f36401de4 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.154112 Jul 28 12:08:29.481199 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3059/6115] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:29 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:30.501363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:30.501995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:30.509754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:30.510245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:30.511023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:30.511665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:30.650070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:30.659802 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e863df1-0d48-4500-98e2-f70aa235d157 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.162669 Jul 28 12:08:30.660756 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3057/6116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:30 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:31.681059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:31.681801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:31.688688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:31.689083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:31.689866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:31.690306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:31.836448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:31.845293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c9fc83a-6091-4bc3-8702-196c686c9b00 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.168329 Jul 28 12:08:31.845881 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3060/6117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:31 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:32.867289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:32.867824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:32.875106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:32.875606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:32.876387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:32.876832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:33.009371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:33.016999 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4d212467-e43a-493e-92f2-50380786cc9c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.153854 Jul 28 12:08:33.017570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3058/6118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:32 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:34.061736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:34.066431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:34.081772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:34.088054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:34.090467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:34.092174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:34.279907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:34.288944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-728e9300-77d4-43b0-a301-0bfc14a38158 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1694 microversion: 2.1 time: 0.254632 Jul 28 12:08:34.289673 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3061/6119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:34 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1694 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:35.310506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:35.311173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:35.318491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:35.319060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:35.320256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:35.320711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:35.459918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:35.467565 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-53e61a36-4706-4ca5-b367-4cb72079f35c tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1700 microversion: 2.1 time: 0.161060 Jul 28 12:08:35.468148 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3059/6120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:35 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:36.490445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:36.491058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:36.498242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:36.498691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:36.499507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:36.499942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:36.638313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:36.646104 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f935018-6f4f-4db2-9cee-fbf3234902c3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1700 microversion: 2.1 time: 0.160050 Jul 28 12:08:36.646736 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3062/6121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:36 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:36.829292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2053961742", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:36.880722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:08:37.070930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:08:37.071394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:08:37.071876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:08:37.072288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:08:37.072701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:08:37.081751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:37.082200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:37.083398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:37.083844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:37.105360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Getting quotas for project e037111681234035ad379e20c5bb9fe6. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:08:37.110989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Getting quotas for user 78b7194449df443d8ed4eae978b936b9 and project e037111681234035ad379e20c5bb9fe6. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:08:37.126963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:08:37.130609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:08:37.189258 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0edfda6e-4c38-4325-ae67-53e17cdcafe7 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.363745 Jul 28 12:08:37.189918 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3060/6122] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 12:08:37.200868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce62c5eb-8f71-40fd-bdae-98f8ea6d0d52 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:37.201609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce62c5eb-8f71-40fd-bdae-98f8ea6d0d52 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:37.254837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ce62c5eb-8f71-40fd-bdae-98f8ea6d0d52 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:37.261712 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce62c5eb-8f71-40fd-bdae-98f8ea6d0d52 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1214 microversion: 2.1 time: 0.064792 Jul 28 12:08:37.262322 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3063/6123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:37 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:37.669724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:37.669724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:37.675879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:37.676610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:37.677402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:37.678021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:37.826256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:37.837180 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6443cc1-d2fd-4ef4-b022-c75d9edae300 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1700 microversion: 2.1 time: 0.173930 Jul 28 12:08:37.851105 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3061/6124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:37 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:37.851284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-52faab6b-ee36-490c-99c0-ced5023aeee4 req-294b6fd1-da2f-4ead-9144-5e4e4aa88d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "name": "network-vif-unplugged", "status": "completed", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:37.863954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-52faab6b-ee36-490c-99c0-ced5023aeee4 req-294b6fd1-da2f-4ead-9144-5e4e4aa88d9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:37.864276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-52faab6b-ee36-490c-99c0-ced5023aeee4 req-294b6fd1-da2f-4ead-9144-5e4e4aa88d9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:37.875209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-52faab6b-ee36-490c-99c0-ced5023aeee4 req-294b6fd1-da2f-4ead-9144-5e4e4aa88d9d service nova] Creating event network-vif-unplugged:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:08:37.881783 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-52faab6b-ee36-490c-99c0-ced5023aeee4 req-294b6fd1-da2f-4ead-9144-5e4e4aa88d9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035743 Jul 28 12:08:37.882401 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3064/6125] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:08:38.283332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:38.284345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:38.293092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:38.293986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:38.295422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:38.296103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:38.373951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:38.381602 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66cb9bf7-f5f8-4986-980f-cded77001301 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1284 microversion: 2.1 time: 0.102235 Jul 28 12:08:38.382278 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3062/6126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:38 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:38.858773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:38.859421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:38.866499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:38.866952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:38.867780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:38.868207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:39.008808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:39.019744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b0cf3038-04ea-4fd5-85b9-c605242d69f3 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1685 microversion: 2.1 time: 0.165029 Jul 28 12:08:39.020354 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3065/6127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:38 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:39.403298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:39.403817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:39.410465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:39.410919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:39.411758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:39.412202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:39.547714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:39.558264 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee1e44b9-6bf5-4707-9342-06eac280c1aa tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.159051 Jul 28 12:08:39.558900 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3063/6128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:39 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:39.731305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-03976a61-516e-4a56-bfa0-f44b3308f103 req-b619bf77-090b-4e4d-a382-2451a5ea9f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e330ccf9-a005-4ff1-acfe-e80b362f6cc7", "tag": "3aaca478-3c0e-4ba9-8a72-8eccf909ec7d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:39.743975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-03976a61-516e-4a56-bfa0-f44b3308f103 req-b619bf77-090b-4e4d-a382-2451a5ea9f21 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:39.749904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-03976a61-516e-4a56-bfa0-f44b3308f103 req-b619bf77-090b-4e4d-a382-2451a5ea9f21 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:39.786228 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-03976a61-516e-4a56-bfa0-f44b3308f103 req-b619bf77-090b-4e4d-a382-2451a5ea9f21 service nova] Creating event network-changed:3aaca478-3c0e-4ba9-8a72-8eccf909ec7d for instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 on n-h2-851368-1 Jul 28 12:08:39.793298 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-03976a61-516e-4a56-bfa0-f44b3308f103 req-b619bf77-090b-4e4d-a382-2451a5ea9f21 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065745 Jul 28 12:08:39.793913 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3066/6129] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:08:39.897577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-076cddb0-6e7c-41f8-a38f-ce68cf55e16e req-70bf9c7a-9072-41c3-a947-9dda6d2f02e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "name": "network-vif-plugged", "status": "completed", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:39.908308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-076cddb0-6e7c-41f8-a38f-ce68cf55e16e req-70bf9c7a-9072-41c3-a947-9dda6d2f02e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:39.908765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-076cddb0-6e7c-41f8-a38f-ce68cf55e16e req-70bf9c7a-9072-41c3-a947-9dda6d2f02e1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:39.927862 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-076cddb0-6e7c-41f8-a38f-ce68cf55e16e req-70bf9c7a-9072-41c3-a947-9dda6d2f02e1 service nova] Creating event network-vif-plugged:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:08:39.934426 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-076cddb0-6e7c-41f8-a38f-ce68cf55e16e req-70bf9c7a-9072-41c3-a947-9dda6d2f02e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040285 Jul 28 12:08:39.936084 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3064/6130] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:08:40.580677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:40.581420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:40.590476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:40.590939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:40.591824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:40.592274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:40.728993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:40.736501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-271bbf9e-c832-44bd-84eb-bb82d41c073a tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.160162 Jul 28 12:08:40.737076 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3067/6131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:40 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:41.758338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:41.758954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:41.765157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:41.765603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:41.766354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:41.766784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:41.900789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:41.908477 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd4d003f-9724-4451-9b79-468051e0908b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.155221 Jul 28 12:08:41.909364 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3065/6132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:41 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:08:42.932676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:42.933295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:42.940186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:42.940637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:42.941395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:42.941830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:43.071119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:43.078564 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ebaa8548-7996-4176-96fb-6c96e7f990ad tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.150389 Jul 28 12:08:43.079145 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3068/6133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:42 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:44.098633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:44.099390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:44.107185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:44.107644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:44.108422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:44.108866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:44.243736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:44.251163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9949af0a-59ec-4bee-98ac-7f7a5fc88602 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.156419 Jul 28 12:08:44.251734 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3066/6134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:44 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:45.272230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:45.273811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:45.280827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:45.281284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:45.282055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:45.282494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:45.414447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:45.421905 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-62cf6059-b887-4e32-b794-1f6ddb9438cd tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.153717 Jul 28 12:08:45.422474 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3069/6135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:45 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:45.788608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7cb4bc55-24dd-4404-b2fe-865719224078 req-f9e2518d-57fa-4533-92eb-1991821c6b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e330ccf9-a005-4ff1-acfe-e80b362f6cc7", "name": "network-vif-plugged", "status": "completed", "tag": "3aaca478-3c0e-4ba9-8a72-8eccf909ec7d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:45.800538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7cb4bc55-24dd-4404-b2fe-865719224078 req-f9e2518d-57fa-4533-92eb-1991821c6b2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:45.800998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7cb4bc55-24dd-4404-b2fe-865719224078 req-f9e2518d-57fa-4533-92eb-1991821c6b2e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:45.812945 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7cb4bc55-24dd-4404-b2fe-865719224078 req-f9e2518d-57fa-4533-92eb-1991821c6b2e service nova] Creating event network-vif-plugged:3aaca478-3c0e-4ba9-8a72-8eccf909ec7d for instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 on n-h2-851368-1 Jul 28 12:08:45.817963 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7cb4bc55-24dd-4404-b2fe-865719224078 req-f9e2518d-57fa-4533-92eb-1991821c6b2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Jul 28 12:08:45.818560 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3067/6136] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:08:46.443628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:46.444387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:46.451673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:46.452127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:46.452918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:46.453364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:46.594457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:46.602337 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbe0afaa-fe9a-42b0-b56e-6d7b7c87dc6b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1314 microversion: 2.1 time: 0.162689 Jul 28 12:08:46.602918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3070/6137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:46 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:47.623730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:08:47.624442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:47.627268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:47.628005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:47.634975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:47.635460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:47.636240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:47.636685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:47.764567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:08:47.772059 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76b2afef-fa30-4f19-95ca-7dc1cfa3e9ff tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1464 microversion: 2.1 time: 0.152608 Jul 28 12:08:47.772637 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3068/6138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:08:47 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:08:47.792069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe616eee-4d8c-4b37-adad-ee8128659cee", "device": "/dev/sdb"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:08:47.794491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:08:47.796510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:08:47.802706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:47.803191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:47.804482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:08:47.804929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:08:48.061057 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e111929a-7d67-47ec-a011-7a45d17af9cb tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "POST /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272823 Jul 28 12:08:48.061698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3071/6139] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:08:47 2022] POST /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:09:13.264639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:09:13.266803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:13.269062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:13.269888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:13.280011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:13.280457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:13.281235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:13.281667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:13.355253 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8e3c4bbb-d4bb-47b4-9692-ab0fbb4dd8fe tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action" status: 200 len: 24571 microversion: 2.1 time: 0.094280 Jul 28 12:09:13.359154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3069/6140] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:09:13 2022] POST /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:09:44.461052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:44.462128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:44.464808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=34 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:44.465558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:44.468327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:44.469107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:09:44.476753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:44.477219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:44.478160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:44.478551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:44.520981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:09:44.634213 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-580742af-4db7-4471-9b9e-58b56e8933f5 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 204 len: 0 microversion: 2.1 time: 0.178307 Jul 28 12:09:44.635224 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3072/6141] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:09:44 2022] DELETE /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 12:09:44.644154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:44.645281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:44.652670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:44.653387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:44.654346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:44.654957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:44.675281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a39064ea-2646-4842-9f18-c15c5e72d860 req-8079eab3-bee1-4657-957a-4f48d1223b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:09:44.687844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a39064ea-2646-4842-9f18-c15c5e72d860 req-8079eab3-bee1-4657-957a-4f48d1223b9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:44.688575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a39064ea-2646-4842-9f18-c15c5e72d860 req-8079eab3-bee1-4657-957a-4f48d1223b9d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:44.702076 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a39064ea-2646-4842-9f18-c15c5e72d860 req-8079eab3-bee1-4657-957a-4f48d1223b9d service nova] Creating event network-changed:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:09:44.710447 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a39064ea-2646-4842-9f18-c15c5e72d860 req-8079eab3-bee1-4657-957a-4f48d1223b9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249988 Jul 28 12:09:44.711622 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3070/6142] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:09:44.818748 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:44.826831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bac4b1db-9215-4dda-8eb2-a4daf22de8cb tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1691 microversion: 2.1 time: 0.186882 Jul 28 12:09:44.833717 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3073/6143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:44 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:45.850166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:45.851834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:45.861381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:45.862330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:45.863409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:45.864058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:46.026356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:46.042431 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93a84b84-2e98-40fc-91ac-e9a23dacc6ac tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1691 microversion: 2.1 time: 0.197556 Jul 28 12:09:46.050743 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3071/6144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:45 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:47.072877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:47.074151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:47.084835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:47.085219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:47.086230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:47.086789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:47.164970 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad897d5445224ba48dc242fb71a77480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd61ccbeb524e1393d665f0fac9f396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:47.173109 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-975aff34-033e-4f90-8522-abe12f3d5964 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 200 len: 1504 microversion: 2.1 time: 0.104824 Jul 28 12:09:47.174051 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3074/6145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:47 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 1504 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:47.198232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-305cc8a9-6e8a-4275-a7be-927880337d03 req-aad1bceb-a255-4023-b940-30a37b82a60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed4d8d6-5472-4021-b3ad-85001080e72b", "name": "network-vif-deleted", "tag": "902bb40d-f5b6-4632-bd0a-cf8278aba6b9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:09:47.210953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-305cc8a9-6e8a-4275-a7be-927880337d03 req-aad1bceb-a255-4023-b940-30a37b82a60a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:47.211886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-305cc8a9-6e8a-4275-a7be-927880337d03 req-aad1bceb-a255-4023-b940-30a37b82a60a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:47.224486 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-305cc8a9-6e8a-4275-a7be-927880337d03 req-aad1bceb-a255-4023-b940-30a37b82a60a service nova] Creating event network-vif-deleted:902bb40d-f5b6-4632-bd0a-cf8278aba6b9 for instance eed4d8d6-5472-4021-b3ad-85001080e72b on n-h1-851368-1 Jul 28 12:09:47.229759 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-305cc8a9-6e8a-4275-a7be-927880337d03 req-aad1bceb-a255-4023-b940-30a37b82a60a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Jul 28 12:09:47.230729 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3072/6146] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:09:48.194671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:48.195441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] [instance: eed4d8d6-5472-4021-b3ad-85001080e72b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:48.203654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:48.204389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:48.205362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:48.206022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:48.221016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] HTTP exception thrown: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Request method failure captured: Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b HTTP/1.1 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nozoHNvSRavIkmD8AajooQaWwNnmMbGdCZ4di285oby44AJzbKAYneiequjHATCTb5eKctYzuptKNmfANbi25s6SPH1xtfH8wUfnPCq739fqsKLpM-fJGBYq-nvo4vTfKz8gNFWsmKyi1YQfHanxAJGiqsL7o98Ri0E2-SKBgmv3-c Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bd61ccbeb524e1393d665f0fac9f396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bd61ccbeb524e1393d665f0fac9f396"}]}] Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0bd61ccbeb524e1393d665f0fac9f396 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2037388331 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: ad897d5445224ba48dc242fb71a77480 Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2037388331-project Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'eed4d8d6-5472-4021-b3ad-85001080e72b'} Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:48.223687 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Returning 404 to user: Instance eed4d8d6-5472-4021-b3ad-85001080e72b could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dac50175-7839-4518-93e5-dbbe60511f10 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b" status: 404 len: 111 microversion: 2.1 time: 0.035409 Jul 28 12:09:48.228315 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3075/6147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:48 2022] GET /compute/v2.1/servers/eed4d8d6-5472-4021-b3ad-85001080e72b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:09:50.469467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:50.470637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:50.487480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:50.487930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:50.489379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:50.489819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:50.577965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lazy-loading 'services' on Instance uuid e330ccf9-a005-4ff1-acfe-e80b362f6cc7 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:09:50.663120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6c99279d-adb6-44e8-8029-efd1141e75f3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7/os-volume_attachments/fe616eee-4d8c-4b37-adad-ee8128659cee" status: 202 len: 0 microversion: 2.1 time: 0.198442 Jul 28 12:09:50.663970 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3073/6148] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:09:50 2022] DELETE /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7/os-volume_attachments/fe616eee-4d8c-4b37-adad-ee8128659cee => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:09:51.497563 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:09:51.498080 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:09:52.121793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2dd2811a-4feb-4f8a-9f56-d2f1b6abf8a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] Calling method '.version_select at 0x7f2eb3167e50>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:52.146378 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2dd2811a-4feb-4f8a-9f56-d2f1b6abf8a7 tempest-TestNetworkAdvancedServerOps-2037388331 tempest-TestNetworkAdvancedServerOps-2037388331-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1828900009" status: 202 len: 0 microversion: 2.1 time: 0.033595 Jul 28 12:09:52.147290 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3076/6149] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1828900009 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:09:53.606563 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:09:53.607169 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:09:56.093686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:56.094343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:56.101546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:56.102066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:56.102894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:56.103437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:56.130061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:09:56.212963 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1652597-9173-4442-a4c3-28c68870aa06 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 204 len: 0 microversion: 2.1 time: 0.123954 Jul 28 12:09:56.213879 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3074/6150] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:09:56 2022] DELETE /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:09:56.226805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:56.227601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:56.234169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:56.234625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:56.235424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:56.235864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:56.428106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:56.437049 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a0d8904-5afa-4dad-adb5-9211f8e5eaa3 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1470 microversion: 2.1 time: 0.217366 Jul 28 12:09:56.437995 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3077/6151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:56 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:57.458351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:57.459719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:57.471457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:57.476408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:57.477572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:57.478184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:57.658329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:57.667693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-364ad5db-e217-4dc5-bed5-a60771ac246b tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1470 microversion: 2.1 time: 0.213451 Jul 28 12:09:57.668276 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3075/6152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:57 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:58.548705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-eab35671-5900-49cf-a0a7-e86dad850ae4 req-ebdac295-e499-4ba5-9ca8-23ec10c7b376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e330ccf9-a005-4ff1-acfe-e80b362f6cc7", "name": "network-vif-deleted", "tag": "3aaca478-3c0e-4ba9-8a72-8eccf909ec7d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:09:58.560843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eab35671-5900-49cf-a0a7-e86dad850ae4 req-ebdac295-e499-4ba5-9ca8-23ec10c7b376 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:58.561104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eab35671-5900-49cf-a0a7-e86dad850ae4 req-ebdac295-e499-4ba5-9ca8-23ec10c7b376 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:58.580653 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-eab35671-5900-49cf-a0a7-e86dad850ae4 req-ebdac295-e499-4ba5-9ca8-23ec10c7b376 service nova] Creating event network-vif-deleted:3aaca478-3c0e-4ba9-8a72-8eccf909ec7d for instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 on n-h2-851368-1 Jul 28 12:09:58.586875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-eab35671-5900-49cf-a0a7-e86dad850ae4 req-ebdac295-e499-4ba5-9ca8-23ec10c7b376 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042116 Jul 28 12:09:58.587772 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3078/6153] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:09:58.690219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:58.692203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:58.701987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:58.702924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:58.703780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:58.704223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:58.760653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:58.761125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:58.761570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lazy-loading 'fault' on Instance uuid e330ccf9-a005-4ff1-acfe-e80b362f6cc7 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:09:58.808584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b7194449df443d8ed4eae978b936b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e037111681234035ad379e20c5bb9fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:09:58.817129 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1620b211-020b-422e-9310-ad7aff843a75 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 200 len: 1304 microversion: 2.1 time: 0.130590 Jul 28 12:09:58.819198 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3076/6154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:58 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:09:59.840508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:09:59.841274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] [instance: e330ccf9-a005-4ff1-acfe-e80b362f6cc7] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:09:59.853003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:59.853472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:59.854278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:09:59.854733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:09:59.870648 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] HTTP exception thrown: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Request method failure captured: Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 HTTP/1.1 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nxDH_iJ4RQmZIy3C0zUAcf_aH0vJ3QNVM21K-_gb1qdsawzp0xpwc9guVCG1sGPCvhIyECXbyL7nSZU6JF6fkxnXLnL-Ce75PXA4DFco6hfPHxPvofg0y3q6vosY8U7up8JwYANEKvgkRpABMnQccKeJYoMNbm5Oia0Vp15F9uxOMo Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e037111681234035ad379e20c5bb9fe6 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-VolumesBackupsTest-1321795886 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e037111681234035ad379e20c5bb9fe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e037111681234035ad379e20c5bb9fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e037111681234035ad379e20c5bb9fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e037111681234035ad379e20c5bb9fe6"}]}] Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-VolumesBackupsTest-1321795886 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e037111681234035ad379e20c5bb9fe6 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-VolumesBackupsTest-1321795886 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-VolumesBackupsTest-1321795886-project Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 78b7194449df443d8ed4eae978b936b9 Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-VolumesBackupsTest-1321795886-project Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'e330ccf9-a005-4ff1-acfe-e80b362f6cc7'} Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:09:59.872840 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. Jul 28 12:09:59.877852 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:09:59.879149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] Returning 404 to user: Instance e330ccf9-a005-4ff1-acfe-e80b362f6cc7 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:09:59.880254 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fb97941-589b-43e6-a0d3-e2d9fbc3e642 tempest-VolumesBackupsTest-1321795886 tempest-VolumesBackupsTest-1321795886-project] 10.222.0.93 "GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7" status: 404 len: 111 microversion: 2.1 time: 0.044855 Jul 28 12:09:59.881014 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3079/6155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:09:59 2022] GET /compute/v2.1/servers/e330ccf9-a005-4ff1-acfe-e80b362f6cc7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:10:05.179274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d6db14b-9c64-403c-bf98-7fdcfeee353a tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Action: 'create', calling method: .version_select at 0x7f2eb197b4c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1423546377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFszAK8U8du8KTsfcznfCoVmFKof5/7N/NFEFfJSk9Ak4OL2XyHNHrM1RFDvqqElvUEjvIWayO/Lgulhf++D+N7M+ikggtMJvB39YUbhMt+2bnNAoUYb5LWIPCbMOvpw=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:10:05.198944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0d6db14b-9c64-403c-bf98-7fdcfeee353a tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for project fa95cb10295249569a5cdc09dfdcb70a. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:10:05.210269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-0d6db14b-9c64-403c-bf98-7fdcfeee353a tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for user 4f09f9ee0d224dfa8c6de95e42273867 and project fa95cb10295249569a5cdc09dfdcb70a. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:10:05.525093 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d6db14b-9c64-403c-bf98-7fdcfeee353a tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.628361 Jul 28 12:10:05.526056 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3077/6156] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:10:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:10:06.704794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-351937305", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1423546377", "security_groups": [{"name": "tempest-secgroup-smoke-504203970"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "358c4921-2d50-46f4-8aad-22d50af15713"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:10:06.818331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] validate_networks() for [('358c4921-2d50-46f4-8aad-22d50af15713', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:10:07.293900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for project fa95cb10295249569a5cdc09dfdcb70a. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:10:07.299296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for user 4f09f9ee0d224dfa8c6de95e42273867 and project fa95cb10295249569a5cdc09dfdcb70a. Resources: dict_keys(['metadata_items']) {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:10:07.312529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:10:07.312959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:10:07.313447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:10:07.313991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:10:07.314358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:10:07.323675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:07.324135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:07.325214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:07.325665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:07.343729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for project fa95cb10295249569a5cdc09dfdcb70a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:10:07.349961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Getting quotas for user 4f09f9ee0d224dfa8c6de95e42273867 and project fa95cb10295249569a5cdc09dfdcb70a. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:10:07.363105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:10:07.365433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:10:07.431391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5f3810e-651b-4d82-943e-ead97f0df01f tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730649 Jul 28 12:10:07.432040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3080/6157] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:10:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:10:07.444074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0968f6c1-a746-4e6f-977d-7e337b14417d tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:07.445373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0968f6c1-a746-4e6f-977d-7e337b14417d tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:07.520372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0968f6c1-a746-4e6f-977d-7e337b14417d tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:07.528600 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0968f6c1-a746-4e6f-977d-7e337b14417d tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1302 microversion: 2.1 time: 0.089705 Jul 28 12:10:07.529585 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3078/6158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:07 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:10:08.549768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:08.551620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:08.562475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:08.563385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:08.564654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:08.565348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:08.660256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:08.671682 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c018e54-3db7-417a-8f70-0a7497d94e96 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1362 microversion: 2.1 time: 0.125789 Jul 28 12:10:08.672935 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3081/6159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:08 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1362 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:09.698909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:09.700335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:09.703924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:09.713419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:09.714242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:09.716206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:09.718635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:10.161851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:10.170864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8259bf69-8650-490f-871d-422d5f3a13b8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.475244 Jul 28 12:10:10.171336 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3079/6160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:09 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:10.611542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-acc652a5-f961-4079-83c6-82c360d7a021 req-de6adf1a-7ce6-4281-aa9a-113305eb1ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d75461-fa82-4418-9782-39809b2305ba", "tag": "a24c4de2-e241-422d-8a47-8bf4961bc4e9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:10:10.628972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-acc652a5-f961-4079-83c6-82c360d7a021 req-de6adf1a-7ce6-4281-aa9a-113305eb1ed6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:10.629996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-acc652a5-f961-4079-83c6-82c360d7a021 req-de6adf1a-7ce6-4281-aa9a-113305eb1ed6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:10.645902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-acc652a5-f961-4079-83c6-82c360d7a021 req-de6adf1a-7ce6-4281-aa9a-113305eb1ed6 service nova] Creating event network-changed:a24c4de2-e241-422d-8a47-8bf4961bc4e9 for instance 02d75461-fa82-4418-9782-39809b2305ba on n-h1-851368-1 Jul 28 12:10:10.652401 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-acc652a5-f961-4079-83c6-82c360d7a021 req-de6adf1a-7ce6-4281-aa9a-113305eb1ed6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044486 Jul 28 12:10:10.653015 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3082/6161] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:10:11.192022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:11.192635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:11.199578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:11.200026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:11.200790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:11.201227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:11.347408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:11.355617 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d812b83-46bd-4376-94d1-4a66122d81c4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.168007 Jul 28 12:10:11.356269 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3080/6162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:11 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:12.381740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:12.382453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:12.388832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:12.389384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:12.390161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:12.390612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:12.531059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:12.539414 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3061977c-10c3-41e9-ae42-d6df5b66a634 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.163614 Jul 28 12:10:12.540306 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3083/6163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:12 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:13.561083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:13.562053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:13.570150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:13.570752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:13.571632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:13.572418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:13.711907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:13.719949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b12273e5-859d-4a30-bbd0-739d825089c8 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.162802 Jul 28 12:10:13.720525 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3081/6164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:13 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:14.741918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:14.743242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:14.746314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:14.754764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:14.755269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:14.756073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:14.756756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:14.762484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:14.916367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:14.923938 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd129e56-5157-496e-b90e-2d0c214c118e tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.186682 Jul 28 12:10:14.924507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3084/6165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:14 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:15.945667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:15.946286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:15.949372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:15.954800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:15.955308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:15.956155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:15.957113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:16.094261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:16.102139 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04b6c7a1-16eb-453f-8348-4015a9e4ab22 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.160352 Jul 28 12:10:16.102709 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3082/6166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:15 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:16.282131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-97cd8cb0-72ce-4c8d-bfc9-f5564096ce8a req-d2e044a3-1a0c-4e59-8a16-1e00ea8720f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d75461-fa82-4418-9782-39809b2305ba", "name": "network-vif-plugged", "status": "completed", "tag": "a24c4de2-e241-422d-8a47-8bf4961bc4e9"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:10:16.293321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-97cd8cb0-72ce-4c8d-bfc9-f5564096ce8a req-d2e044a3-1a0c-4e59-8a16-1e00ea8720f3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:16.293773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-97cd8cb0-72ce-4c8d-bfc9-f5564096ce8a req-d2e044a3-1a0c-4e59-8a16-1e00ea8720f3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:16.305740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-97cd8cb0-72ce-4c8d-bfc9-f5564096ce8a req-d2e044a3-1a0c-4e59-8a16-1e00ea8720f3 service nova] Creating event network-vif-plugged:a24c4de2-e241-422d-8a47-8bf4961bc4e9 for instance 02d75461-fa82-4418-9782-39809b2305ba on n-h1-851368-1 Jul 28 12:10:16.310834 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-97cd8cb0-72ce-4c8d-bfc9-f5564096ce8a req-d2e044a3-1a0c-4e59-8a16-1e00ea8720f3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032927 Jul 28 12:10:16.311967 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3085/6167] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:10:17.122730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:17.123384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:17.130761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:17.131258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:17.132052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:17.132497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:17.269426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:17.277028 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f37dbc87-8c7e-44a6-93de-8e42b9a920e9 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1427 microversion: 2.1 time: 0.158423 Jul 28 12:10:17.277603 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3083/6168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:17 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:18.296153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:18.297481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:18.302690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:18.303448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:18.310740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.311237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.312019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.312468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.455545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:18.463619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4020100-a65c-4575-bd6f-13fd8c3996ee tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1606 microversion: 2.1 time: 0.169317 Jul 28 12:10:18.464265 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3086/6169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:18 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1606 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:18.484566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:18.485202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:18.487009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:10:18.494045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.494502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.495319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.495769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.631332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:18.638968 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-66adfbae-005d-45de-a1fb-1adf14da91ca tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1606 microversion: 2.1 time: 0.158402 Jul 28 12:10:18.639584 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3084/6170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:18 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1606 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:18.658559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:10:18.659240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:10:18.665354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.665797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.666563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:18.666999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:18.812082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:10:18.819786 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a312f764-38fb-4df5-b612-625ea8bb49b4 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1606 microversion: 2.1 time: 0.165041 Jul 28 12:10:18.820354 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3087/6171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:10:18 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1606 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:10:20.940099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-30140642-fb9b-4eda-83c2-ad322e0a3bdd req-57b08f84-611c-4ee1-981c-a5bc1a983adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d75461-fa82-4418-9782-39809b2305ba", "tag": "a24c4de2-e241-422d-8a47-8bf4961bc4e9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:10:20.958313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-30140642-fb9b-4eda-83c2-ad322e0a3bdd req-57b08f84-611c-4ee1-981c-a5bc1a983adc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:10:20.959136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-30140642-fb9b-4eda-83c2-ad322e0a3bdd req-57b08f84-611c-4ee1-981c-a5bc1a983adc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:10:20.977589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-30140642-fb9b-4eda-83c2-ad322e0a3bdd req-57b08f84-611c-4ee1-981c-a5bc1a983adc service nova] Creating event network-changed:a24c4de2-e241-422d-8a47-8bf4961bc4e9 for instance 02d75461-fa82-4418-9782-39809b2305ba on n-h1-851368-1 Jul 28 12:10:20.982840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-30140642-fb9b-4eda-83c2-ad322e0a3bdd req-57b08f84-611c-4ee1-981c-a5bc1a983adc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047501 Jul 28 12:10:20.983713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3085/6172] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:11:27.438052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=7 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:11:27.439359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=19 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:11:27.443876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:11:27.444374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:11:27.451288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:11:27.451743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:11:27.452514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:11:27.452953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:11:27.480074 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f864d76-7be4-4331-8af1-4e71c3c1ebde tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044579 Jul 28 12:11:27.480658 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3088/6173] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Jul 28 12:11:27 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:11:31.620532 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:11:31.621168 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:13:11.509430 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:13:11.510047 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:13:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:13:13.615032 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:13:13.615615 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:13:19.326673 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:13:19.327588 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:13:19.328209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=7 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:19.328950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=38 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:19.495432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57ca1270-52a8-4c6a-8eea-6e015bc5b757 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Action: 'create', calling method: .version_select at 0x7f2eb194b310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2126487588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLneP9EXKRnf6xAvmF6ajmZ4w8r36gTEJoLTGA+EkvZQThuFiUq8ppcz7BM63FKskGO5sM4wJ84CCmeFfhOv/7RUiVbVCE+cO2hWjYsK1GMl0sdy1dr9jIdVtjaTepVRA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:13:19.511420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-57ca1270-52a8-4c6a-8eea-6e015bc5b757 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for project 045595e21d1742ccb52de5f7e75a0560. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:13:19.517034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-57ca1270-52a8-4c6a-8eea-6e015bc5b757 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for user 8742dd64d3bc46ff995d723de8425fdf and project 045595e21d1742ccb52de5f7e75a0560. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:13:19.546624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57ca1270-52a8-4c6a-8eea-6e015bc5b757 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.221705 Jul 28 12:13:19.547310 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3086/6174] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:13:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:13:25.145308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1450469517-access_point-653802331", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "b93e64ea-b329-4d10-b328-a7ff97639637"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2126487588", "security_groups": [{"name": "tempest-secgroup_access--561593623"}, {"name": "tempest-secgroup_general--2040210419"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:13:25.162779 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:13:25.163681 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:13:25.164487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:25.165313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:25.480209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] validate_networks() for [('b93e64ea-b329-4d10-b328-a7ff97639637', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:13:25.941471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:13:25.941923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:13:25.942440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:13:25.942975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:13:25.943352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:13:25.960934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:25.961390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:25.962665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:25.963245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:25.986170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for project 045595e21d1742ccb52de5f7e75a0560. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:13:25.992680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for user 8742dd64d3bc46ff995d723de8425fdf and project 045595e21d1742ccb52de5f7e75a0560. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:13:26.015032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:13:26.019252 n-d-851368-1 devstack@n-api.service[119236]: WARNING nova.utils [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1450469517-access_point-653802331 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1450469517-ac Jul 28 12:13:26.020125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:13:26.071542 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-21569c1d-3f78-4d15-945f-46c5fb66aad8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.930795 Jul 28 12:13:26.072555 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3089/6175] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:13:25 2022] POST /compute/v2.1/servers => generated 457 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:13:26.087005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-327f0526-cd13-4575-9eb1-dbc281cd583e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:26.087793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-327f0526-cd13-4575-9eb1-dbc281cd583e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:26.110092 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 36784. Jul 28 12:13:26.111225 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 36782. Jul 28 12:13:26.179902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-327f0526-cd13-4575-9eb1-dbc281cd583e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:26.188665 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-327f0526-cd13-4575-9eb1-dbc281cd583e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1294 microversion: 2.1 time: 0.108693 Jul 28 12:13:26.189231 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3087/6176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:26 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:27.211418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:27.212060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:27.221367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:27.221819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:27.222600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:27.223042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:27.229928 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 36802. Jul 28 12:13:27.241695 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 36800. Jul 28 12:13:27.292213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:27.300003 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-214dae6c-c497-4faa-97a4-9b4776e191a5 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1346 microversion: 2.1 time: 0.093983 Jul 28 12:13:27.300591 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3090/6177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:27 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:28.320810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:28.321356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:28.329680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:28.330402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:28.331525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:28.331995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:28.486644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:28.494269 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f26d9be-18ba-466a-9d0f-1e8087a9b46c tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.177516 Jul 28 12:13:28.494842 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3088/6178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:28 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:28.801578 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:13:28.801833 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:13:29.064544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dbbb3a6f-0b8e-4175-8d7c-f27426cd590e req-52e62d36-eb48-4439-b3ae-7a3ad3d1a78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866e913a-3564-495d-ab68-6e9f8f035195", "tag": "b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:13:29.074847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dbbb3a6f-0b8e-4175-8d7c-f27426cd590e req-52e62d36-eb48-4439-b3ae-7a3ad3d1a78b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:29.076205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dbbb3a6f-0b8e-4175-8d7c-f27426cd590e req-52e62d36-eb48-4439-b3ae-7a3ad3d1a78b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:29.088585 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-dbbb3a6f-0b8e-4175-8d7c-f27426cd590e req-52e62d36-eb48-4439-b3ae-7a3ad3d1a78b service nova] Creating event network-changed:b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5 for instance 866e913a-3564-495d-ab68-6e9f8f035195 on n-h2-851368-1 Jul 28 12:13:29.094004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dbbb3a6f-0b8e-4175-8d7c-f27426cd590e req-52e62d36-eb48-4439-b3ae-7a3ad3d1a78b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116053 Jul 28 12:13:29.094741 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3091/6179] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:13:29.516272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:29.517150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:29.524579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:29.525046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:29.525821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:29.526266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:29.680370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:29.688513 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a9c1b0c4-8e30-4f2a-8b20-05a5e25e38ad tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.176806 Jul 28 12:13:29.689085 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3089/6180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:29 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:30.711279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:30.711976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:30.718981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:30.719458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:30.720235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:30.720674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:30.875684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:30.883264 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6903a10e-a682-4c90-b45d-743f08a18e0b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.177068 Jul 28 12:13:30.883840 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3092/6181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:30 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:31.904456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:31.905059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:31.911976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:31.912426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:31.913195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:31.913636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:32.054048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:32.062268 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e6ae2b8-0e24-4073-af16-e47725256774 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.161854 Jul 28 12:13:32.062837 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3090/6182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:31 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:33.083457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:33.084106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:33.091246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:33.091712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:33.092496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:33.092946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:33.198310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-8fb04d3e-593a-492a-8de9-35b30f6287b7 req-bfe9d348-f03a-4d1e-9207-93e5866f0e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866e913a-3564-495d-ab68-6e9f8f035195", "name": "network-vif-plugged", "status": "completed", "tag": "b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:13:33.208994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8fb04d3e-593a-492a-8de9-35b30f6287b7 req-bfe9d348-f03a-4d1e-9207-93e5866f0e92 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:33.209999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-8fb04d3e-593a-492a-8de9-35b30f6287b7 req-bfe9d348-f03a-4d1e-9207-93e5866f0e92 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:33.225496 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-8fb04d3e-593a-492a-8de9-35b30f6287b7 req-bfe9d348-f03a-4d1e-9207-93e5866f0e92 service nova] Creating event network-vif-plugged:b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5 for instance 866e913a-3564-495d-ab68-6e9f8f035195 on n-h2-851368-1 Jul 28 12:13:33.234926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-8fb04d3e-593a-492a-8de9-35b30f6287b7 req-bfe9d348-f03a-4d1e-9207-93e5866f0e92 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111709 Jul 28 12:13:33.235596 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3091/6183] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:13:33.263758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:33.272632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ded0b5cf-f95e-4f36-a0ce-c6d99adb4174 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.193064 Jul 28 12:13:33.273139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3093/6184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:33 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:13:34.295275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:34.295956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:34.302204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:34.302664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:34.303476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:34.303922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:34.443215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:34.450842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e52989f2-af85-4396-b3ae-58c2ff25eb97 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1471 microversion: 2.1 time: 0.161445 Jul 28 12:13:34.451480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3092/6185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:34 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:35.471865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:35.472481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:35.481520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.481972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.482743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.483216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.636011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:35.644395 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ff29c86-89eb-4380-84cd-86f09cb86119 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1643 microversion: 2.1 time: 0.176358 Jul 28 12:13:35.644979 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3094/6186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:35 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1643 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:13:35.665390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:35.666000 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:35.672688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.673137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.673903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.674340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.817606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:13:35.826010 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf0d4cd7-9f05-4d37-b922-ac5190a23d93 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1643 microversion: 2.1 time: 0.164503 Jul 28 12:13:35.826577 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3093/6187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:35 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1643 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:35.845450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:13:35.846064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:13:35.852611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.853069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.853834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:35.854273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:35.973369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:36.007027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:36.094828 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9f9c89e4-fce8-44a4-bfd3-2f935c3ece7a tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1794 microversion: 2.1 time: 0.253071 Jul 28 12:13:36.095688 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3095/6188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:13:35 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1794 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:13:37.697754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-615ddcfa-35b8-439f-97f0-d36074cc6a5f req-9803ddf2-b181-4fb8-8b13-94c3b5e39496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866e913a-3564-495d-ab68-6e9f8f035195", "tag": "b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:13:37.703234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:13:37.710115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-615ddcfa-35b8-439f-97f0-d36074cc6a5f req-9803ddf2-b181-4fb8-8b13-94c3b5e39496 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:13:37.710563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-615ddcfa-35b8-439f-97f0-d36074cc6a5f req-9803ddf2-b181-4fb8-8b13-94c3b5e39496 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:13:37.726266 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-615ddcfa-35b8-439f-97f0-d36074cc6a5f req-9803ddf2-b181-4fb8-8b13-94c3b5e39496 service nova] Creating event network-changed:b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5 for instance 866e913a-3564-495d-ab68-6e9f8f035195 on n-h2-851368-1 Jul 28 12:13:37.732609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-615ddcfa-35b8-439f-97f0-d36074cc6a5f req-9803ddf2-b181-4fb8-8b13-94c3b5e39496 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Jul 28 12:13:37.733616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3094/6189] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:14:17.753032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1575987151", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "08517f27-2a33-48ec-82b3-63ef4b6b8f6a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2126487588", "security_groups": []}, "os:scheduler_hints": {"different_host": ["866e913a-3564-495d-ab68-6e9f8f035195"]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:17.762048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:17.762834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=34 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:17.816519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] validate_networks() for [('08517f27-2a33-48ec-82b3-63ef4b6b8f6a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:14:18.249877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:14:18.250571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:14:18.251206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:14:18.252175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:14:18.252697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:14:18.263876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:18.264664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:18.265791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:18.267306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:18.303230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for project 045595e21d1742ccb52de5f7e75a0560. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:14:18.310693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Getting quotas for user 8742dd64d3bc46ff995d723de8425fdf and project 045595e21d1742ccb52de5f7e75a0560. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:14:18.336856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:14:18.339662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:14:18.392307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c1093da-bd1a-4eff-abb8-e833f14ba881 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.643557 Jul 28 12:14:18.399218 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3096/6190] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:14:17 2022] POST /compute/v2.1/servers => generated 361 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:14:18.403024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:18.404339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=34 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:18.409360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dfee38c9-db4f-41b2-9503-45ce06e8e60f tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:18.413624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dfee38c9-db4f-41b2-9503-45ce06e8e60f tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:18.523403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dfee38c9-db4f-41b2-9503-45ce06e8e60f tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:18.532708 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dfee38c9-db4f-41b2-9503-45ce06e8e60f tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1242 microversion: 2.1 time: 0.132160 Jul 28 12:14:18.533304 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3095/6191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:18 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:14:19.553773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:19.555090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:19.562637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:19.563493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:19.564480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:19.565141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:19.652746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:19.682002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16d6e817-94f7-46b0-8d62-990d1bfe015b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1294 microversion: 2.1 time: 0.132124 Jul 28 12:14:19.683908 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3097/6192] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:19 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:20.707386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:20.708727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:20.717778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:20.718596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:20.719682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:20.720815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:20.815914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:20.828838 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba0ff76d-f318-40b9-8a87-9e84fd82e9d0 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.126848 Jul 28 12:14:20.830088 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3096/6193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:20 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:21.105166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-16aa3c39-4c83-4db6-bc8d-f14b055db427 req-1eef8a40-1d4e-40e4-9acd-3bf83791eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a90fadb-4ed0-431d-a256-5a4d1ad9859a", "tag": "07037ae6-2aee-4d93-a31a-21ab3c443ae2"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:21.116202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-16aa3c39-4c83-4db6-bc8d-f14b055db427 req-1eef8a40-1d4e-40e4-9acd-3bf83791eeb1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:21.116571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-16aa3c39-4c83-4db6-bc8d-f14b055db427 req-1eef8a40-1d4e-40e4-9acd-3bf83791eeb1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:21.128085 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-16aa3c39-4c83-4db6-bc8d-f14b055db427 req-1eef8a40-1d4e-40e4-9acd-3bf83791eeb1 service nova] Creating event network-changed:07037ae6-2aee-4d93-a31a-21ab3c443ae2 for instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a on n-h1-851368-1 Jul 28 12:14:21.141875 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-16aa3c39-4c83-4db6-bc8d-f14b055db427 req-1eef8a40-1d4e-40e4-9acd-3bf83791eeb1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045105 Jul 28 12:14:21.142809 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3098/6194] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:14:21.850011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:21.850633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:21.858112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:21.858570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:21.859373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:21.859820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:21.939954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:21.947546 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-176fa700-1009-4aea-a317-8251a6927f29 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.101699 Jul 28 12:14:21.948127 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3097/6195] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:21 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:22.971296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:22.971702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:22.978268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:22.978723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:22.980179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:22.980623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:23.075044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:23.082646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e63e93ce-cd36-4320-9fcb-fc856a8d5525 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.117087 Jul 28 12:14:23.083248 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3099/6196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:22 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:24.103819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:24.104971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:24.111966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:24.112427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:24.113201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:24.113648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:24.194451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:24.202116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eccf93d8-9cfe-4c76-8e72-03de7ffb1c7a tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.102192 Jul 28 12:14:24.202697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3098/6197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:24 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:25.223429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:25.224234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:25.231777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:25.232260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:25.233038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:25.233486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:25.319283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:25.327235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26870a69-fb6d-479d-8ad9-a8797617bb39 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.107700 Jul 28 12:14:25.327838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3100/6198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:25 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:26.350061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:26.350677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:26.357254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:26.357734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:26.358500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:26.358939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:26.442119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:26.450137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89a746b6-f227-4455-9307-76137555a56b tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.104220 Jul 28 12:14:26.450715 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3099/6199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:26 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:27.362390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-883d4a23-9f4e-48e1-b3e8-c0f63cf86e23 req-9e24e42a-ab4d-4c10-aa2b-3bf87b71330a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a90fadb-4ed0-431d-a256-5a4d1ad9859a", "name": "network-vif-plugged", "status": "completed", "tag": "07037ae6-2aee-4d93-a31a-21ab3c443ae2"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:27.373082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-883d4a23-9f4e-48e1-b3e8-c0f63cf86e23 req-9e24e42a-ab4d-4c10-aa2b-3bf87b71330a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:27.373538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-883d4a23-9f4e-48e1-b3e8-c0f63cf86e23 req-9e24e42a-ab4d-4c10-aa2b-3bf87b71330a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:27.384887 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-883d4a23-9f4e-48e1-b3e8-c0f63cf86e23 req-9e24e42a-ab4d-4c10-aa2b-3bf87b71330a service nova] Creating event network-vif-plugged:07037ae6-2aee-4d93-a31a-21ab3c443ae2 for instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a on n-h1-851368-1 Jul 28 12:14:27.390360 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-883d4a23-9f4e-48e1-b3e8-c0f63cf86e23 req-9e24e42a-ab4d-4c10-aa2b-3bf87b71330a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Jul 28 12:14:27.391165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3101/6200] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:14:27.470535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:27.471157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:27.478826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:27.478969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:27.480546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:27.480993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:27.567591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:27.575309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-693a28e2-600f-4a34-a1ad-e4e98384a7be tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.108828 Jul 28 12:14:27.575875 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3100/6201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:27 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:28.594308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:28.595154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:28.602708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:28.603454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:28.610914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:28.611392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:28.612173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:28.613029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:28.700046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:28.708851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b09a6bf0-5b29-44f4-a2b2-2d7eb90c9d82 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1300 microversion: 2.1 time: 0.115454 Jul 28 12:14:28.709430 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3102/6202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:28 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:29.730300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:29.730921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:29.733701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:29.739594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.740055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:29.741046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.741046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:29.825329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:29.834045 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-65216610-ae47-49cc-9464-7914c268707e tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1472 microversion: 2.1 time: 0.107671 Jul 28 12:14:29.834640 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3101/6203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:29 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1472 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:29.854487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:29.855196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:29.862076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.862531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:29.863346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.863792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:29.947530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:29.955988 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15de377c-a02c-4f1b-b3bd-e8162501c3ef tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1472 microversion: 2.1 time: 0.105417 Jul 28 12:14:29.956565 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3103/6204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:29 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1472 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:29.975616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:29.976220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:29.982875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.983300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:29.984059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:29.984495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.068919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5cc6a7e-2d48-4a54-bed0-4746d9d510b0 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1623 microversion: 2.1 time: 0.097287 Jul 28 12:14:30.069490 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3102/6205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:29 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:30.088020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:30.088637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:30.094655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.095152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.095921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.096361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.231116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6a57fdd-e147-4f79-8e8a-51cbed3bf163 tempest-TestSecurityGroupsBasicOps-1610749739 tempest-TestSecurityGroupsBasicOps-1610749739-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1913 microversion: 2.1 time: 0.146700 Jul 28 12:14:30.231698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3104/6206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:30 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1913 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:30.294180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:30.294738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:30.300869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.301328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.302103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.302547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.328173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:14:30.405382 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0dd13d2a-616c-47df-94c3-d75ff5c5f88d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 204 len: 0 microversion: 2.1 time: 0.115391 Jul 28 12:14:30.409082 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3103/6207] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:14:30 2022] DELETE /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:14:30.415496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:30.416141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:30.423189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.423649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.424424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:30.424869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:30.506411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:30.513998 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53f5acff-34dc-474c-a981-25c5d1cc2d9d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1478 microversion: 2.1 time: 0.103472 Jul 28 12:14:30.514567 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3105/6208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:30 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1478 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:31.536192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:31.536899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:31.544145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:31.544610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:31.545411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:31.545873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:31.627163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:31.634995 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-caba8fc2-04fb-4c1d-bfaa-56534d3d85d7 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1478 microversion: 2.1 time: 0.103104 Jul 28 12:14:31.635614 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3104/6209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:31 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1478 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:32.440911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8d67bee1-17f0-433e-8209-3d6b206b3a0b req-f27285e1-a875-41ae-ae41-47b93d868bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a90fadb-4ed0-431d-a256-5a4d1ad9859a", "name": "network-vif-deleted", "tag": "07037ae6-2aee-4d93-a31a-21ab3c443ae2"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:32.451834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8d67bee1-17f0-433e-8209-3d6b206b3a0b req-f27285e1-a875-41ae-ae41-47b93d868bd6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:32.452498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8d67bee1-17f0-433e-8209-3d6b206b3a0b req-f27285e1-a875-41ae-ae41-47b93d868bd6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:32.465770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8d67bee1-17f0-433e-8209-3d6b206b3a0b req-f27285e1-a875-41ae-ae41-47b93d868bd6 service nova] Creating event network-vif-deleted:07037ae6-2aee-4d93-a31a-21ab3c443ae2 for instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a on n-h1-851368-1 Jul 28 12:14:32.477341 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8d67bee1-17f0-433e-8209-3d6b206b3a0b req-f27285e1-a875-41ae-ae41-47b93d868bd6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040159 Jul 28 12:14:32.478273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3106/6210] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:14:32.657022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:32.657586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:32.664697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:32.665151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:32.666009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:32.666447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:32.697856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:32.698332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:32.698784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lazy-loading 'fault' on Instance uuid 7a90fadb-4ed0-431d-a256-5a4d1ad9859a {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:14:32.742888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:32.750350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7190b21d-239e-444d-ac0a-ba69d841d320 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 200 len: 1332 microversion: 2.1 time: 0.097443 Jul 28 12:14:32.750917 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3105/6211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:32 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:33.772401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:33.773092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 7a90fadb-4ed0-431d-a256-5a4d1ad9859a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:33.779382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:33.779833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:33.780591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:33.781026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:33.794742 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] HTTP exception thrown: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Request method failure captured: Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a HTTP/1.1 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n1e6tyUMqu4DHYTLm6InbFsa36-k0514_dOYHy6WQjPB1xcBfv5xErInvRfLgyigLwPrHPaEhS9ClT-SKdTjvAk4KbI9Jp8qMmsv4WDKO42m4dIUk2np2z6SJRNwiy3hewQ_OZJMawsaRVxdoUFSaGNyaSzlTZz-n533ldQFHpV4s4 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 045595e21d1742ccb52de5f7e75a0560 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/045595e21d1742ccb52de5f7e75a0560"}]}] Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 045595e21d1742ccb52de5f7e75a0560 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestSecurityGroupsBasicOps-1450469517-project Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 8742dd64d3bc46ff995d723de8425fdf Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1450469517-project Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7a90fadb-4ed0-431d-a256-5a4d1ad9859a'} Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:14:33.796378 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Returning 404 to user: Instance 7a90fadb-4ed0-431d-a256-5a4d1ad9859a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c17e6cee-b3b2-400c-b474-8a0d5a6cb8cf tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a" status: 404 len: 111 microversion: 2.1 time: 0.030508 Jul 28 12:14:33.801728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3107/6212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:33 2022] GET /compute/v2.1/servers/7a90fadb-4ed0-431d-a256-5a4d1ad9859a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:14:37.888858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:37.889516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:37.891651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b2c7a775-56f2-4991-a009-99058291997c req-99f83ead-8d19-4388-a859-4c458e080521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866e913a-3564-495d-ab68-6e9f8f035195", "tag": "b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:37.898411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:37.899018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:37.899977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:37.900429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:37.902803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b2c7a775-56f2-4991-a009-99058291997c req-99f83ead-8d19-4388-a859-4c458e080521 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:37.903559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b2c7a775-56f2-4991-a009-99058291997c req-99f83ead-8d19-4388-a859-4c458e080521 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:37.915642 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b2c7a775-56f2-4991-a009-99058291997c req-99f83ead-8d19-4388-a859-4c458e080521 service nova] Creating event network-changed:b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5 for instance 866e913a-3564-495d-ab68-6e9f8f035195 on n-h2-851368-1 Jul 28 12:14:37.921544 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b2c7a775-56f2-4991-a009-99058291997c req-99f83ead-8d19-4388-a859-4c458e080521 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Jul 28 12:14:37.923797 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3108/6213] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:14:37.929455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:14:38.013371 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-907a3794-d7f5-4ab3-a2d0-446f31942a59 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "DELETE /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 204 len: 0 microversion: 2.1 time: 0.128253 Jul 28 12:14:38.017285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3106/6214] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:14:37 2022] DELETE /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:14:38.024048 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:38.024854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:38.032253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:38.033053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:38.034140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:38.034597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:38.179451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:38.187689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-df854f30-4f82-4ffa-86ac-ddc5afd8d315 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1768 microversion: 2.1 time: 0.168996 Jul 28 12:14:38.188276 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3109/6215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:38 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1768 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:14:39.210837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:39.211577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:39.218857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:39.219343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:39.220106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:39.220544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:39.362210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:39.369763 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4ac333b-53c7-41da-b73e-ebc68f51c011 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1768 microversion: 2.1 time: 0.163131 Jul 28 12:14:39.370866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3107/6216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:39 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1768 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:39.937396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-706f4743-6aea-4771-8e1f-7fe777dd9b83 req-79fd607c-dce9-4a33-a090-aab682e07d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866e913a-3564-495d-ab68-6e9f8f035195", "name": "network-vif-deleted", "tag": "b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:14:39.948327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-706f4743-6aea-4771-8e1f-7fe777dd9b83 req-79fd607c-dce9-4a33-a090-aab682e07d48 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:39.948781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-706f4743-6aea-4771-8e1f-7fe777dd9b83 req-79fd607c-dce9-4a33-a090-aab682e07d48 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:39.960270 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-706f4743-6aea-4771-8e1f-7fe777dd9b83 req-79fd607c-dce9-4a33-a090-aab682e07d48 service nova] Creating event network-vif-deleted:b152f5d6-bd69-4b1c-b5ad-ed8192bc6ea5 for instance 866e913a-3564-495d-ab68-6e9f8f035195 on n-h2-851368-1 Jul 28 12:14:39.966340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-706f4743-6aea-4771-8e1f-7fe777dd9b83 req-79fd607c-dce9-4a33-a090-aab682e07d48 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 Jul 28 12:14:39.967550 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3110/6217] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:14:40.391678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:40.395259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:40.405946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:40.407238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:40.408109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:40.408633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:40.440673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:40.441030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:40.441502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lazy-loading 'fault' on Instance uuid 866e913a-3564-495d-ab68-6e9f8f035195 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:14:40.444481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:14:40.485477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742dd64d3bc46ff995d723de8425fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '045595e21d1742ccb52de5f7e75a0560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:14:40.492548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8cc7efb8-a587-49bd-98f6-db4f9e90fbf8 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 200 len: 1384 microversion: 2.1 time: 0.104848 Jul 28 12:14:40.493168 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3108/6218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:40 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 1384 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:14:41.514875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:41.515608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] [instance: 866e913a-3564-495d-ab68-6e9f8f035195] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:14:41.522277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:41.522719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:41.523511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:14:41.523946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:14:41.539094 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] HTTP exception thrown: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Request method failure captured: Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 HTTP/1.1 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n1e6tyUMqu4DHYTLm6InbFsa36-k0514_dOYHy6WQjPB1xcBfv5xErInvRfLgyigLwPrHPaEhS9ClT-SKdTjvAk4KbI9Jp8qMmsv4WDKO42m4dIUk2np2z6SJRNwiy3hewQ_OZJMawsaRVxdoUFSaGNyaSzlTZz-n533ldQFHpV4s4 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 045595e21d1742ccb52de5f7e75a0560 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_045595e21d1742ccb52de5f7e75a0560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/045595e21d1742ccb52de5f7e75a0560"}]}] Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 045595e21d1742ccb52de5f7e75a0560 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1450469517 Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestSecurityGroupsBasicOps-1450469517-project Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 8742dd64d3bc46ff995d723de8425fdf Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1450469517-project Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '866e913a-3564-495d-ab68-6e9f8f035195'} Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:14:41.540703 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Returning 404 to user: Instance 866e913a-3564-495d-ab68-6e9f8f035195 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cedcab89-2f3a-4a38-ac74-33a1754e1d95 tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195" status: 404 len: 111 microversion: 2.1 time: 0.032875 Jul 28 12:14:41.546286 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3111/6219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:14:41 2022] GET /compute/v2.1/servers/866e913a-3564-495d-ab68-6e9f8f035195 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:14:44.947468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d8337b5-b6f2-4c02-aa1c-e695109aab2d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] Calling method '.version_select at 0x7f2eb195eca0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:14:44.973960 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d8337b5-b6f2-4c02-aa1c-e695109aab2d tempest-TestSecurityGroupsBasicOps-1450469517 tempest-TestSecurityGroupsBasicOps-1450469517-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2126487588" status: 202 len: 0 microversion: 2.1 time: 0.030062 Jul 28 12:14:44.974519 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3109/6220] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Jul 28 12:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2126487588 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:14:51.628353 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:14:51.628913 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:15:30.974873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:30.975638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=64 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:31.224287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:31.224725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:31.231498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:31.231949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:31.232715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:31.233151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:31.258713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:15:31.334372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3fcb577c-962f-4a09-8b64-e5b0b0232cc2 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "DELETE /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 204 len: 0 microversion: 2.1 time: 0.364786 Jul 28 12:15:31.334973 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3112/6221] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:15:30 2022] DELETE /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:15:31.344652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:31.345279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:31.347372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:31.348146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:31.355852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:31.356310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:31.357092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:31.357533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:31.610461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:31.617986 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7bafb32-f532-4eee-8c47-88cc98ab1489 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1730 microversion: 2.1 time: 0.278088 Jul 28 12:15:31.618555 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3110/6222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:31 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:15:32.638846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:32.639620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:32.646901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:32.647452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:32.648235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:32.648676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:32.714146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f09f9ee0d224dfa8c6de95e42273867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa95cb10295249569a5cdc09dfdcb70a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:32.721795 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bcdcfa8b-c95c-4fa1-a644-3ba172885d67 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 200 len: 1663 microversion: 2.1 time: 0.087335 Jul 28 12:15:32.722661 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3113/6223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:32 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 1663 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:15:32.822766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e4c58097-fb6d-4f7a-ae79-fe882138c36b req-e6c9e3d9-25c1-42c3-950f-3f963f0c2552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d75461-fa82-4418-9782-39809b2305ba", "name": "network-vif-deleted", "tag": "a24c4de2-e241-422d-8a47-8bf4961bc4e9"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:15:32.835568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e4c58097-fb6d-4f7a-ae79-fe882138c36b req-e6c9e3d9-25c1-42c3-950f-3f963f0c2552 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:32.836021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e4c58097-fb6d-4f7a-ae79-fe882138c36b req-e6c9e3d9-25c1-42c3-950f-3f963f0c2552 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:32.862066 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e4c58097-fb6d-4f7a-ae79-fe882138c36b req-e6c9e3d9-25c1-42c3-950f-3f963f0c2552 service nova] Creating event network-vif-deleted:a24c4de2-e241-422d-8a47-8bf4961bc4e9 for instance 02d75461-fa82-4418-9782-39809b2305ba on n-h1-851368-1 Jul 28 12:15:32.867375 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e4c58097-fb6d-4f7a-ae79-fe882138c36b req-e6c9e3d9-25c1-42c3-950f-3f963f0c2552 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048546 Jul 28 12:15:32.869542 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3111/6224] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:15:33.743959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:33.745113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:33.751987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:33.752444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:33.753223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:33.753667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:33.767621 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] HTTP exception thrown: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Request method failure captured: Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba HTTP/1.1 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nyWkOUzkUq5vjIVaLxJwyySfHnrcqWZC2sYzLuzKdcSni3dELnc8CZzwQHJQH8G9fwfbZeeggS3avy4E0QDCZW2zFHoc-9-dauOu5Y8NdPLkt2qbMcJy6KdO1-O7LqniwgoHMmnYL3EB8WjZ2cOLkMI_V68c8RMMv7ULJ0xpiadoKg Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}] Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 4f09f9ee0d224dfa8c6de95e42273867 Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '02d75461-fa82-4418-9782-39809b2305ba'} Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:33.769292 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Returning 404 to user: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d1183402-b456-410f-99f0-329bf2e69b31 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 404 len: 111 microversion: 2.1 time: 0.030901 Jul 28 12:15:33.774704 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3114/6225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:33 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:15:34.241652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:34.242545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:34.251671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:34.252649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:34.253781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:34.254380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:34.269711 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] HTTP exception thrown: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Request method failure captured: Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba HTTP/1.1 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4nyWkOUzkUq5vjIVaLxJwyySfHnrcqWZC2sYzLuzKdcSni3dELnc8CZzwQHJQH8G9fwfbZeeggS3avy4E0QDCZW2zFHoc-9-dauOu5Y8NdPLkt2qbMcJy6KdO1-O7LqniwgoHMmnYL3EB8WjZ2cOLkMI_V68c8RMMv7ULJ0xpiadoKg Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}] Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4f09f9ee0d224dfa8c6de95e42273867 Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '02d75461-fa82-4418-9782-39809b2305ba'} Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:15:34.271404 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Returning 404 to user: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38db75bc-5934-4ba9-8231-533ccd449318 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "DELETE /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 404 len: 111 microversion: 2.1 time: 0.038769 Jul 28 12:15:34.276551 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3112/6226] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:15:34 2022] DELETE /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:15:34.282178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:34.282802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] [instance: 02d75461-fa82-4418-9782-39809b2305ba] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:34.289223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:34.289685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:34.290460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:34.290903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:34.304909 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] HTTP exception thrown: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Request method failure captured: Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba HTTP/1.1 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4nyWkOUzkUq5vjIVaLxJwyySfHnrcqWZC2sYzLuzKdcSni3dELnc8CZzwQHJQH8G9fwfbZeeggS3avy4E0QDCZW2zFHoc-9-dauOu5Y8NdPLkt2qbMcJy6KdO1-O7LqniwgoHMmnYL3EB8WjZ2cOLkMI_V68c8RMMv7ULJ0xpiadoKg Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa95cb10295249569a5cdc09dfdcb70a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa95cb10295249569a5cdc09dfdcb70a"}]}] Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: fa95cb10295249569a5cdc09dfdcb70a Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestServerBasicOps-2088405565 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 4f09f9ee0d224dfa8c6de95e42273867 Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestServerBasicOps-2088405565-project Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '02d75461-fa82-4418-9782-39809b2305ba'} Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:15:34.306370 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Returning 404 to user: Instance 02d75461-fa82-4418-9782-39809b2305ba could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-184b9fa2-d9aa-4077-a061-d16dd3cf77c5 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba" status: 404 len: 111 microversion: 2.1 time: 0.029643 Jul 28 12:15:34.311372 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3115/6227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:34 2022] GET /compute/v2.1/servers/02d75461-fa82-4418-9782-39809b2305ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:15:34.475674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1fdf254-85c4-47f1-a5d9-631a0375c1d3 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] Calling method '.version_select at 0x7f2eb1b69940>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:34.498961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1fdf254-85c4-47f1-a5d9-631a0375c1d3 tempest-TestServerBasicOps-2088405565 tempest-TestServerBasicOps-2088405565-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423546377" status: 202 len: 0 microversion: 2.1 time: 0.027595 Jul 28 12:15:34.499679 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3113/6228] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Jul 28 12:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423546377 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 12:15:35.394859 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:15:35.395396 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:15:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:15:53.670807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790242509", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f3a85859-6cce-4063-b46b-0b9284e3f152", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:15:53.683739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:53.684561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:53.751138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:15:54.143372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:15:54.143805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:15:54.144291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:15:54.144710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:15:54.145137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:15:54.154573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:54.155032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:54.155932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:54.156379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:54.174204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:15:54.179534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:15:54.236553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:15:54.238565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3a85859-6cce-4063-b46b-0b9284e3f152',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:15:54.367658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5cfbcaf-db3e-4a21-8b87-0ed8dc4139c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700575 Jul 28 12:15:54.368317 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3116/6229] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:15:54.377034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:54.377875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:15:54.383355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b05702de-964d-4b03-806d-b7f42ab56e03 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:54.384506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b05702de-964d-4b03-806d-b7f42ab56e03 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:54.442587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b05702de-964d-4b03-806d-b7f42ab56e03 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:54.450398 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b05702de-964d-4b03-806d-b7f42ab56e03 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1057 microversion: 2.1 time: 0.075229 Jul 28 12:15:54.451019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3114/6230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:54 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:15:55.471427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eae82e61-de47-4b83-9af8-9ce9111a0bbc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:55.472059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eae82e61-de47-4b83-9af8-9ce9111a0bbc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:55.539099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eae82e61-de47-4b83-9af8-9ce9111a0bbc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:55.548199 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eae82e61-de47-4b83-9af8-9ce9111a0bbc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1057 microversion: 2.1 time: 0.080150 Jul 28 12:15:55.548976 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3117/6231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:55 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1057 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:15:56.571105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd811256-b299-43d7-ba1c-314c6ec758f9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:56.571822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd811256-b299-43d7-ba1c-314c6ec758f9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:56.643270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd811256-b299-43d7-ba1c-314c6ec758f9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:56.652199 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd811256-b299-43d7-ba1c-314c6ec758f9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1057 microversion: 2.1 time: 0.085237 Jul 28 12:15:56.652770 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3115/6232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:56 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1057 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:15:57.674322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8202d08-7f30-47f0-9b47-8aab661b0183 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:57.675622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e8202d08-7f30-47f0-9b47-8aab661b0183 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:57.736103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e8202d08-7f30-47f0-9b47-8aab661b0183 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:57.745155 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8202d08-7f30-47f0-9b47-8aab661b0183 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1057 microversion: 2.1 time: 0.074887 Jul 28 12:15:57.746073 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3118/6233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:57 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1057 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:15:58.768261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:58.768883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:58.777108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:58.777570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:58.778341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:58.778787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:58.842598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:58.850419 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-db4dd480-cd8e-4a12-9f2e-4eb3756ad3d8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1107 microversion: 2.1 time: 0.086097 Jul 28 12:15:58.851004 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3116/6234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:58 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1107 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:15:59.873102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:15:59.873863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:15:59.881293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:59.881839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:59.882727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:15:59.883276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:15:59.953327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:15:59.961122 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12d4139a-0e56-44ac-90be-c59aa4506d6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1173 microversion: 2.1 time: 0.093366 Jul 28 12:15:59.961998 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3119/6235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:15:59 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1173 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:00.869195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e09171c6-6202-44e0-9e54-ad4ded975c31 req-70ee0a4a-e30e-421d-ba8e-d882a284c8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ec7a5-6bde-4298-990b-72f158efc712", "tag": "5d27062d-89e1-4bb3-99f6-18b3a9e614fc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:00.881716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e09171c6-6202-44e0-9e54-ad4ded975c31 req-70ee0a4a-e30e-421d-ba8e-d882a284c8d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:00.882535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e09171c6-6202-44e0-9e54-ad4ded975c31 req-70ee0a4a-e30e-421d-ba8e-d882a284c8d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:00.897972 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e09171c6-6202-44e0-9e54-ad4ded975c31 req-70ee0a4a-e30e-421d-ba8e-d882a284c8d0 service nova] Creating event network-changed:5d27062d-89e1-4bb3-99f6-18b3a9e614fc for instance 936ec7a5-6bde-4298-990b-72f158efc712 on n-h1-851368-1 Jul 28 12:16:00.904438 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e09171c6-6202-44e0-9e54-ad4ded975c31 req-70ee0a4a-e30e-421d-ba8e-d882a284c8d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041743 Jul 28 12:16:00.906249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3117/6236] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:16:00.982364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:00.983141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:00.990710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:00.991552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:00.992567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:00.993886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:01.160503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:01.169770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0474919c-1b50-4e89-9f1e-1a119dfc9049 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1215 microversion: 2.1 time: 0.191642 Jul 28 12:16:01.170473 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3120/6237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:00 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:02.191537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:02.192286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:02.199452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:02.199914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:02.200697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:02.201143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:02.329937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:02.337959 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a90b245c-dff8-4a86-a7bc-c6aaa1f65aaa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1215 microversion: 2.1 time: 0.150839 Jul 28 12:16:02.338519 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3118/6238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:02 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:03.359747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:03.360369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:03.367466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:03.367976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:03.368746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:03.369183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:03.507513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:03.515915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d69e6d18-a5e0-486f-b027-466789017815 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1215 microversion: 2.1 time: 0.159996 Jul 28 12:16:03.516721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3121/6239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:03 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:04.538108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:04.539515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:04.547128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:04.547420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:04.548229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:04.548671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:04.678184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:04.686427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2badb854-3925-49fc-89d1-467e218ae4cb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.152552 Jul 28 12:16:04.687000 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3119/6240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:04 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:05.707931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:05.708576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:05.710467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:05.716708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:05.717154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:05.717916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:05.718353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:05.853490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:05.861070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f03303c-ecf0-44ab-9258-e4133ad03b5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.157121 Jul 28 12:16:05.861644 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3122/6241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:05 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:06.882177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:06.882713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:06.886202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:06.891608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:06.892059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:06.892819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:06.893254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:07.029376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:07.036837 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21beeb51-dd22-4f75-be83-81c176bd7000 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.158568 Jul 28 12:16:07.037444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3120/6242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:06 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:08.057374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:08.058020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:08.060710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:08.066146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:08.066602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:08.067409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:08.067853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:08.196032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:08.203662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a66e1080-0ef8-4d72-a008-bb8240da349f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.150820 Jul 28 12:16:08.204242 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3123/6243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:08 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:09.224807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:09.225357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:09.232963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:09.233420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:09.234188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:09.234631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:09.364507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:09.372045 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76e51920-60ee-40ef-9904-6029a0f8152f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.151505 Jul 28 12:16:09.372616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3121/6244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:09 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:10.393216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:10.393742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:10.401412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:10.401873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:10.402653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:10.403197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:10.536026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:10.543969 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0bbd8383-7698-4e8c-a74f-c7588f58aa1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.154629 Jul 28 12:16:10.544560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3124/6245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:10 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:11.565554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:11.566156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:11.573154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:11.573610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:11.574383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:11.574827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:11.705374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:11.713901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ebf6a3e-f4a0-49f7-811f-9b3a64ccf8b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.152325 Jul 28 12:16:11.714470 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3122/6246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:11 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:16:12.734615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:12.735262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:12.742327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:12.743416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:12.744191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:12.744633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:12.874445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:12.881955 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cdf09f96-74db-4c10-aaf0-8c556a070a65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.151261 Jul 28 12:16:12.882549 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3125/6247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:12 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:13.901888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:13.902516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:13.909323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:13.909781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:13.910557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:13.911002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:14.048830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:14.057157 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11568b0b-b198-4dfa-959b-baf138834f1f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.159213 Jul 28 12:16:14.057749 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3123/6248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:13 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:15.077586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:15.078202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:15.085141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:15.085593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:15.086841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:15.087323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:15.214530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:15.222215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a3244875-23f1-436b-b942-8041cd3f95f8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.148517 Jul 28 12:16:15.222737 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3126/6249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:15 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:15.935598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-168108e0-2486-497a-a35d-364f3084e521 req-b7e31398-b40e-46be-b18c-e31e9b492cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ec7a5-6bde-4298-990b-72f158efc712", "name": "network-vif-plugged", "status": "completed", "tag": "5d27062d-89e1-4bb3-99f6-18b3a9e614fc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:15.951309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-168108e0-2486-497a-a35d-364f3084e521 req-b7e31398-b40e-46be-b18c-e31e9b492cac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:15.951309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-168108e0-2486-497a-a35d-364f3084e521 req-b7e31398-b40e-46be-b18c-e31e9b492cac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:15.960674 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-168108e0-2486-497a-a35d-364f3084e521 req-b7e31398-b40e-46be-b18c-e31e9b492cac service nova] Creating event network-vif-plugged:5d27062d-89e1-4bb3-99f6-18b3a9e614fc for instance 936ec7a5-6bde-4298-990b-72f158efc712 on n-h1-851368-1 Jul 28 12:16:15.971226 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-168108e0-2486-497a-a35d-364f3084e521 req-b7e31398-b40e-46be-b18c-e31e9b492cac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039250 Jul 28 12:16:15.971857 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3124/6250] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:16:16.243895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:16.244495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:16.251571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:16.252021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:16.252780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:16.253215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:16.381609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:16.389585 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a822f73-550e-4187-8ac6-68dbf96ec536 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.149614 Jul 28 12:16:16.390156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3127/6251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:16 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:17.411523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:17.412313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:17.419203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:17.419654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:17.420425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:17.420863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:17.556173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:17.565140 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df7896db-121e-49ac-8299-0dc0557eea01 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1203 microversion: 2.1 time: 0.158937 Jul 28 12:16:17.565711 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3125/6252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:17 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:18.585628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:18.586269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:18.593203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.593654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:18.594414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.594852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:18.720693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:18.728961 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31081226-62b3-43ed-ab90-4c41da181f5c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1388 microversion: 2.1 time: 0.147284 Jul 28 12:16:18.729538 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3128/6253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:18 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1388 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:18.750454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:18.751103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:18.757951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.758407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:18.759211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.759656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:18.889483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:18.897132 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8fd549ec-f7b9-40b6-9af5-430b667e6c0b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1388 microversion: 2.1 time: 0.151078 Jul 28 12:16:18.897828 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3126/6254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:18 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:18.917744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:18.918356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:18.924358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.924806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:18.925568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:18.925999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:19.053677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:19.061198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb0f5774-0a3f-4316-b030-9fb669caebc4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1388 microversion: 2.1 time: 0.147973 Jul 28 12:16:19.061770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3129/6255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:18 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:19.080688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:19.081203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:19.087823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:19.088280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:19.089055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:19.089502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:19.114044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:16:19.193082 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5762bae2-1884-45f6-af8c-a672824b47cd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 204 len: 0 microversion: 2.1 time: 0.115875 Jul 28 12:16:19.193756 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3127/6256] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:16:19 2022] DELETE /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:16:19.203615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:19.204234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:19.210272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:19.210731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:19.211593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:19.212036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:19.339401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:19.348231 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dbb05363-f00d-4dfb-bd78-66287a385378 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1394 microversion: 2.1 time: 0.148968 Jul 28 12:16:19.350001 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3130/6257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:19 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1394 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:20.372076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:20.372712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:20.380342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:20.380803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:20.381581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:20.382028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:20.514424 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:20.522039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9c3a29d-dd1f-4026-9dbf-50c2abcd63e8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1394 microversion: 2.1 time: 0.155694 Jul 28 12:16:20.522604 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3128/6258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:20 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:21.543646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:21.544276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:21.551848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:21.552232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:21.553032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:21.553479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:21.619692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:21.628139 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-322b8a4d-40be-426c-ba5e-779411903b8c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1352 microversion: 2.1 time: 0.088980 Jul 28 12:16:21.628755 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3131/6259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:21 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:21.696627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ee132ca6-47d7-4748-9fb6-06a20625c069 req-5b4a5cf8-d928-4aaa-b6c0-6f6a5ca443f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ec7a5-6bde-4298-990b-72f158efc712", "name": "network-vif-deleted", "tag": "5d27062d-89e1-4bb3-99f6-18b3a9e614fc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:21.709606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ee132ca6-47d7-4748-9fb6-06a20625c069 req-5b4a5cf8-d928-4aaa-b6c0-6f6a5ca443f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:21.710841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ee132ca6-47d7-4748-9fb6-06a20625c069 req-5b4a5cf8-d928-4aaa-b6c0-6f6a5ca443f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:21.723136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ee132ca6-47d7-4748-9fb6-06a20625c069 req-5b4a5cf8-d928-4aaa-b6c0-6f6a5ca443f9 service nova] Creating event network-vif-deleted:5d27062d-89e1-4bb3-99f6-18b3a9e614fc for instance 936ec7a5-6bde-4298-990b-72f158efc712 on n-h1-851368-1 Jul 28 12:16:21.728999 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ee132ca6-47d7-4748-9fb6-06a20625c069 req-5b4a5cf8-d928-4aaa-b6c0-6f6a5ca443f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036161 Jul 28 12:16:21.729651 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3129/6260] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:16:22.650083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:22.650696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:22.657827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:22.658277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:22.659044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:22.659506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:22.724793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:22.733146 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f9af0bd6-f644-45fd-9969-9c0514b08d56 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1188 microversion: 2.1 time: 0.087549 Jul 28 12:16:22.733803 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3132/6261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:22 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:23.754994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:23.755737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:23.762589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:23.763090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:23.763890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:23.764338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:23.832880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:23.841247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ee4bb418-4520-47fe-ad66-3da3d5f6cca3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1188 microversion: 2.1 time: 0.091452 Jul 28 12:16:23.841839 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3130/6262] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:23 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:24.862365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:24.862947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:24.865570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:24.871051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:24.871528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:24.872323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:24.872766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:24.876431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=87 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:24.938524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:24.946615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-be298a17-4316-4c17-a249-cf9941f5ab42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1188 microversion: 2.1 time: 0.088121 Jul 28 12:16:24.947561 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3133/6263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:24 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:25.967711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:25.968386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:25.971276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:25.977641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:25.978097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:25.978874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:25.979347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:25.984480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:26.014296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:26.015178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:26.015832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid 936ec7a5-6bde-4298-990b-72f158efc712 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:16:26.058818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:26.068649 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49c306e0-d7e6-4e5a-940b-88f5fccb9a2c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 200 len: 1193 microversion: 2.1 time: 0.104863 Jul 28 12:16:26.069246 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3131/6264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:25 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:27.090300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:27.090984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 936ec7a5-6bde-4298-990b-72f158efc712] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:27.098150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:27.098613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:27.099672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:27.100117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:27.114114 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 HTTP/1.1 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '936ec7a5-6bde-4298-990b-72f158efc712'} Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:16:27.115690 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 936ec7a5-6bde-4298-990b-72f158efc712 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ff6875f-d960-4050-bbb5-e90a9c4a90e3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712" status: 404 len: 111 microversion: 2.1 time: 0.031272 Jul 28 12:16:27.120987 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3134/6265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:27 2022] GET /compute/v2.1/servers/936ec7a5-6bde-4298-990b-72f158efc712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:16:32.020566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-691403130", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6803fb4a-d48f-4cb5-b8e2-62f29900a175", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:32.079098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:16:32.547036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:16:32.547501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:16:32.548031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:16:32.548455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:16:32.548880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:16:32.558046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:32.558504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:32.559342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:32.559790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:32.577400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:16:32.582795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:16:32.639414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:16:32.641392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6803fb4a-d48f-4cb5-b8e2-62f29900a175',volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:16:32.769752 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3bca87c5-fb35-42c6-94f5-7ddc0b97e5e7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753293 Jul 28 12:16:32.770637 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3132/6266] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:16:32.781462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-143d2fc8-ff08-441c-ad95-a2b04ba584bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:32.782128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-143d2fc8-ff08-441c-ad95-a2b04ba584bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:32.835993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-143d2fc8-ff08-441c-ad95-a2b04ba584bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:32.842680 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-143d2fc8-ff08-441c-ad95-a2b04ba584bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1056 microversion: 2.1 time: 0.065193 Jul 28 12:16:32.843300 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3135/6267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:32 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1056 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:16:33.865059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:33.865682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:33.873702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:33.874489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:33.875742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:33.876249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:33.957120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:33.970351 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fa1f233-c5f4-4c68-b9c5-16fedee8b537 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1172 microversion: 2.1 time: 0.110209 Jul 28 12:16:33.971171 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3133/6268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:33 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1172 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:16:34.992603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:34.993827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:35.002696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:35.003365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:35.004349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:35.004960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:35.160731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:35.178904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5acb9b59-c5cf-48e3-aead-6082ca744ae4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1214 microversion: 2.1 time: 0.190647 Jul 28 12:16:35.180291 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3136/6269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:34 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:35.188123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-17686171-a6f2-485e-b826-960c7c3a9cf7 req-7edf4844-e90d-470b-ad2d-0133379e566d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fdf206-b7f9-44b4-9102-cdd35911dc1f", "tag": "ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:35.217273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-17686171-a6f2-485e-b826-960c7c3a9cf7 req-7edf4844-e90d-470b-ad2d-0133379e566d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:35.218535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-17686171-a6f2-485e-b826-960c7c3a9cf7 req-7edf4844-e90d-470b-ad2d-0133379e566d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:35.246131 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-17686171-a6f2-485e-b826-960c7c3a9cf7 req-7edf4844-e90d-470b-ad2d-0133379e566d service nova] Creating event network-changed:ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5 for instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f on n-h1-851368-1 Jul 28 12:16:35.252908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-17686171-a6f2-485e-b826-960c7c3a9cf7 req-7edf4844-e90d-470b-ad2d-0133379e566d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067360 Jul 28 12:16:35.254635 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3134/6270] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:16:36.200219 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:36.200835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:36.208505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:36.208961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:36.209762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:36.210203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:36.344044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:36.352782 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7491dd3-80eb-4ced-be5d-4f214f0cf7f2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1214 microversion: 2.1 time: 0.156724 Jul 28 12:16:36.353369 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3137/6271] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:36 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:37.374148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:37.374750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:37.382306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:37.383301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:37.384083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:37.384524 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:37.517906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:37.525901 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0c2ac23-6b67-4925-ac4e-4387f1529408 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1214 microversion: 2.1 time: 0.156170 Jul 28 12:16:37.526469 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3135/6272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:37 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:38.545988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:38.546643 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:38.555852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:38.556322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:38.557117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:38.557841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:38.695892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:38.704093 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c2422d9a-60cf-4c7f-ac58-c0e5c9d94003 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1214 microversion: 2.1 time: 0.162030 Jul 28 12:16:38.704932 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3138/6273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:38 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:39.728015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:39.728590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:39.735522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:39.735988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:39.736763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:39.737211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:39.870693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:39.878181 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ddec7bed-43c9-4c78-9e4f-a8f686c03881 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1202 microversion: 2.1 time: 0.155026 Jul 28 12:16:39.878761 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3136/6274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:39 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:40.898904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:40.899552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:40.906425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:40.906968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:40.907869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:40.908336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:41.040675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:41.048562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0f09530-39a7-40d1-bd70-e5858b48e950 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1202 microversion: 2.1 time: 0.153632 Jul 28 12:16:41.049135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3139/6275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:40 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:42.069441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:42.070722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:42.077898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:42.078356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:42.079149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:42.079591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:42.225668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:42.233242 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4043883-e5a0-4bd5-8b4f-2a7ce3b84a3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1202 microversion: 2.1 time: 0.167777 Jul 28 12:16:42.233822 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3137/6276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:42 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:43.254619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:43.255270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:43.257968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:43.263472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:43.263928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:43.264697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:43.265138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:43.398217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:43.405761 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92e287ab-63e7-4439-8a2e-a68afdfec332 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1202 microversion: 2.1 time: 0.155155 Jul 28 12:16:43.406352 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3140/6277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:43 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:44.030141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-15605617-36d6-480b-a671-f215665eef90 req-f8ebbf4d-d144-48a5-8e54-74d1404acafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fdf206-b7f9-44b4-9102-cdd35911dc1f", "name": "network-vif-plugged", "status": "completed", "tag": "ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:44.035111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:44.035783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:16:44.043585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15605617-36d6-480b-a671-f215665eef90 req-f8ebbf4d-d144-48a5-8e54-74d1404acafc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:44.044030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15605617-36d6-480b-a671-f215665eef90 req-f8ebbf4d-d144-48a5-8e54-74d1404acafc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:44.055366 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-15605617-36d6-480b-a671-f215665eef90 req-f8ebbf4d-d144-48a5-8e54-74d1404acafc service nova] Creating event network-vif-plugged:ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5 for instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f on n-h1-851368-1 Jul 28 12:16:44.060410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-15605617-36d6-480b-a671-f215665eef90 req-f8ebbf4d-d144-48a5-8e54-74d1404acafc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Jul 28 12:16:44.061012 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3138/6278] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:16:44.425838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:44.426505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:44.434069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:44.434526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:44.435330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:44.435777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:44.569166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:44.577798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f2a13c29-6fba-491e-9aa5-e5108add3c68 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1202 microversion: 2.1 time: 0.155797 Jul 28 12:16:44.578377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3141/6279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:44 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:45.604541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:45.605633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:45.613084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.613547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:45.614327 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.615731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:45.755766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:45.764184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35f98c6d-8b33-4e6f-8f10-b35d1155f60e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1387 microversion: 2.1 time: 0.165936 Jul 28 12:16:45.764767 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3139/6280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:45 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1387 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:45.784368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:45.784986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:45.792043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.792489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:45.793249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.793683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:45.926325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:45.934659 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51da7754-eec3-4be3-b10f-48e00ce5b36a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1387 microversion: 2.1 time: 0.154108 Jul 28 12:16:45.935273 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3142/6281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:45 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:45.957687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:45.958313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:45.965486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.965949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:45.966737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:45.967217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:46.100050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:46.107784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ac7e5918-5dfc-41e9-b422-7c9ccd8d7ea0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1387 microversion: 2.1 time: 0.153921 Jul 28 12:16:46.108360 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3140/6282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:45 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:46.128020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:46.128459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:46.135144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:46.135566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:46.136340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:46.136779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:46.160812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:16:46.243847 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec671323-9142-4069-a831-3a356b51f3b8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 204 len: 0 microversion: 2.1 time: 0.119434 Jul 28 12:16:46.244503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3143/6283] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:16:46 2022] DELETE /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:16:46.256341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:46.256964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:46.264528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:46.264985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:46.265824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:46.266265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:46.396489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:46.404158 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8bd871b1-4781-44b1-9f51-d5d211c1bb85 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1393 microversion: 2.1 time: 0.154578 Jul 28 12:16:46.404737 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3141/6284] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:46 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:16:47.426054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:47.426760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:47.433762 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:47.434214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:47.435164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:47.435602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:47.568521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:47.576271 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-75aadc39-2c26-45c2-bc29-4ad7b0185857 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1393 microversion: 2.1 time: 0.154489 Jul 28 12:16:47.576855 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3144/6285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:47 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:48.282525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-00e78955-68d2-46a2-b725-0d05776ae2ad req-cb208ced-0625-4383-9f05-7b63c921476f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fdf206-b7f9-44b4-9102-cdd35911dc1f", "name": "network-vif-deleted", "tag": "ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:16:48.296399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00e78955-68d2-46a2-b725-0d05776ae2ad req-cb208ced-0625-4383-9f05-7b63c921476f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:48.296873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00e78955-68d2-46a2-b725-0d05776ae2ad req-cb208ced-0625-4383-9f05-7b63c921476f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:48.309922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-00e78955-68d2-46a2-b725-0d05776ae2ad req-cb208ced-0625-4383-9f05-7b63c921476f service nova] Creating event network-vif-deleted:ed439eda-b61d-4ae5-bb9b-013b5d8bf2a5 for instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f on n-h1-851368-1 Jul 28 12:16:48.315568 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-00e78955-68d2-46a2-b725-0d05776ae2ad req-cb208ced-0625-4383-9f05-7b63c921476f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036774 Jul 28 12:16:48.316181 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3142/6286] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:16:48.597771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:48.598394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:48.605741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:48.606198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:48.606965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:48.607445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:48.671637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:48.679519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-967b2198-2426-4460-8b3d-88a94e14c577 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1187 microversion: 2.1 time: 0.085726 Jul 28 12:16:48.680102 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3145/6287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:48 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:49.702684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:49.703359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:49.709960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:49.710416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:49.711291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:49.711739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:49.773927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:49.781867 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-67d27c39-d13e-4e2a-a090-256c4401ea52 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1187 microversion: 2.1 time: 0.084934 Jul 28 12:16:49.782452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3143/6288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:49 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:50.801781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:50.802425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:50.810046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:50.810501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:50.811299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:50.811738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:50.878728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:50.886513 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2be56b88-f2c5-437e-886a-a91110676e26 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1187 microversion: 2.1 time: 0.088648 Jul 28 12:16:50.887109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3146/6289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:50 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:51.907282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:51.907913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:51.915734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:51.916194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:51.916971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:51.917415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:51.980298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:16:51.988121 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-49a246dc-1fb0-46c9-95ce-78ea821923dd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 200 len: 1187 microversion: 2.1 time: 0.084847 Jul 28 12:16:51.988703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3144/6290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:51 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:16:53.009045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:16:53.009662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: f0fdf206-b7f9-44b4-9102-cdd35911dc1f] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:16:53.016480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:53.016934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:53.017734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:16:53.018179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:16:53.031274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f HTTP/1.1 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f0fdf206-b7f9-44b4-9102-cdd35911dc1f'} Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:16:53.032915 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance f0fdf206-b7f9-44b4-9102-cdd35911dc1f could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28b82cc4-5731-4dd1-867a-338190aa059c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f" status: 404 len: 111 microversion: 2.1 time: 0.029132 Jul 28 12:16:53.039096 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3147/6291] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:16:53 2022] GET /compute/v2.1/servers/f0fdf206-b7f9-44b4-9102-cdd35911dc1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:17:13.987197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-791541163", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f56be0c6-88b4-4b64-b836-476c1fe31df8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:17:13.997478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:13.998170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=69 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:14.078722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:17:14.439580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:17:14.439955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:17:14.440437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:17:14.440856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:17:14.441275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:17:14.453396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:14.453851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:14.454656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:14.455122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:14.472147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:17:14.478256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:17:14.490289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:17:14.492334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f56be0c6-88b4-4b64-b836-476c1fe31df8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:17:14.566995 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f602282-89d8-49fb-8313-0827d1f78cbd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583919 Jul 28 12:17:14.567703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3145/6292] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:17:14.578420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-78bd8bcb-ffdc-48a3-bd5f-8555ee1ba761 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:14.579041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-78bd8bcb-ffdc-48a3-bd5f-8555ee1ba761 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:14.583718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:14.584942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:14.644664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-78bd8bcb-ffdc-48a3-bd5f-8555ee1ba761 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:14.652128 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-78bd8bcb-ffdc-48a3-bd5f-8555ee1ba761 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1056 microversion: 2.1 time: 0.077499 Jul 28 12:17:14.652706 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3148/6293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:14 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1056 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:15.674701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:15.676948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:15.684536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:15.684995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:15.685921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:15.686566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:15.754476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:15.762116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b768fdf7-f79c-451d-bcf2-68669e9941c1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1126 microversion: 2.1 time: 0.092139 Jul 28 12:17:15.762700 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3146/6294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:15 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1126 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:16.785139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:16.786550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:16.804076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:16.805518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:16.806857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:16.807441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:16.953416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c2991969-667c-4765-a925-38f0a27b45b0 req-ec1b1695-faaa-4928-adda-f19fad0cdff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2204a9fd-051f-4331-a311-f7e9d508db43", "tag": "859d3f11-212c-476e-95e7-8b91fccae8fc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:17:16.972750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c2991969-667c-4765-a925-38f0a27b45b0 req-ec1b1695-faaa-4928-adda-f19fad0cdff0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:16.973398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c2991969-667c-4765-a925-38f0a27b45b0 req-ec1b1695-faaa-4928-adda-f19fad0cdff0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:16.986851 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c2991969-667c-4765-a925-38f0a27b45b0 req-ec1b1695-faaa-4928-adda-f19fad0cdff0 service nova] Creating event network-changed:859d3f11-212c-476e-95e7-8b91fccae8fc for instance 2204a9fd-051f-4331-a311-f7e9d508db43 on n-h1-851368-1 Jul 28 12:17:16.993200 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c2991969-667c-4765-a925-38f0a27b45b0 req-ec1b1695-faaa-4928-adda-f19fad0cdff0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043485 Jul 28 12:17:16.994247 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3147/6295] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:17:17.028954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:17.037193 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12117bb5-2ca3-4fbc-b385-99f188d79c2a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.256903 Jul 28 12:17:17.039158 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3149/6296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:16 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:18.059871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:18.060582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:18.066976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:18.067462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:18.068235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:18.068724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:18.200515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:18.208400 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3b8218b5-2e9e-4dd0-9906-a40525f01560 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.153552 Jul 28 12:17:18.208982 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3148/6297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:18 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:19.232075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:19.233386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:19.240396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:19.241678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:19.242653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:19.243236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:19.399694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:19.409971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d40f888-5bab-4a93-b420-858c4a4a71a8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.182346 Jul 28 12:17:19.410560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3150/6298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:19 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:20.433713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:20.434466 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:20.444370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:20.444823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:20.445600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:20.446097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:20.641275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:20.653670 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-406174dc-7a39-424d-b28f-011e38d61be2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.223979 Jul 28 12:17:20.655029 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3149/6299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:20 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:21.678497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:21.679301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:21.687978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:21.688438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:21.689223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:21.689666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:21.870679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:21.879027 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-355b0fed-9cbf-48a3-90af-0a8ba1bbd706 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.206883 Jul 28 12:17:21.892508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3151/6300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:21 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:17:22.900419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:22.901078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:22.908268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:22.908721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:22.909488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:22.909917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:23.055620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:23.063866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86c42fac-1e2d-4ec7-8348-583cf580a9e6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.167339 Jul 28 12:17:23.064732 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3150/6301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:22 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:24.084986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:24.085603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:24.092515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:24.092967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:24.093733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:24.094173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:24.225372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:24.232834 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f0698de-795b-4950-b6cd-b98c5500c301 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.151815 Jul 28 12:17:24.233403 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3152/6302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:24 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:25.253835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:25.254452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:25.257856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:25.258584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:25.265183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:25.265731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:25.266619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:25.267121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:25.397561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:25.405255 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be1746e6-273b-4379-8f96-7464de2dff43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.155236 Jul 28 12:17:25.405823 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3151/6303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:25 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:26.425712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:26.426370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:26.428378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:26.434708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:26.435198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:26.436014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:26.436459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:26.568495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:26.576194 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80c34ac1-387b-4879-86dc-863f8ec04947 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.154414 Jul 28 12:17:26.576905 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3153/6304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:26 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:27.597908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:27.598614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:27.605249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:27.605723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:27.606541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:27.607386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:27.742651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:27.750177 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c55213b-2fc2-436a-acf1-bbf44729ad8e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.156548 Jul 28 12:17:27.750768 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3152/6305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:27 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:28.771863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:28.772482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:28.778805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:28.779305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:28.780085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:28.780535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:28.911646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:28.919739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-339b5a65-ba14-48d7-a6bb-0d7c3d4cb271 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1168 microversion: 2.1 time: 0.152103 Jul 28 12:17:28.920319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3154/6306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:28 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:29.940750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:29.941375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:29.948583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:29.949043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:29.949828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:29.950368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:30.100733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:30.108942 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de16ce99-9372-4023-958c-40d79a3f779d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1214 microversion: 2.1 time: 0.172072 Jul 28 12:17:30.109638 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3153/6307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:29 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:31.129831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:31.130452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:31.138079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:31.138539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:31.139359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:31.139807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:31.270274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:31.278203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-749325d6-f546-481b-93b7-50f7073c62ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.152416 Jul 28 12:17:31.278880 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3155/6308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:31 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:32.300032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:32.300562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:32.308191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:32.308643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:32.309669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:32.310115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:32.446705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:32.454191 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8b662cc-019e-43cf-aff6-5ae5bfb05eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.158188 Jul 28 12:17:32.454762 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3154/6309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:32 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:33.476159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:33.476781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:33.483793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:33.484251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:33.485026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:33.485472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:33.612380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:33.620450 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-049d2e45-3303-4808-9f1e-9552c6ea46c4 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.149094 Jul 28 12:17:33.621018 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3156/6310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:33 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:34.641031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:34.641647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:34.649182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:34.649631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:34.650404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:34.650852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:34.788202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:34.795753 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-493585d3-1406-49cb-b21a-190497ad008e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.158571 Jul 28 12:17:34.796257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3155/6311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:34 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:35.816226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:35.816835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:35.824289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:35.824734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:35.825494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:35.825937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:35.955819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:35.963956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-50ae230c-04fc-44e9-b73e-e48d568aa8ea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.151675 Jul 28 12:17:35.964526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3157/6312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:35 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:36.985729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:36.986351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:36.994070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:36.994523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:36.995321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:36.995759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:37.133467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:37.141184 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3b66dde-0171-4707-b170-692b1f37df43 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.159321 Jul 28 12:17:37.141703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3156/6313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:36 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:38.162685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:38.163872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:38.171418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:38.171880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:38.172682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:38.173128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:38.314612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:38.323806 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cb328281-b3a2-40ed-b6cd-31b0bf01677c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.165791 Jul 28 12:17:38.324403 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3158/6314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:38 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:39.344676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:39.345295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:39.352868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:39.353335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:39.354132 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:39.354578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:39.481333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:39.488807 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de208344-29d0-414b-90cd-80eb2808bf4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.148069 Jul 28 12:17:39.489387 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3157/6315] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:39 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:40.236263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-94e7c91e-38df-411d-9ee2-810d432477e0 req-ba2449c1-da83-4072-b733-0ee4362fab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2204a9fd-051f-4331-a311-f7e9d508db43", "name": "network-vif-plugged", "status": "completed", "tag": "859d3f11-212c-476e-95e7-8b91fccae8fc"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:17:40.248497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-94e7c91e-38df-411d-9ee2-810d432477e0 req-ba2449c1-da83-4072-b733-0ee4362fab52 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:40.248956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-94e7c91e-38df-411d-9ee2-810d432477e0 req-ba2449c1-da83-4072-b733-0ee4362fab52 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:40.261348 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-94e7c91e-38df-411d-9ee2-810d432477e0 req-ba2449c1-da83-4072-b733-0ee4362fab52 service nova] Creating event network-vif-plugged:859d3f11-212c-476e-95e7-8b91fccae8fc for instance 2204a9fd-051f-4331-a311-f7e9d508db43 on n-h1-851368-1 Jul 28 12:17:40.266813 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-94e7c91e-38df-411d-9ee2-810d432477e0 req-ba2449c1-da83-4072-b733-0ee4362fab52 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Jul 28 12:17:40.267453 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3159/6316] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:17:40.510972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:40.511626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:40.518446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:40.518896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:40.519699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:40.520165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:40.659313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:40.667008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b216d5f6-a280-4793-bd9a-6af0ca3400ab tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.160528 Jul 28 12:17:40.667630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3158/6317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:40 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:41.688927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:41.689642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:41.696891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:41.697294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:41.698067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:41.698515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:41.826108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:41.833674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0bf3d999-2879-472a-9d45-11f3f236867a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1202 microversion: 2.1 time: 0.149051 Jul 28 12:17:41.834257 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3160/6318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:41 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:42.854579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:42.855231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:42.862156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:42.862611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:42.863482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:42.863923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:42.991511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:42.999091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fb4c8548-eecf-4b28-9c70-fa3b87529e94 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1388 microversion: 2.1 time: 0.148471 Jul 28 12:17:42.999675 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3159/6319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:42 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:43.019314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:43.019932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:43.026836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.027322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.028078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.028512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.162044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:43.169557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9d45e146-0463-4afd-8288-70918a43145d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1388 microversion: 2.1 time: 0.154108 Jul 28 12:17:43.170134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3161/6320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:43 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1388 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:43.189789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:43.190405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:43.196507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.196996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.197761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.198203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.327350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:43.334925 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71902015-0145-459f-ac40-0a58a4dd806b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1388 microversion: 2.1 time: 0.149072 Jul 28 12:17:43.335530 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3160/6321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:43 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:43.410730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:43.411270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:43.417712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.418161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.418920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.419392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.444178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:17:43.518402 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7549e35-4720-48b1-8190-6908e1a03ef2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 204 len: 0 microversion: 2.1 time: 0.111181 Jul 28 12:17:43.518999 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3162/6322] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:17:43 2022] DELETE /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:17:43.528420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:43.529039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:43.535194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.535649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.537047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:43.537492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:43.666767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:43.674523 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc8cf69d-1275-4bfa-8511-464a8aba9511 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1394 microversion: 2.1 time: 0.149945 Jul 28 12:17:43.675233 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3161/6323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:43 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1394 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:17:44.696304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:44.697004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:44.699803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:44.705456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:44.705910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:44.706689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:44.707156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:44.713883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:44.844856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:44.853016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d297e0b8-40a0-4320-abba-811b41b1db3c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1394 microversion: 2.1 time: 0.161071 Jul 28 12:17:44.853592 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3163/6324] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:44 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1394 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:45.740055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-94507a1b-6c3b-4c4e-b434-ffb1fe66f6f3 req-dacad399-751a-4b44-aca8-e6de89564143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2204a9fd-051f-4331-a311-f7e9d508db43", "name": "network-vif-deleted", "tag": "859d3f11-212c-476e-95e7-8b91fccae8fc"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:17:45.752982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:45.762880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-94507a1b-6c3b-4c4e-b434-ffb1fe66f6f3 req-dacad399-751a-4b44-aca8-e6de89564143 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:45.763239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-94507a1b-6c3b-4c4e-b434-ffb1fe66f6f3 req-dacad399-751a-4b44-aca8-e6de89564143 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:45.767762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:17:45.778575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-94507a1b-6c3b-4c4e-b434-ffb1fe66f6f3 req-dacad399-751a-4b44-aca8-e6de89564143 service nova] Creating event network-vif-deleted:859d3f11-212c-476e-95e7-8b91fccae8fc for instance 2204a9fd-051f-4331-a311-f7e9d508db43 on n-h1-851368-1 Jul 28 12:17:45.786591 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-94507a1b-6c3b-4c4e-b434-ffb1fe66f6f3 req-dacad399-751a-4b44-aca8-e6de89564143 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056774 Jul 28 12:17:45.788180 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3162/6325] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:17:45.874073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:45.874778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:45.882968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:45.883569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:45.884456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:45.884969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:45.957654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:45.968853 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-032904e8-f5bc-4728-a2d0-81c9b26d6202 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1187 microversion: 2.1 time: 0.098814 Jul 28 12:17:45.972582 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3164/6326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:45 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:46.990354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:46.991215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:46.998660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:46.999155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:46.999939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:47.000390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:47.066814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:47.075100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-88d78f05-5fbf-4b1e-89bc-c92408d23bbb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1187 microversion: 2.1 time: 0.089024 Jul 28 12:17:47.075671 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3163/6327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:46 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:48.097416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:48.098059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:48.105614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:48.106074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:48.106858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:48.107358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:48.169854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:48.177945 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eab6b921-422a-4065-b31a-b7f67eebee23 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1187 microversion: 2.1 time: 0.084433 Jul 28 12:17:48.178767 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3165/6328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:48 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:49.198557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:49.199830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:49.206833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:49.207332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:49.208695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:49.209139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:49.269915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:49.278293 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92a7798d-b2b1-4272-9d47-962e84702c38 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1187 microversion: 2.1 time: 0.083690 Jul 28 12:17:49.278872 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3164/6329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:49 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:50.298875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:50.299863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:50.308518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:50.309263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:50.312603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:50.312603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:50.342775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:50.343406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:50.343988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid 2204a9fd-051f-4331-a311-f7e9d508db43 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:17:50.387407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:17:50.394577 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf1ea121-8f79-43ee-b37b-d1cf6153bf71 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 200 len: 1146 microversion: 2.1 time: 0.099672 Jul 28 12:17:50.395162 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3166/6330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:50 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 1146 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:17:51.415743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:51.416954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:51.424626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:51.424626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:51.425341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:51.425784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:51.440176 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 HTTP/1.1 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '2204a9fd-051f-4331-a311-f7e9d508db43'} Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:51.441881 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13ca46ed-ac35-4ba4-901d-79f8ece685eb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 404 len: 111 microversion: 2.1 time: 0.032388 Jul 28 12:17:51.446902 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3165/6331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:51 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:17:53.584615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:53.585118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:53.592208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:53.592672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:53.593454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:53.593900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:53.610540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 HTTP/1.1 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '2204a9fd-051f-4331-a311-f7e9d508db43'} Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:17:53.612284 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-76af5be4-d99f-4c44-b4d1-f3b97b887808 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 404 len: 111 microversion: 2.1 time: 0.033237 Jul 28 12:17:53.621821 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3167/6332] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:17:53 2022] DELETE /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:17:53.623813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:17:53.623813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 2204a9fd-051f-4331-a311-f7e9d508db43] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:17:53.631042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:53.631530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:53.632312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:17:53.632757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:17:53.646588 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 HTTP/1.1 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '2204a9fd-051f-4331-a311-f7e9d508db43'} Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:17:53.648170 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 2204a9fd-051f-4331-a311-f7e9d508db43 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-978da89e-f62d-4c90-af70-e788e6c2cf44 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43" status: 404 len: 111 microversion: 2.1 time: 0.030720 Jul 28 12:17:53.656107 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3166/6333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:17:53 2022] GET /compute/v2.1/servers/2204a9fd-051f-4331-a311-f7e9d508db43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:18:11.521426 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:18:11.522417 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:18:13.253471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-168110410", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fc29dafc-daf7-444c-b5d4-a7c75f5ec505", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:13.263539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=11 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:13.264498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=27 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:13.317178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:18:13.625914 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:18:13.626404 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.93) !!! Jul 28 12:18:14.003218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:18:14.003675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:18:14.004723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:18:14.005136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:18:14.005555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:18:14.015602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:14.016053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:14.016855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:14.017295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:14.034626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:18:14.039880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:18:14.099417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:18:14.101547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc29dafc-daf7-444c-b5d4-a7c75f5ec505',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:18:14.225705 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a03178f-0ce5-4cba-bf9b-42e82d146e30 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976041 Jul 28 12:18:14.226409 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3168/6334] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:18:14.237454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d34ee17-b992-4f93-9f3e-f8f5d9614900 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:14.238155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d34ee17-b992-4f93-9f3e-f8f5d9614900 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:14.240980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=9 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:14.241705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=17 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:14.302072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d34ee17-b992-4f93-9f3e-f8f5d9614900 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:14.308834 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d34ee17-b992-4f93-9f3e-f8f5d9614900 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1070 microversion: 2.1 time: 0.075554 Jul 28 12:18:14.309426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3167/6335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:14 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1070 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:15.330635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:15.331452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:15.338919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:15.339442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:15.340220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:15.340695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:15.417899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:15.426036 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a6481ebc-95b8-4d0a-9b0b-a4580cec48ff tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1186 microversion: 2.1 time: 0.100074 Jul 28 12:18:15.426621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3169/6336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:15 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:16.447334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:16.447966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:16.455316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:16.456091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:16.456945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:16.457465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:16.589813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:16.598553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1423b951-72f0-438b-9a40-4b4aa8823a21 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1228 microversion: 2.1 time: 0.154596 Jul 28 12:18:16.599482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3168/6337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:16 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1228 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:16.867317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-033302e4-a2f2-4ff0-a5cd-a511429d6930 req-9c5322ce-dfdf-4cd3-9bcc-f2d0b220f20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99462c1-8dba-435c-bf68-38e1cc1c285e", "tag": "db5e33d2-3b49-4937-a3ca-16ffce5d4727"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:16.888609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-033302e4-a2f2-4ff0-a5cd-a511429d6930 req-9c5322ce-dfdf-4cd3-9bcc-f2d0b220f20a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:16.891757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-033302e4-a2f2-4ff0-a5cd-a511429d6930 req-9c5322ce-dfdf-4cd3-9bcc-f2d0b220f20a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:16.904832 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-033302e4-a2f2-4ff0-a5cd-a511429d6930 req-9c5322ce-dfdf-4cd3-9bcc-f2d0b220f20a service nova] Creating event network-changed:db5e33d2-3b49-4937-a3ca-16ffce5d4727 for instance d99462c1-8dba-435c-bf68-38e1cc1c285e on n-h1-851368-1 Jul 28 12:18:16.910793 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-033302e4-a2f2-4ff0-a5cd-a511429d6930 req-9c5322ce-dfdf-4cd3-9bcc-f2d0b220f20a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055495 Jul 28 12:18:16.911441 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3170/6338] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:18:17.620668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:17.621579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:17.629802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:17.630414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:17.631497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:17.632210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:17.777015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:17.784662 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1226282e-dfba-47a9-b171-fdb32297dc42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1228 microversion: 2.1 time: 0.168026 Jul 28 12:18:17.785874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3169/6339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:17 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:18.807114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:18.807737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:18.814237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:18.814686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:18.815510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:18.815954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:18.944886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:18.953172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c59660c1-7a6d-43ab-89e1-a0ff90f8f17d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1228 microversion: 2.1 time: 0.151248 Jul 28 12:18:18.953790 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3171/6340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:18 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1228 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:19.975112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:19.975911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:19.983301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:19.983757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:19.984543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:19.984987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:20.123027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:20.131222 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41b5ac0e-b031-44a7-8457-c01e2e519f3b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1228 microversion: 2.1 time: 0.161072 Jul 28 12:18:20.131801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3170/6341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:19 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1228 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:21.151645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:21.152246 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:21.159173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:21.159633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:21.160402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:21.160844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:21.287373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:21.294851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-91f9fffe-a236-4158-9ed9-a9af21341db0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.147146 Jul 28 12:18:21.295456 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3172/6342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:21 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:22.316935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:22.317490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:22.324426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:22.324884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:22.325660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:22.326101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:22.452236 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:22.460391 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e7760f2a-6dfa-4d83-8bb4-ea2c22085772 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.147977 Jul 28 12:18:22.460963 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3171/6343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:22 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:23.481072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:23.481622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:23.488473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:23.488920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:23.489677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:23.490112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:23.619384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:23.626779 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4acddf6b-34da-491c-8a3b-407cd6147d60 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.149709 Jul 28 12:18:23.627375 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3173/6344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:23 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:24.647992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:24.648623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:24.651388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:24.657304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:24.657780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:24.658547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:24.658986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:24.797782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:24.805422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-557b62ab-862b-44d7-8950-0c27eabdacde tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.161436 Jul 28 12:18:24.806000 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3172/6345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:24 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:25.825854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:25.826478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:25.828457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:25.829128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:25.836531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:25.836983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:25.837750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:25.838187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:26.084202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:26.091753 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4c21ad12-600b-41e9-8eb7-27266e2e48bc tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.269804 Jul 28 12:18:26.092340 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3174/6346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:25 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:27.112785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:27.113900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:27.120069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:27.120516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:27.121270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:27.121710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:27.251668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:27.259866 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-37072e06-140f-405c-8b02-f4df0ca34495 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.151308 Jul 28 12:18:27.260437 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3173/6347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:27 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:28.280597 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:28.281206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:28.288359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:28.288806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:28.289892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:28.290343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:28.422638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:28.431491 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-57bc8a9a-936e-4be3-b940-2b29e8486ae6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.154781 Jul 28 12:18:28.432077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3175/6348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:28 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:29.452652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:29.453279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:29.460821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:29.461277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:29.462050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:29.462495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:29.591404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:29.599775 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92c0f7c6-6eb3-4421-a97f-a313e6189b5f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.151022 Jul 28 12:18:29.600339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3174/6349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:29 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:30.442335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-01c45482-d00e-4552-9959-d612995c79a0 req-b3e480d7-893b-4fd2-9384-a6546ea1b4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99462c1-8dba-435c-bf68-38e1cc1c285e", "name": "network-vif-plugged", "status": "completed", "tag": "db5e33d2-3b49-4937-a3ca-16ffce5d4727"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:30.453098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-01c45482-d00e-4552-9959-d612995c79a0 req-b3e480d7-893b-4fd2-9384-a6546ea1b4ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:30.453548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-01c45482-d00e-4552-9959-d612995c79a0 req-b3e480d7-893b-4fd2-9384-a6546ea1b4ea service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:30.465358 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-01c45482-d00e-4552-9959-d612995c79a0 req-b3e480d7-893b-4fd2-9384-a6546ea1b4ea service nova] Creating event network-vif-plugged:db5e33d2-3b49-4937-a3ca-16ffce5d4727 for instance d99462c1-8dba-435c-bf68-38e1cc1c285e on n-h1-851368-1 Jul 28 12:18:30.470292 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-01c45482-d00e-4552-9959-d612995c79a0 req-b3e480d7-893b-4fd2-9384-a6546ea1b4ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Jul 28 12:18:30.470896 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3176/6350] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:18:30.620101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:30.620738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:30.627907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:30.628394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:30.629689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:30.630125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:30.756462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:30.763879 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ecf1ced-1ef2-42ee-8dd5-0c88733b1406 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.147700 Jul 28 12:18:30.764444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3175/6351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:30 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:31.786563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:31.787473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:31.793737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:31.794187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:31.794950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:31.795415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:31.928613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:31.936170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f15b07e9-e5a8-43cd-9378-2388f1e60291 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1216 microversion: 2.1 time: 0.155398 Jul 28 12:18:31.936745 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3177/6352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:31 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:32.957429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:32.958051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:32.965058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:32.965517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:32.966285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:32.966727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:33.093460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:33.101310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-741924d2-efba-400e-af17-229b75eedb13 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1401 microversion: 2.1 time: 0.148417 Jul 28 12:18:33.101883 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3176/6353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:32 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1401 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:33.121415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:33.122021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:33.129564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:33.130010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:33.130798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:33.131264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:33.264601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:33.272158 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26b354ba-10ea-416b-9dc7-8169f4d08d4c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1401 microversion: 2.1 time: 0.154619 Jul 28 12:18:33.272729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3178/6354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:33 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1401 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:33.291999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1535044448"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:33.294321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:33.300816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:33.301278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:33.302046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:33.302485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:33.393829 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Attempting to quiesce instance before volume snapshot. Jul 28 12:18:33.463221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 28 12:18:33.529784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Creating snapshot from volume fc29dafc-daf7-444c-b5d4-a7c75f5ec505. {{(pid=119235) snapshot_instance /opt/stack/nova/nova/compute/api.py:3457}} Jul 28 12:18:34.436767 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3fe35970-3d54-4737-8452-8007cf566156 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e/action" status: 202 len: 0 microversion: 2.1 time: 1.143407 Jul 28 12:18:34.436767 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3177/6355] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:18:33 2022] POST /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e/action => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 12:18:35.591092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-949112223", "imageRef": "9da0c853-fc03-4252-b33a-aba58ba83615", "flavorRef": "452", "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:35.646566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:18:36.059897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:18:36.060343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:18:36.060814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:18:36.061224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:18:36.061635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:18:36.070624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:36.071010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:36.071837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:36.072270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:36.089016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:18:36.094152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:18:36.106385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:18:36.108870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='98f13075-44e1-4c40-a97f-be96814d4858',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:18:36.184860 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed9f6790-d2af-43a2-a4ea-d711bbf4d1d2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597550 Jul 28 12:18:36.185561 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3179/6356] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:18:36.198492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c2bc62d-286c-427c-b55e-cefa1c5bba62 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:36.199250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c2bc62d-286c-427c-b55e-cefa1c5bba62 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:36.252681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0c2bc62d-286c-427c-b55e-cefa1c5bba62 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:36.260120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c2bc62d-286c-427c-b55e-cefa1c5bba62 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1229 microversion: 2.1 time: 0.066893 Jul 28 12:18:36.260731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3178/6357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:36 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1229 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:37.280980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:37.282288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:37.289511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:37.290310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:37.291435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:37.291877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:37.399736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:37.409581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e88d32e8-6371-4c46-9b27-f5e477c0baea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1289 microversion: 2.1 time: 0.132991 Jul 28 12:18:37.411259 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3180/6358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:37 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:38.432849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:38.433862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:38.446773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:38.447433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:38.448491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:38.449067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:38.656742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:38.665264 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-175427fb-fe50-497e-a7c3-4ba75b970f87 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.237148 Jul 28 12:18:38.666420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3179/6359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:38 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:39.112453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0d0a41ce-b8d9-4072-8d6f-7b69f76768c6 req-eeaca5b5-1405-4c2f-abe7-c8b00f438feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a", "tag": "b3558c1a-dfd6-467a-a473-5318690aa8d1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:18:39.123802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0d0a41ce-b8d9-4072-8d6f-7b69f76768c6 req-eeaca5b5-1405-4c2f-abe7-c8b00f438feb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:39.124437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0d0a41ce-b8d9-4072-8d6f-7b69f76768c6 req-eeaca5b5-1405-4c2f-abe7-c8b00f438feb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:39.140070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0d0a41ce-b8d9-4072-8d6f-7b69f76768c6 req-eeaca5b5-1405-4c2f-abe7-c8b00f438feb service nova] Creating event network-changed:b3558c1a-dfd6-467a-a473-5318690aa8d1 for instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a on n-h2-851368-1 Jul 28 12:18:39.146407 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0d0a41ce-b8d9-4072-8d6f-7b69f76768c6 req-eeaca5b5-1405-4c2f-abe7-c8b00f438feb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127386 Jul 28 12:18:39.147621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3181/6360] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:18:39.688311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:39.688943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:39.697534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:39.698006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:39.698832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:39.699529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:39.913943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:39.921818 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa51571c-2fc9-4473-bc1f-891272744f91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.237439 Jul 28 12:18:39.922535 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3180/6361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:39 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:40.946444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:40.947267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:40.953691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:40.954231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:40.955401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:40.955839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:41.099781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:41.113406 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9124616f-585f-4ab9-875c-0851ca255478 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.173244 Jul 28 12:18:41.114839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3182/6362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:40 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:18:42.135450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:42.137403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:42.146322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:42.147173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:42.148285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:42.148829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:42.339849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:42.360136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df244e44-229d-446b-bf4f-7b5aa631e692 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.227740 Jul 28 12:18:42.361576 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3181/6363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:42 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:43.384652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:43.385363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:43.389373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:43.393895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:43.394355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:43.395791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:43.396420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:43.401167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=71 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:43.561695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:43.577618 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6f590951-6e6d-4e6b-b50b-5e610b6b5ec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.197819 Jul 28 12:18:43.578400 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3183/6364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:43 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:44.599621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:44.600242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:44.604933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:44.609268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:44.609729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:44.610944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:44.611638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:44.634016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:44.755303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:44.762983 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e290e8e-ff51-4ad1-a56c-db8614ee9090 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.168345 Jul 28 12:18:44.764022 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3182/6365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:44 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:45.784425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:45.785949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:45.794919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:45.795388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:45.796446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:45.796915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:45.959170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:45.978519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dad7ea08-2958-43e1-9a5d-67c8a52a4fb0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.198150 Jul 28 12:18:45.979623 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3184/6366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:45 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:47.000128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:47.000775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:47.003790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:47.009532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:47.010002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:47.010795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:47.011294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:47.149093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:47.157314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-641ad21c-eef3-4e07-ba66-e8cce4b6be81 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.161247 Jul 28 12:18:47.157886 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3183/6367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:46 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:48.178358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:48.179010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:48.180887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:48.181570 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:18:48.188543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:48.189004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:48.189784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:48.190231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:48.321628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:48.329347 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1598bc4-28c1-4012-92f1-1d7907d8aff9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.155428 Jul 28 12:18:48.329918 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3185/6368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:48 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:49.350444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:49.351094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:49.358618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:49.359287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:49.360354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:49.360869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:49.500223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:49.508859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21e9cda2-3cb4-466f-87c7-e60fdfbd1ce8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.162786 Jul 28 12:18:49.509570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3184/6369] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:49 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:50.529777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:50.530844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:50.537531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:50.537979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:50.538752 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:50.539212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:50.673139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:50.681178 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f35eb304-f85c-4c3a-86a0-fb1d1e98c759 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1341 microversion: 2.1 time: 0.155446 Jul 28 12:18:50.681744 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3186/6370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:50 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:51.702064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:51.702922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:51.711802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:51.712279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:51.713268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:51.713768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:51.854609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:51.862864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b0adbc16-0ca4-4486-8bf3-cc9f52835cad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1387 microversion: 2.1 time: 0.165377 Jul 28 12:18:51.864028 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3185/6371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:51 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1387 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:52.884330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:52.884960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:52.892576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:52.892968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:52.893753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:52.894200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:53.030496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:53.038016 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e9471d9-d97d-49e9-9812-ebf4f7f99b1e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.157757 Jul 28 12:18:53.038595 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3187/6372] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:52 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:54.058902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:54.059559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:54.066586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:54.067058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:54.067867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:54.068323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:54.198795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:54.206693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6aff1b15-349e-4634-bdd9-a200a0e16eec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.151539 Jul 28 12:18:54.208880 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3186/6373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:54 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:55.229284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:55.230002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:55.237264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:55.237716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:55.239078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:55.239547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:55.377244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:55.385738 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-515ef311-5450-4349-a7d9-c1037404ddad tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.160655 Jul 28 12:18:55.386325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3188/6374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:55 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:18:55.405385 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:18:55.405668 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:18:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:18:56.409514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:56.411156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:56.420700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:56.421281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:56.422446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:56.423126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:56.571779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:56.580336 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-acae4e24-aa06-4b9c-b97f-879e1c098831 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.176287 Jul 28 12:18:56.580951 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3187/6375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:56 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:57.603572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:57.604213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:57.610391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:57.610840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:57.611637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:57.612072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:57.740568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:57.748127 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cce4d882-2cb6-4263-be6c-b548f7a1fc83 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.148880 Jul 28 12:18:57.748813 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3189/6376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:57 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:18:58.770525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:58.771317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:58.778481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:58.778955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:58.779784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:58.780361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:58.919840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:18:58.927314 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-34b2e205-7a8e-4aba-b9b4-c59c6194e040 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.161254 Jul 28 12:18:58.927888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3188/6377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:58 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:18:59.948066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:18:59.948717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:18:59.957266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:59.957714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:18:59.958562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:18:59.958999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:00.105399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:00.113615 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef3b80cc-86c0-433f-b969-299f9bd7b7bf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.169228 Jul 28 12:19:00.114168 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3190/6378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:18:59 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:00.958018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e48857ac-5045-411a-9b6c-f10f0f28e5bd req-b15838d0-4950-4731-bd1d-76eb1f12c265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a", "name": "network-vif-plugged", "status": "completed", "tag": "b3558c1a-dfd6-467a-a473-5318690aa8d1"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:00.969207 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e48857ac-5045-411a-9b6c-f10f0f28e5bd req-b15838d0-4950-4731-bd1d-76eb1f12c265 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:00.969677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e48857ac-5045-411a-9b6c-f10f0f28e5bd req-b15838d0-4950-4731-bd1d-76eb1f12c265 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:00.981727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e48857ac-5045-411a-9b6c-f10f0f28e5bd req-b15838d0-4950-4731-bd1d-76eb1f12c265 service nova] Creating event network-vif-plugged:b3558c1a-dfd6-467a-a473-5318690aa8d1 for instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a on n-h2-851368-1 Jul 28 12:19:00.987449 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e48857ac-5045-411a-9b6c-f10f0f28e5bd req-b15838d0-4950-4731-bd1d-76eb1f12c265 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108533 Jul 28 12:19:00.988960 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3189/6379] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:19:01.136111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:01.137324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:01.144684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:01.145141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:01.145920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:01.146399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:01.296316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:01.305088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f19fc36c-0e04-4b1e-9d13-ebb6f178911b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1375 microversion: 2.1 time: 0.174789 Jul 28 12:19:01.305710 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3191/6380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:01 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:02.329136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:02.330075 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:02.339261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.339848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.340837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.341534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.485353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:02.493738 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-430e6f3c-7943-4d78-9093-a54683aab139 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1561 microversion: 2.1 time: 0.170348 Jul 28 12:19:02.494316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3190/6381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:02 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:02.515269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:02.515911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:02.524550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.525286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.526174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.526746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.686325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:02.695024 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55f5c969-94ae-4781-abb9-9c59ab1441ed tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1561 microversion: 2.1 time: 0.184597 Jul 28 12:19:02.695667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3192/6382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:02 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:02.780292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:02.780976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:02.788500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.789098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.790110 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.790584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.821827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:19:02.903392 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b459a6f7-d316-4240-a6b5-812156b5bc0f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 204 len: 0 microversion: 2.1 time: 0.127551 Jul 28 12:19:02.903963 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3191/6383] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:19:02 2022] DELETE /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:19:02.914101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:02.914725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:02.921596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.922041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:02.922801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:02.923271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:03.062093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:03.071239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cf3a4286-4dff-44c8-8d5a-4008b3ec8268 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1567 microversion: 2.1 time: 0.162452 Jul 28 12:19:03.072170 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3193/6384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:02 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:04.092719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:04.093493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:04.102004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:04.102669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:04.103678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:04.104219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:04.248250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:04.256138 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2897c92e-a16b-4e07-b350-1d4415983f5e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1567 microversion: 2.1 time: 0.168086 Jul 28 12:19:04.256707 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3192/6385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:04 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:19:05.054567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c236b525-2244-4699-bf81-370ff3ea4db1 req-6d4c58c6-edf1-4ff6-95d9-b97ccfb44c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a", "name": "network-vif-deleted", "tag": "b3558c1a-dfd6-467a-a473-5318690aa8d1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:05.065500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c236b525-2244-4699-bf81-370ff3ea4db1 req-6d4c58c6-edf1-4ff6-95d9-b97ccfb44c3f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:05.065874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c236b525-2244-4699-bf81-370ff3ea4db1 req-6d4c58c6-edf1-4ff6-95d9-b97ccfb44c3f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:05.085522 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c236b525-2244-4699-bf81-370ff3ea4db1 req-6d4c58c6-edf1-4ff6-95d9-b97ccfb44c3f service nova] Creating event network-vif-deleted:b3558c1a-dfd6-467a-a473-5318690aa8d1 for instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a on n-h2-851368-1 Jul 28 12:19:05.091976 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c236b525-2244-4699-bf81-370ff3ea4db1 req-6d4c58c6-edf1-4ff6-95d9-b97ccfb44c3f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041110 Jul 28 12:19:05.093332 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3194/6386] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:19:05.283003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:05.283909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:05.291481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:05.292004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:05.292834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:05.293321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:05.361404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:05.369550 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bd54dc48-74df-42b6-9e00-4107c38e65d7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1360 microversion: 2.1 time: 0.090550 Jul 28 12:19:05.370130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3193/6387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:05 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:06.391362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:06.391977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:06.398304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:06.398756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:06.399588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:06.400024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:06.471213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:06.479739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f5520aa-1da1-4a13-af0b-84ac57ebbac3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1360 microversion: 2.1 time: 0.093678 Jul 28 12:19:06.480325 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3195/6388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:06 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:07.504308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:07.505171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:07.512641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:07.513102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:07.513904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:07.514354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:07.579629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:07.587571 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6c136b8-9710-4e01-bf47-d804bf706312 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1360 microversion: 2.1 time: 0.089369 Jul 28 12:19:07.588161 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3194/6389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:07 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:08.608595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:08.609238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:08.616369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:08.616829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:08.617603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:08.618087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:08.684779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:08.694970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a1746ed-c949-4cbc-b29f-858ca579df37 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1360 microversion: 2.1 time: 0.090007 Jul 28 12:19:08.695889 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3196/6390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:08 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:09.724664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:09.726019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:09.733318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:09.733855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:09.734746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:09.735298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:09.768587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:09.769652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:09.770227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:19:09.816294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:09.823148 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e3f278e4-cd40-47d1-89c7-39d2e46e2977 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 200 len: 1319 microversion: 2.1 time: 0.103127 Jul 28 12:19:09.823746 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3195/6391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:09 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:10.849562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:10.850727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:10.857574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:10.858027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:10.858806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:10.859285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:10.873721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a HTTP/1.1 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a'} Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:10.875447 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a17b3b7-d6da-450e-b6cd-852838cdd9b0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 404 len: 111 microversion: 2.1 time: 0.033890 Jul 28 12:19:10.881229 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3197/6392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:10 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:19:15.163933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:15.164462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:15.167361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:15.173665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:15.174136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:15.174932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:15.175425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:15.179970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:15.202537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:19:15.279724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e4d0fb2b-7f43-4705-afbf-643c3ee6ff5d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 204 len: 0 microversion: 2.1 time: 0.119945 Jul 28 12:19:15.280243 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3196/6393] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:19:15 2022] DELETE /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:19:15.289307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:15.289933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:15.292795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=30 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:15.298598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:15.299056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:15.299862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:15.300332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:15.304407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=82 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:15.431501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:15.438971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-60510ac6-0cb4-426e-9349-d613fea98623 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1407 microversion: 2.1 time: 0.153576 Jul 28 12:19:15.439566 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3198/6394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:15 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:16.461863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:16.462587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:16.469492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:16.469964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:16.470742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:16.471221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:16.599702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:16.607331 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8bfa8d6e-a21a-4356-86c8-08a3d0943951 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1407 microversion: 2.1 time: 0.149774 Jul 28 12:19:16.608132 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3197/6395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:16 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:17.604796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b9edc422-72ec-4306-9d42-4d5abb6930b7 req-533ffffb-6e92-4a3a-9259-2946b0003b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99462c1-8dba-435c-bf68-38e1cc1c285e", "name": "network-vif-deleted", "tag": "db5e33d2-3b49-4937-a3ca-16ffce5d4727"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:17.615240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b9edc422-72ec-4306-9d42-4d5abb6930b7 req-533ffffb-6e92-4a3a-9259-2946b0003b01 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:17.615699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b9edc422-72ec-4306-9d42-4d5abb6930b7 req-533ffffb-6e92-4a3a-9259-2946b0003b01 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:17.627766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b9edc422-72ec-4306-9d42-4d5abb6930b7 req-533ffffb-6e92-4a3a-9259-2946b0003b01 service nova] Creating event network-vif-deleted:db5e33d2-3b49-4937-a3ca-16ffce5d4727 for instance d99462c1-8dba-435c-bf68-38e1cc1c285e on n-h1-851368-1 Jul 28 12:19:17.628966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:17.629699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:17.633182 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b9edc422-72ec-4306-9d42-4d5abb6930b7 req-533ffffb-6e92-4a3a-9259-2946b0003b01 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098807 Jul 28 12:19:17.633607 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3199/6396] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:19:17.639615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:17.640212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:17.641123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:17.641705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:17.707057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:17.714814 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-907cd26e-8167-468b-9c43-8a13cc0eaf22 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1201 microversion: 2.1 time: 0.090106 Jul 28 12:19:17.715438 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3198/6397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:17 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:19:18.737936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:18.738527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:18.744939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:18.745392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:18.746164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:18.746604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:18.808325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:18.816065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da92a9b6-62a3-447b-bc84-6dcd5ea9a60d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1201 microversion: 2.1 time: 0.083473 Jul 28 12:19:18.816629 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3200/6398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:18 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:19.836150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:19.836856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:19.843981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:19.844456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:19.845246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:19.845708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:19.908933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:19.917332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3db1fcd4-9307-4683-b731-0d0a70cbd830 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1201 microversion: 2.1 time: 0.085033 Jul 28 12:19:19.917927 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3199/6399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:19 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:20.938964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:20.939605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:20.947318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:20.947778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:20.948562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:20.949003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:21.012228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:21.019928 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38590e9b-22d0-444c-8dd6-be9f8b349805 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1201 microversion: 2.1 time: 0.084950 Jul 28 12:19:21.020502 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3201/6400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:20 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:22.041244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:22.041872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:22.048820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:22.049401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:22.050348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:22.051214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:22.084038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:22.084498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:22.084972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid d99462c1-8dba-435c-bf68-38e1cc1c285e {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:19:22.142149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:22.151532 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bde47040-bd5e-450b-b014-5550128ff1ca tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 200 len: 1206 microversion: 2.1 time: 0.114119 Jul 28 12:19:22.152103 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3200/6401] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:22 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 1206 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:23.173817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:23.174447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:23.182325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:23.182810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:23.183708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:23.184159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:23.202589 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e HTTP/1.1 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd99462c1-8dba-435c-bf68-38e1cc1c285e'} Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:23.204282 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c748252c-217a-4ffc-a286-b99a8dafec63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 404 len: 111 microversion: 2.1 time: 0.035822 Jul 28 12:19:23.210484 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3202/6402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:23 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:19:25.345731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:25.346227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:25.353353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.353815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.354587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.355035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.368832 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a HTTP/1.1 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a'} Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:25.370542 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7a6fbee-ea2e-4b0a-88a2-a9ee16238279 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 404 len: 111 microversion: 2.1 time: 0.030191 Jul 28 12:19:25.375447 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3201/6403] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:19:25 2022] DELETE /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:19:25.382287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:25.382907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:25.390074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.390522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.391366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.391811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.405957 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a HTTP/1.1 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a'} Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.407532 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d872c4e9-df21-47ed-a147-40f6453ba4bb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a" status: 404 len: 111 microversion: 2.1 time: 0.031073 Jul 28 12:19:25.412343 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3203/6404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:25 2022] GET /compute/v2.1/servers/7f82ebc4-b5cb-4cf1-9ea7-29c836ee478a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:19:25.778145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:25.778665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:25.784780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.785251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.786032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.786562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.800357 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e HTTP/1.1 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'd99462c1-8dba-435c-bf68-38e1cc1c285e'} Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:25.801919 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e46048a-d014-4b01-81bf-b413c7f3a28d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 404 len: 111 microversion: 2.1 time: 0.029086 Jul 28 12:19:25.806988 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3202/6405] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:19:25 2022] DELETE /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:19:25.812088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:25.812709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: d99462c1-8dba-435c-bf68-38e1cc1c285e] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:25.819415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.819868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.820685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:25.821070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:25.834310 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e HTTP/1.1 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'd99462c1-8dba-435c-bf68-38e1cc1c285e'} Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:19:25.835863 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance d99462c1-8dba-435c-bf68-38e1cc1c285e could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4cac9fc5-8385-4195-8ee6-ae685402db5a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e" status: 404 len: 111 microversion: 2.1 time: 0.029146 Jul 28 12:19:25.841991 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3204/6406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:25 2022] GET /compute/v2.1/servers/d99462c1-8dba-435c-bf68-38e1cc1c285e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:19:25.910880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6aa60aa-c74a-4386-8b5e-2628f950685e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: .version_select at 0x7f2eb268e9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-366073824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXli7n6huQLO1DSTDKq4pqxMzU5e1lomn4BbwLqtypJ+mO7JmaHgdEfiIDtHsTREv8wOM/Mo1luOCWS/yt66IktLIn2YNMhdjxh9daYEbB2K9zTe8mBiXElHg/f6irTzA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:25.926860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f6aa60aa-c74a-4386-8b5e-2628f950685e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:19:25.931967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f6aa60aa-c74a-4386-8b5e-2628f950685e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:19:25.963795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6aa60aa-c74a-4386-8b5e-2628f950685e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.057203 Jul 28 12:19:25.964410 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3203/6407] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:19:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:19:42.132542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-714339344", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-366073824", "security_groups": [{"name": "tempest-secgroup-smoke-1492326869"}], "block_device_mapping_v2": [{"uuid": "b6186a3a-8aa3-4edc-8832-487038b1668f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:42.142352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=13 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:42.143011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=25 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:42.250709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:19:42.958086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:19:42.958518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:19:42.958998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:19:42.959512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:19:42.959929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:19:42.969868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:42.970324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:42.972005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:42.972223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:42.989208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:19:42.994458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:19:43.054985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:19:43.057183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6186a3a-8aa3-4edc-8832-487038b1668f',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:19:43.185671 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10773587-b007-42d0-bfb8-f6a8d8ca75c2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057260 Jul 28 12:19:43.186394 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3205/6408] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:19:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:19:43.195764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:43.196542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:43.197265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:43.201138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-41ba4191-4472-4ec8-8d46-7008c4ab0be1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:43.201988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-41ba4191-4472-4ec8-8d46-7008c4ab0be1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:43.277560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-41ba4191-4472-4ec8-8d46-7008c4ab0be1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:43.284424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-41ba4191-4472-4ec8-8d46-7008c4ab0be1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1093 microversion: 2.1 time: 0.090715 Jul 28 12:19:43.284986 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3204/6409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:43 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1093 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:44.305909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:44.306665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:44.316036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:44.316612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:44.317509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:44.318062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:44.394975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:44.402880 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97dac881-7d40-4400-a641-eb25fbe2c198 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1209 microversion: 2.1 time: 0.101164 Jul 28 12:19:44.403692 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3206/6410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:44 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:45.424063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:45.425276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:45.437512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:45.438800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:45.439812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:45.440525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:45.661604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:45.669922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e103eac9-1558-49f7-aaf9-a5702719efdb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1277 microversion: 2.1 time: 0.249871 Jul 28 12:19:45.670662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3205/6411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:45 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:45.746944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-076470aa-6b42-424b-9791-4cc7597daf29 req-b0387cd9-afed-4a8c-bf43-6177ad525aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d266b3-c803-4eda-b75f-be5a81df9311", "tag": "7906798a-555d-4e21-a37b-0b96be39fbb8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:45.761807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-076470aa-6b42-424b-9791-4cc7597daf29 req-b0387cd9-afed-4a8c-bf43-6177ad525aa4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:45.762785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-076470aa-6b42-424b-9791-4cc7597daf29 req-b0387cd9-afed-4a8c-bf43-6177ad525aa4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:45.781574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-076470aa-6b42-424b-9791-4cc7597daf29 req-b0387cd9-afed-4a8c-bf43-6177ad525aa4 service nova] Creating event network-changed:7906798a-555d-4e21-a37b-0b96be39fbb8 for instance 21d266b3-c803-4eda-b75f-be5a81df9311 on n-h2-851368-1 Jul 28 12:19:45.788500 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-076470aa-6b42-424b-9791-4cc7597daf29 req-b0387cd9-afed-4a8c-bf43-6177ad525aa4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044936 Jul 28 12:19:45.790069 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3207/6412] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:19:46.692913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:46.693686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:46.701173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:46.701799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:46.702715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:46.703427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:46.853385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:46.861062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4294ca2f-0927-4742-91a8-fb1cb609bab1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1277 microversion: 2.1 time: 0.173325 Jul 28 12:19:46.861663 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3206/6413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:46 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:47.883033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:47.883773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:47.890842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:47.891320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:47.892085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:47.892520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:48.028213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:48.036507 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3c4942b0-0a16-4402-ad9f-838abdc83fcb tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1277 microversion: 2.1 time: 0.158180 Jul 28 12:19:48.037089 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3208/6414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:47 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:49.056931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:49.057561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:49.064886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:49.065363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:49.066159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:49.066623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:49.208756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:49.216577 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5abd69c6-2ad1-49ce-9234-ed55e8f60995 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1277 microversion: 2.1 time: 0.163520 Jul 28 12:19:49.217154 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3207/6415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:49 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:50.238855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:50.239430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:50.246327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:50.246779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:50.247592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:50.248034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:50.377433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:50.384898 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec414b1b-b67d-4d13-b68b-89202b173120 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.150016 Jul 28 12:19:50.385464 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3209/6416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:50 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:51.406606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:51.407186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:51.414615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:51.415090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:51.415902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:51.416360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:51.548842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:51.557125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92f5fda2-e976-4b5e-a922-07518bf36eea tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.154610 Jul 28 12:19:51.557696 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3208/6417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:51 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:51.638584 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:19:51.638803 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:19:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:19:52.577754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:52.578385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:52.585360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:52.585812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:52.586581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:52.587018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:52.732828 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:52.740994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-233d56ed-e1b6-42a4-a76d-07fd2298e375 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.167131 Jul 28 12:19:52.741585 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3210/6418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:52 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:53.761801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:53.762441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:53.765228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:53.771797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:53.772388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:53.773193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:53.773653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:53.906969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:53.914522 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d324e413-51c4-4dd8-9e1c-209f1211b85e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.156646 Jul 28 12:19:53.915117 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3209/6419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:53 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:54.934972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:54.935602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:54.937552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:54.938331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:19:54.945660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:54.946109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:54.946877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:54.947340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:55.077366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:55.085646 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53e16259-4e4d-4838-989b-b6f0f22ae74d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.154544 Jul 28 12:19:55.086221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3211/6420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:54 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:56.106873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:56.107538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:56.115590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:56.116061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:56.116846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:56.117301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:56.252200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:56.259690 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-78ca9804-58bc-43d5-9494-b93a17d38825 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.156758 Jul 28 12:19:56.260284 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3210/6421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:56 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:57.280700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:57.281243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:57.287533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:57.287987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:57.288744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:57.289175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:57.422325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:57.430372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d31fcc77-ccbe-4643-8ec1-f3b31ccbe20f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.153718 Jul 28 12:19:57.430947 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3212/6422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:57 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:19:58.451139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:58.451770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:58.459380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:58.459842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:58.460619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:58.461068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:58.592613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:58.600481 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-739a46cc-9feb-4bfa-9b44-8bc35828ab91 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.153258 Jul 28 12:19:58.601051 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3211/6423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:58 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:19:59.141296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-04216f9d-9a71-4af8-80d6-8bf87f177686 req-1e36f1c5-70ff-4151-9590-4749b134e57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d266b3-c803-4eda-b75f-be5a81df9311", "name": "network-vif-plugged", "status": "completed", "tag": "7906798a-555d-4e21-a37b-0b96be39fbb8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:19:59.153304 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-04216f9d-9a71-4af8-80d6-8bf87f177686 req-1e36f1c5-70ff-4151-9590-4749b134e57c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:59.153786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-04216f9d-9a71-4af8-80d6-8bf87f177686 req-1e36f1c5-70ff-4151-9590-4749b134e57c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:59.165468 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-04216f9d-9a71-4af8-80d6-8bf87f177686 req-1e36f1c5-70ff-4151-9590-4749b134e57c service nova] Creating event network-vif-plugged:7906798a-555d-4e21-a37b-0b96be39fbb8 for instance 21d266b3-c803-4eda-b75f-be5a81df9311 on n-h2-851368-1 Jul 28 12:19:59.170437 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-04216f9d-9a71-4af8-80d6-8bf87f177686 req-1e36f1c5-70ff-4151-9590-4749b134e57c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032940 Jul 28 12:19:59.171027 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3213/6424] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:19:59.621711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:19:59.622292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:19:59.629723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:59.630193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:59.630976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:19:59.631461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:19:59.761966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:19:59.773012 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-528e72c3-83dc-41e4-8132-ae0204e92d42 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1265 microversion: 2.1 time: 0.155165 Jul 28 12:19:59.773602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3212/6425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:19:59 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:20:00.794375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:20:00.794993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:20:00.802110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:20:00.802559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:20:00.803344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:20:00.803781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:20:00.937444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:20:00.945340 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0d9ab8c-a10e-4cbc-a75b-85add5467658 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1450 microversion: 2.1 time: 0.155272 Jul 28 12:20:00.946044 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3214/6426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:20:00 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:20:00.965556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:20:00.966252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:20:00.973917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:20:00.974687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:20:00.975606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:20:00.976068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:20:01.110100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:20:01.117803 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-888bb2e0-0738-47ee-9abb-9875f105ad24 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1450 microversion: 2.1 time: 0.156232 Jul 28 12:20:01.118404 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3213/6427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:20:00 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:20:02.699493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5dcc5cde-0452-4145-b59b-175000ca09d9 req-df98ad66-5766-401c-a9f6-3e2459b83934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d266b3-c803-4eda-b75f-be5a81df9311", "tag": "7906798a-555d-4e21-a37b-0b96be39fbb8"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:20:02.710466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5dcc5cde-0452-4145-b59b-175000ca09d9 req-df98ad66-5766-401c-a9f6-3e2459b83934 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:20:02.710993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5dcc5cde-0452-4145-b59b-175000ca09d9 req-df98ad66-5766-401c-a9f6-3e2459b83934 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:20:02.722356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5dcc5cde-0452-4145-b59b-175000ca09d9 req-df98ad66-5766-401c-a9f6-3e2459b83934 service nova] Creating event network-changed:7906798a-555d-4e21-a37b-0b96be39fbb8 for instance 21d266b3-c803-4eda-b75f-be5a81df9311 on n-h2-851368-1 Jul 28 12:20:02.727620 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5dcc5cde-0452-4145-b59b-175000ca09d9 req-df98ad66-5766-401c-a9f6-3e2459b83934 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031845 Jul 28 12:20:02.728218 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3215/6428] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:21:48.815920 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:21:48.816542 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:21:58.993119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=22 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:21:58.993912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=54 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:21:59.060576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:21:59.061091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:21:59.067665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:21:59.068125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:21:59.068908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:21:59.069357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:21:59.097070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:21:59.171262 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8960b1f1-bd28-4855-bf56-f3b1e3d3eda7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 204 len: 0 microversion: 2.1 time: 0.180134 Jul 28 12:21:59.172215 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3214/6429] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:21:58 2022] DELETE /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:21:59.178752 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 12:21:59.180135 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 12:21:59.180980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:21:59.181726 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=50 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:21:59.186493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:21:59.187236 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:21:59.195589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:21:59.196037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:21:59.196796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:21:59.197234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:21:59.333884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:21:59.341459 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9db47174-b326-473c-a66e-b2c909a318aa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1575 microversion: 2.1 time: 0.164865 Jul 28 12:21:59.342023 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3216/6430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:21:59 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:00.365023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:00.365737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:00.373296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:00.373962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:00.375037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:00.375630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:00.573463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:00.581053 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f23ae20-3dc6-45d7-ae94-88482fa2e917 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1575 microversion: 2.1 time: 0.220752 Jul 28 12:22:00.581629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3215/6431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:00 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:01.602160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:01.603211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:01.613886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:01.614392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:01.615450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:01.615901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:01.633369 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38424. Jul 28 12:22:01.638249 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38426. Jul 28 12:22:01.652487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d26d773a-cff6-4caf-8c2f-0f667e56fe78 req-884428ed-bd4e-4313-8cae-29c6266e49eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d266b3-c803-4eda-b75f-be5a81df9311", "name": "network-vif-deleted", "tag": "7906798a-555d-4e21-a37b-0b96be39fbb8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:22:01.671203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d26d773a-cff6-4caf-8c2f-0f667e56fe78 req-884428ed-bd4e-4313-8cae-29c6266e49eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:01.671766 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d26d773a-cff6-4caf-8c2f-0f667e56fe78 req-884428ed-bd4e-4313-8cae-29c6266e49eb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:01.686514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:01.694553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d26d773a-cff6-4caf-8c2f-0f667e56fe78 req-884428ed-bd4e-4313-8cae-29c6266e49eb service nova] Creating event network-vif-deleted:7906798a-555d-4e21-a37b-0b96be39fbb8 for instance 21d266b3-c803-4eda-b75f-be5a81df9311 on n-h2-851368-1 Jul 28 12:22:01.695377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-744bcb98-f7aa-45bc-8b15-0f33c3062b6d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1507 microversion: 2.1 time: 0.097237 Jul 28 12:22:01.696471 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3217/6432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:01 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1507 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:01.709576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d26d773a-cff6-4caf-8c2f-0f667e56fe78 req-884428ed-bd4e-4313-8cae-29c6266e49eb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060841 Jul 28 12:22:01.715587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3216/6433] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:22:02.719120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:02.719876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:02.728210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:02.728966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:02.729819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:02.730328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:02.797182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:02.807317 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0062df39-eb46-4242-a7d0-bcf3167c4c3e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1224 microversion: 2.1 time: 0.091877 Jul 28 12:22:02.807927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3218/6434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:02 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:03.827678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:03.828407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:03.835832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:03.836307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:03.837100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:03.837560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:03.904531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:03.912741 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76961540-2d74-402e-ba09-3c852b512272 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1224 microversion: 2.1 time: 0.089382 Jul 28 12:22:03.913326 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3217/6435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:03 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:04.934134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:04.934745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:04.941935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:04.942383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:04.943183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:04.943620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:05.012362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:05.020874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-058b83f2-2ca4-4f08-a27e-7a7ecfa411ce tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1224 microversion: 2.1 time: 0.090620 Jul 28 12:22:05.021546 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3219/6436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:04 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:06.042229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:06.042763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:06.050316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:06.050779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:06.051576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:06.052026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:06.081713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:06.082171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:06.082629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid 21d266b3-c803-4eda-b75f-be5a81df9311 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:22:06.124852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:06.132589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6989f8ec-be38-4b06-a7b8-b4f27ee880b9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 200 len: 1229 microversion: 2.1 time: 0.094354 Jul 28 12:22:06.133164 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3218/6437] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:06 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:07.152685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:07.153299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:07.160349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:07.160830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:07.161648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:07.162118 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:07.175980 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 HTTP/1.1 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '21d266b3-c803-4eda-b75f-be5a81df9311'} Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:22:07.177670 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:22:07.183213 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:22:07.190482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:22:07.191370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c127fce0-eefc-473b-9731-776ec3de4d12 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 404 len: 111 microversion: 2.1 time: 0.042690 Jul 28 12:22:07.191908 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3220/6438] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:07 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:22:07.252419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-120568326", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-366073824", "security_groups": [{"name": "tempest-secgroup-smoke-1492326869"}], "block_device_mapping_v2": [{"uuid": "b6186a3a-8aa3-4edc-8832-487038b1668f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:22:07.364926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:22:07.781240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:22:07.781683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:22:07.782181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:22:07.782626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:22:07.783583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:22:07.792543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:07.793011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:07.793825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:07.794278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:07.812612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:22:07.817942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:22:07.875881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:22:07.878123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6186a3a-8aa3-4edc-8832-487038b1668f',volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:22:08.004606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-979ccb62-1d07-438d-a909-1d92a9a6d8e1 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756707 Jul 28 12:22:08.005240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3219/6439] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:22:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:22:08.015882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dbae136e-fa0e-4001-8573-ca70c065446e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:08.016541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dbae136e-fa0e-4001-8573-ca70c065446e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:08.069700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dbae136e-fa0e-4001-8573-ca70c065446e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:08.076610 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dbae136e-fa0e-4001-8573-ca70c065446e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1093 microversion: 2.1 time: 0.064572 Jul 28 12:22:08.077245 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3221/6440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:08 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:09.099642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:09.100582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:09.106958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:09.107513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:09.108312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:09.108777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:09.195916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:09.206620 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5d64800-aad5-40e7-8f8d-fc06bf8f87c6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1209 microversion: 2.1 time: 0.109533 Jul 28 12:22:09.206620 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3220/6441] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:09 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:10.230220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:10.230890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:10.242869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:10.243810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:10.244856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:10.245982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:10.429373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:10.438421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c12175a7-bed7-4e24-93cf-1a82eaeb0a70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1277 microversion: 2.1 time: 0.217759 Jul 28 12:22:10.440728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3222/6442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:10 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:10.483286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9c76f5f1-3db8-4028-91ec-2844170b27cb req-13d45ea1-ab3d-4e4d-a850-e10a19a60c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d2087-3b14-4122-857c-ee785b572766", "tag": "615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:22:10.500396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c76f5f1-3db8-4028-91ec-2844170b27cb req-13d45ea1-ab3d-4e4d-a850-e10a19a60c74 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:10.502043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c76f5f1-3db8-4028-91ec-2844170b27cb req-13d45ea1-ab3d-4e4d-a850-e10a19a60c74 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:10.518135 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9c76f5f1-3db8-4028-91ec-2844170b27cb req-13d45ea1-ab3d-4e4d-a850-e10a19a60c74 service nova] Creating event network-changed:615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0 for instance 7f0d2087-3b14-4122-857c-ee785b572766 on n-h1-851368-1 Jul 28 12:22:10.525174 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9c76f5f1-3db8-4028-91ec-2844170b27cb req-13d45ea1-ab3d-4e4d-a850-e10a19a60c74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046982 Jul 28 12:22:10.526460 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3221/6443] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:22:11.460559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:11.461924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:11.469098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:11.469558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:11.470925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:11.471656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:11.618545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:11.626136 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-997f6d50-1b63-412c-89fd-0a9ce102b411 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1277 microversion: 2.1 time: 0.169554 Jul 28 12:22:11.626727 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3223/6444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:11 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:22:12.647199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:12.647830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:12.654931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:12.655419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:12.656197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:12.656643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:12.792443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:12.801098 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9fa3a6c5-b45a-406b-aa87-98308ae2a20d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1277 microversion: 2.1 time: 0.158177 Jul 28 12:22:12.801684 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3222/6445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:12 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:13.821556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:13.822177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:13.829279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:13.829739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:13.830520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:13.830965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:13.974536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:13.984956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0cfe7571-cc7f-4fbd-aa92-20c0855d25fd tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1277 microversion: 2.1 time: 0.167238 Jul 28 12:22:13.985542 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3224/6446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:13 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:15.012876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:15.013600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:15.021124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:15.021640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:15.022624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:15.023129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:15.162071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:15.169593 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5555c5ba-d45a-4e2e-9d41-a9b4bcb45ec8 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.160730 Jul 28 12:22:15.170180 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3223/6447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:15 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:15.414574 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:22:15.415162 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:22:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:22:16.191359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:16.191986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:16.199789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:16.200247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:16.201030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:16.201471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:16.335416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:16.342944 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83e86d00-78fc-40a3-a9cb-7eeaad35fd46 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.155589 Jul 28 12:22:16.343543 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3225/6448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:16 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:17.365219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:17.365762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:17.372691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:17.373151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:17.373923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:17.374373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:17.503335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:17.510768 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1840b6fa-3a1e-4a16-995b-c2da213250a2 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.150132 Jul 28 12:22:17.511381 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3224/6449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:17 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:18.535988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:18.536598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:18.539315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:22:18.544800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:18.545244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:18.546009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:18.546443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:18.679835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:18.687332 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-abed8368-2836-4cec-a305-e25fb1511005 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.155821 Jul 28 12:22:18.687887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3226/6450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:18 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:19.708319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:19.708937 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:19.710974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:22:19.711828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:22:19.718666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:19.719163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:19.719947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:19.720403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:19.854068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:19.861725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3725c0aa-c1fa-45fb-8ffa-2a1622eadfbf tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.157390 Jul 28 12:22:19.862301 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3225/6451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:19 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:20.881922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:20.882531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:20.889499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:20.889955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:20.890728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:20.891209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:21.027169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:21.034696 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-acde6fa5-1edd-40fb-9e4b-76bcb05070e9 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.156805 Jul 28 12:22:21.035296 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3227/6452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:20 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:22.055165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:22.055722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:22.062667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:22.063165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:22.063940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:22.064389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:22.197140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:22.204686 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5fdbecf7-458e-463d-a830-4a830c550f70 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.153480 Jul 28 12:22:22.205275 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3226/6453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:22 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:22:23.225907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:23.226630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:23.233725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:23.234178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:23.234949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:23.235421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:23.371167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:23.380299 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb7575cb-d404-4603-881f-fb898bfd9996 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.159024 Jul 28 12:22:23.380874 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3228/6454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:23 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:24.401031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:24.401595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:24.408591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:24.409672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:24.410455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:24.410909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:24.538765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:24.546385 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b2ab2fc-405e-4838-9d19-0c400b361b8b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.149321 Jul 28 12:22:24.546969 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3227/6455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:24 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:25.559877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0107ea3e-1b57-4f21-bfaa-cf42120eafac req-1b22ae82-7dc9-4f20-983b-1d6df2a26708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d2087-3b14-4122-857c-ee785b572766", "name": "network-vif-plugged", "status": "completed", "tag": "615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:22:25.569752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:25.569752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:25.576034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0107ea3e-1b57-4f21-bfaa-cf42120eafac req-1b22ae82-7dc9-4f20-983b-1d6df2a26708 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:25.576476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0107ea3e-1b57-4f21-bfaa-cf42120eafac req-1b22ae82-7dc9-4f20-983b-1d6df2a26708 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:25.577399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:25.577878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:25.578673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:25.579154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:25.588975 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0107ea3e-1b57-4f21-bfaa-cf42120eafac req-1b22ae82-7dc9-4f20-983b-1d6df2a26708 service nova] Creating event network-vif-plugged:615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0 for instance 7f0d2087-3b14-4122-857c-ee785b572766 on n-h1-851368-1 Jul 28 12:22:25.594453 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0107ea3e-1b57-4f21-bfaa-cf42120eafac req-1b22ae82-7dc9-4f20-983b-1d6df2a26708 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038669 Jul 28 12:22:25.595200 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3229/6456] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:22:25.728650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:25.736428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19304885-1091-48c0-8266-3704975c134b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.173464 Jul 28 12:22:25.737017 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3228/6457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:25 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:22:26.757978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:26.758672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:26.764893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:26.765342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:26.766097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:26.766533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:26.904954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:26.912467 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc2d9c77-3cc3-45f3-8211-d01a660862fa tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1265 microversion: 2.1 time: 0.159575 Jul 28 12:22:26.913044 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3230/6458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:26 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:27.933095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:27.933725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:27.940087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:27.940559 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:27.941348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:27.941805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:28.076606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:28.085201 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60e1c3c2-2518-4c81-b5c3-8977c00ade34 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1451 microversion: 2.1 time: 0.155998 Jul 28 12:22:28.086277 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3229/6459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:27 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:28.114933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:22:28.117722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:22:28.125313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:28.125765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:28.126544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:28.126980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:28.260913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:22:28.269176 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45328a0e-3e77-4f4f-ba09-ac1c58d67275 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1451 microversion: 2.1 time: 0.157752 Jul 28 12:22:28.269748 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3231/6460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:22:28 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:22:29.888142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-de68db87-e708-4d49-9c53-6b67f39dd5f7 req-06a28282-719f-4224-b221-39eff03886d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d2087-3b14-4122-857c-ee785b572766", "tag": "615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:22:29.894569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:22:29.900570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-de68db87-e708-4d49-9c53-6b67f39dd5f7 req-06a28282-719f-4224-b221-39eff03886d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:22:29.901060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-de68db87-e708-4d49-9c53-6b67f39dd5f7 req-06a28282-719f-4224-b221-39eff03886d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:22:29.904681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:22:29.916099 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-de68db87-e708-4d49-9c53-6b67f39dd5f7 req-06a28282-719f-4224-b221-39eff03886d9 service nova] Creating event network-changed:615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0 for instance 7f0d2087-3b14-4122-857c-ee785b572766 on n-h1-851368-1 Jul 28 12:22:29.921371 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-de68db87-e708-4d49-9c53-6b67f39dd5f7 req-06a28282-719f-4224-b221-39eff03886d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036929 Jul 28 12:22:29.922310 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3230/6461] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:24:23.846175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=34 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:24:23.846929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=82 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:24:23.851309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-269271471", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-366073824", "security_groups": [{"name": "tempest-secgroup-smoke-1492326869"}], "block_device_mapping_v2": [{"uuid": "3d1457dd-11f9-4494-aeca-6cc8fb01b55d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48e9a655-18f4-4f52-906b-8dd6652dfe5a"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:24:24.506323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] validate_networks() for [('48e9a655-18f4-4f52-906b-8dd6652dfe5a', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:24:24.956813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:24:24.957422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:24:24.957713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:24:24.958132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:24:24.958589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:24:24.970063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:24.970520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:24.971369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:24.971813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:24.993792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:24:24.999119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Getting quotas for user 23696f589f4442edb4c049d955c5a561 and project d4972af534c341168a2937903e8d870e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:24:25.056090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:24:25.058256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d1457dd-11f9-4494-aeca-6cc8fb01b55d',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:24:25.188243 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [c11b8769-ff05-4ef7-93ad-508c6238c5e7] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:24:26.195912 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [c11b8769-ff05-4ef7-93ad-508c6238c5e7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38626. Jul 28 12:24:26.199976 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5db9d45-87d8-4ee6-8044-abd6e132d6a6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.356052 Jul 28 12:24:26.200639 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3232/6462] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:24:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:24:26.210538 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:24:26.211921 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:24:26.216729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc860043-20cf-493d-9ae2-53303aeb8ee5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:26.217446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dc860043-20cf-493d-9ae2-53303aeb8ee5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:26.395136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dc860043-20cf-493d-9ae2-53303aeb8ee5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:26.404124 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc860043-20cf-493d-9ae2-53303aeb8ee5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1093 microversion: 2.1 time: 0.196432 Jul 28 12:24:26.404693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3231/6463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:26 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1093 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:27.425931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-067cd915-8ff9-4cf3-9698-d3b89e0e5407 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:27.426588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-067cd915-8ff9-4cf3-9698-d3b89e0e5407 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:27.478668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-067cd915-8ff9-4cf3-9698-d3b89e0e5407 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:27.485309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-067cd915-8ff9-4cf3-9698-d3b89e0e5407 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1093 microversion: 2.1 time: 0.064111 Jul 28 12:24:27.485867 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3233/6464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:27 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:28.505538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3537f7b-eec6-4bee-a781-b3aad0a4ac4d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:28.506467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3537f7b-eec6-4bee-a781-b3aad0a4ac4d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:28.537273 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38658. Jul 28 12:24:28.538014 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38656. Jul 28 12:24:28.570303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3537f7b-eec6-4bee-a781-b3aad0a4ac4d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:28.578057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3537f7b-eec6-4bee-a781-b3aad0a4ac4d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1093 microversion: 2.1 time: 0.076490 Jul 28 12:24:28.578616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3232/6465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:28 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:29.599415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-019f28e8-9136-4e2e-8c06-d09585a78d6f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:29.600034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-019f28e8-9136-4e2e-8c06-d09585a78d6f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:29.656910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-019f28e8-9136-4e2e-8c06-d09585a78d6f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:29.663695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-019f28e8-9136-4e2e-8c06-d09585a78d6f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1093 microversion: 2.1 time: 0.068288 Jul 28 12:24:29.664262 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3234/6466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:29 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:30.683886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:30.684588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:30.691699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:30.692754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:30.693543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:30.693997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:30.760232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:30.767815 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-959eb9ba-2342-4736-9827-b5bd39ed88ec tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1143 microversion: 2.1 time: 0.088200 Jul 28 12:24:30.768539 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3233/6467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:30 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:31.788836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:31.789458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:31.796780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:31.796980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:31.797964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:31.798609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:32.050533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:32.062248 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a08cc42c-96c7-45ab-be7e-9b1ac54ee135 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1277 microversion: 2.1 time: 0.277410 Jul 28 12:24:32.076413 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3235/6468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:31 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:32.991633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-cdcf119b-dfe5-4174-a6d5-c0a330394bee req-44422b6e-681c-437c-980c-a7196bdf949c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62941dad-85ed-42bc-9319-088a10ed6535", "tag": "b0def5a2-9bef-49f2-9160-12ba3a6ad91f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:24:33.003516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cdcf119b-dfe5-4174-a6d5-c0a330394bee req-44422b6e-681c-437c-980c-a7196bdf949c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:33.004478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-cdcf119b-dfe5-4174-a6d5-c0a330394bee req-44422b6e-681c-437c-980c-a7196bdf949c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:33.017532 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-cdcf119b-dfe5-4174-a6d5-c0a330394bee req-44422b6e-681c-437c-980c-a7196bdf949c service nova] Creating event network-changed:b0def5a2-9bef-49f2-9160-12ba3a6ad91f for instance 62941dad-85ed-42bc-9319-088a10ed6535 on n-h2-851368-1 Jul 28 12:24:33.024339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-cdcf119b-dfe5-4174-a6d5-c0a330394bee req-44422b6e-681c-437c-980c-a7196bdf949c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104965 Jul 28 12:24:33.025928 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3234/6469] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:24:33.086442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:33.087056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:33.094766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:33.095487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:33.096734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:33.097379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:33.342668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:33.353946 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2298801e-5f65-4050-9f92-db5c366ec3d0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1277 microversion: 2.1 time: 0.271918 Jul 28 12:24:33.364094 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3236/6470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:33 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:34.375201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:34.375923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:34.383284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:34.383755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:34.384580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:34.385040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:34.519323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:34.528398 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfb5d510-0d44-4ce6-9213-64e4501bcf49 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1277 microversion: 2.1 time: 0.157325 Jul 28 12:24:34.529039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3235/6471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:34 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:35.549414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:35.550222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:35.553578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:24:35.560433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:35.561002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:35.562216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:35.562862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:35.724072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:35.732716 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4c28017-9534-4b5d-a3ad-f872a7ee6786 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1277 microversion: 2.1 time: 0.187668 Jul 28 12:24:35.733362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3237/6472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:35 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:36.755114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:36.755868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:36.763723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:36.764201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:36.765084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:36.765579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:36.902794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:36.911115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9855527d-f231-4733-ae90-b03c9b76b6c3 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.159911 Jul 28 12:24:36.911716 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3236/6473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:36 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:24:37.933490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:37.934173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:37.941183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:37.941641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:37.942454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:37.942900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:38.074061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:38.081600 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a4fae28e-ece4-4451-9cf0-370d694162b6 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.152016 Jul 28 12:24:38.082132 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3238/6474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:37 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:39.103230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:39.103799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:39.106613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:24:39.112004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:39.112470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:39.113251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:39.113701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:39.244038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:39.251612 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b28c19ee-6b8c-4618-adf0-91e6d15566f7 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.152715 Jul 28 12:24:39.252184 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3237/6475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:39 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:40.272838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:40.273464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:40.276193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:24:40.281774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:40.282232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:40.283114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:40.283564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:40.414438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:40.421985 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a11cb801-aecc-46ff-a67c-584c27498888 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.153681 Jul 28 12:24:40.422558 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3239/6476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:40 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:41.443551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:41.444188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:41.451209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:41.451678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:41.452458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:41.452912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:41.586946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:41.594502 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54f47b76-43a5-49ff-a2d4-300e34823070 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.155390 Jul 28 12:24:41.595131 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3238/6477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:41 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:42.615356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:42.616483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:42.623374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:42.623822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:42.624586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:42.625021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:42.763486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:42.771361 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8de891a6-93f4-4447-852f-6445237c3eef tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.159881 Jul 28 12:24:42.771966 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3240/6478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:42 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:43.792101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:43.792710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:43.799803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:43.800271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:43.801055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:43.801511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:43.937552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:43.945954 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa6e167f-ab3d-4467-bedd-1cf888089802 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.157690 Jul 28 12:24:43.946707 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3239/6479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:43 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:44.965834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:44.966524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:44.973471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:44.973917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:44.974683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:44.975157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:45.111472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:45.120474 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5c62cac2-b70f-4927-a98e-426494ad2f65 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.158516 Jul 28 12:24:45.121160 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3241/6480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:44 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:46.141904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:46.142789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:46.149998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:46.150542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:46.151445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:46.152283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:46.312446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:46.325971 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57f86731-036b-468a-998d-a29b5b2e943f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.187890 Jul 28 12:24:46.340594 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3240/6481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:46 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:46.405967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62941dad-85ed-42bc-9319-088a10ed6535", "name": "network-vif-plugged", "status": "completed", "tag": "b0def5a2-9bef-49f2-9160-12ba3a6ad91f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:24:46.416423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:46.416871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:46.427559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] Creating event network-vif-plugged:b0def5a2-9bef-49f2-9160-12ba3a6ad91f for instance 62941dad-85ed-42bc-9319-088a10ed6535 on n-h2-851368-1 Jul 28 12:24:46.431183 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] [ba971fa1-6e54-4b4c-9c4b-db10a15a4295] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:24:47.349269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:47.349928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:47.357247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:47.357710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:47.358492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:47.358942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:47.440532 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] [ba971fa1-6e54-4b4c-9c4b-db10a15a4295] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38718. Jul 28 12:24:47.444870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-657c6a1a-2c2d-40a1-8654-36e26b990b6c req-3966c822-1b88-4d72-8e99-05ffec616df9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.096802 Jul 28 12:24:47.445800 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3242/6482] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:24:47.496928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:47.505327 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff3a4f94-bf5d-45d4-91a1-b6808e0a4575 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.159890 Jul 28 12:24:47.505935 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3241/6483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:47 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:24:48.529719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:48.530462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:48.536684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:48.537145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:48.537910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:48.539010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:48.680709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:48.688429 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-38df1a4b-2266-46a9-8639-c9244616567a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1265 microversion: 2.1 time: 0.163907 Jul 28 12:24:48.689007 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3243/6484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:48 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:49.709037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:49.709667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:49.716933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:49.717400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:49.718187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:49.718643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:49.860609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:49.869104 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b7626806-ae71-495e-a053-036c5caadec5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1450 microversion: 2.1 time: 0.163996 Jul 28 12:24:49.869677 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3242/6485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:49 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:49.888696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:24:49.889353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:24:49.896262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:49.896714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:49.897485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:49.898174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:50.031829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:24:50.039915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7408a7f-b941-49f8-9e6f-d9b9a98e2c47 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1450 microversion: 2.1 time: 0.155041 Jul 28 12:24:50.040486 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3244/6486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:24:49 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:24:51.537335 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:24:51.537964 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:24:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:24:51.648423 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:24:51.648659 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:24:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:24:51.973679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a24f04c0-c9f3-47b2-80de-1a480adc3896 req-cd676993-e684-4817-8998-0989b21af4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62941dad-85ed-42bc-9319-088a10ed6535", "tag": "b0def5a2-9bef-49f2-9160-12ba3a6ad91f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:24:51.987818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a24f04c0-c9f3-47b2-80de-1a480adc3896 req-cd676993-e684-4817-8998-0989b21af4f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:24:51.988378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a24f04c0-c9f3-47b2-80de-1a480adc3896 req-cd676993-e684-4817-8998-0989b21af4f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:24:52.000529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a24f04c0-c9f3-47b2-80de-1a480adc3896 req-cd676993-e684-4817-8998-0989b21af4f1 service nova] Creating event network-changed:b0def5a2-9bef-49f2-9160-12ba3a6ad91f for instance 62941dad-85ed-42bc-9319-088a10ed6535 on n-h2-851368-1 Jul 28 12:24:52.005760 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a24f04c0-c9f3-47b2-80de-1a480adc3896 req-cd676993-e684-4817-8998-0989b21af4f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038368 Jul 28 12:24:52.006559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3243/6487] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:25:35.423030 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:25:35.423660 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:26:22.209749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:26:22.214191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=31 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:26:22.215026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=58 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:26:22.215714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=59 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:26:22.219974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7e5a2c0d-6555-4273-a6c1-580b78dbe6ac req-2c06a080-e1cc-4a0e-a2b6-bbe8795dfa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62941dad-85ed-42bc-9319-088a10ed6535", "tag": "b0def5a2-9bef-49f2-9160-12ba3a6ad91f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:26:22.232291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:22.232811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:22.244461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7e5a2c0d-6555-4273-a6c1-580b78dbe6ac req-2c06a080-e1cc-4a0e-a2b6-bbe8795dfa4e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:22.244925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7e5a2c0d-6555-4273-a6c1-580b78dbe6ac req-2c06a080-e1cc-4a0e-a2b6-bbe8795dfa4e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:22.252068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:22.252530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:22.253326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:22.253770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:22.257404 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7e5a2c0d-6555-4273-a6c1-580b78dbe6ac req-2c06a080-e1cc-4a0e-a2b6-bbe8795dfa4e service nova] Creating event network-changed:b0def5a2-9bef-49f2-9160-12ba3a6ad91f for instance 62941dad-85ed-42bc-9319-088a10ed6535 on n-h2-851368-1 Jul 28 12:26:22.262741 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7e5a2c0d-6555-4273-a6c1-580b78dbe6ac req-2c06a080-e1cc-4a0e-a2b6-bbe8795dfa4e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050756 Jul 28 12:26:22.263600 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3244/6488] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:26:22.279610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:26:22.370603 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-63940df0-74b0-4461-8914-b55b51191a4e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 204 len: 0 microversion: 2.1 time: 0.162445 Jul 28 12:26:22.374371 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3245/6489] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:26:22 2022] DELETE /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:26:22.380104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:22.380970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:22.387345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:22.387895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:22.388765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:22.389291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:22.547119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:22.554949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8618ed11-b983-4ae0-ab9c-b7f2e247104c tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1575 microversion: 2.1 time: 0.179027 Jul 28 12:26:22.555559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3245/6490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:22 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:23.577684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:23.578398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:23.590108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:23.590564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:23.591394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:23.591835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:23.823107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:23.830606 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7669f7f8-88dc-4030-95fc-dadbb2eb4b6a tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1575 microversion: 2.1 time: 0.257486 Jul 28 12:26:23.831194 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3246/6491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:23 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1575 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:24.520058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4c87f066-11a1-47ad-a7e3-92c83ed2e0c2 req-24c7f430-19a0-43dc-a702-903985504072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62941dad-85ed-42bc-9319-088a10ed6535", "name": "network-vif-deleted", "tag": "b0def5a2-9bef-49f2-9160-12ba3a6ad91f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:26:24.532545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4c87f066-11a1-47ad-a7e3-92c83ed2e0c2 req-24c7f430-19a0-43dc-a702-903985504072 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:24.533071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4c87f066-11a1-47ad-a7e3-92c83ed2e0c2 req-24c7f430-19a0-43dc-a702-903985504072 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:24.544935 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4c87f066-11a1-47ad-a7e3-92c83ed2e0c2 req-24c7f430-19a0-43dc-a702-903985504072 service nova] Creating event network-vif-deleted:b0def5a2-9bef-49f2-9160-12ba3a6ad91f for instance 62941dad-85ed-42bc-9319-088a10ed6535 on n-h2-851368-1 Jul 28 12:26:24.550694 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4c87f066-11a1-47ad-a7e3-92c83ed2e0c2 req-24c7f430-19a0-43dc-a702-903985504072 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Jul 28 12:26:24.551356 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3246/6492] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:26:24.852680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:24.853893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:24.861105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:24.861811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:24.862602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:24.863044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:24.934832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:24.943000 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b325761-4191-4db5-bfa4-cab46f73df2b tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1224 microversion: 2.1 time: 0.094410 Jul 28 12:26:24.944503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3247/6493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:24 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:26:25.967765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:25.968483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:25.974888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:25.975377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:25.976158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:25.976983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:26.044087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:26.051961 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bcbc92df-95f1-48cb-9dd4-a58e29c2b582 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1224 microversion: 2.1 time: 0.089264 Jul 28 12:26:26.052543 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3247/6494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:25 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:27.073081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:27.073693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:27.080864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:27.081320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:27.082096 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:27.082538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:27.144494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:27.152733 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-89d77c79-bfb9-4d12-a61b-87ccf97b5295 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1224 microversion: 2.1 time: 0.083643 Jul 28 12:26:27.153291 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3248/6495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:27 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:28.173066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:28.173700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:28.181449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:28.181914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:28.182703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:28.183185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:28.245422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:28.253580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f371036-dbd7-4038-a2e5-c5a3be6acaf5 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 200 len: 1224 microversion: 2.1 time: 0.084444 Jul 28 12:26:28.254149 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3248/6496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:28 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:29.274334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:29.274892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 62941dad-85ed-42bc-9319-088a10ed6535] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:29.281751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:29.282204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:29.282971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:29.283439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:29.296618 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 HTTP/1.1 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '62941dad-85ed-42bc-9319-088a10ed6535'} Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:29.298272 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 62941dad-85ed-42bc-9319-088a10ed6535 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1ad8dbe0-0d1e-492c-bc83-87db11a74e00 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535" status: 404 len: 111 microversion: 2.1 time: 0.029362 Jul 28 12:26:29.304377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3249/6497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:29 2022] GET /compute/v2.1/servers/62941dad-85ed-42bc-9319-088a10ed6535 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:26:35.511249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:35.511826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:35.518577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:35.519154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:35.520040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:35.520671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:35.546460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:26:35.630196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9a66cb64-2c20-441a-9f1f-5d7f275c42fd req-7f4538f2-d3c9-4faf-b0e9-6e1293e87d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d2087-3b14-4122-857c-ee785b572766", "tag": "615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:26:35.631506 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8eed0311-5562-4171-b531-5c97f677f923 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 204 len: 0 microversion: 2.1 time: 0.124024 Jul 28 12:26:35.632755 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3249/6498] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:26:35 2022] DELETE /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:26:35.643213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9a66cb64-2c20-441a-9f1f-5d7f275c42fd req-7f4538f2-d3c9-4faf-b0e9-6e1293e87d5f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:35.644050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9a66cb64-2c20-441a-9f1f-5d7f275c42fd req-7f4538f2-d3c9-4faf-b0e9-6e1293e87d5f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:35.644222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:35.645087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:35.651722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:35.652197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:35.652994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:35.653678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:35.656667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9a66cb64-2c20-441a-9f1f-5d7f275c42fd req-7f4538f2-d3c9-4faf-b0e9-6e1293e87d5f service nova] Creating event network-changed:615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0 for instance 7f0d2087-3b14-4122-857c-ee785b572766 on n-h1-851368-1 Jul 28 12:26:35.662602 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9a66cb64-2c20-441a-9f1f-5d7f275c42fd req-7f4538f2-d3c9-4faf-b0e9-6e1293e87d5f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091474 Jul 28 12:26:35.663444 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3250/6499] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:26:35.791806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:35.799485 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-19dc6c38-11a0-4ecc-93c4-4738c75c7d63 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1575 microversion: 2.1 time: 0.161788 Jul 28 12:26:35.800065 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3250/6500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:35 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:36.823821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:36.824539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:36.830938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:36.831424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:36.832211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:36.832654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:36.965776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:36.973587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3168ff75-7336-415c-905c-68e66009eca0 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1575 microversion: 2.1 time: 0.155807 Jul 28 12:26:36.974165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3251/6501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:36 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:37.947502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-58e43ada-9c0c-4002-93ab-ff2e3b5bc1fb req-e48bed11-1947-438a-ac69-bbe0134845ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d2087-3b14-4122-857c-ee785b572766", "name": "network-vif-deleted", "tag": "615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:26:37.958331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-58e43ada-9c0c-4002-93ab-ff2e3b5bc1fb req-e48bed11-1947-438a-ac69-bbe0134845ff service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:37.958723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-58e43ada-9c0c-4002-93ab-ff2e3b5bc1fb req-e48bed11-1947-438a-ac69-bbe0134845ff service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:37.970149 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-58e43ada-9c0c-4002-93ab-ff2e3b5bc1fb req-e48bed11-1947-438a-ac69-bbe0134845ff service nova] Creating event network-vif-deleted:615f23bd-0dc8-41d4-84b5-0a5b5d6d8fc0 for instance 7f0d2087-3b14-4122-857c-ee785b572766 on n-h1-851368-1 Jul 28 12:26:37.976024 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-58e43ada-9c0c-4002-93ab-ff2e3b5bc1fb req-e48bed11-1947-438a-ac69-bbe0134845ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032154 Jul 28 12:26:37.977110 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3251/6502] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:26:37.995368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:37.995989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:38.003232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:38.003696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:38.004472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:38.005147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:38.067953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:38.076018 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f983268-df9c-4bd9-840c-7c31e1681e84 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1224 microversion: 2.1 time: 0.084586 Jul 28 12:26:38.076604 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3252/6503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:37 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:26:39.098605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:39.101257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:39.108179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:39.108645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:39.109437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:39.109888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:39.183728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:39.191751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-629f5f3c-f70f-4087-ba73-4a85603b7c76 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1224 microversion: 2.1 time: 0.098298 Jul 28 12:26:39.192332 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3252/6504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:39 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:40.213835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:40.214455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:40.221518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:40.221977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:40.222758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:40.223242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:40.290780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:40.298533 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98effc64-ef73-4b6d-916f-8ce227a4b94e tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1224 microversion: 2.1 time: 0.088563 Jul 28 12:26:40.299132 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3253/6505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:40 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:41.320380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:41.321003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:41.327915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:41.328372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:41.329149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:41.329608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:41.391512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:41.399751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8562d57-4ce1-4b92-8b42-b399335b241f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1224 microversion: 2.1 time: 0.083768 Jul 28 12:26:41.400325 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3253/6506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:41 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:42.419877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:42.420553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:42.428356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:42.428751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:42.429555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:42.429996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:42.461998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:42.462451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:42.462903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lazy-loading 'fault' on Instance uuid 7f0d2087-3b14-4122-857c-ee785b572766 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:26:42.506247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f589f4442edb4c049d955c5a561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4972af534c341168a2937903e8d870e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:26:42.513495 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-14cf4198-8420-4c5c-9a0c-1198117e8630 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 200 len: 1183 microversion: 2.1 time: 0.097586 Jul 28 12:26:42.514076 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3254/6507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:42 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 1183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:26:43.534022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:43.534647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 7f0d2087-3b14-4122-857c-ee785b572766] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:43.541607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:43.542072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:43.542850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:43.543338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:43.556499 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 HTTP/1.1 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7f0d2087-3b14-4122-857c-ee785b572766'} Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:43.558147 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 7f0d2087-3b14-4122-857c-ee785b572766 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8964ac5-4e01-4446-85d7-4101c8f55a8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766" status: 404 len: 111 microversion: 2.1 time: 0.029526 Jul 28 12:26:43.563498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3254/6508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:43 2022] GET /compute/v2.1/servers/7f0d2087-3b14-4122-857c-ee785b572766 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:26:44.009350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:44.009856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:44.016656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:44.017106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:44.017868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:44.018302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:44.031461 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 HTTP/1.1 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '21d266b3-c803-4eda-b75f-be5a81df9311'} Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:26:44.033103 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7f6ed8c2-83f1-48ae-95f0-694f01560608 tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 404 len: 111 microversion: 2.1 time: 0.029649 Jul 28 12:26:44.037902 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3255/6509] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:26:44 2022] DELETE /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:26:44.043312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:44.043981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] [instance: 21d266b3-c803-4eda-b75f-be5a81df9311] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:26:44.050021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:44.050475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:44.051283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:26:44.051737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:26:44.065589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] HTTP exception thrown: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Request method failure captured: Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 HTTP/1.1 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4n3yC7lMaxaO1Nv8eau60X-bLSCKngLYIECQ2X4Lx5N_ijf328IVgmzcxdfoingCzGN7I5Xi00ZVYZVchCDCfBdRssAz5VAZnIxS1959VxkceFLXDSr2wtiyvBeI54cHLRrRs0cm9KrH5thI7yUl57uRtYdUlByKGyMMWeC9rzTOytk Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d4972af534c341168a2937903e8d870e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d4972af534c341168a2937903e8d870e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d4972af534c341168a2937903e8d870e"}]}] Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: d4972af534c341168a2937903e8d870e Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestVolumeBootPattern-48371144 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 23696f589f4442edb4c049d955c5a561 Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestVolumeBootPattern-48371144-project Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '21d266b3-c803-4eda-b75f-be5a81df9311'} Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:26:44.067131 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Returning 404 to user: Instance 21d266b3-c803-4eda-b75f-be5a81df9311 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1d23d82d-9536-4ff4-8667-1f47338c4b8d tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311" status: 404 len: 111 microversion: 2.1 time: 0.029825 Jul 28 12:26:44.073346 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3255/6510] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:26:44 2022] GET /compute/v2.1/servers/21d266b3-c803-4eda-b75f-be5a81df9311 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:26:47.511931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eb821ea5-89c6-4c5c-a7d0-e28558eee96f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] Calling method '.version_select at 0x7f2ebbe90820>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:26:47.539939 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eb821ea5-89c6-4c5c-a7d0-e28558eee96f tempest-TestVolumeBootPattern-48371144 tempest-TestVolumeBootPattern-48371144-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-366073824" status: 202 len: 0 microversion: 2.1 time: 0.032081 Jul 28 12:26:47.540562 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3256/6511] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Jul 28 12:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-366073824 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:27:05.672617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:05.673540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:05.783613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1225580968", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:05.835987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] validate_networks() for None {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:27:06.019931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:27:06.020376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:27:06.020872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:27:06.021306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:27:06.021742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:27:06.030904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:06.031420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:06.032246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:06.032703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:06.053281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Getting quotas for project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:27:06.058584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Getting quotas for user 9da4e3fc94af4a11ab40f9ca6c5405d1 and project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:27:06.070965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:27:06.073296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:27:06.118092 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f039fd8d-c1ef-484a-a7de-969fac94a0d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450660 Jul 28 12:27:06.118753 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3256/6512] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:27:06.131353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51c812bf-8739-4fa8-adb2-c08360a7ab4b tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:06.131969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51c812bf-8739-4fa8-adb2-c08360a7ab4b tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:06.134976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:06.138927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:06.204717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51c812bf-8739-4fa8-adb2-c08360a7ab4b tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:06.211561 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51c812bf-8739-4fa8-adb2-c08360a7ab4b tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1222 microversion: 2.1 time: 0.084675 Jul 28 12:27:06.212142 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3257/6513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:06 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:07.234274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:07.234844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:07.244700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:07.245182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:07.245994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:07.246449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:07.344242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:07.354227 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd2eb42c-e89e-45f3-a01a-ad7f51ca73e1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1282 microversion: 2.1 time: 0.124870 Jul 28 12:27:07.355110 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3257/6514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:07 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:08.376550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:08.377220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:08.385028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:08.385486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:08.386268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:08.386709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:08.604403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:08.612082 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97e8745b-2d75-4655-aadb-3a1c41a9bb1c tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.239499 Jul 28 12:27:08.612897 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3258/6515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:08 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:09.116611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-9c6d9363-072b-4534-b1eb-50c28e498a32 req-bb14a997-da55-412b-8e5d-c32adc17b678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74adbd21-1d09-46d9-ab01-6f413143f677", "tag": "a8cb0dff-303e-4947-8e63-8fb7dc806a64"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:09.129254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c6d9363-072b-4534-b1eb-50c28e498a32 req-bb14a997-da55-412b-8e5d-c32adc17b678 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:09.130467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-9c6d9363-072b-4534-b1eb-50c28e498a32 req-bb14a997-da55-412b-8e5d-c32adc17b678 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:09.149779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-9c6d9363-072b-4534-b1eb-50c28e498a32 req-bb14a997-da55-412b-8e5d-c32adc17b678 service nova] Creating event network-changed:a8cb0dff-303e-4947-8e63-8fb7dc806a64 for instance 74adbd21-1d09-46d9-ab01-6f413143f677 on n-h1-851368-1 Jul 28 12:27:09.154869 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-9c6d9363-072b-4534-b1eb-50c28e498a32 req-bb14a997-da55-412b-8e5d-c32adc17b678 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041956 Jul 28 12:27:09.155692 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3258/6516] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:09.633298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:09.633854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:09.640724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:09.641180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:09.641959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:09.642408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:09.769895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:09.778502 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a3d346e-d838-4e85-badb-eae444c79f41 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.149737 Jul 28 12:27:09.779109 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3259/6517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:09 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:10.800596 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:10.801264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:10.808076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:10.808544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:10.809336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:10.809794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:10.943970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:10.951562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-01a8304f-851d-4bbc-a25e-e6ac5e4fd016 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.156177 Jul 28 12:27:10.952339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3259/6518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:10 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:11.971377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:11.971805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:11.978879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:11.979371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:11.980153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:11.980593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:12.139646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:12.148304 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9aa61d59-b1d5-4981-9ab6-d337712ff0e0 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.180631 Jul 28 12:27:12.148304 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3260/6519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:11 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:13.168276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:13.168941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:13.175926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:13.176381 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:13.177665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:13.178114 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:13.308347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:13.315865 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e9118975-daba-401e-950e-c4f6cad60ee1 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.151559 Jul 28 12:27:13.316452 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3260/6520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:13 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:14.337169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:14.337858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:14.344674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:14.345128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:14.345904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:14.346346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:14.481353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:14.488874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca8ed62a-b423-4df7-8255-bcc54c82b1d4 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.155759 Jul 28 12:27:14.489960 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3261/6521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:14 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:14.955825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-00f16446-dd1f-4d88-811b-a43e6e4aa16f req-99a59467-2d59-4007-a254-fe279f850b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74adbd21-1d09-46d9-ab01-6f413143f677", "name": "network-vif-plugged", "status": "completed", "tag": "a8cb0dff-303e-4947-8e63-8fb7dc806a64"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:14.966438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00f16446-dd1f-4d88-811b-a43e6e4aa16f req-99a59467-2d59-4007-a254-fe279f850b6e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:14.967045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00f16446-dd1f-4d88-811b-a43e6e4aa16f req-99a59467-2d59-4007-a254-fe279f850b6e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:14.978822 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-00f16446-dd1f-4d88-811b-a43e6e4aa16f req-99a59467-2d59-4007-a254-fe279f850b6e service nova] Creating event network-vif-plugged:a8cb0dff-303e-4947-8e63-8fb7dc806a64 for instance 74adbd21-1d09-46d9-ab01-6f413143f677 on n-h1-851368-1 Jul 28 12:27:14.983772 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-00f16446-dd1f-4d88-811b-a43e6e4aa16f req-99a59467-2d59-4007-a254-fe279f850b6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Jul 28 12:27:14.984362 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3261/6522] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:15.509261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:15.509885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:15.516788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:15.517248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:15.518020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:15.518464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:15.649436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:15.656917 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d0390c59-6dbe-4c73-b9d7-42daa7391391 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1322 microversion: 2.1 time: 0.151525 Jul 28 12:27:15.657492 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3262/6523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:15 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:16.676045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:16.677324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:16.681535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:16.682255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:16.689401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:16.689873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:16.690649 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:16.691126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:16.820807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:16.828360 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9924a280-7ac8-42af-8aab-b72562752bc7 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1471 microversion: 2.1 time: 0.154202 Jul 28 12:27:16.828933 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3262/6524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:16 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:16.852471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:16.903057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6df353c-4a8a-4df3-b87b-5a47d570b1aa tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '.version_select at 0x7f2eb1aac700>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:16.966043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6df353c-4a8a-4df3-b87b-5a47d570b1aa tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/0bc06bff932c4d93bfb98ad74e6dea42" status: 200 len: 371 microversion: 2.1 time: 0.119352 Jul 28 12:27:16.966620 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3263/6525] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 12:27:16 2022] GET /compute/v2.1/os-quota-sets/0bc06bff932c4d93bfb98ad74e6dea42 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:16.978537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dcb0c26d-edda-4cb8-bc16-4d56f320e412 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1253649458", "id": 422590339, "os-flavor-access:is_public": "True"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:16.981485 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 12:27:16.981485 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 12:27:16.996476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dcb0c26d-edda-4cb8-bc16-4d56f320e412 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021874 Jul 28 12:27:16.997037 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3263/6526] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:27:16 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:17.008644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "422590339"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:17.010976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:17.017153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.017608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.018378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.018825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.104183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e170885e0dc548938a731bf743613cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc06bff932c4d93bfb98ad74e6dea42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:17.110161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1253649458 {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:27:17.117082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.117524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.118313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.118742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.139961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Getting quotas for project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'ram', 'cores'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:27:17.144893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Getting quotas for user 9da4e3fc94af4a11ab40f9ca6c5405d1 and project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'ram', 'cores'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:27:17.158357 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] ram quota exceeded for 0bc06bff932c4d93bfb98ad74e6dea42, tried to resize instance. Jul 28 12:27:17.158892 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Request method failure captured: Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action HTTP/1.1 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 38 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oCZzQNdyF9Hwz4lVqBOzBxYGID57jHHvI60R0I0cTj2gNeF7hmp_TT5xgqEZX-NDf7_qTBrtePbtI120Ipv0RLGSX25yEtgvm9SBkCLuPMAF6rxDaVihYc-L29AgD5bEMHShC9FA5tRWjrxfwtYyYGOMDRwfQU3yWLxeKRZRIXfdVs Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0bc06bff932c4d93bfb98ad74e6dea42 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Role: admin,reader,member Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: admin,reader,member Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc06bff932c4d93bfb98ad74e6dea42"}]}] Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0bc06bff932c4d93bfb98ad74e6dea42 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersAdminNegativeTestJSON-1364917611-project-admin Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e170885e0dc548938a731bf743613cc8 Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1364917611-project-admin Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: {"resize": {"flavorRef": "422590339"}} Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74adbd21-1d09-46d9-ab01-6f413143f677', 'body': {'resize': {'flavorRef': '422590339'}}} Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3824, in _check_quota_for_upsize Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.161517 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4193, in resize Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3842, in _check_quota_for_upsize Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-419b3df3-f98e-4570-9fa7-67f3ce1b9682 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action" status: 403 len: 118 microversion: 2.1 time: 0.158161 Jul 28 12:27:17.167328 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3264/6527] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:27:17 2022] POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action => generated 118 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:27:17.171986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6dc6abc4-d725-4778-9369-eb4825146e8c tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.172743 n-d-851368-1 devstack@n-api.service[119235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 12:27:17.172743 n-d-851368-1 devstack@n-api.service[119235]: warnings.warn(msg) Jul 28 12:27:17.188563 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6dc6abc4-d725-4778-9369-eb4825146e8c tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/422590339" status: 202 len: 0 microversion: 2.1 time: 0.020240 Jul 28 12:27:17.189116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3264/6528] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Jul 28 12:27:17 2022] DELETE /compute/v2.1/flavors/422590339 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 12:27:17.197079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1eca268f-9f35-456c-9ced-b978a54d539c tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.217908 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1eca268f-9f35-456c-9ced-b978a54d539c tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024522 Jul 28 12:27:17.218472 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3265/6529] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 12:27:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:17.238393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06d8a2e8-0363-4c45-8623-b1de7089dc95 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '.version_select at 0x7f2eb26615e0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.304358 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06d8a2e8-0363-4c45-8623-b1de7089dc95 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/0bc06bff932c4d93bfb98ad74e6dea42" status: 200 len: 371 microversion: 2.1 time: 0.069564 Jul 28 12:27:17.304924 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3265/6530] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Jul 28 12:27:17 2022] GET /compute/v2.1/os-quota-sets/0bc06bff932c4d93bfb98ad74e6dea42 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:17.316088 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-71f16830-14eb-4097-8f6f-72a7bd170dde tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-221241709", "id": 21576781, "os-flavor-access:is_public": "True"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:17.319160 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 12:27:17.319160 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 12:27:17.335214 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-71f16830-14eb-4097-8f6f-72a7bd170dde tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.022775 Jul 28 12:27:17.335789 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3266/6531] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:27:17 2022] POST /compute/v2.1/flavors => generated 430 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:17.347284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "21576781"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:17.350344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:17.356832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.357261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.358061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.358523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.567796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e170885e0dc548938a731bf743613cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc06bff932c4d93bfb98ad74e6dea42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:17.574314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-221241709 {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:27:17.580809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.581281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.582102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.582584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.604165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Getting quotas for project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:27:17.609187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Getting quotas for user 9da4e3fc94af4a11ab40f9ca6c5405d1 and project de87a78d37e24944a3bcbc5e3f78621d. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:27:17.621033 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.compute.api [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] cores quota exceeded for 0bc06bff932c4d93bfb98ad74e6dea42, tried to resize instance. Jul 28 12:27:17.621846 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Request method failure captured: Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action HTTP/1.1 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 37 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oCZzQNdyF9Hwz4lVqBOzBxYGID57jHHvI60R0I0cTj2gNeF7hmp_TT5xgqEZX-NDf7_qTBrtePbtI120Ipv0RLGSX25yEtgvm9SBkCLuPMAF6rxDaVihYc-L29AgD5bEMHShC9FA5tRWjrxfwtYyYGOMDRwfQU3yWLxeKRZRIXfdVs Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0bc06bff932c4d93bfb98ad74e6dea42 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Role: admin,reader,member Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: admin,reader,member Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0bc06bff932c4d93bfb98ad74e6dea42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0bc06bff932c4d93bfb98ad74e6dea42"}]}] Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0bc06bff932c4d93bfb98ad74e6dea42 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1364917611 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminNegativeTestJSON-1364917611-project-admin Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: e170885e0dc548938a731bf743613cc8 Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1364917611-project-admin Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: {"resize": {"flavorRef": "21576781"}} Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74adbd21-1d09-46d9-ab01-6f413143f677', 'body': {'resize': {'flavorRef': '21576781'}}} Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3824, in _check_quota_for_upsize Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.640411 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4193, in resize Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3842, in _check_quota_for_upsize Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7d33956-8124-4de5-9f15-9b2fb32fc9a0 tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action" status: 403 len: 113 microversion: 2.1 time: 0.298616 Jul 28 12:27:17.646270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3266/6532] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:27:17 2022] POST /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677/action => generated 113 bytes in 300 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:27:17.651676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0091e15b-b143-4b92-a4f6-83ba7eb26b7e tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.652443 n-d-851368-1 devstack@n-api.service[119236]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 12:27:17.652443 n-d-851368-1 devstack@n-api.service[119236]: warnings.warn(msg) Jul 28 12:27:17.668555 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0091e15b-b143-4b92-a4f6-83ba7eb26b7e tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/21576781" status: 202 len: 0 microversion: 2.1 time: 0.020893 Jul 28 12:27:17.669102 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3267/6533] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Jul 28 12:27:17 2022] DELETE /compute/v2.1/flavors/21576781 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:27:17.677620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f34ba85-2f94-439b-be5a-19a57ebc17ce tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.700284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f34ba85-2f94-439b-be5a-19a57ebc17ce tempest-ServersAdminNegativeTestJSON-1364917611 tempest-ServersAdminNegativeTestJSON-1364917611-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026336 Jul 28 12:27:17.700875 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3267/6534] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Jul 28 12:27:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:17.721271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.721780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:17.728177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.728633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.729397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.729838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.753935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:27:17.839032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c602b09b-6286-4c06-aef0-8b024751f155 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 204 len: 0 microversion: 2.1 time: 0.121250 Jul 28 12:27:17.839907 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3268/6535] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:27:17 2022] DELETE /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:27:17.848197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:17.848832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:17.855166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.855635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.856415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:17.856866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:17.988053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:17.996118 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ab96b67-94a7-49ca-8506-91ab40ebb990 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1477 microversion: 2.1 time: 0.151788 Jul 28 12:27:17.996688 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3268/6536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:17 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:19.018011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:19.018712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:19.026139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:19.026581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:19.027368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:19.027804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:19.162014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:19.169584 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4bd4a0ac-9b09-4d65-9d3f-a2a7a47515a8 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1477 microversion: 2.1 time: 0.155786 Jul 28 12:27:19.170159 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3269/6537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:19 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:19.849482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-48c13917-2247-4d5e-8e5a-81b365cffd04 req-b448ebfe-48cd-4135-af39-16e0c889555d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74adbd21-1d09-46d9-ab01-6f413143f677", "name": "network-vif-deleted", "tag": "a8cb0dff-303e-4947-8e63-8fb7dc806a64"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:19.861727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-48c13917-2247-4d5e-8e5a-81b365cffd04 req-b448ebfe-48cd-4135-af39-16e0c889555d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:19.862224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-48c13917-2247-4d5e-8e5a-81b365cffd04 req-b448ebfe-48cd-4135-af39-16e0c889555d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:19.874894 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-48c13917-2247-4d5e-8e5a-81b365cffd04 req-b448ebfe-48cd-4135-af39-16e0c889555d service nova] Creating event network-vif-deleted:a8cb0dff-303e-4947-8e63-8fb7dc806a64 for instance 74adbd21-1d09-46d9-ab01-6f413143f677 on n-h1-851368-1 Jul 28 12:27:19.881407 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-48c13917-2247-4d5e-8e5a-81b365cffd04 req-b448ebfe-48cd-4135-af39-16e0c889555d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Jul 28 12:27:19.882217 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3269/6538] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:20.190877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:20.191547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:20.199011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:20.199493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:20.200263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:20.200704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:20.231095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:20.231550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:20.232008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lazy-loading 'fault' on Instance uuid 74adbd21-1d09-46d9-ab01-6f413143f677 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:27:20.281116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da4e3fc94af4a11ab40f9ca6c5405d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87a78d37e24944a3bcbc5e3f78621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:20.289477 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8fc4edc8-f40a-4ece-ab9d-4a4f26366002 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 200 len: 1312 microversion: 2.1 time: 0.102488 Jul 28 12:27:20.290053 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3270/6539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:20 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:21.312220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:21.312908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] [instance: 74adbd21-1d09-46d9-ab01-6f413143f677] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:21.319322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:21.319797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:21.320590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:21.321049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:21.334193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] HTTP exception thrown: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Request method failure captured: Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 HTTP/1.1 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oCYOUy1fZm2Goug0z9PvZ77IHZuTlPWwNyLJ8lryKthTRYHAp5bjsLnNeY0p4uAcFRvay9J5YIcc4yIAK-exBDCAFeUvQQxD6p_rYKK9yLRTF2UXcK1dNCVVDm7di0UjVQIKZoxbQFMRfC9SEm5o7MZSKmkFo_GE9sqHBPhmECt79s Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: de87a78d37e24944a3bcbc5e3f78621d Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680247220 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de87a78d37e24944a3bcbc5e3f78621d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de87a78d37e24944a3bcbc5e3f78621d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de87a78d37e24944a3bcbc5e3f78621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de87a78d37e24944a3bcbc5e3f78621d"}]}] Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680247220 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: de87a78d37e24944a3bcbc5e3f78621d Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680247220 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersAdminNegativeTestJSON-1680247220-project Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9da4e3fc94af4a11ab40f9ca6c5405d1 Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680247220-project Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74adbd21-1d09-46d9-ab01-6f413143f677'} Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:21.335853 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] Returning 404 to user: Instance 74adbd21-1d09-46d9-ab01-6f413143f677 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6c9d59cd-d24b-468c-868b-08f026122ff5 tempest-ServersAdminNegativeTestJSON-1680247220 tempest-ServersAdminNegativeTestJSON-1680247220-project] 10.222.0.93 "GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677" status: 404 len: 111 microversion: 2.1 time: 0.030326 Jul 28 12:27:21.341575 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3270/6540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:21 2022] GET /compute/v2.1/servers/74adbd21-1d09-46d9-ab01-6f413143f677 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:27:27.284342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:27.285145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:27.404154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1722045705", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "8283abb0-c21c-410d-9ac8-5f996f2faa1f"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:27.475378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] validate_networks() for [('8283abb0-c21c-410d-9ac8-5f996f2faa1f', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:27:27.881007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:27:27.881427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:27:27.883094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:27:27.883533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:27:27.883962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:27:27.893124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:27.893571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:27.894372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:27.895357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:27.915699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Getting quotas for project 64c3a61bd4ad43369067da9f9de287ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:27:27.921889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Getting quotas for user 9d19b5153c5c4ff3b3d89d7e49583140 and project 64c3a61bd4ad43369067da9f9de287ad. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:27:27.942801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:27:27.945257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:27:28.013970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1a355307-1a6e-4cc5-b934-302336c0d453 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735544 Jul 28 12:27:28.021078 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3271/6541] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:27:28.026253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5bafd234-123e-4894-9953-7ed4ec2700d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:28.026959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5bafd234-123e-4894-9953-7ed4ec2700d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:28.030659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:28.033699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:28.109945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5bafd234-123e-4894-9953-7ed4ec2700d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:28.121016 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5bafd234-123e-4894-9953-7ed4ec2700d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1215 microversion: 2.1 time: 0.096843 Jul 28 12:27:28.123568 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3271/6542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:28 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:29.141980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:29.142701 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:29.154002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:29.154891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:29.155957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:29.156476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:29.268494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:29.276409 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47ad21d3-8aec-4e84-b5cd-b56a2727d0fd tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1275 microversion: 2.1 time: 0.138367 Jul 28 12:27:29.277663 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3272/6543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:29 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:30.301062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:30.303095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:30.315116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:30.315836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:30.318150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:30.321210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:30.589126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:30.605439 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9d56901f-8c27-44d6-813d-d9f5f35206c6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.310877 Jul 28 12:27:30.607801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3272/6544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:30 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:30.821092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e57de0ca-fef4-479e-97d8-16333df7658e req-209c1f31-74b6-40e5-8650-53820b422057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:30.835279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e57de0ca-fef4-479e-97d8-16333df7658e req-209c1f31-74b6-40e5-8650-53820b422057 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:30.836013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e57de0ca-fef4-479e-97d8-16333df7658e req-209c1f31-74b6-40e5-8650-53820b422057 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:30.849402 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e57de0ca-fef4-479e-97d8-16333df7658e req-209c1f31-74b6-40e5-8650-53820b422057 service nova] Creating event network-changed:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h1-851368-1 Jul 28 12:27:30.857005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e57de0ca-fef4-479e-97d8-16333df7658e req-209c1f31-74b6-40e5-8650-53820b422057 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049582 Jul 28 12:27:30.858768 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3273/6545] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:27:31.633136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:31.633816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:31.640847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:31.641307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:31.642092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:31.642542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:31.772922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:31.780840 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e9e219a-5dfb-4f87-9310-39c1739912df tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.152433 Jul 28 12:27:31.781613 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3273/6546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:31 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:32.808366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:32.809067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:32.815350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:32.816102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:32.817384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:32.817822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:32.945743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:32.953296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92343a4b-0e8b-45da-9bbf-635d8d1644d9 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.150121 Jul 28 12:27:32.953870 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3274/6547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:32 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:33.974416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:33.975103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:33.982299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:33.982769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:33.983576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:33.984031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:34.120118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:34.127549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13e718f8-b170-435b-8ee3-a38d466bf034 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.157705 Jul 28 12:27:34.128115 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3274/6548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:33 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:35.148470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:35.149082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:35.156066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:35.156526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:35.157295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:35.157729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:35.289554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:35.297073 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-027c43d8-1d5a-4079-b4a6-5ae1bde3d488 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.153006 Jul 28 12:27:35.297668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3275/6549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:35 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:36.317249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:36.317910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:36.320738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:36.326833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:36.327346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:36.328136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:36.328599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:36.333078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=72 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:36.459986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:36.467568 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e4d2e727-901c-452c-a4f5-3cf02727623d tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.154244 Jul 28 12:27:36.468143 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3275/6550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:36 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:37.022659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0d559434-178a-4c80-a97c-8c7832f9b36b req-5515f671-ff7d-47e6-b807-1fe8278efc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "name": "network-vif-plugged", "status": "completed", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:37.028551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:37.034672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0d559434-178a-4c80-a97c-8c7832f9b36b req-5515f671-ff7d-47e6-b807-1fe8278efc4c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:37.035263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0d559434-178a-4c80-a97c-8c7832f9b36b req-5515f671-ff7d-47e6-b807-1fe8278efc4c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:37.039945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:37.048246 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0d559434-178a-4c80-a97c-8c7832f9b36b req-5515f671-ff7d-47e6-b807-1fe8278efc4c service nova] Creating event network-vif-plugged:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h1-851368-1 Jul 28 12:27:37.053725 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0d559434-178a-4c80-a97c-8c7832f9b36b req-5515f671-ff7d-47e6-b807-1fe8278efc4c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Jul 28 12:27:37.054400 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3276/6551] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:27:37.489128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:37.489757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:37.496619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:37.497072 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:37.497836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:37.498284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:37.626907 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:37.635029 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59410195-bc08-4159-bbc2-67bd1f4c3691 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1315 microversion: 2.1 time: 0.150278 Jul 28 12:27:37.635642 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3276/6552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:37 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:38.653894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:38.654665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:38.659741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:38.660947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:38.670692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:38.671255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:38.672046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:38.672618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:38.806712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:38.814226 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d492ef7-e84b-43dd-8690-52d0c49a6bb3 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1502 microversion: 2.1 time: 0.161311 Jul 28 12:27:38.814787 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3277/6553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:38 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:38.835733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:27:38.837991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:38.840045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:27:38.846257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:38.846724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:38.847538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:38.848196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:38.922085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:38.928416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Old instance type m1.heat2, new instance type m1.heat {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:27:38.934641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:27:38.935099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:27:38.935601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:27:38.936030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:27:38.936470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:27:39.043373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0db5538-d3ce-495b-ac59-61aace62ea8f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "POST /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce/action" status: 202 len: 0 microversion: 2.1 time: 0.212775 Jul 28 12:27:39.043981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3277/6554] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:27:38 2022] POST /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:27:39.052665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:39.053239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:39.059317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:39.059772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:39.060591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:39.060987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:39.231352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:39.239607 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f16070d-7bca-4fa1-a9d7-3aff022d6db4 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1511 microversion: 2.1 time: 0.191392 Jul 28 12:27:39.240195 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3278/6555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:39 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:40.262149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:40.262781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:40.270543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:40.271010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:40.271827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:40.272279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:40.403566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:40.411278 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f0cb4d3-e6b8-49cd-aa3f-773e19477885 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1511 microversion: 2.1 time: 0.153908 Jul 28 12:27:40.411849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3278/6556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:40 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:41.432488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:41.433105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:41.440041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:41.440497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:41.441272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:41.442345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:41.580017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:41.587505 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ed8e417-7021-46e5-b895-77388456cbf8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.158846 Jul 28 12:27:41.588077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3279/6557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:41 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:42.608839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:42.609414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:42.616250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:42.616709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:42.617476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:42.617920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:43.090698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:43.099162 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8b028547-d1d6-4a52-8421-ab56a4e1d5ee tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.494219 Jul 28 12:27:43.099991 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3279/6558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:42 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:44.121712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:44.122270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:44.129145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:44.129590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:44.130379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:44.130811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:44.259890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:44.267599 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37cdf434-79c6-4d66-b71c-8883c4d3844b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.149809 Jul 28 12:27:44.268177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3280/6559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:44 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:45.288477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:45.289118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:45.296041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:45.296510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:45.297293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:45.297751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:45.431007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:45.438630 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b8b7ce8b-b64d-417a-b347-598f2c194141 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.154749 Jul 28 12:27:45.439225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3280/6560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:45 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:46.459908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:46.460582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:46.467577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:46.468033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:46.468811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:46.469280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:46.604872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:46.612836 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-55f1b18b-a014-4d14-88b3-987692e22417 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.157315 Jul 28 12:27:46.613431 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3281/6561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:46 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:47.635401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:47.636409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:47.643639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:47.644225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:47.646142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:47.646599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:47.772912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:47.780265 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ecfa063-c403-4775-b18c-93dbc0d4fccf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.150464 Jul 28 12:27:47.780834 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3281/6562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:47 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:48.801103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:48.801709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:48.808610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:48.809057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:48.809812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:48.810277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:48.948034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:48.955667 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2034be1c-996e-46a4-aeb7-9bc3b9cec277 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.158389 Jul 28 12:27:48.956260 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3282/6563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:48 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:49.977310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:49.977928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:49.984849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:49.985309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:49.986079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:49.986532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:50.116083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:50.123427 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3cc57bf-d3e4-4b88-9b21-4a135b4ef020 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.150204 Jul 28 12:27:50.124353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3282/6564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:49 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:51.144869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:51.145524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:51.152418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:51.152876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:51.153647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:51.154091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:51.286674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:51.294332 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-401de21f-a0f4-4da7-b221-031beb7b6354 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.153897 Jul 28 12:27:51.294906 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3283/6565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:51 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:52.315778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:52.316413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:52.323396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:52.323872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:52.324658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:52.325109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:52.453235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:52.461341 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-54cb696f-4379-4d2f-a0ac-8072af16ca1e tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.149527 Jul 28 12:27:52.461914 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3283/6566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:52 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:53.483883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:53.484509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:53.491325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:53.491772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:53.492534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:53.492967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:53.619983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:53.627469 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-01a2ba95-ba68-48d6-b781-8bc29985fbf6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.147470 Jul 28 12:27:53.628047 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3284/6567] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:53 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:54.648464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:54.649041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:54.655871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:54.656337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:54.657429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:54.657878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:54.793974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:54.801908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f4ba801-f0b2-47e3-96f4-f514bd8ded3a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.157435 Jul 28 12:27:54.802472 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3284/6568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:54 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:55.822451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:55.823095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:55.829951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:55.830405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:55.831203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:55.831647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:55.960483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:55.969635 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-231d113d-30f6-41a8-ad8d-f47e13f7a4cc tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.151087 Jul 28 12:27:55.970213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3285/6569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:55 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:56.995650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:56.996289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:57.004939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:57.005409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:57.006204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:57.006663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:57.141181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:57.149193 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-15674dbd-a918-4437-ba1b-6d8a5957b6e7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.159782 Jul 28 12:27:57.149778 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3285/6570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:56 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:27:58.170479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:58.171115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:58.178733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:58.179255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:58.180057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:58.180502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:58.306079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:58.313492 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5e0e7cb7-e7bf-4797-88a0-77adbc303b51 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.147575 Jul 28 12:27:58.314065 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3286/6571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:58 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:27:59.334566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:27:59.335174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:27:59.341586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:59.342056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:59.342835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:27:59.343333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:27:59.483365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:27:59.490593 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62e5b799-4c81-4e19-a200-2fbe8c2b838b tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.160031 Jul 28 12:27:59.491509 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3286/6572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:27:59 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:00.511516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:00.512157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:00.519793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:00.520242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:00.521009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:00.521446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:00.649237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:00.656662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53d0e495-ef9d-4d6e-82ab-1af0ca9b29b0 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.149019 Jul 28 12:28:00.657235 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3287/6573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:00 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:01.677194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:01.677806 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:01.684744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:01.685206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:01.685980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:01.686428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:01.813739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:01.821693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-17ba50e5-d954-4505-a963-57605c9d1e2a tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.148585 Jul 28 12:28:01.822263 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3287/6574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:01 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:02.843326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:02.843976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:02.850202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:02.850662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:02.851458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:02.851902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:02.988159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:02.995744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc24f240-74dd-41bd-ad82-a6cb3f171e2c tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.156526 Jul 28 12:28:02.996319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3288/6575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:02 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:04.017397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:04.018030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:04.025545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:04.026014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:04.026799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:04.027301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:04.155113 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:04.162602 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b5ec08c-ba1d-4cec-add7-23a7f2fc96aa tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.149209 Jul 28 12:28:04.163185 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3288/6576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:04 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:05.183389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:05.184003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:05.190885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:05.191370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:05.192139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:05.192577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:05.323043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:05.330566 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6c4fa54-d2b9-4890-8b1e-e7d5e3448222 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.151075 Jul 28 12:28:05.331151 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3289/6577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:05 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:06.352573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:06.353202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:06.355935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=32 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:06.361324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:06.361787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:06.363243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:06.363697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:06.367655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:06.493222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:06.500748 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24749ed4-9a4a-477b-a09f-a9ea3a42d772 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.152412 Jul 28 12:28:06.501315 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3289/6578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:06 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:07.522348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:07.522965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:07.530727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:07.531210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:07.531985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:07.532426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:07.660196 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:07.667685 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1974a32-1a00-41b9-b25f-60ba36028cc6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1516 microversion: 2.1 time: 0.149747 Jul 28 12:28:07.668263 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3290/6579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:07 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:08.688438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:08.689069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:08.696468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:08.696943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:08.697740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:08.698195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:08.775003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "name": "network-vif-unplugged", "status": "completed", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:08.781252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=30 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:08.787001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:08.787486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:08.791629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=86 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:08.800902 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] Creating event network-vif-unplugged:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h2-851368-1 Jul 28 12:28:08.812033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] Instance c38410c0-680c-49c3-ac6c-efa4832270ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:28:08.823929 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2f2e1f5f-6b3d-4943-bfb8-1150e325ca96 req-c453cd8a-14cc-40ef-9e00-2f2fd4b603c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052557 Jul 28 12:28:08.824546 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3291/6580] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:28:08.939661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:08.948346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7834f1c6-b856-463c-8bdf-aa9573543420 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1515 microversion: 2.1 time: 0.263822 Jul 28 12:28:08.948925 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3290/6581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:08 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:09.971215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:09.972528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:09.978955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:09.979438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:09.980198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:09.980634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:10.111327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:10.118831 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3727659-7d98-4d3c-b7bb-de34648e35b6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1513 microversion: 2.1 time: 0.152727 Jul 28 12:28:10.119440 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3292/6582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:09 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:10.862247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:10.872500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:10.872966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:10.884746 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] Creating event network-changed:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h2-851368-1 Jul 28 12:28:10.890401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] Instance c38410c0-680c-49c3-ac6c-efa4832270ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:28:10.902205 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-680ac4fd-ba0c-4bc5-bb35-47f3ad82c1c9 req-19b40563-1f5c-48ec-8464-160079ea3167 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043598 Jul 28 12:28:10.902811 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3291/6583] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:28:11.140713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:11.141327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:11.148644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:11.149129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:11.149900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:11.150340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:11.464774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:11.472414 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-149bc66d-e911-4500-bf02-ee0e5509fbd8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1513 microversion: 2.1 time: 0.335622 Jul 28 12:28:11.472980 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3293/6584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:11 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:11.546618 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:28:11.546852 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:28:12.499436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:12.500186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:12.511436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:12.512145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:12.513340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:12.514030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:12.647160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:12.654663 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e0befbf3-4af7-483f-b8ad-b2f8968dd6f2 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1510 microversion: 2.1 time: 0.161783 Jul 28 12:28:12.655266 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3292/6585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:12 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:12.675045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:12.675571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:12.682332 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:12.682886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:12.683549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:12.683987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:12.709083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:28:12.759919 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Found an unconfirmed migration during delete, id: 16, status: finished Jul 28 12:28:14.209873 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f35b9ac2-9d69-4b0d-97cb-ce301fe9170f tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 204 len: 0 microversion: 2.1 time: 1.538023 Jul 28 12:28:14.210629 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3294/6586] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:28:12 2022] DELETE /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 0 bytes in 1540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:28:14.218950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:14.219611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:14.227369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:14.227841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:14.228828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:14.229282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:14.358620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:14.366663 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-116bdca7-8943-473d-a27e-e60f63c4eebf tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1502 microversion: 2.1 time: 0.151573 Jul 28 12:28:14.367272 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3293/6587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:14 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:15.274602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e3bd8c34-ada5-4f69-acab-03518b214cb1 req-b6658d68-3309-4b7f-a94e-1d718dca9ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "name": "network-vif-plugged", "status": "completed", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:15.285574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e3bd8c34-ada5-4f69-acab-03518b214cb1 req-b6658d68-3309-4b7f-a94e-1d718dca9ada service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:15.286039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e3bd8c34-ada5-4f69-acab-03518b214cb1 req-b6658d68-3309-4b7f-a94e-1d718dca9ada service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:15.296977 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e3bd8c34-ada5-4f69-acab-03518b214cb1 req-b6658d68-3309-4b7f-a94e-1d718dca9ada service nova] Creating event network-vif-plugged:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h2-851368-1 Jul 28 12:28:15.302313 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e3bd8c34-ada5-4f69-acab-03518b214cb1 req-b6658d68-3309-4b7f-a94e-1d718dca9ada service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Jul 28 12:28:15.302868 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3295/6588] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:28:15.388009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:15.388641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:15.395574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:15.396045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:15.396830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:15.397287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:15.528865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d19b5153c5c4ff3b3d89d7e49583140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c3a61bd4ad43369067da9f9de287ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:15.536393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-daeb29b3-8a2f-43ab-a3c9-d534719fc3f6 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 200 len: 1502 microversion: 2.1 time: 0.152258 Jul 28 12:28:15.536970 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3294/6589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:15 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:16.118089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cdc8d423-dca9-4bed-9997-f0b2bdfccac7 req-5ff17935-304c-4f96-a6e8-947115f63623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38410c0-680c-49c3-ac6c-efa4832270ce", "name": "network-vif-deleted", "tag": "a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:16.129535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cdc8d423-dca9-4bed-9997-f0b2bdfccac7 req-5ff17935-304c-4f96-a6e8-947115f63623 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.129993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cdc8d423-dca9-4bed-9997-f0b2bdfccac7 req-5ff17935-304c-4f96-a6e8-947115f63623 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.141767 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cdc8d423-dca9-4bed-9997-f0b2bdfccac7 req-5ff17935-304c-4f96-a6e8-947115f63623 service nova] Creating event network-vif-deleted:a4ab0ca2-3670-4fb3-ab38-c0681a1b3fd7 for instance c38410c0-680c-49c3-ac6c-efa4832270ce on n-h2-851368-1 Jul 28 12:28:16.148499 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cdc8d423-dca9-4bed-9997-f0b2bdfccac7 req-5ff17935-304c-4f96-a6e8-947115f63623 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035428 Jul 28 12:28:16.149207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3296/6590] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:28:16.556969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:16.557587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:16.564423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.564886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.566190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.566640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.579514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] HTTP exception thrown: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Request method failure captured: Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce HTTP/1.1 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oCv5sDnhXZh_v3dRJrtLZa98jUjFya2OF-J6BAY99ocdi5LnRWK2D53rUw-GlT_KqkDt1vS46kmF2dp48gPySbBu_6fHsevUxFyxUVqcCZZMssMcFgAAUJiuryPpfTiUfX2A121MaRkqSVElVXAhMtm2Hb9L5b0jT_524JTDbcwggU Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}] Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9d19b5153c5c4ff3b3d89d7e49583140 Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c38410c0-680c-49c3-ac6c-efa4832270ce'} Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.581130 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Returning 404 to user: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a2e9f03a-4c14-4806-bfbc-51a516ae1df8 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 404 len: 111 microversion: 2.1 time: 0.030097 Jul 28 12:28:16.587480 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3295/6591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:16 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:28:16.599465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:16.600055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:16.606526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.606959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.607788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.608227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.621325 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] HTTP exception thrown: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Request method failure captured: Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce HTTP/1.1 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oCv5sDnhXZh_v3dRJrtLZa98jUjFya2OF-J6BAY99ocdi5LnRWK2D53rUw-GlT_KqkDt1vS46kmF2dp48gPySbBu_6fHsevUxFyxUVqcCZZMssMcFgAAUJiuryPpfTiUfX2A121MaRkqSVElVXAhMtm2Hb9L5b0jT_524JTDbcwggU Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}] Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 9d19b5153c5c4ff3b3d89d7e49583140 Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c38410c0-680c-49c3-ac6c-efa4832270ce'} Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:28:16.622960 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Returning 404 to user: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-13ba15a2-144f-426e-9ff4-7a35207871b7 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 404 len: 111 microversion: 2.1 time: 0.029984 Jul 28 12:28:16.628043 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3297/6592] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:28:16 2022] DELETE /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:28:16.633317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:16.633986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] [instance: c38410c0-680c-49c3-ac6c-efa4832270ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:16.640021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.640492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.641275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:16.641731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:16.657386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] HTTP exception thrown: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Request method failure captured: Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce HTTP/1.1 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oCv5sDnhXZh_v3dRJrtLZa98jUjFya2OF-J6BAY99ocdi5LnRWK2D53rUw-GlT_KqkDt1vS46kmF2dp48gPySbBu_6fHsevUxFyxUVqcCZZMssMcFgAAUJiuryPpfTiUfX2A121MaRkqSVElVXAhMtm2Hb9L5b0jT_524JTDbcwggU Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64c3a61bd4ad43369067da9f9de287ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64c3a61bd4ad43369067da9f9de287ad"}]}] Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 64c3a61bd4ad43369067da9f9de287ad Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-DeleteServersTestJSON-63769469 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 9d19b5153c5c4ff3b3d89d7e49583140 Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-DeleteServersTestJSON-63769469-project Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'c38410c0-680c-49c3-ac6c-efa4832270ce'} Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:28:16.658938 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] Returning 404 to user: Instance c38410c0-680c-49c3-ac6c-efa4832270ce could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6b40e03f-c58c-4961-90ab-52faae285b90 tempest-DeleteServersTestJSON-63769469 tempest-DeleteServersTestJSON-63769469-project] 10.222.0.93 "GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce" status: 404 len: 111 microversion: 2.1 time: 0.030900 Jul 28 12:28:16.664279 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3296/6593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:16 2022] GET /compute/v2.1/servers/c38410c0-680c-49c3-ac6c-efa4832270ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:28:25.355307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-768267922", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "d172f363-467c-4f0c-88b9-d61b079ca37c"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:25.412848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] validate_networks() for [('d172f363-467c-4f0c-88b9-d61b079ca37c', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:28:25.781531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:28:25.781963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:28:25.782445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:28:25.782864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:28:25.783325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:28:25.792929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:25.793384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:25.794195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:25.794640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:25.811847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for project 0c819309bc994d598eca876e238f2766. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:28:25.817243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for user d903c7202d334f8b87b016527a83c5f3 and project 0c819309bc994d598eca876e238f2766. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:28:25.829463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:28:25.832258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:28:25.876442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eea40b74-e6b6-48a2-83ce-a2dacf451261 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644678 Jul 28 12:28:25.877099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3298/6594] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:28:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:28:25.887994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a7d04d16-9f4c-4179-9d27-e4313d0d02db tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:25.888631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a7d04d16-9f4c-4179-9d27-e4313d0d02db tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:25.948776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a7d04d16-9f4c-4179-9d27-e4313d0d02db tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:25.963401 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a7d04d16-9f4c-4179-9d27-e4313d0d02db tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1217 microversion: 2.1 time: 0.079075 Jul 28 12:28:25.964444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3297/6595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:25 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:28:26.987853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:26.988556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:26.999862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:27.000319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:27.001108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:27.001544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:27.102897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:27.110823 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8088b1d3-dd0c-4cd8-8769-e88345282df6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1287 microversion: 2.1 time: 0.128655 Jul 28 12:28:27.111775 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3299/6596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:26 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:28.135654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:28.138322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:28.155794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=37 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:28.160590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:28.161588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:28.162800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:28.163875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:28.387048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:28.399256 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-412ffbb5-8772-45a0-a070-ed8b74c96f39 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.270861 Jul 28 12:28:28.400356 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3298/6597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:28 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:28.700226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-844192f0-4af9-4283-b939-d7d85bd9dc6e req-d458528b-21ed-404d-a948-021b816a3194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:28.712585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-844192f0-4af9-4283-b939-d7d85bd9dc6e req-d458528b-21ed-404d-a948-021b816a3194 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:28.714367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-844192f0-4af9-4283-b939-d7d85bd9dc6e req-d458528b-21ed-404d-a948-021b816a3194 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:28.743499 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-844192f0-4af9-4283-b939-d7d85bd9dc6e req-d458528b-21ed-404d-a948-021b816a3194 service nova] Creating event network-changed:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h2-851368-1 Jul 28 12:28:28.749713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-844192f0-4af9-4283-b939-d7d85bd9dc6e req-d458528b-21ed-404d-a948-021b816a3194 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054031 Jul 28 12:28:28.751124 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3300/6598] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:28:29.421147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:29.421775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:29.428196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:29.428660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:29.429436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:29.429889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:29.562535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:29.570722 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f208655d-8cc3-4784-9bd1-f72ba350ace6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.153443 Jul 28 12:28:29.571339 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3299/6599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:29 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:30.592937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:30.593639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:30.600560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:30.601012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:30.601776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:30.602474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:30.736372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:30.743960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-569db563-84d8-4540-b0c4-2316def3ee7e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.156140 Jul 28 12:28:30.744473 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3301/6600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:30 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:31.764737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:31.765367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:31.772448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:31.772917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:31.773703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:31.774160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:31.903226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:31.910683 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-08304fb4-7d6d-4368-8cb6-3eade7923cbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.149855 Jul 28 12:28:31.911292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3300/6601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:31 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:32.931013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:32.931651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:32.938134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:32.938590 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:32.939410 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:32.939855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:33.073464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:33.080951 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d38596a6-1c45-48bd-af25-fd3e0460331e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.153956 Jul 28 12:28:33.081542 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3302/6602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:32 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:33.300637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7f499378-ecbc-4ffc-8eb1-8a4a5042e4d0 req-07ac2766-f3d5-4a99-ae88-4b0242356d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "name": "network-vif-plugged", "status": "completed", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:33.311574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7f499378-ecbc-4ffc-8eb1-8a4a5042e4d0 req-07ac2766-f3d5-4a99-ae88-4b0242356d31 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:33.312036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7f499378-ecbc-4ffc-8eb1-8a4a5042e4d0 req-07ac2766-f3d5-4a99-ae88-4b0242356d31 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:33.323013 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7f499378-ecbc-4ffc-8eb1-8a4a5042e4d0 req-07ac2766-f3d5-4a99-ae88-4b0242356d31 service nova] Creating event network-vif-plugged:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h2-851368-1 Jul 28 12:28:33.327929 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7f499378-ecbc-4ffc-8eb1-8a4a5042e4d0 req-07ac2766-f3d5-4a99-ae88-4b0242356d31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031041 Jul 28 12:28:33.328688 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3301/6603] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:28:34.102007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:34.102883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:34.109712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:34.110162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:34.110931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:34.111394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:34.242513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:34.249986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ff18388-d5d6-40e1-a426-cf4c80cd11c4 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1317 microversion: 2.1 time: 0.152514 Jul 28 12:28:34.250559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3303/6604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:34 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:35.271795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:35.272452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:35.278725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.279227 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.280007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.280462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.408595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:35.416605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dae9c720-a502-4421-b70a-7b863eafea9e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1506 microversion: 2.1 time: 0.150594 Jul 28 12:28:35.417174 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3302/6605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:35 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:35.436859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:35.437479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:35.444404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.444862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.445629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.446074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.570595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:35.578020 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42af5e40-5682-4f26-ae58-f7aff3c648e8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1506 microversion: 2.1 time: 0.144925 Jul 28 12:28:35.578618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3304/6606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:35 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:35.599100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:35.601591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:35.609706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.610577 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.611700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.612582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.675653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d4df768c-1f9b-4147-a51c-2e2e889fe9d9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "PUT /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1078 microversion: 2.1 time: 0.081023 Jul 28 12:28:35.676271 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3303/6607] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Jul 28 12:28:35 2022] PUT /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1078 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:35.693074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:35.693691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:35.702506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.703293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.704546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.705283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.802679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:35.823421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:35.837892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:35.845289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6d546a4b-9ee8-4efc-abd3-05689149ba21 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1504 microversion: 2.1 time: 0.156022 Jul 28 12:28:35.845867 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3305/6608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:35 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:35.865471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:35.866125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:35.872204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.872665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.873427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:35.873874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:35.963545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:36.018307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:36.025665 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9253c245-66c1-4d5f-a059-cdd9c5a3b86b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1504 microversion: 2.1 time: 0.164077 Jul 28 12:28:36.026223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3304/6609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:35 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:36.045695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:28:36.047971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:36.054668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:36.055151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:36.055928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:36.056373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:36.083206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:36.088843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Old instance type m1.heat2, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:28:36.094961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:28:36.095420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:28:36.095896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:28:36.096325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:28:36.096727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:28:36.158536 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3ef46806-5ac6-4667-bb37-fd507c9acc82 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2/action" status: 202 len: 0 microversion: 2.1 time: 0.116807 Jul 28 12:28:36.159180 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3306/6610] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:28:36 2022] POST /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:28:36.167976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:36.168632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:36.177214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:36.177680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:36.178470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:36.178920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:36.681338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:36.689105 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c29c58d8-bf39-42a4-8607-dc3c917a75fb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1515 microversion: 2.1 time: 0.525038 Jul 28 12:28:36.689683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3305/6611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:36 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:37.711153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:37.711797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:37.718993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:37.719474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:37.720267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:37.720708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:37.859176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:37.861386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:37.868145 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4ba0fbff-3b0e-4523-a7c3-ae59203aba02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1515 microversion: 2.1 time: 0.161833 Jul 28 12:28:37.868731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3307/6612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:37 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:38.889025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:38.889574 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:38.892294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=36 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:38.897650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:38.898111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:38.898887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:38.899361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:39.034181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:39.042428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76aa4e98-02ca-4c4e-9c52-e8d389b30f5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.157386 Jul 28 12:28:39.043039 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3306/6613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:38 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:40.064218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:40.064859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:40.067498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:40.074541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:40.074989 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:40.075774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:40.076215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:40.205917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:40.214040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c9b2aac-6107-4a31-9bf7-35bd26d1ae46 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.153940 Jul 28 12:28:40.214567 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3308/6614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:40 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:41.236860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:41.237512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:41.245408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:41.245875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:41.246670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:41.247147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:41.460189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:41.467919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fa2b1d2c-9b6f-4f2f-8f4c-c51fb854721c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.235105 Jul 28 12:28:41.468511 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3307/6615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:41 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:28:42.489511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:42.490056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:42.496975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:42.497431 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:42.498203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:42.498650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:42.627214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:42.634694 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db1111c5-c45a-46d8-9a40-a8ed0e232ce9 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.149789 Jul 28 12:28:42.635303 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3309/6616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:42 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:43.657336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:43.657946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:43.665140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:43.665607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:43.666398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:43.666855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:43.799838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:43.807856 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c69da4a-f564-442f-8d75-081ac903e204 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.155893 Jul 28 12:28:43.808417 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3308/6617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:43 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:44.829581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:44.830207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:44.837170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:44.837628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:44.838398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:44.838846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:44.967955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:44.976088 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42309af9-52c7-40d3-ae4c-b3a875a74830 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150474 Jul 28 12:28:44.976662 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3310/6618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:44 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:45.997856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:45.998493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:46.006197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:46.006668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:46.007499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:46.007958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:46.140956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:46.148617 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fcfec258-237a-4433-bced-675a96ebadf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.154674 Jul 28 12:28:46.149193 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3309/6619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:45 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:47.169680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:47.170299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:47.177469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:47.177914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:47.178681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:47.179157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:47.315295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:47.324933 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27e4a5a8-00de-4267-9e81-64fbf695fc93 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.159215 Jul 28 12:28:47.325508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3311/6620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:47 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:48.346459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:48.347045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:48.354889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:48.355385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:48.356190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:48.356638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:48.485082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:48.492601 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c73424ec-962a-4ce9-80bd-7b0b5a59dc74 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150094 Jul 28 12:28:48.493168 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3310/6621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:48 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:49.512731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:49.513383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:49.520914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:49.521367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:49.522135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:49.522575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:49.651992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:49.659496 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8bff255-3079-4d34-9c7b-3e6012e2d157 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150616 Jul 28 12:28:49.660064 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3312/6622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:49 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:50.680169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:50.680774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:50.687562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:50.688025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:50.688801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:50.689247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:50.817166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:50.824723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d923edcc-d8e6-4556-bc18-80d01c585fd3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.148504 Jul 28 12:28:50.825289 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3311/6623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:50 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:51.845891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:51.846464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:51.854283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:51.854740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:51.855547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:51.855991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:51.992582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:52.000056 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dfff7391-2721-4ea9-9987-31c03afe5956 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.158175 Jul 28 12:28:52.000642 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3313/6624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:51 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:53.020631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:53.021262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:53.028359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:53.028873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:53.029686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:53.030142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:53.157369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:53.165584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-adec010a-413f-4722-a52d-0c9fe375fa69 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.148866 Jul 28 12:28:53.166184 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3312/6625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:53 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:54.187042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:54.187689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:54.195179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:54.195637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:54.196409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:54.196850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:54.326215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:54.333813 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7655ba7b-4fd1-4e8b-b8b6-c889f82bc2c3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150660 Jul 28 12:28:54.334389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3314/6626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:54 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:55.356407 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:55.356959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:55.363795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:55.364258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:55.365025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:55.365467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:55.502655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:55.510782 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f29313fc-1886-41d0-9047-97467511b1f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.158550 Jul 28 12:28:55.511399 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3313/6627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:55 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:56.532144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:56.533022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:56.540830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:56.541367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:56.542147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:56.542592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:56.669152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:56.676712 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5166c6a-4f33-450a-ad78-90d94e49cb05 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.148672 Jul 28 12:28:56.677289 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3315/6628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:56 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:57.697578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:57.698201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:57.705133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:57.705591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:57.706412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:57.706860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:57.725007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:28:57.839514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:57.847562 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-44147f59-b3e8-445a-a989-735a094ff95f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.153369 Jul 28 12:28:57.848139 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3314/6629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:57 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:28:58.869076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:28:58.869697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:28:58.876785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:58.877242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:58.878013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:28:58.879098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:28:59.008922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:28:59.016545 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbd2c624-3e7f-442c-a2d8-37f9f6bf7c5c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.151430 Jul 28 12:28:59.017119 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3316/6630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:28:58 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:00.037303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:00.037934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:00.044340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:00.044811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:00.045594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:00.046058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:00.176247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:00.183657 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b6f120ed-004b-4f3c-9a12-da051894aae8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150303 Jul 28 12:29:00.184223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3315/6631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:00 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:01.204846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:01.205468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:01.212367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:01.212822 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:01.213589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:01.214027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:01.341939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:01.349963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aa154355-520f-474f-8be0-4580b26f3a2c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.148971 Jul 28 12:29:01.350532 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3317/6632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:01 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:02.371477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:02.372032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:02.379442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:02.379909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:02.380686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:02.381139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:02.509967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:02.517418 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e6ccb1d-a79e-4b43-b1c1-f45d1b3ac297 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.150015 Jul 28 12:29:02.517985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3316/6633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:02 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:03.539220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:03.539865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:03.545936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:03.546398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:03.547202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:03.547646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:03.683659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:03.691937 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b10848db-c8e1-41fe-8f56-fdfe77da621a tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.157550 Jul 28 12:29:03.692515 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3318/6634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:03 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:04.712670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:04.713321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:04.720191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:04.720654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:04.721431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:04.722376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:04.850367 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:04.858124 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b4ee6418-abd6-4397-b87c-8624f046063d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.149325 Jul 28 12:29:04.858611 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3317/6635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:04 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:05.879269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:05.879872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:05.887876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:05.888328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:05.889103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:05.889544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:06.025369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:06.032892 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9940c929-cdfa-4a95-b1ae-c7f4d64ec3ae tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.158194 Jul 28 12:29:06.033475 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3319/6636] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:05 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:07.054232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:07.054969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:07.063181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:07.063643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:07.064427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:07.065036 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:07.199608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:07.207271 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f1ccbd34-83a4-4577-97e3-61c22e2d37c8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.157367 Jul 28 12:29:07.207845 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3318/6637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:07 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:08.228272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:08.228824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:08.235662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:08.236112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:08.236905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:08.237385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:08.363274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:08.370692 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec21c587-ff5d-4216-8281-ae74171d7b5b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.146652 Jul 28 12:29:08.371297 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3320/6638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:08 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:09.392250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:09.392808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:09.396144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=26 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:09.401567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:09.402034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:09.402821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:09.403306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:09.538155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:09.545660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-821b6d5e-abcd-43ad-acc0-534a8bfbe5e1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.157594 Jul 28 12:29:09.546222 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3319/6639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:09 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:10.566271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:10.566890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:10.569807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=26 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:10.576355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:10.576355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:10.576718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:10.578319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:10.581619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=80 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:10.754792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:10.762383 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afcb66b2-9c0a-4707-a39b-8e67e221ff01 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1520 microversion: 2.1 time: 0.200546 Jul 28 12:29:10.763186 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3321/6640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:10 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:11.356234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "name": "network-vif-unplugged", "status": "completed", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:11.366778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:11.367267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:11.379483 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] Creating event network-vif-unplugged:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h1-851368-1 Jul 28 12:29:11.384772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:29:11.396026 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a7842d3a-dad9-4c8c-ac9f-b258eaefa9d5 req-fbc418ee-ca1e-4e41-b888-8b58a9365b63 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043187 Jul 28 12:29:11.396816 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3320/6641] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:11.783930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:11.784601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:11.791652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:11.792115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:11.793027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:11.793562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:12.033145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:12.041120 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db36e521-576e-464d-9a2e-3b13180a40ff tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1519 microversion: 2.1 time: 0.261379 Jul 28 12:29:12.041686 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3322/6642] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:11 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:13.064465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:13.065188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:13.072187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:13.072660 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:13.073446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:13.074188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:13.202459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:13.210784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47fef4ff-3b5e-4577-baed-620745a3d49d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1517 microversion: 2.1 time: 0.151515 Jul 28 12:29:13.211382 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3321/6643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:13 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:13.413161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:13.423445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:13.423897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:13.435851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] Creating event network-changed:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h1-851368-1 Jul 28 12:29:13.441092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:29:13.451550 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-aa7b19f3-7b42-414b-b369-baec6860ae49 req-2964488c-30f3-44da-84db-a5a6fed2aee5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042763 Jul 28 12:29:13.452139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3323/6644] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:29:14.232904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:14.233459 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:14.240555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:14.241029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:14.241818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:14.242276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:14.378985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:14.386472 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f362c89f-9f71-4099-b013-607dfb5b1e95 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1517 microversion: 2.1 time: 0.157749 Jul 28 12:29:14.387047 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3322/6645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:14 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:15.411014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:15.412020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:15.418696 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.419175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.419964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.420406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.557330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:15.565284 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-49b9626c-ac66-4b4a-9434-ec0935189b3b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1514 microversion: 2.1 time: 0.160895 Jul 28 12:29:15.565876 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3324/6646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:15 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:15.586079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:15.586643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:15.593519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.593983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.595007 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.595490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.654647 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e5e67420-cf78-4855-b5d6-f1aa0f7fa082 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2/action" status: 204 len: 0 microversion: 2.1 time: 0.072458 Jul 28 12:29:15.655514 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3323/6647] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:29:15 2022] POST /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:29:15.665351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:15.665975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:15.672160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.672941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.673860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:15.674352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:15.899441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:15.906942 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc176d54-0a76-419e-84c4-04cd39ff98bd tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1514 microversion: 2.1 time: 0.246901 Jul 28 12:29:15.907550 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3325/6648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:15 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:16.929340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:16.930060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:16.938255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:16.938724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:16.939535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:16.939987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:17.077625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:17.085135 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5f4cb410-3e75-4aa7-b9d3-28c523d65c4b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1506 microversion: 2.1 time: 0.161767 Jul 28 12:29:17.085701 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3324/6649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:16 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:17.105992 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:17.106602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:17.114138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:17.114523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:17.115311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:17.115744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:17.252355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:17.259923 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3900a21f-8bf3-48b4-b181-0fb8ab320485 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1506 microversion: 2.1 time: 0.158015 Jul 28 12:29:17.260512 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3326/6650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:17 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:17.282708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13144c66-70c0-457c-b826-3ed7054f0125 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'create', calling method: .version_select at 0x7f2ebbe36790>, body: {"keypair": {"name": "tempest-keypair-1018218280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJ3ZYzfrOvh5Hu3lToCKEzpwgzOqlHZwFOUfg2wVc7NuMdI/AZKKMsvrEphbamIXHSGWGEohQlEivjFSy6TGvQ3NvQ2JwVE3VvBA1lvAs2rHNzWokdG3lUPoggo+J53Q=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:17.298255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-13144c66-70c0-457c-b826-3ed7054f0125 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for project 0c819309bc994d598eca876e238f2766. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:29:17.304295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-13144c66-70c0-457c-b826-3ed7054f0125 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for user d903c7202d334f8b87b016527a83c5f3 and project 0c819309bc994d598eca876e238f2766. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:29:17.331504 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13144c66-70c0-457c-b826-3ed7054f0125 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052455 Jul 28 12:29:17.332094 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3325/6651] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:29:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:17.508430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a88a18fb-d22f-42a5-bcbc-32bdc7b64eed req-be6fbe12-6d98-42b3-9d0d-1cdc639535c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "name": "network-vif-plugged", "status": "completed", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:17.519008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a88a18fb-d22f-42a5-bcbc-32bdc7b64eed req-be6fbe12-6d98-42b3-9d0d-1cdc639535c2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:17.519850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a88a18fb-d22f-42a5-bcbc-32bdc7b64eed req-be6fbe12-6d98-42b3-9d0d-1cdc639535c2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:17.531606 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a88a18fb-d22f-42a5-bcbc-32bdc7b64eed req-be6fbe12-6d98-42b3-9d0d-1cdc639535c2 service nova] Creating event network-vif-plugged:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h1-851368-1 Jul 28 12:29:17.537495 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a88a18fb-d22f-42a5-bcbc-32bdc7b64eed req-be6fbe12-6d98-42b3-9d0d-1cdc639535c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035432 Jul 28 12:29:17.538694 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3327/6652] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:18.867025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:18.867780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:18.874630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:18.875123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:18.875912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:18.876371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:19.007165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:19.014651 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cf06e227-209b-4016-b5db-6636cb5a597d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 200 len: 1506 microversion: 2.1 time: 0.153094 Jul 28 12:29:19.015240 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3326/6653] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:18 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:19.036201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:19.036785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:19.042864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:19.043349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:19.044113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:19.044547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:19.069272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:29:19.140576 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8ce3cd19-4047-4175-af53-cecf2d76ea87 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 204 len: 0 microversion: 2.1 time: 0.109484 Jul 28 12:29:19.141103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3328/6654] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:29:19 2022] DELETE /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:29:19.196120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-914962030", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "d172f363-467c-4f0c-88b9-d61b079ca37c"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:19.250626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] validate_networks() for [('d172f363-467c-4f0c-88b9-d61b079ca37c', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:29:19.620637 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:29:19.621096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:29:19.621610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:29:19.622030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:29:19.622453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:29:19.631213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:19.631673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:19.632472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:19.632919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:19.649611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for project 0c819309bc994d598eca876e238f2766. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:29:19.654726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Getting quotas for user d903c7202d334f8b87b016527a83c5f3 and project 0c819309bc994d598eca876e238f2766. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:29:19.667478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:29:19.669716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:29:19.714914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-195d76f7-97b9-45b7-8586-a7793511efeb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522623 Jul 28 12:29:19.715540 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3327/6655] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:29:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:29:19.727362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1008ceea-cb3c-48c5-a896-2c79351d905e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:19.728313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1008ceea-cb3c-48c5-a896-2c79351d905e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:19.785491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1008ceea-cb3c-48c5-a896-2c79351d905e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:19.792170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1008ceea-cb3c-48c5-a896-2c79351d905e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1217 microversion: 2.1 time: 0.069583 Jul 28 12:29:19.792733 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3329/6656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:19 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:20.813163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:20.813828 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:20.820334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:20.820801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:20.821590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:20.822045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:20.889933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:20.898279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c96aab5-39c6-4b1c-a298-8dd623b1e9c6 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1269 microversion: 2.1 time: 0.089814 Jul 28 12:29:20.898849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3328/6657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:20 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:21.399959 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bf05c2bd-d0bc-4549-952a-05f58301f3fa req-1d1ae1b6-1ea9-4ddd-b183-826d80b40e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c581-b14f-41cf-9307-cb828bc8e0e2", "name": "network-vif-deleted", "tag": "a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:21.416991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bf05c2bd-d0bc-4549-952a-05f58301f3fa req-1d1ae1b6-1ea9-4ddd-b183-826d80b40e69 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:21.417469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bf05c2bd-d0bc-4549-952a-05f58301f3fa req-1d1ae1b6-1ea9-4ddd-b183-826d80b40e69 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:21.429807 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bf05c2bd-d0bc-4549-952a-05f58301f3fa req-1d1ae1b6-1ea9-4ddd-b183-826d80b40e69 service nova] Creating event network-vif-deleted:a98cd4ce-ba19-4f6a-812d-e1fb13e7f4f1 for instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 on n-h1-851368-1 Jul 28 12:29:21.435276 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bf05c2bd-d0bc-4549-952a-05f58301f3fa req-1d1ae1b6-1ea9-4ddd-b183-826d80b40e69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039400 Jul 28 12:29:21.436100 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3330/6658] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:21.919463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:21.920087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:21.928229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:21.928787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:21.929646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:21.930170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:22.070755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:22.078525 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8161d0ab-a19c-43dd-9ed1-fa65071ccaf7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.163285 Jul 28 12:29:22.079119 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3329/6659] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:21 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:22.451469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f130a9c1-929f-41dc-a0b1-e5e52727ffb6 req-9585289f-36a4-4653-8991-e3966ef10b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:22.465916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f130a9c1-929f-41dc-a0b1-e5e52727ffb6 req-9585289f-36a4-4653-8991-e3966ef10b77 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:22.485772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f130a9c1-929f-41dc-a0b1-e5e52727ffb6 req-9585289f-36a4-4653-8991-e3966ef10b77 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:22.498265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f130a9c1-929f-41dc-a0b1-e5e52727ffb6 req-9585289f-36a4-4653-8991-e3966ef10b77 service nova] Creating event network-changed:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h1-851368-1 Jul 28 12:29:22.503305 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f130a9c1-929f-41dc-a0b1-e5e52727ffb6 req-9585289f-36a4-4653-8991-e3966ef10b77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061626 Jul 28 12:29:22.503913 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3331/6660] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:23.098689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:23.099382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:23.106463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:23.106929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:23.107742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:23.108197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:23.243673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:23.251260 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-597c5855-5910-4305-9ecf-bb9220f128c5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.156372 Jul 28 12:29:23.251831 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3330/6661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:23 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:24.274223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:24.274942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:24.281321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:24.281778 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:24.282551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:24.282996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:24.459850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:24.467443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7dede4a-4709-43ab-860c-737fb894590e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.198901 Jul 28 12:29:24.468009 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3332/6662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:24 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:25.488743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:25.489516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:25.497821 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:25.498321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:25.499271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:25.499736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:25.633521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:25.640957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64e28e9d-985c-4db9-b829-62705bae73d8 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.156263 Jul 28 12:29:25.641526 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3331/6663] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:25 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:29:26.661348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:26.661952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:26.668922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:26.669369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:26.670124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:26.670556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:26.796545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:26.803907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b7952de-d434-4501-9684-9f743c9d45ac tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.146462 Jul 28 12:29:26.804483 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3333/6664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:26 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:27.823706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:27.824337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:27.831955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:27.832423 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:27.833253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:27.833711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:27.836546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:28.018004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:28.026260 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-814d2bdb-c43e-4ade-bfc8-ed39f21bf420 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.206377 Jul 28 12:29:28.026834 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3332/6665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:27 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:29.045718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:29.046334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:29.053848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:29.054299 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:29.055060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:29.055530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:29.188438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:29.196156 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95afeedb-2ebd-44c2-950b-2aefe1f2dc79 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.154011 Jul 28 12:29:29.196724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3334/6666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:29 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:29.530473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ad26d451-fd29-4edb-862b-e33d02d28675 req-5ae4de62-0d20-4fae-b1b0-5ec46f44a304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "name": "network-vif-plugged", "status": "completed", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:29.540871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ad26d451-fd29-4edb-862b-e33d02d28675 req-5ae4de62-0d20-4fae-b1b0-5ec46f44a304 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:29.541337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ad26d451-fd29-4edb-862b-e33d02d28675 req-5ae4de62-0d20-4fae-b1b0-5ec46f44a304 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:29.552520 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ad26d451-fd29-4edb-862b-e33d02d28675 req-5ae4de62-0d20-4fae-b1b0-5ec46f44a304 service nova] Creating event network-vif-plugged:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h1-851368-1 Jul 28 12:29:29.557660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ad26d451-fd29-4edb-862b-e33d02d28675 req-5ae4de62-0d20-4fae-b1b0-5ec46f44a304 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030918 Jul 28 12:29:29.558269 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3333/6667] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:29:30.217184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:30.217798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:30.219829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:30.226996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:30.227480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:30.228500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:30.228942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:30.374838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:30.382366 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15171d50-b679-43da-9577-45c2760ee08c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1317 microversion: 2.1 time: 0.169039 Jul 28 12:29:30.382937 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3335/6668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:30 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:31.400584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:31.401368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:31.406542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:31.407294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:31.415646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.416106 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.416876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.417324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.550992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:31.558521 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eeb77b07-4450-41a4-bed5-b3b1f8f51872 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1507 microversion: 2.1 time: 0.159000 Jul 28 12:29:31.559116 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3334/6669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:31 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:31.578131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:31.578747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:31.586093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.586547 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.587348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.587793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.718833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:31.727148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40681296-7498-4e69-a984-8eb738654299 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1507 microversion: 2.1 time: 0.152801 Jul 28 12:29:31.727988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3336/6670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:31 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:31.746927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:29:31.749280 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:31.755908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.756370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.757140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.757588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.785548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:31.791347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Old instance type m1.heat2, new instance type m1.heat {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:29:31.797480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:29:31.797912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:29:31.798403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:29:31.798824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:29:31.799287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:29:31.860470 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e647a2f-c657-420b-a44e-625e4632f684 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551/action" status: 202 len: 0 microversion: 2.1 time: 0.117417 Jul 28 12:29:31.861424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3335/6671] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:29:31 2022] POST /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:29:31.869362 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:31.870073 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:31.876531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.876983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:31.877755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:31.878307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:32.042166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:32.049722 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d81087c2-d2da-4b08-bfee-4c82c1a57add tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1514 microversion: 2.1 time: 0.184396 Jul 28 12:29:32.050299 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3337/6672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:31 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:33.072004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:33.072633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:33.078693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:33.079192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:33.079979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:33.080429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:33.217733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:33.226999 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab98ba77-791b-4eef-bbff-0c9e30545c20 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1514 microversion: 2.1 time: 0.159946 Jul 28 12:29:33.227985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3336/6673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:33 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:34.248735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:34.249344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:34.256672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:34.257130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:34.257901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:34.258341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:34.388071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:34.395488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca979ddb-0ddc-4f14-bb49-d37251b5dc33 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.150587 Jul 28 12:29:34.396088 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3338/6674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:34 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:35.417244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:35.417876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:35.425047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:35.425527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:35.426310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:35.426765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:35.553887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:35.561420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b02e3214-d747-41a1-a4b3-90f05388a6ca tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148086 Jul 28 12:29:35.561996 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3337/6675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:35 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:36.581858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:36.583125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:36.589987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:36.590435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:36.591226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:36.591685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:36.606399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:36.730020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:36.737584 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c03cd79e-3f5d-454e-8d17-a2b470287bbb tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.159648 Jul 28 12:29:36.738684 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3339/6676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:36 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:37.757975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:37.758600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:37.765474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:37.765947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:37.766721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:37.767198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:37.894751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:37.902309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-406df3e9-f5b8-4f8a-ae0d-8b0e6dbb9d8b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148255 Jul 28 12:29:37.902885 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3338/6677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:37 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:38.923576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:38.924200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:38.931626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:38.932079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:38.932847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:38.933286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:39.069403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:39.076873 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-12855bed-e55b-40bf-a6ca-793cf1f7f8c0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.157192 Jul 28 12:29:39.077441 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3340/6678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:38 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:40.097793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:40.098421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:40.101443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:40.108039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:40.108506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:40.109296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:40.109752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:40.242706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:40.250465 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-407c6015-766c-406f-b4f8-566a9d25b18f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.156585 Jul 28 12:29:40.251050 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3339/6679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:40 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:41.272624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:41.273161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:41.275918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:41.281221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:41.281672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:41.282441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:41.282881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:41.419049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:41.426612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0a773afe-4582-4736-805a-23ae29c022d3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.158482 Jul 28 12:29:41.427213 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3341/6680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:41 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:42.446918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:42.447578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:42.454518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:42.454977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:42.455783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:42.456230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:42.588067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:42.595680 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-608c3510-5d0e-4a91-a546-c53a7e4c955e tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.152677 Jul 28 12:29:42.596247 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3340/6681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:42 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:43.618075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:43.618686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:43.625609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:43.626074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:43.626816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:43.627285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:43.756079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:43.763710 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-72ab412d-251c-4ff5-8585-6d68e3c72aa2 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.149654 Jul 28 12:29:43.764342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3342/6682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:43 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:44.784528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:44.785164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:44.792140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:44.792616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:44.793397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:44.793855 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:44.924984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:44.932953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b83b243c-4f84-4bd6-be08-5eb87eab48f1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.152363 Jul 28 12:29:44.933537 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3341/6683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:44 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:45.953859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:45.954645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:45.961942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:45.962485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:45.963414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:45.963937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:46.096816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:46.105501 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-616d79ce-2268-4929-9cb4-99ffbe875980 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.155450 Jul 28 12:29:46.106311 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3343/6684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:45 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:47.132035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:47.132636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:47.139757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:47.140214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:47.140986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:47.141434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:47.276493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:47.283990 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-693282b1-05ac-464f-b48a-677a8f93c397 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.156597 Jul 28 12:29:47.284559 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3342/6685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:47 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:48.304356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:48.304921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:48.311699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:48.312152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:48.312923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:48.313360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:48.440413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:48.448448 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad0660cf-104a-4f15-8bfc-2936fba35e6c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148224 Jul 28 12:29:48.449023 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3344/6686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:48 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:49.469837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:49.470509 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:49.477382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:49.478109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:49.478889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:49.479373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:49.606046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:49.614095 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e733fbc8-7f3d-46a5-add8-b69e491a3c18 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148134 Jul 28 12:29:49.614667 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3343/6687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:49 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:50.635343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:50.635993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:50.642825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:50.643317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:50.644771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:50.645223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:50.776225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:50.783773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f7521297-60e5-4e6c-b1b8-e34dd10a1bf1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.152400 Jul 28 12:29:50.784344 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3345/6688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:50 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:51.805145 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:51.805774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:51.812628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:51.813100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:51.813895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:51.814352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:51.945252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:51.952915 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24ac6c21-630d-46a4-afc6-35576e9f7599 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.151644 Jul 28 12:29:51.953496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3344/6689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:51 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:52.972889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:52.973507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:52.980774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:52.981227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:52.982009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:52.982450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:53.120450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:53.128777 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a209e7f2-6a1b-4911-92bd-1ebdf35a6c02 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.159144 Jul 28 12:29:53.129744 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3346/6690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:52 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:54.150616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:54.151312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:54.158606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:54.159108 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:54.160866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:54.161676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:54.308956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:54.316447 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e19f876d-86d8-418c-9b19-96ce6146e842 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.170644 Jul 28 12:29:54.317026 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3345/6691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:54 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:55.337175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:55.337739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:55.344693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:55.345150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:55.345930 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:55.346377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:55.474389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:55.482032 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-19895ae7-24b8-4cc6-bb3a-2a67b2533e1b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148898 Jul 28 12:29:55.482605 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3347/6692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:55 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:56.503877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:56.504502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:56.511406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:56.511879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:56.513104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:56.513569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:56.646040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:56.653619 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d559152c-f1d5-4d94-8235-a4c025e4c511 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.154576 Jul 28 12:29:56.654192 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3346/6693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:56 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:57.673779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:57.674388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:57.682129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:57.682591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:57.683390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:57.683836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:57.811119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:57.818587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d3ba256-ab9c-4818-821d-91940d663850 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.148719 Jul 28 12:29:57.819193 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3348/6694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:57 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:29:58.838902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:29:58.839551 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:29:58.845935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:58.846392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:58.847845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:29:58.848291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:29:58.852171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:29:58.982379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:29:58.989965 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79e0eaeb-d31e-455e-a666-12dca46e9069 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.154976 Jul 28 12:29:58.990535 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3347/6695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:29:58 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:00.010573 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:00.011239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:00.018185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:00.018645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:00.019451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:00.019896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:00.169330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:00.177367 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ea9bfab6-f2a2-498f-9e79-b3d60469d95b tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1519 microversion: 2.1 time: 0.170800 Jul 28 12:30:00.177933 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3349/6696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:00 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:01.198409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:01.199041 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:01.206030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:01.206498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:01.207314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:01.207765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:01.473122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:01.480904 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4b6c1858-fc2a-4c89-9c78-fa6b406a633c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1518 microversion: 2.1 time: 0.286453 Jul 28 12:30:01.481486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3348/6697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:01 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:01.628524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "name": "network-vif-unplugged", "status": "completed", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:01.638580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:01.639027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:01.655297 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] Creating event network-vif-unplugged:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h2-851368-1 Jul 28 12:30:01.664595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] Instance 6a4d7603-6faa-45a2-9733-37244a63f551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:30:01.685335 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5c65f42f-c2df-4fab-a25f-7ca46d1bd380 req-45ef6a75-94d7-4e6a-ac30-c8aca40a3b2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118839 Jul 28 12:30:01.686274 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3350/6698] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:02.503479 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:02.504164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:02.511149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:02.511612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:02.512385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:02.512831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:02.644480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:02.651944 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b82e4842-a6c9-459e-802d-844bca0727ef tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1516 microversion: 2.1 time: 0.152828 Jul 28 12:30:02.652517 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3349/6699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:02 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:03.674084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:03.675318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:03.681596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:03.682074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:03.682831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:03.683294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:03.713920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:03.724946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:03.725409 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:03.738354 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] Creating event network-changed:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h2-851368-1 Jul 28 12:30:03.743696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] Instance 6a4d7603-6faa-45a2-9733-37244a63f551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:30:03.754629 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3d793ac5-78a6-4597-a54e-693f8f3fb429 req-4a01c3e9-6c95-4d6e-9250-d2ed902762f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044294 Jul 28 12:30:03.755421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3350/6700] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:30:03.817060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:03.824828 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a764b0a0-eff5-4042-9b85-a1fd5dfbfe24 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1516 microversion: 2.1 time: 0.155865 Jul 28 12:30:03.825408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3351/6701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:03 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:04.847673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:04.848388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:04.855017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:04.855511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:04.856290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:04.856743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:04.990154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:04.997621 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f7aa2c69-8dc3-4697-96c8-42e74cb29e73 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1513 microversion: 2.1 time: 0.155256 Jul 28 12:30:04.998197 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3351/6702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:04 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:05.018028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:05.018582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:05.025869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:05.026349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:05.027243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:05.027713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:05.085920 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28b88ad5-a545-4c79-b8e7-bd280c6a4435 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "POST /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551/action" status: 204 len: 0 microversion: 2.1 time: 0.071601 Jul 28 12:30:05.086565 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3352/6703] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:30:05 2022] POST /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:30:05.095776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:05.096416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:05.103090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:05.103571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:05.104684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:05.105141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:05.245400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:05.253252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-94447c3a-1346-4859-b7e9-928d0b9df5a5 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1513 microversion: 2.1 time: 0.162356 Jul 28 12:30:05.253903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3352/6704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:05 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:06.275391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:06.276099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:06.283103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.283569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.284832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.285270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.431567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:06.439135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c1aed20-02a5-4191-af75-e75ed3b8333c tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1505 microversion: 2.1 time: 0.169017 Jul 28 12:30:06.439955 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3353/6705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:06 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:06.460283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:06.460900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:06.467749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.468212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.469308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.469504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.600076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:06.607922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cd84737f-061d-41f2-ae53-f9e2edec98c7 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1505 microversion: 2.1 time: 0.151944 Jul 28 12:30:06.608498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3353/6706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:06 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:06.627425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:06.628033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:06.633994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.634452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.635257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.635700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.639765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:06.765837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:06.774166 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-394be3ac-c280-405b-9d8a-9a5d7922d868 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1505 microversion: 2.1 time: 0.150666 Jul 28 12:30:06.774747 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3354/6707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:06 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:06.793797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:06.794342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:06.800310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.800715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.801485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.801956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.826134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:30:06.902604 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13874173-52e4-47cb-bbe0-16b7beb54789 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 204 len: 0 microversion: 2.1 time: 0.111558 Jul 28 12:30:06.903695 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3354/6708] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:30:06 2022] DELETE /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:30:06.923523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:06.924028 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:06.930735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.931228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.931995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:06.932433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:06.957443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:30:07.004610 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.compute.api [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Instance is already in deleting state, ignoring this request Jul 28 12:30:07.005442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e907684b-6e8c-47f2-8d05-e11fc5ae2b4d tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 204 len: 0 microversion: 2.1 time: 0.086710 Jul 28 12:30:07.006016 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3355/6709] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:30:06 2022] DELETE /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 12:30:07.014513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:07.015262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:07.021249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:07.021826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:07.022616 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:07.023099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:07.157249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:07.165390 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e64f2f5-6db0-4dd2-9914-aa466f074f1f tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1511 microversion: 2.1 time: 0.155080 Jul 28 12:30:07.165962 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3355/6710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:07 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:07.922482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-445834fd-7024-46fa-b890-e0116c376e93 req-5f8d8608-0634-4b67-a481-b587ccbbe081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "name": "network-vif-plugged", "status": "completed", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:07.933383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-445834fd-7024-46fa-b890-e0116c376e93 req-5f8d8608-0634-4b67-a481-b587ccbbe081 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:07.933830 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-445834fd-7024-46fa-b890-e0116c376e93 req-5f8d8608-0634-4b67-a481-b587ccbbe081 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:07.944559 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-445834fd-7024-46fa-b890-e0116c376e93 req-5f8d8608-0634-4b67-a481-b587ccbbe081 service nova] Creating event network-vif-plugged:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h2-851368-1 Jul 28 12:30:07.952609 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-445834fd-7024-46fa-b890-e0116c376e93 req-5f8d8608-0634-4b67-a481-b587ccbbe081 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091728 Jul 28 12:30:07.953139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3356/6711] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:08.185825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:08.186436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:08.193947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:08.194412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:08.195213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:08.195668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:08.364531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd903c7202d334f8b87b016527a83c5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c819309bc994d598eca876e238f2766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:08.372173 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6cb326a3-fbf9-4669-8dee-73d300718438 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 200 len: 1511 microversion: 2.1 time: 0.190228 Jul 28 12:30:08.372750 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3356/6712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:08 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:08.775525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9e6a5025-a8f5-4f6d-87e1-c2124d309959 req-18bb32b8-fbfc-4399-90d4-4fc024fbef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4d7603-6faa-45a2-9733-37244a63f551", "name": "network-vif-deleted", "tag": "e3729fb9-ab3e-4360-8bf2-b9396dc7a124"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:08.785799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9e6a5025-a8f5-4f6d-87e1-c2124d309959 req-18bb32b8-fbfc-4399-90d4-4fc024fbef00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:08.786253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9e6a5025-a8f5-4f6d-87e1-c2124d309959 req-18bb32b8-fbfc-4399-90d4-4fc024fbef00 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:08.798275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9e6a5025-a8f5-4f6d-87e1-c2124d309959 req-18bb32b8-fbfc-4399-90d4-4fc024fbef00 service nova] Creating event network-vif-deleted:e3729fb9-ab3e-4360-8bf2-b9396dc7a124 for instance 6a4d7603-6faa-45a2-9733-37244a63f551 on n-h2-851368-1 Jul 28 12:30:08.804773 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9e6a5025-a8f5-4f6d-87e1-c2124d309959 req-18bb32b8-fbfc-4399-90d4-4fc024fbef00 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033218 Jul 28 12:30:08.805387 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3357/6713] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:09.393004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:09.394163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 6a4d7603-6faa-45a2-9733-37244a63f551] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:09.400984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:09.401449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:09.402221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:09.402673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:09.419503 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] HTTP exception thrown: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Request method failure captured: Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 HTTP/1.1 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oDp2YAoEHZ2hU4KvtE8lc7kiZllb29slsyzNJdQS-7CdN4e27kD3VVk6AEFB7s2MN08i84KY0ltnhh0E_nTYPZjA3IBbzrlpG5ELjig1ML7FYQXiESAFzUxhZsXM0YRfrJz48a9Kjq6Guk2RP29ndO48Wk409NRuLLx7oUCFATLn1E Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c819309bc994d598eca876e238f2766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c819309bc994d598eca876e238f2766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}] Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d903c7202d334f8b87b016527a83c5f3 Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6a4d7603-6faa-45a2-9733-37244a63f551'} Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:09.421174 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Returning 404 to user: Instance 6a4d7603-6faa-45a2-9733-37244a63f551 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4762e78d-4bb6-4687-93ea-4c0ad2d80877 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551" status: 404 len: 111 microversion: 2.1 time: 0.033591 Jul 28 12:30:09.424073 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3357/6714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:09 2022] GET /compute/v2.1/servers/6a4d7603-6faa-45a2-9733-37244a63f551 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:30:09.432874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-25854b1d-67b2-4504-87a8-7d62bdac93d1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '.version_select at 0x7f2ebbe90790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:09.452547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-25854b1d-67b2-4504-87a8-7d62bdac93d1 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018218280" status: 202 len: 0 microversion: 2.1 time: 0.024652 Jul 28 12:30:09.453115 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3358/6715] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 12:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018218280 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:30:10.057006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:10.057560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:10.063653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:10.064122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:10.064910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:10.065375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:10.078767 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] HTTP exception thrown: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Request method failure captured: Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 HTTP/1.1 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oDp2YAoEHZ2hU4KvtE8lc7kiZllb29slsyzNJdQS-7CdN4e27kD3VVk6AEFB7s2MN08i84KY0ltnhh0E_nTYPZjA3IBbzrlpG5ELjig1ML7FYQXiESAFzUxhZsXM0YRfrJz48a9Kjq6Guk2RP29ndO48Wk409NRuLLx7oUCFATLn1E Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c819309bc994d598eca876e238f2766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c819309bc994d598eca876e238f2766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}] Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: d903c7202d334f8b87b016527a83c5f3 Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '7d09c581-b14f-41cf-9307-cb828bc8e0e2'} Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:30:10.080342 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Returning 404 to user: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-234d3017-ed1a-41c4-86d9-236c3cae32f3 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 404 len: 111 microversion: 2.1 time: 0.029239 Jul 28 12:30:10.084341 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3358/6716] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:30:10 2022] DELETE /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:30:10.090705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:10.091506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] [instance: 7d09c581-b14f-41cf-9307-cb828bc8e0e2] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:10.098897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:10.099418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:10.100195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:10.100644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:10.114067 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] HTTP exception thrown: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Request method failure captured: Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 HTTP/1.1 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oDp2YAoEHZ2hU4KvtE8lc7kiZllb29slsyzNJdQS-7CdN4e27kD3VVk6AEFB7s2MN08i84KY0ltnhh0E_nTYPZjA3IBbzrlpG5ELjig1ML7FYQXiESAFzUxhZsXM0YRfrJz48a9Kjq6Guk2RP29ndO48Wk409NRuLLx7oUCFATLn1E Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c819309bc994d598eca876e238f2766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c819309bc994d598eca876e238f2766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c819309bc994d598eca876e238f2766"}]}] Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 0c819309bc994d598eca876e238f2766 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1974992021 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: d903c7202d334f8b87b016527a83c5f3 Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerDiskConfigTestJSON-1974992021-project Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '7d09c581-b14f-41cf-9307-cb828bc8e0e2'} Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:30:10.115721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] Returning 404 to user: Instance 7d09c581-b14f-41cf-9307-cb828bc8e0e2 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f513e92-5017-4ed2-84cf-81b442cc14f0 tempest-ServerDiskConfigTestJSON-1974992021 tempest-ServerDiskConfigTestJSON-1974992021-project] 10.222.0.93 "GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2" status: 404 len: 111 microversion: 2.1 time: 0.030320 Jul 28 12:30:10.119127 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3359/6717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:10 2022] GET /compute/v2.1/servers/7d09c581-b14f-41cf-9307-cb828bc8e0e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:30:18.715398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8be4b9eb-52cb-434c-a86a-24f98b10acbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: .version_select at 0x7f2eb30b3160>, body: {"keypair": {"name": "tempest-keypair-1688882548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZSxSmD/TBNm5VI8rox+1Q8btWExf83W9SXbVMQfA9Acxn6ayifKS73F45DgVR2CQOlk5J3DieJRo5pZVKDICDI7q/Xg0YVGfMPvJe7ZxLA+hB+9DntOodq/U0G7f5R4g=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:18.720878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:18.734467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8be4b9eb-52cb-434c-a86a-24f98b10acbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:30:18.741412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8be4b9eb-52cb-434c-a86a-24f98b10acbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:30:18.768207 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8be4b9eb-52cb-434c-a86a-24f98b10acbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173291 Jul 28 12:30:18.769005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3359/6718] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:30:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:19.993339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1066864747", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4"}], "security_groups": [{"name": "tempest-securitygroup--1782895217"}], "key_name": "tempest-keypair-1688882548", "user_data": "}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:20.003234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:20.106295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:20.117968 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] validate_networks() for [('1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:30:20.614879 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:30:20.615367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:30:20.615850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:30:20.616262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:30:20.616677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:30:20.626303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:20.626786 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:20.627668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:20.628112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:20.648713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:30:20.656810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:30:20.674037 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:30:20.677131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:30:20.753862 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ce0aa948-c4ad-49f9-a996-036191539065 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.764932 Jul 28 12:30:20.759218 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3360/6719] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:30:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:30:20.768787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4fdb80a5-c9f8-4cc0-b25d-01ddf3ba7e90 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:20.770020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4fdb80a5-c9f8-4cc0-b25d-01ddf3ba7e90 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:20.774653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:20.876627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4fdb80a5-c9f8-4cc0-b25d-01ddf3ba7e90 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:20.887379 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4fdb80a5-c9f8-4cc0-b25d-01ddf3ba7e90 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1239 microversion: 2.1 time: 0.122817 Jul 28 12:30:20.888543 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3360/6720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:20 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1239 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:21.915490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:21.920632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:21.927979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:21.928525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:21.929551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:21.930059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:22.035294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:22.046960 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5fc2d33-7ff4-447b-83aa-83f6de4be09b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1299 microversion: 2.1 time: 0.136416 Jul 28 12:30:22.055221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3361/6721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:21 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:23.069582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:23.070221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:23.079946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:23.080925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:23.081716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:23.082173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:23.285716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:23.293333 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75d53e82-39f3-4ee1-bb3a-e084d642819e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.228104 Jul 28 12:30:23.293905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3361/6722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:23 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:23.402375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-0535a30b-2bd9-4f55-84e3-8f901de3f9a6 req-3ade5a9c-40e1-4344-80f3-7a6b252b1041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:23.419278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0535a30b-2bd9-4f55-84e3-8f901de3f9a6 req-3ade5a9c-40e1-4344-80f3-7a6b252b1041 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:23.419735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-0535a30b-2bd9-4f55-84e3-8f901de3f9a6 req-3ade5a9c-40e1-4344-80f3-7a6b252b1041 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:23.431375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-0535a30b-2bd9-4f55-84e3-8f901de3f9a6 req-3ade5a9c-40e1-4344-80f3-7a6b252b1041 service nova] Creating event network-changed:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h2-851368-1 Jul 28 12:30:23.439672 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-0535a30b-2bd9-4f55-84e3-8f901de3f9a6 req-3ade5a9c-40e1-4344-80f3-7a6b252b1041 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041278 Jul 28 12:30:23.440791 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3362/6723] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:24.313953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:24.314620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:24.321747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:24.322217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:24.323003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:24.323494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:24.451908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:24.460339 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ed611692-5bb1-4393-b6ca-e0db29555353 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.150215 Jul 28 12:30:24.460932 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3362/6724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:24 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:25.485938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:25.487014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:25.495208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:25.495663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:25.496443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:25.496887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:25.624931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:25.633004 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d7dfb10-0948-4280-b498-481d434cf962 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.154838 Jul 28 12:30:25.633573 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3363/6725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:25 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:26.653810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:26.654468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:26.661764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:26.662237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:26.663030 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:26.663539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:26.794750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:26.802819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d74538b2-6b66-46e1-94ad-4054db150b4a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.152905 Jul 28 12:30:26.803423 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3363/6726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:26 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:27.824276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:27.824897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:27.833128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:27.833586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:27.834358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:27.834795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:27.941080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-37ca81a4-462e-4519-a8fc-ca72cd97d01a req-d76f714a-c024-4bd2-b8b4-b44f982708a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "name": "network-vif-plugged", "status": "completed", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:27.951745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-37ca81a4-462e-4519-a8fc-ca72cd97d01a req-d76f714a-c024-4bd2-b8b4-b44f982708a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:27.952285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-37ca81a4-462e-4519-a8fc-ca72cd97d01a req-d76f714a-c024-4bd2-b8b4-b44f982708a7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:27.966310 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-37ca81a4-462e-4519-a8fc-ca72cd97d01a req-d76f714a-c024-4bd2-b8b4-b44f982708a7 service nova] Creating event network-vif-plugged:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h2-851368-1 Jul 28 12:30:27.972608 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-37ca81a4-462e-4519-a8fc-ca72cd97d01a req-d76f714a-c024-4bd2-b8b4-b44f982708a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035680 Jul 28 12:30:27.973509 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3364/6727] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:27.974281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:27.982339 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fb21c497-5462-45de-9c32-4dbe20298d3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.162387 Jul 28 12:30:27.982990 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3364/6728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:27 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:29.002714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:29.003469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:29.010035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:29.010502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:29.011321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:29.011781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:29.139621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:29.147559 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad977d7d-ee2f-435a-aa40-e78fb23747b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1365 microversion: 2.1 time: 0.149177 Jul 28 12:30:29.148140 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3365/6729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:28 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:30.169689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:30.170302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:30.177818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:30.178268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:30.179063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:30.179521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:30.306404 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:30:30.313824 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ebea0157-96af-4c0e-a6b3-fa9745317b86 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1551 microversion: 2.1 time: 0.148061 Jul 28 12:30:30.314389 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3365/6730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:30:30 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:30:30.335498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:30:30.335995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:30:30.342755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:30.343259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:30.344045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:30.344495 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:30.424527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f7433ff-32e2-4b86-adaf-af8200f5ed87 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092349 Jul 28 12:30:30.425128 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3366/6731] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:30:30 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:30:31.371965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9d08e07d-e9f6-4128-b9af-7a10acfe77e8 req-d50813a8-da57-410c-b470-3925393cc425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:30:31.376913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:31.377809 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:30:31.385631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d08e07d-e9f6-4128-b9af-7a10acfe77e8 req-d50813a8-da57-410c-b470-3925393cc425 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:30:31.386074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9d08e07d-e9f6-4128-b9af-7a10acfe77e8 req-d50813a8-da57-410c-b470-3925393cc425 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:30:31.397137 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9d08e07d-e9f6-4128-b9af-7a10acfe77e8 req-d50813a8-da57-410c-b470-3925393cc425 service nova] Creating event network-changed:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h2-851368-1 Jul 28 12:30:31.402211 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9d08e07d-e9f6-4128-b9af-7a10acfe77e8 req-d50813a8-da57-410c-b470-3925393cc425 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Jul 28 12:30:31.402801 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3366/6732] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:07.452696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:07.454740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:07.455439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=30 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:07.459554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:07.460177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:07.467523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.467986 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.468759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.469210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.608322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:07.617744 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eeec1335-f237-46df-afdd-20f1b13f2dd1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.165521 Jul 28 12:31:07.618818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3367/6733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:07 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:07.641338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:07.642182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=30 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:07.646305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:07.647004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:07.654160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.654602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.655394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.655831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.785244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:07.792867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6902ad20-b693-4d57-b3b8-84f4071a76d3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.153658 Jul 28 12:31:07.793431 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3367/6734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:07 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:07.812731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:07.813364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:07.819865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.820328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.821107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.821553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.953818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:07.961372 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3aa348de-3ccc-4c07-b882-ac2795fbe9c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.152522 Jul 28 12:31:07.961949 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3368/6735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:07 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:07.982116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:07.984512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:07.991027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.991517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:07.992281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:07.992724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:08.022064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:08.027723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:31:08.034367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:31:08.034789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:31:08.035298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:31:08.035714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:31:08.036125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:31:08.097965 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f84a28f6-013a-4f6d-940a-058c2b15a70b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/action" status: 202 len: 0 microversion: 2.1 time: 0.120091 Jul 28 12:31:08.098603 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3368/6736] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:31:07 2022] POST /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:31:08.107049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:08.107911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:08.115243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:08.115746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:08.116800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:08.117268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:08.265130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:08.273172 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e8feece4-a763-4303-a470-177680c3e864 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1679 microversion: 2.1 time: 0.170339 Jul 28 12:31:08.273762 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3369/6737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:08 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:31:09.294877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:09.295522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:09.301789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:09.302245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:09.303051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:09.303549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:09.463768 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:09.471451 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0339614-58b0-430b-80fc-d0c148a0882b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1679 microversion: 2.1 time: 0.181269 Jul 28 12:31:09.472034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3369/6738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:09 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:10.492733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:10.493362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:10.500197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:10.500661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:10.501431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:10.502223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:10.636198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:10.644178 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d9a231be-c3e0-4599-938e-1af038e1feb7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.155315 Jul 28 12:31:10.644745 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3370/6739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:10 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:11.665764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:11.666415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:11.673464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:11.674526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:11.675325 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:11.675767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:11.807712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:11.815338 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6801c689-9f98-45f7-ba9a-6facd81697a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.153427 Jul 28 12:31:11.815911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3370/6740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:11 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:12.836219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:12.836852 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:12.844146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:12.844608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:12.845389 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:12.845840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:12.973316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:12.981156 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de2bddb1-c3f7-4c5c-833a-db966f0dacee tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.149057 Jul 28 12:31:12.981723 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3371/6741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:12 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:14.001945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:14.002603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:14.009526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:14.009977 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:14.010737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:14.011198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:14.141588 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:14.149519 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-884fb198-5851-4d31-8bc7-d0702fd61354 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.151628 Jul 28 12:31:14.150173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3371/6742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:13 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:15.171050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:15.171701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:15.179231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:15.179696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:15.180473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:15.180923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:15.308569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:15.317420 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef3c6f51-ea2b-4688-9166-c08c49780c75 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.149986 Jul 28 12:31:15.317998 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3372/6743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:15 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:16.339240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:16.339824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:16.347260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:16.347711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:16.348476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:16.348915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:16.478027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:16.485744 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-499955e1-a9a0-40d9-9182-88a84d7e9b31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.151302 Jul 28 12:31:16.486319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3372/6744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:16 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:17.507062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:17.507708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:17.514675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:17.515179 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:17.515958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:17.516413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:17.658532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:17.666062 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-02234e8f-e07b-40a9-8f0a-3c224ee429a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.162909 Jul 28 12:31:17.666631 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3373/6745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:17 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:18.687480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:18.688090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:18.694983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:18.695459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:18.696228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:18.696659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:18.828499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:18.836541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22d0bb37-fe5d-4c3d-80b3-af925e95c59d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.152958 Jul 28 12:31:18.837104 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3373/6746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:18 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:19.858099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:19.858722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:19.866330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:19.866792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:19.867594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:19.868048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:20.000216 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:20.007856 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-525d32a0-a5f9-4efb-ae21-373ab4c636df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.153631 Jul 28 12:31:20.008424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3374/6747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:19 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:21.029174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:21.029821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:21.037330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:21.037784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:21.038555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:21.038996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:21.170849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:21.179091 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45549dfb-b7b4-4df2-bc37-991b6a8d4a09 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1684 microversion: 2.1 time: 0.153738 Jul 28 12:31:21.179666 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3374/6748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:21 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:22.199521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:22.200372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:22.207299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:22.207764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:22.209169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:22.209623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:22.351970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:22.359889 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8aeff108-945f-47c2-97e9-afabf7192590 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1683 microversion: 2.1 time: 0.164202 Jul 28 12:31:22.360485 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3375/6749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:22 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:22.450215 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "name": "network-vif-unplugged", "status": "completed", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:22.462623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:22.463102 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:22.475643 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] Creating event network-vif-unplugged:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h1-851368-1 Jul 28 12:31:22.482561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:31:22.503295 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a98d3602-2684-4df3-a56c-fb428bb30616 req-8d05124a-e2e3-432c-9c9d-6160f8858ec4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056709 Jul 28 12:31:22.503911 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3375/6750] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:23.382395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:23.383022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:23.389968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:23.390439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:23.391268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:23.391741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:23.527228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:23.535188 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7fd14560-2bb2-4286-a7dc-80d12fd33e93 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1683 microversion: 2.1 time: 0.156789 Jul 28 12:31:23.535746 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3376/6751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:23 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:24.521186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:24.530530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:24.530908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:24.542847 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] Creating event network-changed:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h1-851368-1 Jul 28 12:31:24.547917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:31:24.555537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:24.556165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:24.558841 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-03b243d6-8ec7-4f1d-9534-f6b748ef2131 req-4f1d592b-986c-4cd7-b4ef-9d5f425db7c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042969 Jul 28 12:31:24.559530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3376/6752] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:24.563237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:24.563705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:24.564490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:24.564944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:24.780417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:24.788101 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-35e06ebb-2983-4cf3-af80-18d34f2e540e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1681 microversion: 2.1 time: 0.236330 Jul 28 12:31:24.788601 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3377/6753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:24 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:31:25.809703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:25.810395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:25.817413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:25.817858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:25.818610 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:25.819043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:25.946388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:25.954038 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e1364107-12bc-48ca-8e1d-fa3eceff3fcf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1681 microversion: 2.1 time: 0.148509 Jul 28 12:31:25.955110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3377/6754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:25 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:26.975786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:26.976418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:26.983671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:26.984140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:26.984923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:26.985383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:27.119853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:27.127352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0bb9f92b-6bb3-4bc1-965d-f6f1b06a3e98 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1678 microversion: 2.1 time: 0.155448 Jul 28 12:31:27.127929 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3378/6755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:26 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:27.147376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:27.148258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:27.155038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:27.155516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:27.156273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:27.156700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:27.215439 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-988b4bcb-a4c1-41a6-a315-0b8e2aba84b7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/action" status: 204 len: 0 microversion: 2.1 time: 0.071639 Jul 28 12:31:27.216027 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3378/6756] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:31:27 2022] POST /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:31:27.224450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:27.225071 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:27.231694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:27.232175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:27.232991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:27.233415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:27.448585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:27.457078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c0bab624-e81d-43cb-a236-ba8fa40d29f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1678 microversion: 2.1 time: 0.236849 Jul 28 12:31:27.457662 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3379/6757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:27 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:31:28.480848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:28.481552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:28.488347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:28.488802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:28.489582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:28.490027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:28.618831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:28.626288 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-569dbe78-3004-49d6-bb73-610b4f40e27a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1678 microversion: 2.1 time: 0.150813 Jul 28 12:31:28.626851 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3379/6758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:28 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:29.648011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:29.648642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:29.654976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.655477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:29.656256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.656712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:29.788769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:29.796248 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8becc5c6-8f8f-4e4a-b0c4-c8fa078dcb7c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.152269 Jul 28 12:31:29.796828 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3380/6759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:29 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:29.817524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:29.818168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:29.825111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.825563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:29.826324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.826761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:29.958297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:29.967391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40f5a637-d9d3-4676-a01e-970adb20f788 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.154254 Jul 28 12:31:29.967989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3380/6760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:29 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:29.988288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:29.988911 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:29.994839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.995351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:29.996105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:29.996550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.042612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ea3b9542-0124-4783-9881-296b79a1960b req-b0b7380c-7490-4df3-9b4a-6fc1d1a0d4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "name": "network-vif-plugged", "status": "completed", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:30.054263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ea3b9542-0124-4783-9881-296b79a1960b req-b0b7380c-7490-4df3-9b4a-6fc1d1a0d4c2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:30.054471 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ea3b9542-0124-4783-9881-296b79a1960b req-b0b7380c-7490-4df3-9b4a-6fc1d1a0d4c2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.067963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ea3b9542-0124-4783-9881-296b79a1960b req-b0b7380c-7490-4df3-9b4a-6fc1d1a0d4c2 service nova] Creating event network-vif-plugged:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h1-851368-1 Jul 28 12:31:30.073219 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ea3b9542-0124-4783-9881-296b79a1960b req-b0b7380c-7490-4df3-9b4a-6fc1d1a0d4c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034308 Jul 28 12:31:30.074088 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3381/6761] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:30.132874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:30.140731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-09cb0ec8-2a5f-4419-b7ad-2eaa2fbb612c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1670 microversion: 2.1 time: 0.156746 Jul 28 12:31:30.141316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3381/6762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:29 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:30.161604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:30.162131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:30.168422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:30.168880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.169656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:30.170119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.185271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:30.196506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:31:30.270512 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ad473160-7ec9-4f6b-9c0a-e3eed0620a19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 204 len: 0 microversion: 2.1 time: 0.113160 Jul 28 12:31:30.271704 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3382/6763] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:31:30 2022] DELETE /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:31:30.280259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:30.280888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:30.287562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:30.288029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.288810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:30.289267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:30.415691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:30.424010 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-18e8f361-8785-42f9-a877-60105851a5ff tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1676 microversion: 2.1 time: 0.147601 Jul 28 12:31:30.424592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3382/6764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:30 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:31.448982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:31.449689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:31.458027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:31.458489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:31.459303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:31.459745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:31.590100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:31.598272 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd9a3dbe-5071-48d1-ac6c-d4bacba13301 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1676 microversion: 2.1 time: 0.153611 Jul 28 12:31:31.598873 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3383/6765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:31 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:32.619963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:32.620601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:32.623248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-2a24055f-81e9-40c9-9726-370a452dcc4d req-e2c3d0a8-fc35-41d1-8e91-04dacdcb9378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bbc73c-9c63-4961-9c24-e4f52d8b18b9", "name": "network-vif-deleted", "tag": "f91d98b0-9dfd-4679-a10e-4ef0423006ac"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:32.628360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:32.630346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:32.630346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:32.630346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:32.640962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2a24055f-81e9-40c9-9726-370a452dcc4d req-e2c3d0a8-fc35-41d1-8e91-04dacdcb9378 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:32.641414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-2a24055f-81e9-40c9-9726-370a452dcc4d req-e2c3d0a8-fc35-41d1-8e91-04dacdcb9378 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:32.650002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=100 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:32.656135 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-2a24055f-81e9-40c9-9726-370a452dcc4d req-e2c3d0a8-fc35-41d1-8e91-04dacdcb9378 service nova] Creating event network-vif-deleted:f91d98b0-9dfd-4679-a10e-4ef0423006ac for instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 on n-h1-851368-1 Jul 28 12:31:32.662794 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-2a24055f-81e9-40c9-9726-370a452dcc4d req-e2c3d0a8-fc35-41d1-8e91-04dacdcb9378 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043999 Jul 28 12:31:32.663698 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3384/6766] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:32.700809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:32.709848 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1ba0d451-0e02-4c19-a113-bd2e20286447 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 200 len: 1608 microversion: 2.1 time: 0.093539 Jul 28 12:31:32.710697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3383/6767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:32 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 1608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:33.734265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:33.735083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:33.741618 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:33.742154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:33.743008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:33.743518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:33.758499 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 HTTP/1.1 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '88bbc73c-9c63-4961-9c24-e4f52d8b18b9'} Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:31:33.760131 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-870b048a-9647-4fdf-bc9c-327c5488abc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 404 len: 111 microversion: 2.1 time: 0.034641 Jul 28 12:31:33.763909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3385/6768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:33 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:31:33.774686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:33.775348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:33.782259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:33.782729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:33.783613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:33.784067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:33.797198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 HTTP/1.1 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '88bbc73c-9c63-4961-9c24-e4f52d8b18b9'} Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:31:33.798864 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1041741-410e-4403-b40a-971edc5d741f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 404 len: 111 microversion: 2.1 time: 0.029477 Jul 28 12:31:33.802693 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3384/6769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:33 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:31:33.849352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1077037790", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4"}], "security_groups": [{"name": "tempest-securitygroup--1782895217"}], "key_name": "tempest-keypair-1688882548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:33.953157 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] validate_networks() for [('1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:31:34.314823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:31:34.315317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:31:34.315797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:31:34.316213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:31:34.316658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:31:34.325447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:34.325890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:34.326718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:34.327203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:34.343606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:31:34.348843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:31:34.362312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:31:34.364629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:31:34.409904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1152b5c1-421f-4914-a685-fca3819bd77a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.564481 Jul 28 12:31:34.410563 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3386/6770] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:31:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:31:34.421902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2c308ee9-b26c-41f1-ad54-cc23d0a9fa64 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:34.422623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2c308ee9-b26c-41f1-ad54-cc23d0a9fa64 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:34.475860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2c308ee9-b26c-41f1-ad54-cc23d0a9fa64 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:34.482810 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2c308ee9-b26c-41f1-ad54-cc23d0a9fa64 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1239 microversion: 2.1 time: 0.065099 Jul 28 12:31:34.483459 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3385/6771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:34 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:31:35.506612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:35.507356 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:35.515655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:35.516195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:35.517599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:35.518119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:35.585927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:35.593435 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dc0a5792-11c1-4e74-aeac-609c72a1615c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1297 microversion: 2.1 time: 0.092742 Jul 28 12:31:35.603250 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3387/6772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:35 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:36.616938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:36.617584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:36.627744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:36.628719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:36.629521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:36.630147 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:36.827548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:36.835039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bbb8b356-fb83-4f94-812c-b9c0b030c55b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.223256 Jul 28 12:31:36.836208 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3386/6773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:36 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:36.886847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4c437919-f45c-4963-932c-e1a6596199fc req-05942607-da01-47c7-b78f-2b5125828bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:36.898512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4c437919-f45c-4963-932c-e1a6596199fc req-05942607-da01-47c7-b78f-2b5125828bce service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:36.899383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4c437919-f45c-4963-932c-e1a6596199fc req-05942607-da01-47c7-b78f-2b5125828bce service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:36.914137 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4c437919-f45c-4963-932c-e1a6596199fc req-05942607-da01-47c7-b78f-2b5125828bce service nova] Creating event network-changed:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h2-851368-1 Jul 28 12:31:36.918882 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4c437919-f45c-4963-932c-e1a6596199fc req-05942607-da01-47c7-b78f-2b5125828bce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036062 Jul 28 12:31:36.919572 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3388/6774] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:37.856972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:37.857608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:37.860350 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=43 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:37.865956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:37.866429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:37.867248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:37.867708 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:37.996621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:38.004868 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cb8ff752-6f0c-458e-a7d1-4b8512ffa3eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.152037 Jul 28 12:31:38.005437 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3387/6775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:37 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:39.029413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:39.030109 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:39.032090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:39.037676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:39.038130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:39.038902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:39.039368 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:39.168259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:39.175743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92899582-59ce-4329-a668-232c590cc8dc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.151435 Jul 28 12:31:39.176316 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3389/6776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:39 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:40.197339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:40.197966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:40.205491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:40.205960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:40.206748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:40.207244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:40.347292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:40.355039 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71cf3272-277d-4522-bfcc-fd443327ccc7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.161625 Jul 28 12:31:40.355630 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3388/6777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:40 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:41.376969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:41.377550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:41.384803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:41.385255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:41.386021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:41.386461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:41.515486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:41.524475 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84ee2b03-ea37-42f9-bda6-2f10722c9d4e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.151952 Jul 28 12:31:41.525054 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3390/6778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:41 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:42.308338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-3c06fc39-1ecb-4730-bc1e-8cb04b06f4a8 req-b2f2f62e-1b19-479f-9358-6f7d66836710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "name": "network-vif-plugged", "status": "completed", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:42.319357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3c06fc39-1ecb-4730-bc1e-8cb04b06f4a8 req-b2f2f62e-1b19-479f-9358-6f7d66836710 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:42.319816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-3c06fc39-1ecb-4730-bc1e-8cb04b06f4a8 req-b2f2f62e-1b19-479f-9358-6f7d66836710 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:42.331478 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-3c06fc39-1ecb-4730-bc1e-8cb04b06f4a8 req-b2f2f62e-1b19-479f-9358-6f7d66836710 service nova] Creating event network-vif-plugged:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h2-851368-1 Jul 28 12:31:42.336373 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-3c06fc39-1ecb-4730-bc1e-8cb04b06f4a8 req-b2f2f62e-1b19-479f-9358-6f7d66836710 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Jul 28 12:31:42.336970 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3389/6779] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:42.545895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:42.546507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:42.553811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:42.554259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:42.555021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:42.555486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:42.683797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:42.692035 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-520df7af-b14a-4045-8ab5-bbf8a489aa2e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1365 microversion: 2.1 time: 0.150172 Jul 28 12:31:42.692605 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3391/6780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:42 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:43.714468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:43.715217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:43.721405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:43.721866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:43.722640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:43.723112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:43.856953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:31:43.864579 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6b90e05-6995-45cd-861e-5e8f5ca52808 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1552 microversion: 2.1 time: 0.155205 Jul 28 12:31:43.865166 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3390/6781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:31:43 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:31:43.885940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:31:43.886470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:31:43.894042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:43.894492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:43.895305 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:43.895746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:43.972573 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7fe3fca8-ec21-427c-9a0f-76ffaca3cbd6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090626 Jul 28 12:31:43.973173 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3392/6782] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:31:43 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:31:45.654519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-326a77b2-c1c3-414f-9d2b-ca73008c59b2 req-16e75b96-e34c-4a09-80cb-58c8fc4c6bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:31:45.659645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:31:45.666543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-326a77b2-c1c3-414f-9d2b-ca73008c59b2 req-16e75b96-e34c-4a09-80cb-58c8fc4c6bf6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:31:45.667230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-326a77b2-c1c3-414f-9d2b-ca73008c59b2 req-16e75b96-e34c-4a09-80cb-58c8fc4c6bf6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:31:45.679456 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-326a77b2-c1c3-414f-9d2b-ca73008c59b2 req-16e75b96-e34c-4a09-80cb-58c8fc4c6bf6 service nova] Creating event network-changed:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h2-851368-1 Jul 28 12:31:45.685307 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-326a77b2-c1c3-414f-9d2b-ca73008c59b2 req-16e75b96-e34c-4a09-80cb-58c8fc4c6bf6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Jul 28 12:31:45.687232 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3391/6783] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:32:18.549612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.550415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.552497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=7 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.553248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.558130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b6ef7695-17bc-4863-bdef-e7280947fed1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:18.566283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6ef7695-17bc-4863-bdef-e7280947fed1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:18.566732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b6ef7695-17bc-4863-bdef-e7280947fed1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:18.592189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b6ef7695-17bc-4863-bdef-e7280947fed1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Going to try to stop instance {{(pid=119236) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 12:32:18.634116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b6ef7695-17bc-4863-bdef-e7280947fed1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.084936 Jul 28 12:32:18.634770 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3393/6784] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:32:18 2022] POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:32:18.643846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=9 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.644661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=32 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:18.649638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:18.650501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:18.660679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:18.661144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:18.661941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:18.662395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:18.792088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:18.800066 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-676ceb24-0b2b-433d-939b-f27e974d90a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.159427 Jul 28 12:32:18.800587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3392/6785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:18 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:19.822314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:19.823013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:19.829296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:19.829747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:19.830508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:19.830945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:19.964913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:19.973647 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e8acca9-3c2a-4cf5-b91d-03bb6ee03af0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.156298 Jul 28 12:32:19.974212 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3394/6786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:19 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:20.994734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:20.995405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:21.002337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:21.002811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:21.003631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:21.004090 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:21.131201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:21.138662 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6bd1a4a3-8552-4d61-9d90-a07caa1c23c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.147818 Jul 28 12:32:21.139270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3393/6787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:20 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:22.160033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:22.160679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:22.167530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:22.167980 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:22.168747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:22.169185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:22.307855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:22.315388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5dd63126-3455-4fd8-9c6f-fae39ccd61ac tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.159898 Jul 28 12:32:22.315979 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3395/6788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:22 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:23.337781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:23.338331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:23.345279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:23.345743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:23.346525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:23.346976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:23.476264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:23.483949 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14197387-b138-46b1-bdcb-598afffc3816 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.150131 Jul 28 12:32:23.484520 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3394/6789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:23 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:24.504920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:24.505529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:24.512340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:24.512789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:24.513543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:24.513976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:24.649525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:24.656962 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1594d195-51df-4f4d-ad0f-6905f5fc702f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.156127 Jul 28 12:32:24.657596 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3396/6790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:24 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:25.677735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:25.678373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:25.685295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:25.685750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:25.686546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:25.686997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:25.814662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:25.822228 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc30a7b9-b6ad-4ceb-ac5f-e8eb37c62787 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.148322 Jul 28 12:32:25.822797 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3395/6791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:25 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:26.843783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:26.844416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:26.852059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:26.852500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:26.853270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:26.853720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:26.981484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:26.989639 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-266060e2-d7ea-416b-9104-5aea17c7b4eb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.149787 Jul 28 12:32:26.990207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3397/6792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:26 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:28.010499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:28.011146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:28.018077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:28.018540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:28.019380 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:28.019835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:28.155850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:28.163922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b260f23f-3c4e-4c27-b4b2-3eec0cc7d806 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.157276 Jul 28 12:32:28.164502 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3396/6793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:28 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:29.185164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:29.185783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:29.192853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.193308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.194078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.194530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.322498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:29.330898 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8027c7dc-cd8a-489d-9fa2-9f73b91eb3c6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1658 microversion: 2.1 time: 0.149292 Jul 28 12:32:29.331958 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3398/6794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:29 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:29.358764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:29.361421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:29.368824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.369287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.370070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.370521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.398084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:29.403717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Old instance type m1.heat2, new instance type m1.heat {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:32:29.410437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:32:29.410873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:32:29.411390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:32:29.411813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:32:29.412238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:32:29.474440 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7c0b45ff-cb44-40b9-acd5-32ec82848346 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.119634 Jul 28 12:32:29.475033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3397/6795] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:32:29 2022] POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:32:29.483506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:29.484162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:29.490084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.490541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.491348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:29.491794 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:29.652084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:29.660060 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-36cbbb66-286d-45b5-b11c-9f0df286d3cc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.180773 Jul 28 12:32:29.660641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3399/6796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:29 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:32:30.681033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:30.681669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:30.688683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:30.689150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:30.690100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:30.690556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:30.824112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:30.833533 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad36ab1f-6e01-48b2-9579-ac03b7f6a3bb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1681 microversion: 2.1 time: 0.156207 Jul 28 12:32:30.834249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3398/6797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:30 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:31.857153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:31.857797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:31.866422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:31.867144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:31.867924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:31.868369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:31.998442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:32.005842 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80485d5d-bc15-4ca9-8ceb-34490c6fc689 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1686 microversion: 2.1 time: 0.153243 Jul 28 12:32:32.006415 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3400/6798] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:31 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:33.026879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:33.027536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:33.034760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:33.035270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:33.036073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:33.036531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:33.167328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:33.175740 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d32664f-dcd8-4cb4-b434-6474896f790f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1686 microversion: 2.1 time: 0.152790 Jul 28 12:32:33.176305 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3399/6799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:33 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:34.196697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:34.198105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:34.206016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:34.206556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:34.207442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:34.208016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:34.218603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:34.231695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:34.232163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:34.248387 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] Creating event network-vif-unplugged:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h1-851368-1 Jul 28 12:32:34.255185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:32:34.269356 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-f54e1707-5dc6-426e-8f8a-ec59c6b943fc req-3adcedf8-2020-4243-acf8-75051463fc65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140810 Jul 28 12:32:34.270156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3401/6800] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:32:34.375747 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:34.384980 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b895f2b-9f0b-4400-b8b8-ed8629a5e1d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1685 microversion: 2.1 time: 0.192281 Jul 28 12:32:34.385721 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3400/6801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:34 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:35.407265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:35.407925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:35.414985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:35.415470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:35.416587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:35.417033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:35.558218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:35.566562 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f177d36b-8d3d-4b6f-b775-799e21c73147 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1683 microversion: 2.1 time: 0.163685 Jul 28 12:32:35.567209 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3402/6802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:35 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:36.288326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:36.298419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:36.298873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:36.310209 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] Creating event network-changed:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h1-851368-1 Jul 28 12:32:36.315379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:32:36.325849 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1845411d-f6eb-41e7-82b6-7fe9d8440972 req-b0555c2d-096b-4ba7-9a02-ed9287b3dd1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041153 Jul 28 12:32:36.326482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3401/6803] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:32:36.587695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:36.588315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:36.595183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:36.595644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:36.596422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:36.596866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:36.821259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:36.828661 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2dfb5a4d-c91e-4a5a-9266-57661db26f3d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1683 microversion: 2.1 time: 0.244887 Jul 28 12:32:36.829238 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3403/6804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:36 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:37.855599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:37.856331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:37.863055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:37.863547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:37.864338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:37.864796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:38.008446 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:38.018645 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c04166f9-77a5-460a-b5d4-5a2d453b90ab tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1679 microversion: 2.1 time: 0.168510 Jul 28 12:32:38.019285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3402/6805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:37 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:38.040321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:38.040871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:38.047717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:38.048769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:38.049555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:38.050031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:38.111436 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92db41bb-144d-4fc7-b38f-67770e6c9417 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action" status: 204 len: 0 microversion: 2.1 time: 0.074647 Jul 28 12:32:38.112081 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3404/6806] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:32:38 2022] POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:32:38.120288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:38.121028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:38.127203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:38.127748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:38.128745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:38.129359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:38.337697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:38.355589 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-542db796-8e98-469e-a810-1f24ae9a5f23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1679 microversion: 2.1 time: 0.238456 Jul 28 12:32:38.357393 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3403/6807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:38 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:39.379927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:39.380635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:39.386914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.387390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.388161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.388605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.522208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:39.531229 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-868b5146-e257-4620-ab34-e2d0625f7235 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1658 microversion: 2.1 time: 0.157318 Jul 28 12:32:39.531804 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3405/6808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:39 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:39.553597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:39.554364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:39.561961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.562658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.563520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.564230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.696286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:39.703976 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c59ca831-dd00-4bba-b016-27bcfa14f855 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1658 microversion: 2.1 time: 0.154496 Jul 28 12:32:39.704566 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3404/6809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:39 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:39.724375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc1ad944-354e-4257-8d34-025b1e89d010 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:39.730672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc1ad944-354e-4257-8d34-025b1e89d010 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.731173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc1ad944-354e-4257-8d34-025b1e89d010 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.753179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc1ad944-354e-4257-8d34-025b1e89d010 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Going to try to start instance {{(pid=119236) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 12:32:39.785986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:39.794855 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc1ad944-354e-4257-8d34-025b1e89d010 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.074807 Jul 28 12:32:39.795518 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3406/6810] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:32:39 2022] POST /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:32:39.803886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:39.804652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:39.811137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.811739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.812604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:39.813073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:39.944632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:39.952492 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cff5d5f4-aee5-4386-9c0b-56db878395fd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1667 microversion: 2.1 time: 0.152418 Jul 28 12:32:39.953080 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3405/6811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:39 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:40.320376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-4c85cbfd-f938-4191-8399-a0b3f5d3a8c0 req-8642c809-19f4-49e5-b54c-b618fa7ebec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "name": "network-vif-plugged", "status": "completed", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:40.333974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4c85cbfd-f938-4191-8399-a0b3f5d3a8c0 req-8642c809-19f4-49e5-b54c-b618fa7ebec3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:40.334735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-4c85cbfd-f938-4191-8399-a0b3f5d3a8c0 req-8642c809-19f4-49e5-b54c-b618fa7ebec3 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:40.346808 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-4c85cbfd-f938-4191-8399-a0b3f5d3a8c0 req-8642c809-19f4-49e5-b54c-b618fa7ebec3 service nova] Creating event network-vif-plugged:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h1-851368-1 Jul 28 12:32:40.352256 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-4c85cbfd-f938-4191-8399-a0b3f5d3a8c0 req-8642c809-19f4-49e5-b54c-b618fa7ebec3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037346 Jul 28 12:32:40.353562 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3407/6812] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:32:40.974393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:40.975020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:40.982200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:40.982668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:40.983475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:40.983930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:41.117142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:41.124648 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2461a27-78b5-45d6-8445-f56a2c6633bd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1667 microversion: 2.1 time: 0.154664 Jul 28 12:32:41.125217 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3406/6813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:40 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:42.145961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:42.146682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:42.154340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.154433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.155479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.155714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.291699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:42.299857 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f4a037fd-44da-46f3-9edb-fb2d6e965637 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1671 microversion: 2.1 time: 0.158159 Jul 28 12:32:42.300428 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3408/6814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:42 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:42.320601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:42.321217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:42.328067 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.328555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.329360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.329811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.347306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:42.355601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:32:42.435113 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b9527d4b-1008-4027-82ed-f6089668c6cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 204 len: 0 microversion: 2.1 time: 0.117980 Jul 28 12:32:42.435950 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3407/6815] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:32:42 2022] DELETE /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:32:42.444169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:42.444782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:42.450790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.451280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.452040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:42.452482 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:42.580275 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:42.587796 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec5fc981-f094-400e-9011-5b5ef3f7a998 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1677 microversion: 2.1 time: 0.147535 Jul 28 12:32:42.588364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3409/6816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:42 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:32:43.611148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:43.611995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:43.619047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:43.619544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:43.620339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:43.620797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:43.759725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:43.767287 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-badbc382-6df8-40b1-81bc-4f7b485d219a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1677 microversion: 2.1 time: 0.161390 Jul 28 12:32:43.767865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3408/6817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:43 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:44.789259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:44.790711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:44.798524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:44.799010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:44.799810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:44.800289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:44.869340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-24ec10d7-2adf-495f-b0ca-d83e4a1edfdd req-6d0a9297-0b66-4039-b3ce-0e0337ff8377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1bbcda-94c9-495e-8b1f-ed236084e9ce", "name": "network-vif-deleted", "tag": "4a25b38d-8a73-471e-afd2-1d41b1d6c42c"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:44.874091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:44.881642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-24ec10d7-2adf-495f-b0ca-d83e4a1edfdd req-6d0a9297-0b66-4039-b3ce-0e0337ff8377 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:44.882400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-24ec10d7-2adf-495f-b0ca-d83e4a1edfdd req-6d0a9297-0b66-4039-b3ce-0e0337ff8377 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:44.884239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0de38bf-f4e6-4b3a-ad4b-60ed8d192fcd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 200 len: 1609 microversion: 2.1 time: 0.099237 Jul 28 12:32:44.884822 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3410/6818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:44 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 1609 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:44.910855 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-24ec10d7-2adf-495f-b0ca-d83e4a1edfdd req-6d0a9297-0b66-4039-b3ce-0e0337ff8377 service nova] Creating event network-vif-deleted:4a25b38d-8a73-471e-afd2-1d41b1d6c42c for instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce on n-h1-851368-1 Jul 28 12:32:44.916708 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-24ec10d7-2adf-495f-b0ca-d83e4a1edfdd req-6d0a9297-0b66-4039-b3ce-0e0337ff8377 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051044 Jul 28 12:32:44.917764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3409/6819] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:32:45.906913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:45.907654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:45.914908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:45.915418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:45.916224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:45.916878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:45.932116 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce HTTP/1.1 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'fe1bbcda-94c9-495e-8b1f-ed236084e9ce'} Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:32:45.933812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e5e3e620-7f33-4d5b-ae96-f72387ec3545 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 404 len: 111 microversion: 2.1 time: 0.032413 Jul 28 12:32:45.937267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3411/6820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:45 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:32:45.960955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:45.962568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:45.969474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:45.970426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:45.971273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:45.972173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:45.988186 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce HTTP/1.1 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'fe1bbcda-94c9-495e-8b1f-ed236084e9ce'} Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:32:45.989894 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:32:45.994198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e611d932-fef7-41ef-a851-74713bb700fb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 404 len: 111 microversion: 2.1 time: 0.035655 Jul 28 12:32:45.995223 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3410/6821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:45 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:32:46.045259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-953557724", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4"}], "security_groups": [{"name": "tempest-securitygroup--1782895217"}], "key_name": "tempest-keypair-1688882548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:46.150617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] validate_networks() for [('1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:32:46.529932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:32:46.530360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:32:46.530857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:32:46.531313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:32:46.531729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:32:46.541375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:46.541826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:46.542626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:46.543061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:46.560944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:32:46.566567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:32:46.580283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:32:46.582592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:32:46.628630 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-214191cb-e6ad-4728-8d85-cb9dd768c1be tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.587801 Jul 28 12:32:46.629272 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3412/6822] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:32:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:32:46.640189 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec5d372a-54a9-4d69-b30f-3acadebb8ca6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:46.640822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec5d372a-54a9-4d69-b30f-3acadebb8ca6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:46.700993 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec5d372a-54a9-4d69-b30f-3acadebb8ca6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:46.708535 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec5d372a-54a9-4d69-b30f-3acadebb8ca6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1238 microversion: 2.1 time: 0.072266 Jul 28 12:32:46.709192 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3411/6823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:46 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:32:47.730355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:47.730971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:47.739010 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:47.739487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:47.740252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:47.740685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:47.821355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:47.828815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-745bc5e5-0ed7-4df9-a2d4-2e6447707f19 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1308 microversion: 2.1 time: 0.102860 Jul 28 12:32:47.830103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3413/6824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:47 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:48.851137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:48.851866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:48.855345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:48.864598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:48.864987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:48.865934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:48.866675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:49.060727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:49.069443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3c95ef29-1780-4c16-bd7d-5c535776c21f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.222489 Jul 28 12:32:49.070030 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3412/6825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:48 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:49.145531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1cb25182-1603-4624-8ba7-2d0561e08528 req-9335ecf0-58c4-44af-b011-c9510ba016d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:49.153542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:49.161704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1cb25182-1603-4624-8ba7-2d0561e08528 req-9335ecf0-58c4-44af-b011-c9510ba016d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:49.162203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1cb25182-1603-4624-8ba7-2d0561e08528 req-9335ecf0-58c4-44af-b011-c9510ba016d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:49.179296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1cb25182-1603-4624-8ba7-2d0561e08528 req-9335ecf0-58c4-44af-b011-c9510ba016d0 service nova] Creating event network-changed:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:32:49.184815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1cb25182-1603-4624-8ba7-2d0561e08528 req-9335ecf0-58c4-44af-b011-c9510ba016d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043400 Jul 28 12:32:49.185435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3414/6826] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:32:50.090761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:50.091427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:50.099088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:50.099569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:50.100385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:50.100871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:50.228182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:50.236606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d172b204-d2c6-4b02-aff2-73358023d419 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.149895 Jul 28 12:32:50.237178 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3413/6827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:50 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:51.258827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:51.259480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:51.266124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:51.266914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:51.267849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:51.268341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:51.454679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:51.462387 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f1498c3-8d99-4196-8c07-807d534aa222 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.208797 Jul 28 12:32:51.463056 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3415/6828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:51 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:52.484950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:52.485834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:52.492680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:52.493141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:52.493916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:52.494362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:52.629452 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:52.637065 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a0448ae-6fcd-4d55-be51-790492acfd6e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.156036 Jul 28 12:32:52.637639 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3414/6829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:52 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:53.658885 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:53.659583 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:53.666799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:53.667292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:53.668079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:53.668512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:53.795685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:53.803645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-04bdeae0-5565-4d31-963e-fc15c22d645a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.148725 Jul 28 12:32:53.804224 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3416/6830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:53 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:54.559704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-2febbba6-74ab-4a10-8631-463f5485e1c7 req-27990f41-39b1-4a45-814b-3b234ae47c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "name": "network-vif-plugged", "status": "completed", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:54.570981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2febbba6-74ab-4a10-8631-463f5485e1c7 req-27990f41-39b1-4a45-814b-3b234ae47c48 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:54.571510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-2febbba6-74ab-4a10-8631-463f5485e1c7 req-27990f41-39b1-4a45-814b-3b234ae47c48 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:54.583187 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-2febbba6-74ab-4a10-8631-463f5485e1c7 req-27990f41-39b1-4a45-814b-3b234ae47c48 service nova] Creating event network-vif-plugged:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:32:54.588078 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-2febbba6-74ab-4a10-8631-463f5485e1c7 req-27990f41-39b1-4a45-814b-3b234ae47c48 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032307 Jul 28 12:32:54.588682 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3415/6831] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:32:54.825326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:54.825905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:54.833301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:54.833755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:54.834528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:54.835212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:54.962931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:54.970608 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2e1c3196-05dc-42de-ab88-303968f00a99 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1364 microversion: 2.1 time: 0.149184 Jul 28 12:32:54.971211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3417/6832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:54 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:55.993210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:55.993951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:56.000126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:56.000583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:56.001354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:56.001794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:56.135748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:32:56.143928 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b957bd5f-bdbf-42c2-bade-f9d9a2540892 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1550 microversion: 2.1 time: 0.155740 Jul 28 12:32:56.144516 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3416/6833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:32:55 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:32:56.166639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:32:56.167175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:32:56.174110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:56.174552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:56.175445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:56.175881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:56.256890 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97203608-85de-4e4d-8eac-afd84ce39fc3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094211 Jul 28 12:32:56.257507 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3418/6834] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:32:56 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:32:57.198089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f1510330-9027-44a6-adbc-d3aeb49585f0 req-8dd8151c-91d0-40aa-93df-365a80a188dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:32:57.202976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:32:57.209645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f1510330-9027-44a6-adbc-d3aeb49585f0 req-8dd8151c-91d0-40aa-93df-365a80a188dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:32:57.210102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f1510330-9027-44a6-adbc-d3aeb49585f0 req-8dd8151c-91d0-40aa-93df-365a80a188dc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:32:57.221510 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f1510330-9027-44a6-adbc-d3aeb49585f0 req-8dd8151c-91d0-40aa-93df-365a80a188dc service nova] Creating event network-changed:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:32:57.226313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f1510330-9027-44a6-adbc-d3aeb49585f0 req-8dd8151c-91d0-40aa-93df-365a80a188dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031893 Jul 28 12:32:57.226910 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3417/6835] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:33:11.557325 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:33:11.558005 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:33:30.290077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.290776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.293049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=9 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.293815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=54 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.298969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:30.301281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:30.309790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:30.310242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:30.311015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:30.311484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:30.338733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:30.344854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Old instance type m1.heat2, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:33:30.350936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:33:30.351463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:33:30.351945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:33:30.352357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:33:30.352770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:33:30.413971 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1128138-2976-4a96-90b0-55847899b71e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/action" status: 202 len: 0 microversion: 2.1 time: 0.124722 Jul 28 12:33:30.414804 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3419/6836] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:33:30 2022] POST /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:33:30.421302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=11 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.423119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:30.427877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:30.428617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:30.442326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:30.442326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:30.442936 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:30.443521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:30.614038 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:30.622011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7ece90a2-39c8-4d99-9fbc-f7228798fb97 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1678 microversion: 2.1 time: 0.202590 Jul 28 12:33:30.622562 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3418/6837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:30 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:31.644163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:31.644780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:31.650827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:31.651312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:31.652076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:31.652511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:31.792042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:31.800343 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f3c100e7-cdf0-4d8b-afa4-1ec2792ebcbb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1678 microversion: 2.1 time: 0.161350 Jul 28 12:33:31.801062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3420/6838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:31 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:32.821854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:32.822488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:32.829458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:32.829929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:32.830712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:32.831197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:32.961941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:32.969590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ad38a88-1b38-43ff-861b-b52be774e336 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.151649 Jul 28 12:33:32.970158 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3419/6839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:32 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:33.991230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:33.991851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:33.998767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:33.999255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:34.000026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:34.000468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:34.125059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:34.132592 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-705d0060-51c9-4bb3-a533-c75f83a24100 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.145329 Jul 28 12:33:34.133165 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3421/6840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:33 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:35.154270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:35.154900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:35.162433 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:35.162894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:35.163697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:35.164148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:35.295995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:35.303395 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-52dfa5b3-f5e8-42cc-9cd6-18f7c8bbd247 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.152967 Jul 28 12:33:35.303965 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3420/6841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:35 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:36.324470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:36.325016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:36.331942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:36.332397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:36.333165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:36.333612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:36.466672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:36.475455 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5abff576-5988-426a-905a-65597d5699af tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.154943 Jul 28 12:33:36.476042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3422/6842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:36 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:37.497150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:37.497777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:37.504638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:37.505101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:37.505873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:37.506320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:37.636217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:37.644220 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3455a52d-a84b-41b0-a219-931f5e580ca5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.150982 Jul 28 12:33:37.644789 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3421/6843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:37 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:38.664993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:38.665601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:38.673123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:38.673574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:38.674378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:38.674817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:38.801430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:38.808932 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-361fa7c0-1b7f-489e-a907-b7c404719546 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.147825 Jul 28 12:33:38.809508 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3423/6844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:38 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:39.830340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:39.830968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:39.837873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:39.838338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:39.839131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:39.839587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:39.966623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:39.974678 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c3a5232b-3a22-4812-b859-f5f2e31b3b21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.148807 Jul 28 12:33:39.975270 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3422/6845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:39 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:40.996288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:40.996905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:41.003911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:41.004369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:41.005132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:41.005574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:41.135787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:41.143672 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4b5da603-aad2-47c5-8a76-52160f69e3f9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.151268 Jul 28 12:33:41.144249 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3424/6846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:40 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:42.165256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:42.165880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:42.172889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:42.173346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:42.174115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:42.174555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:42.308320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:42.316367 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be9a2113-fcd0-4689-aacf-b6919800e4d1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.154938 Jul 28 12:33:42.316943 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3423/6847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:42 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:43.337886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:43.338421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:43.345289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:43.345733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:43.346489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:43.346923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:43.477537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:43.485688 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b7037b9e-080a-4950-b5e5-d90473bce6a2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.151810 Jul 28 12:33:43.486258 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3425/6848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:43 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:44.506862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:44.507528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:44.514373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:44.514843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:44.516271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:44.516933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:44.652634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:44.660167 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5c780dab-3328-4cca-90dd-c5b99d242a82 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.157294 Jul 28 12:33:44.660731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3424/6849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:44 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:45.681172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:45.681792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:45.688776 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:45.689229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:45.689997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:45.690440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:45.818392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:45.825974 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b076c537-a9b3-41fd-9fb4-231e5a508cc0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.148725 Jul 28 12:33:45.826544 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3426/6850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:45 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:46.848143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:46.848697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:46.855826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:46.856292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:46.857068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:46.857555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:46.991846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:46.999343 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf7dc9d4-3a69-412b-9cef-ee9404f4d20c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.155210 Jul 28 12:33:46.999911 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3425/6851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:46 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:48.020252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:48.020929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:48.027801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:48.028258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:48.029022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:48.029461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:48.155239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:48.163815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d48c4a84-26aa-4213-b8c8-adc95638ecbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.147448 Jul 28 12:33:48.164388 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3427/6852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:48 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:33:49.185472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:49.186107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:49.193042 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:49.193513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:49.194297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:49.194757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:49.374039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:49.381702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14c5b982-93f3-4fe8-8a27-c2fcc6dbf9cd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1683 microversion: 2.1 time: 0.200190 Jul 28 12:33:49.382278 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3426/6853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:49 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:49.927438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "name": "network-vif-unplugged", "status": "completed", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:49.941263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:49.941935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:49.963349 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] Creating event network-vif-unplugged:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h1-851368-1 Jul 28 12:33:49.970710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:33:49.984353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8baf83cb-ee02-4895-a556-40ba5d25b317 req-4c1a9c4f-4ff2-4b00-bbbc-90d5f8f8b2cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060408 Jul 28 12:33:49.985152 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3428/6854] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:33:50.405956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:50.405956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:50.415614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:50.416401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:50.417471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:50.418022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:50.564956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:50.573638 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c57f9a49-b9eb-440e-b9f7-07a7bfa49de1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1682 microversion: 2.1 time: 0.173238 Jul 28 12:33:50.574262 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3427/6855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:50 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:51.595695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:51.596391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:51.603694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:51.604148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:51.605184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:51.605621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:52.002203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:52.013298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:52.016981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:52.017450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:52.024419 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-81aa9e74-d6dc-4707-8aaf-bbf4626199db tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1680 microversion: 2.1 time: 0.432764 Jul 28 12:33:52.025019 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3429/6856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:51 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1680 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:52.029917 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] Creating event network-changed:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h1-851368-1 Jul 28 12:33:52.035931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:33:52.047544 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-39c5dd2a-d69f-4350-907f-b2911d868030 req-86ab0134-7b5d-4ea1-8e36-8591d767ce17 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049092 Jul 28 12:33:52.048155 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3428/6857] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:33:53.047279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:53.047901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:53.054731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:53.055224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:53.055994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:53.056433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:53.185250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:53.194005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b1a794ca-dd90-4e2c-96ae-a3252398ceb3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1680 microversion: 2.1 time: 0.151145 Jul 28 12:33:53.194610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3430/6858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:53 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:54.217302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:54.218019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:54.224763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.225157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.225956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.226403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.368152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:54.376913 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2b30fa3f-6418-45ac-ac47-7c15614e0f12 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1677 microversion: 2.1 time: 0.164819 Jul 28 12:33:54.377759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3429/6859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:54 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:54.400630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:54.402212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:54.412742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.413194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.414253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.414851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.456330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.456837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.457714 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.458187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.480198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'ram', 'cores'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:33:54.485953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'ram', 'cores'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:33:54.570851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:33:54.599899 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a40e1c38-5fc8-47df-a59a-8903cae5cf31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/action" status: 202 len: 0 microversion: 2.1 time: 0.203722 Jul 28 12:33:54.600530 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3431/6860] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:33:54 2022] POST /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:33:54.609933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:54.610567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:54.617376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.618219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.619243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:54.619707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:54.760294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:54.767918 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2f6cf1c8-ba77-470b-bdab-f7a375923e31 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.162503 Jul 28 12:33:54.768496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3430/6861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:54 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:33:55.789738 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:55.790433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:55.798361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:55.798806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:55.799600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:55.800034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:55.930926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:55.938398 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1da796bb-b619-4c01-ba8c-a808b28d0f9b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.153847 Jul 28 12:33:55.938957 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3432/6862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:55 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:56.556462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "name": "network-vif-plugged", "status": "completed", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:56.566840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:56.567333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:56.582061 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] Creating event network-vif-plugged:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h1-851368-1 Jul 28 12:33:56.587422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:33:56.598609 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-d571a73d-3ce2-49f7-b8ec-bc45c9799ee2 req-3c1a69f2-fbf9-4e28-bb67-3ba5c7cf354a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045859 Jul 28 12:33:56.599247 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3431/6863] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:33:56.959328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:56.959957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:56.966535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:56.966995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:56.968468 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:56.968933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:57.097262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:57.105108 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c892960b-88f2-4591-9f12-bfcdc82a029e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.149540 Jul 28 12:33:57.105681 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3433/6864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:56 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:58.128271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:58.129287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:58.136905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:58.137386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:58.138291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:58.138639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:58.325285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "name": "network-vif-unplugged", "status": "completed", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:33:58.336002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:58.336453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:58.350475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:58.351513 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] Creating event network-vif-unplugged:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:33:58.357495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:33:58.359615 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-21938078-2012-40d8-afc0-efc712e8bae5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.237024 Jul 28 12:33:58.367776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3432/6865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:58 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:33:58.379945 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ab28952c-4aa9-4151-82c7-c0686d78a2b2 req-cd3fca7e-a4d2-45e7-92ba-5fba62ed2253 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058502 Jul 28 12:33:58.380897 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3434/6866] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:33:59.380943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:33:59.381599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:33:59.387694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:59.388163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:59.388956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:33:59.389410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:33:59.619091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:33:59.626632 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-89c142ec-6d64-4e6a-8975-e1c9a2f516df tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.249887 Jul 28 12:33:59.627227 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3433/6867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:33:59 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:00.399430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:00.404161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:00.410556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:00.411007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:00.423697 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] Creating event network-changed:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:34:00.428909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:34:00.439841 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ca19883c-2290-47c4-82b0-a06eb3b7e368 req-f87212b6-9dd0-4ec7-a720-fba484359800 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045381 Jul 28 12:34:00.440426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3435/6868] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:34:00.647797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:00.648352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:00.651250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=33 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:00.657322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:00.657793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:00.658585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:00.659040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:00.663275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=93 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:00.793529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:00.803396 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0747f484-6fbd-4055-81da-75ad8931281c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1676 microversion: 2.1 time: 0.159451 Jul 28 12:34:00.803981 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3434/6869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:00 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:01.826229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:01.826852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:01.833766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:01.834231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:01.835032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:01.835502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:01.970126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:01.977774 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6bdbc6f-fb4f-448c-81be-3ff081db7756 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1669 microversion: 2.1 time: 0.156989 Jul 28 12:34:01.978353 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3436/6870] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:01 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:01.998102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:01.998723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:02.005610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.006070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.006835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.007312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.133905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:02.141797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61492e34-6c87-4c3e-8fb8-18780efcc950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1669 microversion: 2.1 time: 0.147522 Jul 28 12:34:02.142407 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3435/6871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:01 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:02.161787 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:02.162432 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:02.168499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.168952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.169715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.170155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.298330 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:02.305858 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e691a7cf-7212-48d1-a135-21015266139b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1669 microversion: 2.1 time: 0.147903 Jul 28 12:34:02.306418 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3437/6872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:02 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:02.325578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:02.326100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:02.332732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.333244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.333981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.334439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.359229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:34:02.434469 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1440aa9f-9261-475c-a556-63374c860650 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 204 len: 0 microversion: 2.1 time: 0.111652 Jul 28 12:34:02.435703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3436/6873] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:34:02 2022] DELETE /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:34:02.444961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:02.445760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:02.453184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.453753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.454641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:02.455286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:02.589823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:02.597443 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4d33c46b-3518-4bb1-ba3c-d4d73a7f8ec9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1675 microversion: 2.1 time: 0.156487 Jul 28 12:34:02.598026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3438/6874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:02 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:03.619443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:03.620077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:03.627761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:03.628239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:03.629043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:03.629756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:03.760533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:03.768150 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e90c1fc1-de39-4cc8-ae2f-63d0a8ec5c30 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1675 microversion: 2.1 time: 0.153047 Jul 28 12:34:03.769089 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3437/6875] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:03 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:04.647125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-06dc12a6-b54c-45b9-ad95-ba96b185949c req-0558e866-c767-4488-80cc-7ff319a135b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a961be-3d6d-4e3b-9989-6b8b51345388", "name": "network-vif-deleted", "tag": "859dea10-461f-46fe-8522-c11b211c75fb"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:04.658336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:04.664385 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-06dc12a6-b54c-45b9-ad95-ba96b185949c req-0558e866-c767-4488-80cc-7ff319a135b2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:04.664916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-06dc12a6-b54c-45b9-ad95-ba96b185949c req-0558e866-c767-4488-80cc-7ff319a135b2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:04.677235 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-06dc12a6-b54c-45b9-ad95-ba96b185949c req-0558e866-c767-4488-80cc-7ff319a135b2 service nova] Creating event network-vif-deleted:859dea10-461f-46fe-8522-c11b211c75fb for instance 74a961be-3d6d-4e3b-9989-6b8b51345388 on n-h2-851368-1 Jul 28 12:34:04.682711 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-06dc12a6-b54c-45b9-ad95-ba96b185949c req-0558e866-c767-4488-80cc-7ff319a135b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039398 Jul 28 12:34:04.683689 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3439/6876] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:34:04.789276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:04.790541 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:04.798841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:04.799513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:04.800318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:04.800959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:04.839123 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:04.839595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:04.840154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lazy-loading 'fault' on Instance uuid 74a961be-3d6d-4e3b-9989-6b8b51345388 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:34:04.885017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:04.894372 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-606aac72-3a24-4cba-bc01-a273b8c97aeb tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 200 len: 1328 microversion: 2.1 time: 0.108837 Jul 28 12:34:04.895322 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3438/6877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:04 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:34:05.918640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:05.919407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:05.926170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:05.926626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:05.927430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:05.927877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:05.941802 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 HTTP/1.1 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74a961be-3d6d-4e3b-9989-6b8b51345388'} Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:34:05.943491 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c6ed1c4a-3e66-44d9-ad9d-b9693bbc200a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jul 28 12:34:05.947678 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3440/6878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:05 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 12:34:05.961812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:05.962440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:05.969388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:05.969884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:05.970627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:05.971105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:05.984966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 HTTP/1.1 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74a961be-3d6d-4e3b-9989-6b8b51345388'} Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:34:05.986612 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-207b644a-3fe0-449e-84d6-d48d72c96cbc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 404 len: 111 microversion: 2.1 time: 0.030171 Jul 28 12:34:05.990346 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3439/6879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:05 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:34:06.105045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-372681033", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4"}], "security_groups": [{"name": "tempest-securitygroup--1782895217"}], "key_name": "tempest-keypair-1688882548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:06.211391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] validate_networks() for [('1b5afd23-f6c3-4222-98fc-0ccbcde6a1a4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:34:06.576323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:34:06.576751 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:34:06.577228 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:34:06.577672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:34:06.578116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:34:06.586962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:06.587446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:06.588251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:06.588693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:06.605293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:34:06.611101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:34:06.623229 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:34:06.626055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:34:06.673019 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80a9777f-fc31-474b-a2e6-9c609729814b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.572145 Jul 28 12:34:06.673670 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3441/6880] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:34:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:34:06.684622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eb190afc-4685-4709-9f31-53e3e5b8b430 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:06.685255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eb190afc-4685-4709-9f31-53e3e5b8b430 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:06.739428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eb190afc-4685-4709-9f31-53e3e5b8b430 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:06.746091 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eb190afc-4685-4709-9f31-53e3e5b8b430 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1238 microversion: 2.1 time: 0.065436 Jul 28 12:34:06.746597 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3440/6881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:06 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:07.768456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:07.769176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:07.776825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:07.777745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:07.778068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:07.778517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:07.842112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:07.849592 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e75d22a6-b3f7-40b8-ac6c-e471a14ae55e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1308 microversion: 2.1 time: 0.085882 Jul 28 12:34:07.850166 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3442/6882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:07 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:08.871323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:08.871935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:08.880205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:08.880687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:08.881857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:08.882322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:09.027544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:09.036575 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8796d03-7b47-4cb2-947d-4f7fa77c1f38 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.169074 Jul 28 12:34:09.037377 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3441/6883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:08 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:09.102965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5f7e6559-85ab-4b0a-b195-9937eaf59dff req-29d72d06-84ec-4156-9b65-b51b2d1dfa81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:09.120443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5f7e6559-85ab-4b0a-b195-9937eaf59dff req-29d72d06-84ec-4156-9b65-b51b2d1dfa81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:09.120895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5f7e6559-85ab-4b0a-b195-9937eaf59dff req-29d72d06-84ec-4156-9b65-b51b2d1dfa81 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:09.135870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5f7e6559-85ab-4b0a-b195-9937eaf59dff req-29d72d06-84ec-4156-9b65-b51b2d1dfa81 service nova] Creating event network-changed:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:34:09.141167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5f7e6559-85ab-4b0a-b195-9937eaf59dff req-29d72d06-84ec-4156-9b65-b51b2d1dfa81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047155 Jul 28 12:34:09.141784 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3443/6884] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:34:10.057248 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:10.057914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:10.064785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:10.065260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:10.066051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:10.066686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:10.196268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:10.204332 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a91bc408-cbc0-4066-bb02-fb60f1f8701e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.150984 Jul 28 12:34:10.204905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3442/6885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:10 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:11.227495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:11.228125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:11.235191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:11.235649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:11.236415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:11.236858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:11.364395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:11.371835 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06f252c5-b6f8-4659-84d8-c67585de90c2 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.149554 Jul 28 12:34:11.372582 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3444/6886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:11 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:12.392799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:12.393438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:12.400511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:12.400920 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:12.401703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:12.402169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:12.534621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:12.542268 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d09fc50a-b3e6-4169-92f9-b4afc116f389 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.153924 Jul 28 12:34:12.542849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3443/6887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:12 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:13.564694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:13.565310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:13.572319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:13.572773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:13.573536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:13.573974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:13.712634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:13.720541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3833ce5-96fb-41b1-bc25-170ae5f3292d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.160382 Jul 28 12:34:13.721114 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3445/6888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:13 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:14.686565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7474f7a3-6e17-4aa7-8734-a87138f4211e req-e0a125c0-adde-4c81-99c6-da8f7d9d5713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "name": "network-vif-plugged", "status": "completed", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:14.697233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7474f7a3-6e17-4aa7-8734-a87138f4211e req-e0a125c0-adde-4c81-99c6-da8f7d9d5713 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:14.697713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7474f7a3-6e17-4aa7-8734-a87138f4211e req-e0a125c0-adde-4c81-99c6-da8f7d9d5713 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:14.709523 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7474f7a3-6e17-4aa7-8734-a87138f4211e req-e0a125c0-adde-4c81-99c6-da8f7d9d5713 service nova] Creating event network-vif-plugged:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:34:14.714424 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7474f7a3-6e17-4aa7-8734-a87138f4211e req-e0a125c0-adde-4c81-99c6-da8f7d9d5713 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032154 Jul 28 12:34:14.715202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3444/6889] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:34:14.742007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:14.742619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:14.752503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:14.752957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:14.753729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:14.754165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:14.891912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:14.900427 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c83a97e4-4f48-45c9-8ed1-e92ed219c5d0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.162582 Jul 28 12:34:14.900997 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3446/6890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:14 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:15.923249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:15.923964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:15.930259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:15.930726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:15.931530 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:15.931985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:16.063823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:16.071372 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-71e595f6-54c8-480b-a3ee-b9a8e2e97e35 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1364 microversion: 2.1 time: 0.153968 Jul 28 12:34:16.071938 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3445/6891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:15 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:17.092322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:17.092944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:17.095781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:17.096450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:17.102966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:17.103445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:17.104217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:17.104657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:17.237630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:34:17.245175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-582ce7fa-91de-4225-bac8-f4773de3dd95 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1551 microversion: 2.1 time: 0.156781 Jul 28 12:34:17.245748 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3447/6892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:34:17 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:34:17.266713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:34:17.267264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:34:17.269238 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:34:17.276112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:17.276584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:17.277360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:17.277811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:17.355751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1760f7cc-7188-4683-bc94-e7360e2fc51c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093540 Jul 28 12:34:17.356361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3446/6893] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:34:17 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:34:18.294365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-aa75958a-98a7-401a-9b7f-2b83f9ab079e req-b19e9419-4e88-466d-8f63-267f841910df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:34:18.304808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa75958a-98a7-401a-9b7f-2b83f9ab079e req-b19e9419-4e88-466d-8f63-267f841910df service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:34:18.305340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-aa75958a-98a7-401a-9b7f-2b83f9ab079e req-b19e9419-4e88-466d-8f63-267f841910df service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:34:18.317549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-aa75958a-98a7-401a-9b7f-2b83f9ab079e req-b19e9419-4e88-466d-8f63-267f841910df service nova] Creating event network-changed:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:34:18.322864 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-aa75958a-98a7-401a-9b7f-2b83f9ab079e req-b19e9419-4e88-466d-8f63-267f841910df service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032327 Jul 28 12:34:18.323832 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3448/6894] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:34:51.663447 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:34:51.664011 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:34:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:35:32.753655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:32.754477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:32.758831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:32.759554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:32.768028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:32.768528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:32.769305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:32.769760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:32.958563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:32.966120 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-270ef391-2a04-44af-ba59-44b89998a517 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1670 microversion: 2.1 time: 0.215995 Jul 28 12:35:32.966687 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3447/6895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:32 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:32.985380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:32.986148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:32.991132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f027f99-04a1-4d6e-9bcb-42dc1a059957"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:35:32.993605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:33.002647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:33.003126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:33.003901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:33.004338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:33.366040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bdd39848-7fc1-494a-b115-21ff83e9660c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383251 Jul 28 12:35:33.366663 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3449/6896] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:35:32 2022] POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:35:35.438214 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:35:35.438877 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:35:44.066869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:35:44.069104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:44.071866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:44.072531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:44.078062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:44.078526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:44.079338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:44.079795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:44.107600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:44.113587 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119235) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:35:44.120368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:35:44.120804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:35:44.121292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:35:44.121714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:35:44.122138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:35:44.184650 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d0d1d56c-5a50-4a3e-93c4-3cf1fac65ee3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/action" status: 202 len: 0 microversion: 2.1 time: 0.122087 Jul 28 12:35:44.185250 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3448/6897] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:35:44 2022] POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:35:44.191963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:44.192741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:35:44.198074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:44.198421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:44.206484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:44.206876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:44.207708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:44.208143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:44.362278 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:44.370896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-310569bf-cdf9-4f4c-90b2-6d918acda357 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1725 microversion: 2.1 time: 0.181271 Jul 28 12:35:44.371502 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3450/6898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:44 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:45.393841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:45.394469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:45.400601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:45.401064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:45.401835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:45.402283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:45.546126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:45.555216 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-decc5036-6dc9-4cb1-a3fb-73b4d571855f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1725 microversion: 2.1 time: 0.166650 Jul 28 12:35:45.556140 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3449/6899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:45 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:46.577197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:46.577815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:46.584717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:46.585173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:46.585939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:46.586378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:46.719172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:46.727796 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95d29abb-7404-45af-bbed-f9b9bcf07dfa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.154471 Jul 28 12:35:46.728303 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3451/6900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:46 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:47.749116 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:47.749765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:47.757131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:47.757613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:47.758376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:47.758832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:47.887037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:47.895442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3eccd41d-8e99-426a-b179-4955274a7de5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.150161 Jul 28 12:35:47.896003 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3450/6901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:47 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:48.916437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:48.917056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:48.924085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:48.924539 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:48.925301 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:48.925740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:49.052754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:49.060771 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b268f7ee-8fef-416d-b3aa-2aaa4536beef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.148277 Jul 28 12:35:49.061344 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3452/6902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:48 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:50.082064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:50.082728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:50.089762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:50.090234 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:50.091018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:50.091503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:50.223195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:50.231498 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98760349-6ebf-4013-9922-212e1c61ef67 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.153294 Jul 28 12:35:50.232066 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3451/6903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:50 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:51.253852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:51.254394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:51.261214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:51.261666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:51.262430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:51.262870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:51.389218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:51.397322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e1c9c2f-7a04-437a-827f-b0903a73f9ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.148080 Jul 28 12:35:51.397887 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3453/6904] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:51 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:52.420311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:52.420943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:52.427968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:52.428431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:52.429219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:52.429676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:52.579102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:52.588966 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-989ecc4f-12c7-4539-b9f5-399925cd34c3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.172965 Jul 28 12:35:52.590005 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3452/6905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:52 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:53.611203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:53.611863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:53.619445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:53.619902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:53.620705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:53.621148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:53.752575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:53.760635 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7221d65c-16cb-4dfb-a4b1-1e090a47278b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.153322 Jul 28 12:35:53.761205 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3454/6906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:53 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:54.781694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:54.782349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:54.789969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:54.790436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:54.791251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:54.791710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:54.920897 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:54.928938 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc2b6b09-4dae-4f08-99af-28ad4fa71328 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.151113 Jul 28 12:35:54.929506 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3453/6907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:54 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:55.950173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:55.950798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:55.958623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:55.959097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:55.960168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:55.960602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:56.111577 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:56.119604 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-475ddebe-07e1-410d-9663-48a96af864a5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.173491 Jul 28 12:35:56.120192 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3455/6908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:55 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:57.140330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:57.140958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:57.148404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:57.148871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:57.149647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:57.150097 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:57.276580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:57.284564 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0fb3e950-d93f-471f-ae2e-8131bbe478a9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.148116 Jul 28 12:35:57.285751 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3454/6909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:57 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:58.305843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:58.306367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:58.313204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:58.313653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:58.314417 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:58.314855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:58.448640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:58.458176 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6ae0ee65-6535-41d8-a7a4-27e4ebe00156 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.156244 Jul 28 12:35:58.458744 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3456/6910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:58 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:35:59.479932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:35:59.480832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:35:59.487220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:59.487690 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:59.488483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:35:59.488940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:35:59.621202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:35:59.630148 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11e04620-308e-4f8a-bf12-a77390fbe205 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1730 microversion: 2.1 time: 0.154156 Jul 28 12:35:59.630744 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3455/6911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:35:59 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:00.651766 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:00.652464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:00.660152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:00.660932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:00.662051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:00.662591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:00.813084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:00.821848 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7a0b1d3-9f17-4c51-ade1-cfd1f0f3bae3 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1729 microversion: 2.1 time: 0.174006 Jul 28 12:36:00.822618 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3457/6912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:00 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:01.259065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:01.269925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:01.270385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:01.284229 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] Creating event network-vif-unplugged:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h2-851368-1 Jul 28 12:36:01.290994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:36:01.304920 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-304fb790-a6ba-4120-940f-dcf0d4837baf req-db15e566-05b8-4564-8f4e-a310bde67b97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110518 Jul 28 12:36:01.306130 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3456/6913] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:36:01.843427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:01.844060 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:01.850927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:01.851409 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:01.852183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:01.852626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:02.056408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:02.065853 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a72da66b-15fa-4c79-a7d2-3ddb454a452b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1729 microversion: 2.1 time: 0.226221 Jul 28 12:36:02.067237 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3458/6914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:01 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:03.088008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:03.088731 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:03.095953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:03.096428 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:03.097212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:03.097666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:03.234311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:03.242954 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-15c2762a-0a10-4e61-b2a1-70ab359c09b0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.159242 Jul 28 12:36:03.243572 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3457/6915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:03 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:03.320719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:03.331679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:03.332220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:03.344766 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] Creating event network-changed:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h2-851368-1 Jul 28 12:36:03.350676 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:36:03.362537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8b7347b8-9250-4f35-9ac0-892e3e1c0a94 req-ee497666-ce57-48e8-873a-a82d36f810cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046115 Jul 28 12:36:03.363946 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3459/6916] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:36:04.265016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:04.265638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:04.273151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:04.273615 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:04.274392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:04.274840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:04.408807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:04.416891 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-15dca3d4-152d-485c-a2fb-6416fce66c51 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.155843 Jul 28 12:36:04.417462 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3458/6917] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:04 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:05.445357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:05.446312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:05.453363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:05.453813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:05.454582 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:05.455016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:05.586027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:05.594269 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5a55fbb2-e6d8-4449-9160-792cc092b5e8 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.155702 Jul 28 12:36:05.594854 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3460/6918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:05 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:06.617077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:06.617709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:06.624928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:06.625397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:06.626190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:06.626645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:06.762944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:06.771674 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-da05c974-e5ee-406a-b347-f9af228d0586 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.159142 Jul 28 12:36:06.772249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3459/6919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:06 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:07.793815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:07.794439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:07.801657 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:07.802119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:07.802891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:07.803365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:07.933724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:07.942087 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3956386f-b817-4cea-a986-377d04bf98ae tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.152301 Jul 28 12:36:07.942651 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3461/6920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:07 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:08.963822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:08.964460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:08.971384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:08.971851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:08.972634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:08.973084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:09.105994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:09.113960 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79cf3440-9040-447e-b404-0b49ddfeccfc tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.154066 Jul 28 12:36:09.114527 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3460/6921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:08 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:10.134991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:10.135689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:10.142630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:10.143115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:10.143938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:10.144388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:10.276178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:10.284162 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-45a7d8fd-7d94-4e82-8b53-78358e08310f tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.153166 Jul 28 12:36:10.285286 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3462/6922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:10 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:11.305730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:11.306358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:11.313271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:11.313732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:11.314514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:11.314970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:11.444739 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:11.453498 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a4e805d-9995-4bc1-b4d7-86fd56d06e66 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.151698 Jul 28 12:36:11.454069 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3461/6923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:11 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:12.475378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:12.476001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:12.483596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:12.484000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:12.484780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:12.485230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:12.618815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:12.633159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-da724f34-5810-4c13-bd59-f2aac4d00d69 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.161683 Jul 28 12:36:12.634139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3463/6924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:12 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:13.655323 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:13.655945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:13.662816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:13.663321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:13.664100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:13.664554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:13.795800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:13.804263 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3c011f92-55fe-4e48-9b50-545e40eee2f0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1727 microversion: 2.1 time: 0.152893 Jul 28 12:36:13.804834 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3462/6925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:13 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:14.825818 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:14.826341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:14.829143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=29 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:14.837233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:14.837693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:14.838621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:14.839092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:14.841789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=83 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:14.973112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:14.981282 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c0b84112-8523-489c-bf01-e10b3447c9c0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1724 microversion: 2.1 time: 0.159238 Jul 28 12:36:14.982007 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3464/6926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:14 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:15.002639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:15.005292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:15.007833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:15.011491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.011946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.012719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.013167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.017595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:15.051769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.052233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.053056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.053518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.074168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for project acad3faa5b784c968b7836423b35812e. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:36:15.079322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Getting quotas for user b524434a900e4295bca8bd62b3dc1684 and project acad3faa5b784c968b7836423b35812e. Resources: {'ram', 'cores'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:36:15.176613 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-24c2d7d3-7963-4192-a832-1678ac9cb0ad tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/action" status: 202 len: 0 microversion: 2.1 time: 0.177612 Jul 28 12:36:15.177228 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3463/6927] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:36:14 2022] POST /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:36:15.185641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:15.186259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:15.193166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.193673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.194465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:15.194909 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:15.393756 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:15.402266 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1fdc8e6e-a227-40a7-87a3-8b67d5088f54 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.220667 Jul 28 12:36:15.402839 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3465/6928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:15 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:16.426048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:16.426769 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:16.434010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:16.434472 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:16.435285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:16.435736 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:16.578232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:16.586825 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a49c1d7b-7ba6-42ed-bf6f-f4c8f9028c8d tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.166549 Jul 28 12:36:16.587440 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3464/6929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:16 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:17.609100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:17.609674 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:17.617274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:17.617734 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:17.618514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:17.618966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:17.759835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:17.767892 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-870adad6-3697-47b5-8bff-407af1372319 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.163076 Jul 28 12:36:17.768472 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3466/6930] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:17 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:18.789268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:18.789816 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:18.796745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:18.797215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:18.797997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:18.798455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:18.932750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:18.940914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d90a10f2-448f-4c15-8d5e-dcf79f600ba6 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.155637 Jul 28 12:36:18.941495 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3465/6931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:18 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:19.962064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:19.962793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:19.970386 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:19.970480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:19.971279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:19.971719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:20.105629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:20.114553 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aaf09d59-deef-43cf-8c15-db787961adef tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.155706 Jul 28 12:36:20.115151 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3467/6932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:19 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:21.136351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:21.136995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:21.143952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:21.144421 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:21.145273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:21.145734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:21.183621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:21.197533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:21.198217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:21.215597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] Creating event network-changed:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:36:21.221810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851368-1', 'n-h2-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:36:21.236556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-eaab55e7-ccf7-4249-b60a-e7790e0584a4 req-1d104dd6-4f65-40c4-8f6f-866e873e1430 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056388 Jul 28 12:36:21.237785 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3468/6933] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:36:21.340258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:21.349702 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-318af91a-7f3b-4732-81a1-99dcec8b4f6b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.217686 Jul 28 12:36:21.364104 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3466/6934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:21 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:22.374071 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:22.374781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:22.381113 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:22.381568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:22.382382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:22.382829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:22.524527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:22.532733 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e061b52-3182-4995-8dc9-20298ab344b5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.163783 Jul 28 12:36:22.533320 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3469/6935] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:22 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:23.554597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:23.555143 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:23.562229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:23.562705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:23.563540 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:23.564034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:23.694002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:23.702270 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-05ef8fe4-59e6-46da-a870-9996438cbea5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.151603 Jul 28 12:36:23.702868 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3467/6936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:23 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:24.724055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:24.724678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:24.732388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:24.732840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:24.733633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:24.734070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:24.871922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:24.880254 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b79b742a-a374-470f-b912-0fa178ea8f3c tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.160123 Jul 28 12:36:24.881426 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3470/6937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:24 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:25.902285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:25.902804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:25.905592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:25.911020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:25.911517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:25.912289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:25.912733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:26.047612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:26.055999 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aebf321b-6fd3-4661-b1a1-3e784a333ebf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.157692 Jul 28 12:36:26.056587 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3468/6938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:25 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:27.077518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:27.078136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:27.085505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:27.085962 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:27.086730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:27.087205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:27.217713 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:27.226370 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-edd42d64-fadf-4032-9682-6fa5427c8550 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.152734 Jul 28 12:36:27.226900 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3471/6939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:27 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:36:28.248264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:28.248829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:28.255879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:28.256341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:28.257125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:28.257580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:28.388864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:28.396859 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c2778db4-e4f7-4ad6-a782-7c64947031c7 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.152560 Jul 28 12:36:28.397427 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3469/6940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:28 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:29.419718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:29.420342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:29.427824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:29.428310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:29.429083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:29.429531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:29.560956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:29.569689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-effbe1b3-cabd-46cb-b1bc-73fc4bf0806b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.153924 Jul 28 12:36:29.570267 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3472/6941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:29 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:30.590949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:30.591625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:30.597758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:30.598221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:30.599006 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:30.599491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:30.735959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:30.744443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5c2a06d-7470-4559-8684-0ad888fbf7a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.157686 Jul 28 12:36:30.745019 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3470/6942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:30 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:31.565539 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:36:31.565786 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:36:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:36:31.765905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:31.766526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:31.773499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:31.773953 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:31.774717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:31.775188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:31.903990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:31.912152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-935e9eef-7926-4ffe-b613-032b873538aa tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.150181 Jul 28 12:36:31.912724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3473/6943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:31 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:32.933244 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:32.933866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:32.940888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:32.941353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:32.942729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:32.943213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:33.075121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:33.083083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-483db679-cd4d-473b-b354-f5df3795fbe9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.153808 Jul 28 12:36:33.083648 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3471/6944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:32 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:33.649509 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:36:33.650086 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:36:34.104063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:34.104694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:34.112125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:34.112584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:34.113364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:34.113810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:34.240865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:34.248870 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2da98cd4-20cb-42aa-a485-1db8df553bbe tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1723 microversion: 2.1 time: 0.148770 Jul 28 12:36:34.249438 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3474/6945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:34 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:35.272444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:35.272970 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:35.279860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.280324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.281099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.281557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.412362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:35.420571 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d2de4004-a71a-4383-9ded-b939d280d440 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1716 microversion: 2.1 time: 0.152678 Jul 28 12:36:35.421512 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3472/6946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:35 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:35.440689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:35.441320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:35.448604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.449207 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.450211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.450884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.586934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:35.595197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2725f5b5-6cd6-4dd1-8201-8f8bc6b62e3e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1716 microversion: 2.1 time: 0.158395 Jul 28 12:36:35.596000 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3475/6947] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:35 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:36:35.615274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:35.615935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:35.621981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.622447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.623264 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.623716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.751871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:35.760396 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-60fd4c64-ca61-4020-bdc7-84a3d394a0f5 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1716 microversion: 2.1 time: 0.149105 Jul 28 12:36:35.760957 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3473/6948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:35 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:35.780668 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:35.781172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:35.787268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.787664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.788434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.788880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.812780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:36:35.892913 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-16069f54-0bcb-44b2-911c-a1f030184a23 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 204 len: 0 microversion: 2.1 time: 0.115808 Jul 28 12:36:35.893513 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3476/6949] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:36:35 2022] DELETE /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:36:35.902518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:35.903170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:35.909224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.909689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:35.910462 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:35.910914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:36.044498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:36.053317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85b939ff-34cb-47f9-bf0b-6e153a2a1afd tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1722 microversion: 2.1 time: 0.154681 Jul 28 12:36:36.053903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3474/6950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:35 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:37.075929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:37.076623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:37.084016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:37.084464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:37.085226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:37.085673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:37.214416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:37.222520 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-68e2af46-a9a6-434a-9aa8-e2aedb3b1b0a tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1722 microversion: 2.1 time: 0.150842 Jul 28 12:36:37.223036 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3477/6951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:37 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:37.591978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-904eb05c-ae44-4ede-8c59-8574e7410920 req-da200c87-bd1b-4094-94af-16c66ebbe528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "name": "network-vif-plugged", "status": "completed", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:37.601989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-904eb05c-ae44-4ede-8c59-8574e7410920 req-da200c87-bd1b-4094-94af-16c66ebbe528 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:37.602443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-904eb05c-ae44-4ede-8c59-8574e7410920 req-da200c87-bd1b-4094-94af-16c66ebbe528 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:37.614170 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-904eb05c-ae44-4ede-8c59-8574e7410920 req-da200c87-bd1b-4094-94af-16c66ebbe528 service nova] Creating event network-vif-plugged:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:36:37.619279 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-904eb05c-ae44-4ede-8c59-8574e7410920 req-da200c87-bd1b-4094-94af-16c66ebbe528 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107691 Jul 28 12:36:37.619888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3475/6952] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:36:38.244142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:38.244796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:38.251678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:38.252161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:38.252948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:38.253388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:38.321845 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:38.331681 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6144512b-1895-467e-8bfd-e02b8c1c9950 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1654 microversion: 2.1 time: 0.091495 Jul 28 12:36:38.332897 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3478/6953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:38 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:38.585796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a5350cc0-099e-43ea-8909-e4a3f9f2c640 req-4382e1cf-d43c-478b-89f3-bead7121d359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccae01e-8175-4f25-b4fc-1075dcaa42b1", "name": "network-vif-deleted", "tag": "dc2dd2cc-23f9-4edd-be4d-d047fa71849f"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:38.596155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a5350cc0-099e-43ea-8909-e4a3f9f2c640 req-4382e1cf-d43c-478b-89f3-bead7121d359 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:38.596823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a5350cc0-099e-43ea-8909-e4a3f9f2c640 req-4382e1cf-d43c-478b-89f3-bead7121d359 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:38.608036 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a5350cc0-099e-43ea-8909-e4a3f9f2c640 req-4382e1cf-d43c-478b-89f3-bead7121d359 service nova] Creating event network-vif-deleted:dc2dd2cc-23f9-4edd-be4d-d047fa71849f for instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 on n-h1-851368-1 Jul 28 12:36:38.612826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a5350cc0-099e-43ea-8909-e4a3f9f2c640 req-4382e1cf-d43c-478b-89f3-bead7121d359 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Jul 28 12:36:38.613465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3476/6954] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:36:39.360241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:39.361531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:39.369639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:39.370372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:39.371189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:39.371631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:39.387637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:39.445876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:39.455114 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-06ec6c10-bba8-4763-a710-58039f65fddf tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1369 microversion: 2.1 time: 0.105042 Jul 28 12:36:39.455703 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3479/6955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:39 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:40.477550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:40.478188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:40.484664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:40.485121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:40.485890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:40.486335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:40.550496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:40.559290 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64cee99c-a3c5-4aec-a031-0ae932a6a1c9 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1369 microversion: 2.1 time: 0.086741 Jul 28 12:36:40.560188 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3477/6956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:40 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:41.580396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:41.581020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:41.588198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:41.588655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:41.589429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:41.589876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:41.653270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:41.661989 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c317632-0f94-408a-9ff3-0d665d43f93e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1369 microversion: 2.1 time: 0.085498 Jul 28 12:36:41.662518 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3480/6957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:41 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:42.683255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:42.683880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:42.690513 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:42.690971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:42.692398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:42.692845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:42.696829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:42.759720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524434a900e4295bca8bd62b3dc1684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad3faa5b784c968b7836423b35812e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:42.767789 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7741c419-ec36-44f4-a440-cf970c5f0659 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 200 len: 1369 microversion: 2.1 time: 0.088445 Jul 28 12:36:42.768355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3478/6958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:42 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:43.789733 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:43.790344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:43.797342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:43.797795 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:43.798555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:43.798994 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:43.814659 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 HTTP/1.1 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '5ccae01e-8175-4f25-b4fc-1075dcaa42b1'} Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:43.816821 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-26bad76e-e368-466e-96de-262ad2852c21 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 404 len: 111 microversion: 2.1 time: 0.033023 Jul 28 12:36:43.821026 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3481/6959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:43 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:43.876619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:43.879337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:43.886185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:43.886684 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:43.887569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:43.888027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:43.901024 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-volume_attachments HTTP/1.1 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '5ccae01e-8175-4f25-b4fc-1075dcaa42b1'} Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:43.902685 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a0cb526-b46a-4536-953f-9402ca2edce0 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031564 Jul 28 12:36:43.907933 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3479/6960] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:36:43 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.231834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.232407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.235318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:47.240782 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.241238 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.242011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.242455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.256936 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 HTTP/1.1 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '5ccae01e-8175-4f25-b4fc-1075dcaa42b1'} Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.258604 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae0168cb-3921-4482-95e9-06ab99f2ed9e tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 404 len: 111 microversion: 2.1 time: 0.032463 Jul 28 12:36:47.262721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3482/6961] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:36:47 2022] DELETE /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.269028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.270161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 5ccae01e-8175-4f25-b4fc-1075dcaa42b1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.273702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:47.279440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.279908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.280687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.281139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.295807 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 HTTP/1.1 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '5ccae01e-8175-4f25-b4fc-1075dcaa42b1'} Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.297354 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 5ccae01e-8175-4f25-b4fc-1075dcaa42b1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6cbd0992-98ba-43b4-8107-57dab65a4879 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1" status: 404 len: 111 microversion: 2.1 time: 0.034050 Jul 28 12:36:47.301163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3480/6962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:47 2022] GET /compute/v2.1/servers/5ccae01e-8175-4f25-b4fc-1075dcaa42b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.307761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.308281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.314637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.315200 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.316014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.316465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.331063 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 HTTP/1.1 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '74a961be-3d6d-4e3b-9989-6b8b51345388'} Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.333197 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b5429740-aec2-4d2e-9222-9879efaae2a1 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 404 len: 111 microversion: 2.1 time: 0.030984 Jul 28 12:36:47.337002 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3483/6963] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:36:47 2022] DELETE /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.343379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.344021 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 74a961be-3d6d-4e3b-9989-6b8b51345388] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.351032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.351528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.352337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.352799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.367408 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 HTTP/1.1 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '74a961be-3d6d-4e3b-9989-6b8b51345388'} Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.368976 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 74a961be-3d6d-4e3b-9989-6b8b51345388 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-95209e41-d581-431a-bf70-a5bf4a2b3077 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388" status: 404 len: 111 microversion: 2.1 time: 0.030978 Jul 28 12:36:47.372386 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3481/6964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:47 2022] GET /compute/v2.1/servers/74a961be-3d6d-4e3b-9989-6b8b51345388 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.379298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.380052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.386237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.386689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.387497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.387940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.401907 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce HTTP/1.1 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'fe1bbcda-94c9-495e-8b1f-ed236084e9ce'} Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.403496 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aebf6a12-15b8-462f-85e9-a04580c5c763 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 404 len: 111 microversion: 2.1 time: 0.029756 Jul 28 12:36:47.406979 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3484/6965] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:36:47 2022] DELETE /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.414168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.415107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: fe1bbcda-94c9-495e-8b1f-ed236084e9ce] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.421211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.421675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.422456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.422906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.436477 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce HTTP/1.1 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'fe1bbcda-94c9-495e-8b1f-ed236084e9ce'} Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.438003 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance fe1bbcda-94c9-495e-8b1f-ed236084e9ce could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef8e5bdb-0cde-4eaa-893b-53e8cc9e995b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce" status: 404 len: 111 microversion: 2.1 time: 0.030205 Jul 28 12:36:47.441627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3482/6966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:47 2022] GET /compute/v2.1/servers/fe1bbcda-94c9-495e-8b1f-ed236084e9ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.448270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.448780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.455214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.455720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.456449 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.457384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.471100 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 HTTP/1.1 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '88bbc73c-9c63-4961-9c24-e4f52d8b18b9'} Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.473324 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-73a06869-5351-4fe2-9640-b51bdf93d233 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 404 len: 111 microversion: 2.1 time: 0.030418 Jul 28 12:36:47.478144 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3485/6967] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:36:47 2022] DELETE /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.483527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.484152 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] [instance: 88bbc73c-9c63-4961-9c24-e4f52d8b18b9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:47.490099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.490561 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.491369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:47.491825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:47.505703 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] HTTP exception thrown: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Request method failure captured: Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 HTTP/1.1 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oFaz2RZz_UtJZ0IlFXa7OLPAkAp-zTSGgGfrB4JxLu5ggQvdxgtPIxB-GkCGwN2FaIl_XOatgkzYFyxoDXhqF0eJjD_R5TFta10S-MDvhb065dc4DARncLa1bkZnFMS2OF9dqurdT8jVjYXCpgt9MeU58tFe0pa4sBCfFCqezljUu0 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/acad3faa5b784c968b7836423b35812e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_acad3faa5b784c968b7836423b35812e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/acad3faa5b784c968b7836423b35812e"}]}] Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: acad3faa5b784c968b7836423b35812e Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServerActionsTestJSON-1955458038 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b524434a900e4295bca8bd62b3dc1684 Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServerActionsTestJSON-1955458038-project Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '88bbc73c-9c63-4961-9c24-e4f52d8b18b9'} Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:36:47.507315 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Returning 404 to user: Instance 88bbc73c-9c63-4961-9c24-e4f52d8b18b9 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aa52786d-e807-4628-81ad-2dc82f93ac63 tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9" status: 404 len: 111 microversion: 2.1 time: 0.029436 Jul 28 12:36:47.511817 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3483/6968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:47 2022] GET /compute/v2.1/servers/88bbc73c-9c63-4961-9c24-e4f52d8b18b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:36:47.517542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92dc4874-f415-4f74-a982-3251409efc3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] Calling method '.version_select at 0x7f2eb17d4ee0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:47.541551 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92dc4874-f415-4f74-a982-3251409efc3b tempest-ServerActionsTestJSON-1955458038 tempest-ServerActionsTestJSON-1955458038-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688882548" status: 202 len: 0 microversion: 2.1 time: 0.027765 Jul 28 12:36:47.542128 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3486/6969] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Jul 28 12:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688882548 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:36:56.912068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1814890367", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "f826e443-0a30-448d-8b30-0a87c8277539"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:36:56.969651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] validate_networks() for [('f826e443-0a30-448d-8b30-0a87c8277539', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:36:57.385285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:36:57.385734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:36:57.386260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:36:57.386692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:36:57.387167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:36:57.396962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:57.397489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:57.398265 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:57.398721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:57.416338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Getting quotas for project 38c5d5ceabb84bbe980861df6db9a6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:36:57.421908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Getting quotas for user b791e820b9fa4822acff1e9f39da9942 and project 38c5d5ceabb84bbe980861df6db9a6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:36:57.434854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:36:57.437203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:36:57.482532 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e45836c3-e2d9-4a5b-8437-858a8bf2db4d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693411 Jul 28 12:36:57.483202 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3484/6970] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:36:57.491895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=19 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:36:57.497860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-93596b54-a4bb-435b-b241-12712064121f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:57.498485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-93596b54-a4bb-435b-b241-12712064121f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:57.562779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-93596b54-a4bb-435b-b241-12712064121f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:57.570539 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-93596b54-a4bb-435b-b241-12712064121f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1217 microversion: 2.1 time: 0.080414 Jul 28 12:36:57.579989 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3487/6971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:57 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:58.595550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:58.596256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:58.606010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:58.607341 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:58.608217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:58.608689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:58.676979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:58.689081 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20bfba79-75ab-44d4-8d23-99dbd70bf1eb tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1277 microversion: 2.1 time: 0.099270 Jul 28 12:36:58.704697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3485/6972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:58 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:36:59.710458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:36:59.711098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:36:59.718531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:59.718902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:59.719712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:36:59.720150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:36:59.863815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:36:59.872026 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46bfccde-4e63-41e0-b5a8-1f10578a800f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.166025 Jul 28 12:36:59.872675 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3488/6973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:36:59 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:00.474364 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a99130e3-9ec8-4e41-aa27-bb1596b0c2a3 req-34d6b215-751a-41d7-a5de-fa98126db96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e023ae7-113b-4c4e-a761-8df3b3c92297", "tag": "da072e66-8525-43df-9cca-65e85a5d13a6"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:00.500111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a99130e3-9ec8-4e41-aa27-bb1596b0c2a3 req-34d6b215-751a-41d7-a5de-fa98126db96a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:00.500733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a99130e3-9ec8-4e41-aa27-bb1596b0c2a3 req-34d6b215-751a-41d7-a5de-fa98126db96a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:00.525596 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a99130e3-9ec8-4e41-aa27-bb1596b0c2a3 req-34d6b215-751a-41d7-a5de-fa98126db96a service nova] Creating event network-changed:da072e66-8525-43df-9cca-65e85a5d13a6 for instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 on n-h1-851368-1 Jul 28 12:37:00.532083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a99130e3-9ec8-4e41-aa27-bb1596b0c2a3 req-34d6b215-751a-41d7-a5de-fa98126db96a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061537 Jul 28 12:37:00.533290 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3486/6974] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:00.893659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:00.894942 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:00.901949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:00.902412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:00.903269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:00.903717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:01.046137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:01.054383 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47998083-8e5e-4ead-9e54-bb3088a70cb9 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.164647 Jul 28 12:37:01.054997 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3489/6975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:00 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:02.075951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:02.076671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:02.083862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:02.084321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:02.085133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:02.085578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:02.214115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:02.221622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abab3c97-9ad0-470a-9596-fd4593376698 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.149860 Jul 28 12:37:02.222753 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3487/6976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:02 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:03.242739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:03.243472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:03.249826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:03.250379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:03.251181 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:03.251628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:03.385502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:03.393154 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c587a862-f73f-4f23-ade6-4b5748f2440f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.154468 Jul 28 12:37:03.393728 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3490/6977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:03 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:04.414511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:04.415169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:04.421279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:04.421755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:04.422531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:04.422987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:04.552270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:04.559725 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cafae133-1327-4593-980f-f28fb6d895e6 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.150097 Jul 28 12:37:04.560306 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3488/6978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:04 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:05.580599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:05.581849 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:05.588689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:05.589149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:05.589926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:05.590364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:05.670809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1765360c-51f1-41da-843c-56a3e8b4f106 req-c2e891a9-5b83-4305-89e0-530e8b70d000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e023ae7-113b-4c4e-a761-8df3b3c92297", "name": "network-vif-plugged", "status": "completed", "tag": "da072e66-8525-43df-9cca-65e85a5d13a6"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:05.681711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1765360c-51f1-41da-843c-56a3e8b4f106 req-c2e891a9-5b83-4305-89e0-530e8b70d000 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:05.682186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1765360c-51f1-41da-843c-56a3e8b4f106 req-c2e891a9-5b83-4305-89e0-530e8b70d000 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:05.694863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1765360c-51f1-41da-843c-56a3e8b4f106 req-c2e891a9-5b83-4305-89e0-530e8b70d000 service nova] Creating event network-vif-plugged:da072e66-8525-43df-9cca-65e85a5d13a6 for instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 on n-h1-851368-1 Jul 28 12:37:05.700241 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1765360c-51f1-41da-843c-56a3e8b4f106 req-c2e891a9-5b83-4305-89e0-530e8b70d000 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Jul 28 12:37:05.701169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3489/6979] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:05.732513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:05.740398 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eec91573-837e-45b5-9bf2-b509bf5b35b2 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.163656 Jul 28 12:37:05.741846 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3491/6980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:05 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:06.763618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:06.764325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:06.771015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:06.771499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:06.772268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:06.772713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:06.904715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:06.913199 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a57f686f-84fe-40a8-928f-4bd6bb45834f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1317 microversion: 2.1 time: 0.154567 Jul 28 12:37:06.913776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3490/6981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:06 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:07.940107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:07.940732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:07.943495 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:07.949250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:07.949707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:07.950492 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:07.950939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:08.079806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:08.087319 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff1d1a17-a0b7-482e-8f5f-268fb152e2a7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.151127 Jul 28 12:37:08.087888 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3492/6982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:07 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:08.146469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697571936", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "f826e443-0a30-448d-8b30-0a87c8277539"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:08.154505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:08.155859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:08.203791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] validate_networks() for [('f826e443-0a30-448d-8b30-0a87c8277539', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:37:08.576111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:37:08.576553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:37:08.577055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:37:08.577482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:37:08.577910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:37:08.590694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:08.591572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:08.592636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:08.593082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:08.616871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Getting quotas for project 38c5d5ceabb84bbe980861df6db9a6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:37:08.622208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Getting quotas for user b791e820b9fa4822acff1e9f39da9942 and project 38c5d5ceabb84bbe980861df6db9a6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:37:08.635608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:37:08.637889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:37:08.682474 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-76d118b0-096d-4745-8a98-31264411d58f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539891 Jul 28 12:37:08.683226 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3491/6983] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:37:08.694445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ed12fadc-c61b-478b-8ea4-58b34e37ba1f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:08.695187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ed12fadc-c61b-478b-8ea4-58b34e37ba1f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:08.754689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ed12fadc-c61b-478b-8ea4-58b34e37ba1f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:08.761509 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ed12fadc-c61b-478b-8ea4-58b34e37ba1f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1217 microversion: 2.1 time: 0.071636 Jul 28 12:37:08.762293 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3493/6984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:08 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:09.782093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:09.782735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:09.790909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:09.791406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:09.792231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:09.792691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:09.860722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:09.868445 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-425753c3-cf77-43aa-81e6-57fe63bb8a27 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1275 microversion: 2.1 time: 0.090287 Jul 28 12:37:09.869025 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3492/6985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:09 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:10.889208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:10.890530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:10.898424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:10.898881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:10.899692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:10.900135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:11.086358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ef5fac15-e811-44a8-8de7-e82843053bb0 req-8c4c1b03-4ea2-49a4-87b3-0b267f0783bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1737d35a-10fd-4573-8874-e6add6e70fec", "tag": "aa076f59-203c-45ea-aed4-8e7f7a1f6ed8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:11.105291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ef5fac15-e811-44a8-8de7-e82843053bb0 req-8c4c1b03-4ea2-49a4-87b3-0b267f0783bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:11.105822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ef5fac15-e811-44a8-8de7-e82843053bb0 req-8c4c1b03-4ea2-49a4-87b3-0b267f0783bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:11.117937 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ef5fac15-e811-44a8-8de7-e82843053bb0 req-8c4c1b03-4ea2-49a4-87b3-0b267f0783bb service nova] Creating event network-changed:aa076f59-203c-45ea-aed4-8e7f7a1f6ed8 for instance 1737d35a-10fd-4573-8874-e6add6e70fec on n-h2-851368-1 Jul 28 12:37:11.121894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:11.132889 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ef5fac15-e811-44a8-8de7-e82843053bb0 req-8c4c1b03-4ea2-49a4-87b3-0b267f0783bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050821 Jul 28 12:37:11.133883 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3493/6986] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:11.138674 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d2426d8-12b6-414b-ba2c-a51ddad6cafd tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.252949 Jul 28 12:37:11.139300 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3494/6987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:10 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:12.162644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:12.163417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:12.169668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:12.170134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:12.170914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:12.171391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:12.306320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:12.313888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3e03680c-1cd0-477f-9ae4-d049a2cb0295 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.157235 Jul 28 12:37:12.314462 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3494/6988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:12 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:13.335388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:13.336011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:13.342944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:13.343437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:13.344210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:13.344656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:13.473435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:13.480856 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5b8af40-4592-4dfa-85c7-cf75f43675c0 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.149502 Jul 28 12:37:13.481691 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3495/6989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:13 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:14.501039 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:14.501586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:14.509210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:14.509665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:14.510432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:14.510878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:14.513625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=62 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:14.642712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:14.650616 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8c8e2e1d-9fce-4d6b-af05-31177f7222e8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.153476 Jul 28 12:37:14.651429 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3495/6990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:14 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:15.672438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:15.673051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:15.680489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:15.680940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:15.681707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:15.682149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:15.812595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:15.820673 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8bedb8da-0422-4c20-a2b7-fa4185516b98 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.152125 Jul 28 12:37:15.821242 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3496/6991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:15 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:16.764629 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-79f3911a-af74-4f2f-999f-a9732f65a37d req-bc785e69-ebab-487f-a653-82d429ecdfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1737d35a-10fd-4573-8874-e6add6e70fec", "name": "network-vif-plugged", "status": "completed", "tag": "aa076f59-203c-45ea-aed4-8e7f7a1f6ed8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:16.775805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-79f3911a-af74-4f2f-999f-a9732f65a37d req-bc785e69-ebab-487f-a653-82d429ecdfc6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:16.776266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-79f3911a-af74-4f2f-999f-a9732f65a37d req-bc785e69-ebab-487f-a653-82d429ecdfc6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:16.787409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-79f3911a-af74-4f2f-999f-a9732f65a37d req-bc785e69-ebab-487f-a653-82d429ecdfc6 service nova] Creating event network-vif-plugged:aa076f59-203c-45ea-aed4-8e7f7a1f6ed8 for instance 1737d35a-10fd-4573-8874-e6add6e70fec on n-h2-851368-1 Jul 28 12:37:16.792230 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-79f3911a-af74-4f2f-999f-a9732f65a37d req-bc785e69-ebab-487f-a653-82d429ecdfc6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031284 Jul 28 12:37:16.792818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3496/6992] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:37:16.841981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:16.843266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:16.850881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:16.851440 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:16.852347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:16.852837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:17.054747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:17.062244 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8021b8e3-755c-4b54-8f04-0898e1cf2fcc tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1317 microversion: 2.1 time: 0.225016 Jul 28 12:37:17.062812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3497/6993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:16 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:37:18.085168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:18.085987 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:18.089105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:18.093383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.093845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.094628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.095131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.228644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:18.237088 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec897cbe-2241-45a1-a3c7-1ef11dc3c229 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1505 microversion: 2.1 time: 0.157329 Jul 28 12:37:18.237698 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3497/6994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:18 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:18.258487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:18.259094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:18.262221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:18.267910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.268365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.269158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.269660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.301866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:37:18.383487 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c499d2e2-da1e-46d1-bd04-b90f4c61521a tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 204 len: 0 microversion: 2.1 time: 0.129195 Jul 28 12:37:18.384084 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3498/6995] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:37:18 2022] DELETE /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:37:18.392009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:18.392654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:18.399249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.399711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.400476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:18.400921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:18.537938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:18.545694 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5ccfe44f-7d69-42dd-9755-545c09a63aa8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1511 microversion: 2.1 time: 0.157437 Jul 28 12:37:18.546299 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3498/6996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:18 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:37:19.566307 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:19.567624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:19.569587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:19.575673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:19.576124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:19.576898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:19.577341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:19.705542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:19.714489 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-754cd41c-1cc2-4019-bfdb-01c628e7db96 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1511 microversion: 2.1 time: 0.152251 Jul 28 12:37:19.715355 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3499/6997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:19 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:20.573180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1f39a140-0d14-4e9b-b984-c69372243bc8 req-59e26bd5-1f63-4d15-941b-f3a136cc0ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1737d35a-10fd-4573-8874-e6add6e70fec", "name": "network-vif-deleted", "tag": "aa076f59-203c-45ea-aed4-8e7f7a1f6ed8"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:20.578516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:20.579455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:20.588405 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1f39a140-0d14-4e9b-b984-c69372243bc8 req-59e26bd5-1f63-4d15-941b-f3a136cc0ebd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:20.589214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1f39a140-0d14-4e9b-b984-c69372243bc8 req-59e26bd5-1f63-4d15-941b-f3a136cc0ebd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:20.602681 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1f39a140-0d14-4e9b-b984-c69372243bc8 req-59e26bd5-1f63-4d15-941b-f3a136cc0ebd service nova] Creating event network-vif-deleted:aa076f59-203c-45ea-aed4-8e7f7a1f6ed8 for instance 1737d35a-10fd-4573-8874-e6add6e70fec on n-h2-851368-1 Jul 28 12:37:20.608203 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1f39a140-0d14-4e9b-b984-c69372243bc8 req-59e26bd5-1f63-4d15-941b-f3a136cc0ebd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038723 Jul 28 12:37:20.611972 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3499/6998] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:20.736568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:20.737324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:20.746259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:20.746719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:20.747542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:20.747988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:20.780358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:20.780813 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:20.781268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lazy-loading 'fault' on Instance uuid 1737d35a-10fd-4573-8874-e6add6e70fec {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:37:20.821750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:20.829153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-15fa359d-b5d3-450b-acb5-dd5b7ac273c1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 200 len: 1307 microversion: 2.1 time: 0.097021 Jul 28 12:37:20.829734 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3500/6999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:20 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:21.851464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:21.852218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:21.858890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:21.859384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:21.860159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:21.860612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:21.873541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec HTTP/1.1 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1737d35a-10fd-4573-8874-e6add6e70fec'} Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:21.875172 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 404 to user: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-62e8428b-77da-4fce-80e0-e107f1dbb95d tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 404 len: 111 microversion: 2.1 time: 0.030859 Jul 28 12:37:21.879281 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3500/7000] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:21 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:37:21.885507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:21.886124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:21.893000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:21.893453 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:21.894220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:21.895163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.023649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.031210 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4191cc30-91c8-49f5-8e21-539e5365dbc1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.149504 Jul 28 12:37:22.031790 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3501/7001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:21 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:22.050834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:22.053134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 3e06e14b-32b8-495c-bff0-25f31a489e9b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.058527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/3e06e14b-32b8-495c-bff0-25f31a489e9b/action HTTP/1.1 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 32 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: {"resize": {"flavorRef": "452"}} Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '3e06e14b-32b8-495c-bff0-25f31a489e9b', 'body': {'resize': {'flavorRef': '452'}}} Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2901, in _get_instance Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:37:22.060118 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 404 to user: Instance 3e06e14b-32b8-495c-bff0-25f31a489e9b could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c6f433f3-af36-477c-908a-5d5dedb84a21 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "POST /compute/v2.1/servers/3e06e14b-32b8-495c-bff0-25f31a489e9b/action" status: 404 len: 111 microversion: 2.1 time: 0.014637 Jul 28 12:37:22.064340 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3501/7002] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:37:22 2022] POST /compute/v2.1/servers/3e06e14b-32b8-495c-bff0-25f31a489e9b/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:37:22.070413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:22.071030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.077230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.077685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.078451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.078891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.209528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.216983 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ae9a90c-c0da-4041-9848-1a9bbb381aa7 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.150822 Jul 28 12:37:22.217550 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3502/7003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:22 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:37:22.237581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:22.238211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.245235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.245705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.246498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.246951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.374032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.382667 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-77ca7fd4-691f-4069-94e7-20e76d06e65e tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.148805 Jul 28 12:37:22.383264 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3502/7004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:22 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:22.403907 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "53d484fa-69d9-429e-8578-6370be2b5d26"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:22.406288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.412363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.412819 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.413594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.414041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.435046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:22.501322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.508714 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: request: POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action HTTP/1.1 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 65 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: {"resize": {"flavorRef": "53d484fa-69d9-429e-8578-6370be2b5d26"}} Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: exception: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6e023ae7-113b-4c4e-a761-8df3b3c92297', 'body': {'resize': {'flavorRef': '53d484fa-69d9-429e-8578-6370be2b5d26'}}} Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4149, in resize Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 12:37:22.511858 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 400 to user: Flavor 53d484fa-69d9-429e-8578-6370be2b5d26 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6483f8c1-546b-4425-ad9d-660201c81db1 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action" status: 400 len: 107 microversion: 2.1 time: 0.113794 Jul 28 12:37:22.516281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3503/7005] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:37:22 2022] POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action => generated 107 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:37:22.523137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:22.523765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.529733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.530195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.530967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.531442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.665035 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.672624 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a4e43ae1-e5fc-42da-8e29-2db9af745092 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.153395 Jul 28 12:37:22.673191 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3503/7006] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:22 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:22.694947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:22.695611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.701649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.702138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.702916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.703464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.840488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:22.848547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0f7a59d3-9111-4de1-a849-de5b97e85ff4 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.157616 Jul 28 12:37:22.849281 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3504/7007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:22 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:22.869469 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9e21d34-66d7-4000-abac-86235f5b138b tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9e21d34-66d7-4000-abac-86235f5b138b tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: request: POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action HTTP/1.1 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 29 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: {"resize": {"flavorRef": ""}} Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6e023ae7-113b-4c4e-a761-8df3b3c92297', 'body': {'resize': {'flavorRef': ''}}} Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise error Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi '' Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.873070 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9e21d34-66d7-4000-abac-86235f5b138b tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9e21d34-66d7-4000-abac-86235f5b138b tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action" status: 400 len: 113 microversion: 2.1 time: 0.009146 Jul 28 12:37:22.877556 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3504/7008] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:37:22 2022] POST /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 12:37:22.882592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:22.883231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:22.889202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.889699 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:22.890392 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:22.890826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.020243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:23.029453 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e0a15f07-b204-452e-a233-770e09d69424 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1506 microversion: 2.1 time: 0.150653 Jul 28 12:37:23.030031 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3505/7009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:22 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:37:23.054623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:23.055169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:23.064083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.064553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.065344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.065802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.079598 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec HTTP/1.1 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '1737d35a-10fd-4573-8874-e6add6e70fec'} Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:37:23.081209 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 404 to user: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4722221e-c6a6-4621-8d12-03f93a93cb7c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 404 len: 111 microversion: 2.1 time: 0.033339 Jul 28 12:37:23.085252 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3505/7010] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:37:23 2022] DELETE /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:37:23.092843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:23.093475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 1737d35a-10fd-4573-8874-e6add6e70fec] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:23.101705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.102167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.103007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.103469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.118983 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec HTTP/1.1 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '1737d35a-10fd-4573-8874-e6add6e70fec'} Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:23.120574 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 404 to user: Instance 1737d35a-10fd-4573-8874-e6add6e70fec could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a02931f0-402f-423e-84e9-beecaebc239f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec" status: 404 len: 111 microversion: 2.1 time: 0.034376 Jul 28 12:37:23.124812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3506/7011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:23 2022] GET /compute/v2.1/servers/1737d35a-10fd-4573-8874-e6add6e70fec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:37:23.130715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:23.131269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:23.137339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.137803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.138584 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.139037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.164588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:37:23.237979 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e41d026-8184-411a-ab6d-2d9a0d54ae2f tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 204 len: 0 microversion: 2.1 time: 0.110760 Jul 28 12:37:23.239125 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3506/7012] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:37:23 2022] DELETE /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:37:23.247565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:23.248188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:23.254945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.255444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.256216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:23.256692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:23.387709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:23.395209 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a8317ca-9aaf-4f72-b28d-b4611f3e87a8 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1512 microversion: 2.1 time: 0.151687 Jul 28 12:37:23.395779 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3507/7013] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:23 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:24.416582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:24.417342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:24.424170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:24.424641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:24.425425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:24.425918 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:24.557945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:24.565349 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6fa1a3d-cef8-43aa-ab13-7eb55750898c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1512 microversion: 2.1 time: 0.153079 Jul 28 12:37:24.566151 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3507/7014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:24 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:25.309661 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-553a08a7-abf6-47f8-86c0-58e33ade8239 req-97c1d71a-2a19-4aee-a207-618eacd1411a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e023ae7-113b-4c4e-a761-8df3b3c92297", "name": "network-vif-deleted", "tag": "da072e66-8525-43df-9cca-65e85a5d13a6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:25.323147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-553a08a7-abf6-47f8-86c0-58e33ade8239 req-97c1d71a-2a19-4aee-a207-618eacd1411a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:25.323629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-553a08a7-abf6-47f8-86c0-58e33ade8239 req-97c1d71a-2a19-4aee-a207-618eacd1411a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:25.336927 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-553a08a7-abf6-47f8-86c0-58e33ade8239 req-97c1d71a-2a19-4aee-a207-618eacd1411a service nova] Creating event network-vif-deleted:da072e66-8525-43df-9cca-65e85a5d13a6 for instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 on n-h1-851368-1 Jul 28 12:37:25.342998 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-553a08a7-abf6-47f8-86c0-58e33ade8239 req-97c1d71a-2a19-4aee-a207-618eacd1411a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 Jul 28 12:37:25.343927 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3508/7015] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:25.585887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:25.586411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:25.593294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:25.593757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:25.594537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:25.595020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:25.625165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:25.625623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:25.626085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lazy-loading 'fault' on Instance uuid 6e023ae7-113b-4c4e-a761-8df3b3c92297 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:37:25.669834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791e820b9fa4822acff1e9f39da9942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c5d5ceabb84bbe980861df6db9a6a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:25.677731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5182c3be-ef98-4c74-b879-9adf3ad6bbd5 tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 200 len: 1307 microversion: 2.1 time: 0.095834 Jul 28 12:37:25.678431 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3508/7016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:25 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:26.698801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:26.699566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] [instance: 6e023ae7-113b-4c4e-a761-8df3b3c92297] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:26.706993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:26.708043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:26.708814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:26.709283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:26.722866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] HTTP exception thrown: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Request method failure captured: Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 HTTP/1.1 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oLo2hFKo1bDoA6nPLc3UbL55gMRyCJIrZ6tnqNEoi0M0QHcA9lazT1V22RZ4dtt3BMZX8saped96IhKc4qoSgMD50gaW78f5rfTkBusQxugo6dPw1TosArI_wmiaq-WTm37d8YrSLW1Jl2lUOBOWiJkpLg4MwPcKUt64jO-K51xCkU Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38c5d5ceabb84bbe980861df6db9a6a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38c5d5ceabb84bbe980861df6db9a6a0"}]}] Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 38c5d5ceabb84bbe980861df6db9a6a0 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-ServersNegativeTestJSON-802485834 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: b791e820b9fa4822acff1e9f39da9942 Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-ServersNegativeTestJSON-802485834-project Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6e023ae7-113b-4c4e-a761-8df3b3c92297'} Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:37:26.724512 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] Returning 404 to user: Instance 6e023ae7-113b-4c4e-a761-8df3b3c92297 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3377be2-f307-4bce-9a83-c2251cdb473c tempest-ServersNegativeTestJSON-802485834 tempest-ServersNegativeTestJSON-802485834-project] 10.222.0.93 "GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jul 28 12:37:26.729117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3509/7017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:26 2022] GET /compute/v2.1/servers/6e023ae7-113b-4c4e-a761-8df3b3c92297 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:37:57.492885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:57.493735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:57.666230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd4b0ece-6a42-455a-bd27-d7e8b55f0d54 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: .version_select at 0x7f2eb237f670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-584734340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/sBKA3hfTAwKAyPIvAKYGyWUD4q+UKr2IiebOn6duoK8QBRu8VaVKW6SX415+TCU9F9QoaDBo4gcQTjwsXV7Ugktxs3LmUxWx61GzrUCGF2TDrTkO05XGXqbvbNrkKg=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:57.682618 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fd4b0ece-6a42-455a-bd27-d7e8b55f0d54 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:37:57.687692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fd4b0ece-6a42-455a-bd27-d7e8b55f0d54 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:37:57.716974 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd4b0ece-6a42-455a-bd27-d7e8b55f0d54 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.229421 Jul 28 12:37:57.717577 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3509/7018] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:37:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:37:57.776418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1704502932", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-584734340", "networks": [{"uuid": "5ad7fc4e-0acf-464f-bcc8-766d6d63241b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:37:57.788507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:57.789192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=24 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:37:57.840499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] validate_networks() for [('5ad7fc4e-0acf-464f-bcc8-766d6d63241b', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:37:58.259447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:37:58.260000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:37:58.260593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:37:58.261117 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:37:58.261645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:37:58.272089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:58.272457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:58.273467 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:58.273906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:58.294024 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:37:58.299725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:37:58.313136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:37:58.315500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:37:58.365247 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e36f2adc-64f9-49b6-84e7-d28514fd893b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595868 Jul 28 12:37:58.366235 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3510/7019] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:37:58.377443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfa78013-3d76-462c-a50c-2b232886d8bf tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:58.378078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfa78013-3d76-462c-a50c-2b232886d8bf tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:58.458517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfa78013-3d76-462c-a50c-2b232886d8bf tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:58.467580 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfa78013-3d76-462c-a50c-2b232886d8bf tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1262 microversion: 2.1 time: 0.094250 Jul 28 12:37:58.483922 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3510/7020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:58 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1262 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:37:59.491141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:37:59.491865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:37:59.498055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:59.498511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:59.499331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:37:59.499770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:37:59.565688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:37:59.574549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0ce8f164-60e3-4edc-8e37-eb850629b44f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1314 microversion: 2.1 time: 0.088624 Jul 28 12:37:59.575153 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3511/7021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:37:59 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:00.596081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:00.596930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:00.612521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:00.616500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:00.617755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:00.622427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:00.865134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:00.878419 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-616dc180-fcca-4544-adcc-95e919af8ee3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.286163 Jul 28 12:38:00.880198 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3511/7022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:00 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:01.490076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dd212a69-247f-46de-bb5e-1e3623e7d595 req-3302cfa1-ce5b-41ee-809f-4de316c14bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f3707d-0cd5-48fc-a3bf-1699a77cce68", "tag": "41e6986a-1211-4df6-b899-cde840a332b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:01.503166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dd212a69-247f-46de-bb5e-1e3623e7d595 req-3302cfa1-ce5b-41ee-809f-4de316c14bac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:01.503791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dd212a69-247f-46de-bb5e-1e3623e7d595 req-3302cfa1-ce5b-41ee-809f-4de316c14bac service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:01.517090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-dd212a69-247f-46de-bb5e-1e3623e7d595 req-3302cfa1-ce5b-41ee-809f-4de316c14bac service nova] Creating event network-changed:41e6986a-1211-4df6-b899-cde840a332b4 for instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 on n-h1-851368-1 Jul 28 12:38:01.523249 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dd212a69-247f-46de-bb5e-1e3623e7d595 req-3302cfa1-ce5b-41ee-809f-4de316c14bac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167879 Jul 28 12:38:01.524538 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3512/7023] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:01.908774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:01.910401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:01.920486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:01.921342 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:01.922722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:01.924715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:02.086648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:02.094548 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-de81a3a7-b267-4d90-a571-3a00148d4bff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.191786 Jul 28 12:38:02.095615 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3512/7024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:01 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:03.117009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:03.117722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:03.123954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:03.124405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:03.125164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:03.125603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:03.256628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:03.264238 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bfd66318-0e0d-4d3d-80b5-ce7949304c8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.152472 Jul 28 12:38:03.265002 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3513/7025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:03 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:04.284934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:04.285520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:04.292624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:04.293089 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:04.293860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:04.294310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:04.422642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:04.430606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ef6e24fd-1274-40a5-94e6-cfd523ad3bf4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.149595 Jul 28 12:38:04.431191 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3513/7026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:04 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:05.451863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:05.452375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:05.460771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:05.461247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:05.462015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:05.462462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:05.595540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:05.602998 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6177c3b2-7613-4fc3-86e1-dc6dbf7e897a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.155141 Jul 28 12:38:05.603585 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3514/7027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:05 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:06.623792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:06.624344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:06.631793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:06.632271 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:06.633061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:06.633521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:06.781257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:06.788687 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a504c1a3-a80d-4073-86a9-5a8598f0e72c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.168894 Jul 28 12:38:06.789257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3514/7028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:06 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:07.809847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:07.810608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:07.817470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:07.817921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:07.818690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:07.819147 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:07.954581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:07.962372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95b99678-ba91-41f0-9db0-a0418727134f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.156484 Jul 28 12:38:07.963081 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3515/7029] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:07 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:08.984748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:08.985378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:08.988697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:08.994208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:08.994681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:08.995497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:08.995956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:09.124696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:09.133133 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfd9a6b2-8628-497d-a914-21e41c674c5e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.152934 Jul 28 12:38:09.133702 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3515/7030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:08 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:09.911881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-091af90b-9fef-42b9-9047-d759848a9a46 req-8a889dd8-0544-4829-adb8-94f7389ee4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f3707d-0cd5-48fc-a3bf-1699a77cce68", "name": "network-vif-plugged", "status": "completed", "tag": "41e6986a-1211-4df6-b899-cde840a332b4"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:09.917311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:09.918013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:09.926036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-091af90b-9fef-42b9-9047-d759848a9a46 req-8a889dd8-0544-4829-adb8-94f7389ee4d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:09.926491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-091af90b-9fef-42b9-9047-d759848a9a46 req-8a889dd8-0544-4829-adb8-94f7389ee4d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:09.937625 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-091af90b-9fef-42b9-9047-d759848a9a46 req-8a889dd8-0544-4829-adb8-94f7389ee4d1 service nova] Creating event network-vif-plugged:41e6986a-1211-4df6-b899-cde840a332b4 for instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 on n-h1-851368-1 Jul 28 12:38:09.942546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-091af90b-9fef-42b9-9047-d759848a9a46 req-8a889dd8-0544-4829-adb8-94f7389ee4d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Jul 28 12:38:09.943177 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3516/7031] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:10.153582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:10.154235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:10.161121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:10.161597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:10.162360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:10.162796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:10.293662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:10.301112 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-403d490b-006e-443f-83c0-ce6b5b0ea1a6 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.151502 Jul 28 12:38:10.301683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3516/7032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:10 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:11.323091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:11.323857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:11.330239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:11.330693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:11.331501 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:11.332442 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:11.462477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:11.470319 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e139b2f-6b9c-4178-9a4e-49d994e2ed1b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1362 microversion: 2.1 time: 0.152276 Jul 28 12:38:11.470930 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3517/7033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:11 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:12.491939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:12.492528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:12.499498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:12.499971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:12.500760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:12.501219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:12.627652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:12.635327 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-619c4b38-e0e7-429b-8bbe-fb07b93ec479 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1553 microversion: 2.1 time: 0.148020 Jul 28 12:38:12.635905 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3517/7034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:12 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:12.655578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:12.656198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:12.663775 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:12.664257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:12.665029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:12.665470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:12.795872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:12.803537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1c5e2a66-e218-4851-869f-ff35128b2e27 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1553 microversion: 2.1 time: 0.151768 Jul 28 12:38:12.804116 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3518/7035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:12 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:14.407467 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ed7118b-1ab8-4522-b4be-9aba530814b3"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:14.409906 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:14.416919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:14.417394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:14.418183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:14.418641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:14.679344 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4184e61b-ab32-4828-8374-4943742f6459 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275599 Jul 28 12:38:14.679999 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3518/7036] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:38:14 2022] POST /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:25.357309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:25.357827 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:25.360920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:25.361698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=42 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:25.369052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:25.369555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:25.370359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:25.370821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:25.454732 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lazy-loading 'services' on Instance uuid 30f3707d-0cd5-48fc-a3bf-1699a77cce68 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:38:25.535418 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-af7ca4b8-3ade-4c51-a82d-71e6acbd477f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments/3ed7118b-1ab8-4522-b4be-9aba530814b3" status: 202 len: 0 microversion: 2.1 time: 0.182425 Jul 28 12:38:25.536870 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3519/7037] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:38:25 2022] DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments/3ed7118b-1ab8-4522-b4be-9aba530814b3 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:38:25.545606 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:25.546887 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:25.555292 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:25.558710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:25.567253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:25.567718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:25.568506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:25.568953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:25.599700 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-551b51e7-17ea-4596-a320-653c555b4104 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057639 Jul 28 12:38:25.600273 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3519/7038] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:25 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:26.615033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:26.617327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:26.623810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:26.624264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:26.625038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:26.625477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:26.655368 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1cb0a406-9cf2-4fe2-a737-bcf761cd4e59 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Jul 28 12:38:26.655855 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3520/7039] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:26 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:27.667853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:27.670022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:27.677822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:27.678283 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:27.679099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:27.679554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:27.710926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-813961eb-97f5-4d0b-bfa8-ae5f862db03b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Jul 28 12:38:27.711534 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3520/7040] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:27 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:38:28.723343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:28.725439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:28.732630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:28.733077 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:28.733834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:28.734265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:28.764031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9d61e6b3-c347-4e8e-b170-b1e30aa142f7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Jul 28 12:38:28.764586 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3521/7041] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:28 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:29.776391 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:29.778575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:29.785150 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:29.786109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:29.786886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:29.787361 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:29.816605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f32ae0de-7088-45e3-b52f-13ab7961226a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Jul 28 12:38:29.817163 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3521/7042] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:29 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:30.828869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:30.831090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:30.837958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:30.838445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:30.839256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:30.839700 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:30.868575 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5e395896-84e0-4f3d-861f-9b0303951a71 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043755 Jul 28 12:38:30.869134 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3522/7043] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:38:30 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 12:38:30.880345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:30.880888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:30.887729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:30.888198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:30.888984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:30.889437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:30.966839 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 is not attached to volume 3ed7118b-1ab8-4522-b4be-9aba530814b3 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments/3ed7118b-1ab8-4522-b4be-9aba530814b3 HTTP/1.1 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 is not attached to volume 3ed7118b-1ab8-4522-b4be-9aba530814b3 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '30f3707d-0cd5-48fc-a3bf-1699a77cce68', 'id': '3ed7118b-1ab8-4522-b4be-9aba530814b3'} Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ed7118b-1ab8-4522-b4be-9aba530814b3. Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 is not attached to volume 3ed7118b-1ab8-4522-b4be-9aba530814b3 Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:38:30.978165 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 is not attached to volume 3ed7118b-1ab8-4522-b4be-9aba530814b3 Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 is not attached to volume 3ed7118b-1ab8-4522-b4be-9aba530814b3 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3a146188-ce17-4b48-8b49-afc56cce6e98 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments/3ed7118b-1ab8-4522-b4be-9aba530814b3" status: 404 len: 154 microversion: 2.1 time: 0.104079 Jul 28 12:38:30.982980 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3522/7044] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:38:30 2022] DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68/os-volume_attachments/3ed7118b-1ab8-4522-b4be-9aba530814b3 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:38:34.315217 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:34.315798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:34.322321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:34.322784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:34.323606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:34.324054 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:34.351282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:38:34.435236 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-52f17ef3-a57f-4012-94e7-4aaa5076fd65 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 204 len: 0 microversion: 2.1 time: 0.123690 Jul 28 12:38:34.436351 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3523/7045] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:38:34 2022] DELETE /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:38:34.444450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:34.445158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:34.452788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:34.453333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:34.454185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:34.454705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:34.586161 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:34.593864 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a9acf46-3d1a-4973-beea-96cc978ed826 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1559 microversion: 2.1 time: 0.153378 Jul 28 12:38:34.594505 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3523/7046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:34 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:35.615921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:35.616621 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:35.623654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:35.624101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:35.624859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:35.625296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:35.757480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:35.764991 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3f773ee-fe3b-4ff4-8880-22fecb0cb98e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1559 microversion: 2.1 time: 0.153406 Jul 28 12:38:35.765560 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3524/7047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:35 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:36.755170 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4f8d32d7-2331-47c5-8087-c1a6be3eb661 req-3465a5c4-2c29-438f-81a6-d222fff05b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f3707d-0cd5-48fc-a3bf-1699a77cce68", "name": "network-vif-deleted", "tag": "41e6986a-1211-4df6-b899-cde840a332b4"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:36.765489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4f8d32d7-2331-47c5-8087-c1a6be3eb661 req-3465a5c4-2c29-438f-81a6-d222fff05b2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:36.765950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4f8d32d7-2331-47c5-8087-c1a6be3eb661 req-3465a5c4-2c29-438f-81a6-d222fff05b2f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:36.779189 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4f8d32d7-2331-47c5-8087-c1a6be3eb661 req-3465a5c4-2c29-438f-81a6-d222fff05b2f service nova] Creating event network-vif-deleted:41e6986a-1211-4df6-b899-cde840a332b4 for instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 on n-h1-851368-1 Jul 28 12:38:36.785288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4f8d32d7-2331-47c5-8087-c1a6be3eb661 req-3465a5c4-2c29-438f-81a6-d222fff05b2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Jul 28 12:38:36.786570 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3524/7048] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:36.788481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:36.789049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:36.796647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:36.797105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:36.797899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:36.798378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:36.875973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:36.884200 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2cfdbdfb-16b2-41d9-9633-174321808684 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 200 len: 1347 microversion: 2.1 time: 0.101871 Jul 28 12:38:36.885034 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3525/7049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:36 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:37.906845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:37.907586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 30f3707d-0cd5-48fc-a3bf-1699a77cce68] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:37.914450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:37.914916 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:37.915744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:37.916199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:37.933008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 HTTP/1.1 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '30f3707d-0cd5-48fc-a3bf-1699a77cce68'} Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:38:37.935658 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 30f3707d-0cd5-48fc-a3bf-1699a77cce68 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-75d7989e-74c5-4a7e-bdc7-eb6a7bcdbed7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68" status: 404 len: 111 microversion: 2.1 time: 0.035583 Jul 28 12:38:37.939697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3525/7050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:37 2022] GET /compute/v2.1/servers/30f3707d-0cd5-48fc-a3bf-1699a77cce68 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:38:37.947924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c98c5888-96d6-4e48-9341-50e459106490 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '.version_select at 0x7f2ebbea2790>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:37.969038 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c98c5888-96d6-4e48-9341-50e459106490 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-584734340" status: 202 len: 0 microversion: 2.1 time: 0.026049 Jul 28 12:38:37.969632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3526/7051] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-584734340 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:38:37.988909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fe68904e-218a-4c8b-9466-8ac2d838aa35 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: .version_select at 0x7f2e9c7df280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1761468885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMxkL+HCCNcQFz2qUVXAZJRGHqQX0SAj/Y/Nox9Prc19Z3V/tghRaQ18sL4/lRhxihhiZLSfHoKf4ZpJo3SrU6bGS7tTmrK9/9Ns5+iixxW77ECbqrB1/jpaMF5XpFAMQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:38.004094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fe68904e-218a-4c8b-9466-8ac2d838aa35 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:38:38.012219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-fe68904e-218a-4c8b-9466-8ac2d838aa35 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:38:38.034417 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fe68904e-218a-4c8b-9466-8ac2d838aa35 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050051 Jul 28 12:38:38.035007 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3526/7052] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:38:37 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:38.086645 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-615081852", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1761468885", "networks": [{"uuid": "5ad7fc4e-0acf-464f-bcc8-766d6d63241b"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:38.140412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] validate_networks() for [('5ad7fc4e-0acf-464f-bcc8-766d6d63241b', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:38:38.512195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:38:38.512680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:38:38.513161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:38:38.513580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:38:38.513999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:38:38.523505 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:38.523957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:38.524763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:38.525212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:38.542434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:38:38.547774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:38:38.560112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:38:38.562402 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:38:38.609885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-95e7ae67-022f-4e4e-9346-8d5f17e2483c tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526847 Jul 28 12:38:38.610587 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3527/7053] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:38:38.622137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dc39da01-8f95-4893-a50c-72d06fd76c30 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:38.622866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dc39da01-8f95-4893-a50c-72d06fd76c30 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:38.679148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dc39da01-8f95-4893-a50c-72d06fd76c30 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:38.686003 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dc39da01-8f95-4893-a50c-72d06fd76c30 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1262 microversion: 2.1 time: 0.067991 Jul 28 12:38:38.686694 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3527/7054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:38 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:39.709873 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:39.711231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:39.718723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:39.720641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:39.722100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:39.723704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:39.787903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:39.795488 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5f7054dc-9478-4933-9d0d-d3915a02ee00 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1332 microversion: 2.1 time: 0.090835 Jul 28 12:38:39.796044 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3528/7055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:39 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:40.816622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:40.817783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:40.825399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:40.825881 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:40.826688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:40.827326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:40.950373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fedc3836-61bb-4455-991d-540e87646949 req-8bca73a9-1c92-4d4e-80e3-1da64f55f2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfd1122-fc8d-4d07-9544-3f0597c0d994", "tag": "4b0a4fe3-5ac5-4e44-842f-1c8f93351837"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:40.971049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fedc3836-61bb-4455-991d-540e87646949 req-8bca73a9-1c92-4d4e-80e3-1da64f55f2d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:40.971470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fedc3836-61bb-4455-991d-540e87646949 req-8bca73a9-1c92-4d4e-80e3-1da64f55f2d9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:41.004867 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fedc3836-61bb-4455-991d-540e87646949 req-8bca73a9-1c92-4d4e-80e3-1da64f55f2d9 service nova] Creating event network-changed:4b0a4fe3-5ac5-4e44-842f-1c8f93351837 for instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 on n-h1-851368-1 Jul 28 12:38:41.010891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fedc3836-61bb-4455-991d-540e87646949 req-8bca73a9-1c92-4d4e-80e3-1da64f55f2d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064281 Jul 28 12:38:41.012871 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3529/7056] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:41.020965 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:41.030724 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d357b07a-bf71-4cdf-b254-407afd70caff tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.218045 Jul 28 12:38:41.031470 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3528/7057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:40 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:42.053426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:42.054165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:42.060444 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:42.060898 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:42.061662 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:42.062106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:42.192295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:42.199986 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c1a2776-355e-4901-9ccc-3cd955c632a8 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.152162 Jul 28 12:38:42.200555 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3530/7058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:42 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:43.220447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:43.221024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:43.227890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:43.228355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:43.229135 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:43.229585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:43.359957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:43.368059 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ad8bf3c3-dd22-44bf-a843-b5de5fd72951 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.151617 Jul 28 12:38:43.368818 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3529/7059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:43 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:44.389341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:44.389964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:44.397524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:44.397993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:44.398779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:44.399695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:44.528454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:44.535910 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a547fa0e-a406-47f4-8aef-8cf7377bb3b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.150492 Jul 28 12:38:44.536487 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3531/7060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:44 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:45.557197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:45.557820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:45.564835 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:45.565278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:45.566058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:45.566511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:45.700929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:45.708993 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2350d7ae-4327-4941-9f87-3cc4d016f18d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.155790 Jul 28 12:38:45.709900 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3530/7061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:45 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:46.730080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:46.730606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:46.737805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:46.738259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:46.739636 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:46.740072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:46.866294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:46.873792 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c51fd0c5-a5d4-4818-a70d-6d14fea0f5d9 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.147801 Jul 28 12:38:46.874369 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3532/7062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:46 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:47.894464 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:47.895169 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:47.902091 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:47.902555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:47.903354 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:47.903807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:48.034910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:48.042788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-47745007-bba2-45ab-8361-042d2c90941b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.152097 Jul 28 12:38:48.043626 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3531/7063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:47 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:48.224781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7312305b-3c02-42bc-92d3-3727bfc27d37 req-3e3121c4-f0af-4087-a743-7410f034cc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfd1122-fc8d-4d07-9544-3f0597c0d994", "name": "network-vif-plugged", "status": "completed", "tag": "4b0a4fe3-5ac5-4e44-842f-1c8f93351837"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:48.236735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7312305b-3c02-42bc-92d3-3727bfc27d37 req-3e3121c4-f0af-4087-a743-7410f034cc1d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:48.237208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7312305b-3c02-42bc-92d3-3727bfc27d37 req-3e3121c4-f0af-4087-a743-7410f034cc1d service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:48.252164 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7312305b-3c02-42bc-92d3-3727bfc27d37 req-3e3121c4-f0af-4087-a743-7410f034cc1d service nova] Creating event network-vif-plugged:4b0a4fe3-5ac5-4e44-842f-1c8f93351837 for instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 on n-h1-851368-1 Jul 28 12:38:48.257416 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7312305b-3c02-42bc-92d3-3727bfc27d37 req-3e3121c4-f0af-4087-a743-7410f034cc1d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036728 Jul 28 12:38:48.258364 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3533/7064] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:38:49.064962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:49.065627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:49.068173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:49.074602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:49.075088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:49.075895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:49.076356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:49.209180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:49.216637 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56761b5e-9980-4a10-9b23-dc12c1b5574e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1362 microversion: 2.1 time: 0.155644 Jul 28 12:38:49.217209 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3532/7065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:49 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:50.238149 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:50.238862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:50.240944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:50.241615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:50.248840 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:50.249293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:50.250104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:50.250545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:50.378925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:50.386431 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-db89723f-64c9-47cb-b3cf-12b4cf1d87b7 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1554 microversion: 2.1 time: 0.152691 Jul 28 12:38:50.387006 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3534/7066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:50 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:50.406582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:38:50.407247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:50.414935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:50.415310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:50.416282 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:50.416772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:50.549395 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:38:50.556827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7b5c0e32-e726-4d32-91ce-83346a8bd238 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1554 microversion: 2.1 time: 0.154100 Jul 28 12:38:50.557418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3533/7067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:38:50 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:38:52.040260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d09330ff-87ea-4d71-872f-45f50775fb3b"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:38:52.042603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:38:52.049466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:52.049937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:52.050831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:38:52.051366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:38:52.213648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:38:52.330149 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34365606-8efb-42a6-9d5d-c048c5de64b3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293704 Jul 28 12:38:52.330909 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3535/7068] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:38:52 2022] POST /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:03.015188 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:03.015702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:03.018016 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:03.018948 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=70 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:03.025652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:03.026118 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:03.026919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:03.027403 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:03.106018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lazy-loading 'services' on Instance uuid 6bfd1122-fc8d-4d07-9544-3f0597c0d994 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:39:03.178861 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d7c1680-cb4a-4fc2-856a-119cb3f03b53 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments/d09330ff-87ea-4d71-872f-45f50775fb3b" status: 202 len: 0 microversion: 2.1 time: 0.167394 Jul 28 12:39:03.179569 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3534/7069] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:39:03 2022] DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments/d09330ff-87ea-4d71-872f-45f50775fb3b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:39:03.190021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:03.194903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:03.200328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:03.201334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:03.211852 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:03.212478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:03.213387 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:03.213902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:03.250840 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-92b8a889-9e89-4bc5-86c7-1f92a3570c20 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065512 Jul 28 12:39:03.251449 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3536/7070] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:03 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:04.265573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:04.268258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:04.274594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:04.275063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:04.276138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:04.276592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:04.309280 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8b90d6c-2cd5-42ad-926f-8327e0b917a4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048922 Jul 28 12:39:04.310057 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3535/7071] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:04 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:05.322166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:05.324377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:05.331765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:05.332227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:05.333019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:05.333465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:05.366012 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1be54008-be02-48a9-8f21-ffa8bc2aa4f5 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 Jul 28 12:39:05.366610 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3537/7072] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:05 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:06.378484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:06.381083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:06.388054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:06.388523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:06.389297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:06.389742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:06.418827 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fba42aa9-8fc8-45dc-8afb-634f67ba5ace tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jul 28 12:39:06.419408 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3536/7073] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:06 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:07.430955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:07.433388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:07.440509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:07.441052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:07.441904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:07.442423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:07.474705 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-69407eb0-92c5-4a15-90ad-3e5ea479c815 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047775 Jul 28 12:39:07.475416 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3538/7074] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:07 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:08.487196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:08.490049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:08.496953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:08.497415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:08.498190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:08.498644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:08.526378 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b690b072-d71d-4158-a119-6bf919250b82 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043198 Jul 28 12:39:08.526930 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3537/7075] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:08 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 12:39:08.538124 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:08.538663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:08.545541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:08.546001 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:08.546774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:08.547251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:08.625048 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 is not attached to volume d09330ff-87ea-4d71-872f-45f50775fb3b Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments/d09330ff-87ea-4d71-872f-45f50775fb3b HTTP/1.1 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 is not attached to volume d09330ff-87ea-4d71-872f-45f50775fb3b Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '6bfd1122-fc8d-4d07-9544-3f0597c0d994', 'id': 'd09330ff-87ea-4d71-872f-45f50775fb3b'} Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d09330ff-87ea-4d71-872f-45f50775fb3b. Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 is not attached to volume d09330ff-87ea-4d71-872f-45f50775fb3b Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:08.626983 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 is not attached to volume d09330ff-87ea-4d71-872f-45f50775fb3b Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 is not attached to volume d09330ff-87ea-4d71-872f-45f50775fb3b {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1d48a52b-1b89-49bf-b8e1-bbe158295b8b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments/d09330ff-87ea-4d71-872f-45f50775fb3b" status: 404 len: 154 microversion: 2.1 time: 0.094878 Jul 28 12:39:08.631541 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3539/7076] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:39:08 2022] DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994/os-volume_attachments/d09330ff-87ea-4d71-872f-45f50775fb3b => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:39:11.968890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:11.969489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:11.976638 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:11.977109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:11.977903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:11.978356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:12.006086 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:39:12.082402 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6c836c85-a4ce-4002-833d-48c7bf407a74 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 204 len: 0 microversion: 2.1 time: 0.117047 Jul 28 12:39:12.083054 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3538/7077] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:39:11 2022] DELETE /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:39:12.091347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:12.091982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:12.098973 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:12.099419 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:12.100192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:12.100631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:12.248671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:12.259479 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b3fe0a5-5bc6-4c0a-9fe8-d15ec38d4443 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1560 microversion: 2.1 time: 0.171994 Jul 28 12:39:12.260150 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3540/7078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:12 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:39:13.281650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:13.282368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:13.289598 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:13.290059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:13.290839 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:13.291319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:13.421601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:13.429646 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0933805a-8508-4872-abb4-fce281649e47 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1560 microversion: 2.1 time: 0.152323 Jul 28 12:39:13.430230 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3539/7079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:13 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:14.286895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1f4a3709-8a79-4790-aae5-c7c897879ce7 req-2df1ff30-1f1a-4510-9c17-55aa855e5e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfd1122-fc8d-4d07-9544-3f0597c0d994", "name": "network-vif-deleted", "tag": "4b0a4fe3-5ac5-4e44-842f-1c8f93351837"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:14.298357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1f4a3709-8a79-4790-aae5-c7c897879ce7 req-2df1ff30-1f1a-4510-9c17-55aa855e5e86 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:14.298807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1f4a3709-8a79-4790-aae5-c7c897879ce7 req-2df1ff30-1f1a-4510-9c17-55aa855e5e86 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:14.312111 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1f4a3709-8a79-4790-aae5-c7c897879ce7 req-2df1ff30-1f1a-4510-9c17-55aa855e5e86 service nova] Creating event network-vif-deleted:4b0a4fe3-5ac5-4e44-842f-1c8f93351837 for instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 on n-h1-851368-1 Jul 28 12:39:14.319274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1f4a3709-8a79-4790-aae5-c7c897879ce7 req-2df1ff30-1f1a-4510-9c17-55aa855e5e86 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Jul 28 12:39:14.319907 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3541/7080] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:14.450601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:14.451175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:14.458730 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:14.459230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:14.460020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:14.460475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:14.491478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:14.491947 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:14.492416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lazy-loading 'fault' on Instance uuid 6bfd1122-fc8d-4d07-9544-3f0597c0d994 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:39:14.536733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:14.544301 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f9de6bbf-f1bf-4a5e-aa2a-9a0baa5e1625 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 200 len: 1352 microversion: 2.1 time: 0.097792 Jul 28 12:39:14.544874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3540/7081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:14 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:39:15.566111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:15.566951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 6bfd1122-fc8d-4d07-9544-3f0597c0d994] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:15.576593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:15.577038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:15.577800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:15.578235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:15.592442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 HTTP/1.1 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '6bfd1122-fc8d-4d07-9544-3f0597c0d994'} Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:15.594058 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 6bfd1122-fc8d-4d07-9544-3f0597c0d994 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0c6ebf6-64ca-4bea-9e6a-ec705da7470d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994" status: 404 len: 111 microversion: 2.1 time: 0.033726 Jul 28 12:39:15.599015 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3542/7082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:15 2022] GET /compute/v2.1/servers/6bfd1122-fc8d-4d07-9544-3f0597c0d994 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:39:15.604941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46918747-d53a-469f-9324-c2a5b7ec700b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '.version_select at 0x7f2eb0070550>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:15.624189 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46918747-d53a-469f-9324-c2a5b7ec700b tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1761468885" status: 202 len: 0 microversion: 2.1 time: 0.023066 Jul 28 12:39:15.624737 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3541/7083] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Jul 28 12:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1761468885 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:39:15.641821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0fba3203-afd6-4396-a47e-5cf7b1e60f9a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: .version_select at 0x7f2eb1b03280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-759917834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUINVoNrQ3QEvKM8j7rPoGFDZFZQkwyaoaskXzADKICHB11YYuTalbME3C3CbLdnGGAJvT3CUKu4PyPuxV1UYwXSwl8CIZIe3I6CK3NMtD6XWUw6wKzlK/tbGJexxpoPQ=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:15.657567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0fba3203-afd6-4396-a47e-5cf7b1e60f9a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:39:15.663281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-0fba3203-afd6-4396-a47e-5cf7b1e60f9a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:39:15.685918 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0fba3203-afd6-4396-a47e-5cf7b1e60f9a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048095 Jul 28 12:39:15.686496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3543/7084] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:39:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:15.736024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-887516548", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-759917834", "networks": [{"uuid": "5ad7fc4e-0acf-464f-bcc8-766d6d63241b"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:15.788366 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] validate_networks() for [('5ad7fc4e-0acf-464f-bcc8-766d6d63241b', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:39:16.154260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:39:16.154719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:39:16.155245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:39:16.155695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:39:16.156146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:39:16.165549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:16.166020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:16.166844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:16.167343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:16.184070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:39:16.189355 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Getting quotas for user 09b3e5295fdb4edca1865bb45709d638 and project e2a38ec9bb1043f19a2aa75d897da00b. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:39:16.202019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:39:16.204359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:39:16.249422 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-96d6f4dc-52f5-476e-a126-2a7c81fcf04d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517558 Jul 28 12:39:16.250074 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3542/7085] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:39:16.261408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eca85337-f9cf-480f-a536-a8aeb8128b5a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:16.262030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eca85337-f9cf-480f-a536-a8aeb8128b5a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:16.317888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eca85337-f9cf-480f-a536-a8aeb8128b5a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:16.325645 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eca85337-f9cf-480f-a536-a8aeb8128b5a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1261 microversion: 2.1 time: 0.068266 Jul 28 12:39:16.326324 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3544/7086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:16 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:17.347278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:17.348659 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:17.356214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:17.356710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:17.357943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:17.358429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:17.431991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:17.439331 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5e86b6f8-c13c-493e-b224-adb6e3b84d6d tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1331 microversion: 2.1 time: 0.097386 Jul 28 12:39:17.439898 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3543/7087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:17 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:18.461955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:18.462600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:18.470893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:18.471969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:18.473397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:18.474069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:18.670217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e8febe32-9a57-4721-afb7-672df8da7044 req-8f2af589-2146-434d-8f74-a6e535f445df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e18e44-fa67-48e5-b85b-a9ef227c9ac1", "tag": "c07e7b67-d5b2-4660-902b-031f2c21deae"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:18.682820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e8febe32-9a57-4721-afb7-672df8da7044 req-8f2af589-2146-434d-8f74-a6e535f445df service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:18.683412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e8febe32-9a57-4721-afb7-672df8da7044 req-8f2af589-2146-434d-8f74-a6e535f445df service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:18.684612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:18.693167 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-51d7f1b3-2fbb-4a41-9008-babb12f06827 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.235983 Jul 28 12:39:18.693752 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3545/7088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:18 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:18.706526 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e8febe32-9a57-4721-afb7-672df8da7044 req-8f2af589-2146-434d-8f74-a6e535f445df service nova] Creating event network-changed:c07e7b67-d5b2-4660-902b-031f2c21deae for instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 on n-h2-851368-1 Jul 28 12:39:18.712631 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e8febe32-9a57-4721-afb7-672df8da7044 req-8f2af589-2146-434d-8f74-a6e535f445df service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048161 Jul 28 12:39:18.713332 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3544/7089] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:39:19.713770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:19.714612 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:19.723689 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:19.724143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:19.724922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:19.725369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:19.853378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:19.861159 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfe66768-22eb-4705-91db-a78abd3a88c2 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.151381 Jul 28 12:39:19.861732 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3546/7090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:19 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:20.883588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:20.884210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:20.890449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:20.890912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:20.891715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:20.892196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:21.025591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:21.033025 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-afb99b4c-7451-4be8-94bc-8f646e0b1150 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.155281 Jul 28 12:39:21.033588 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3545/7091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:20 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:22.052637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:22.053260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:22.060247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:22.060708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:22.061488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:22.061935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:22.190803 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:22.199090 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c685404-f6de-42de-b0b7-c19b30b4c51a tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.150314 Jul 28 12:39:22.199702 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3547/7092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:22 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:23.220556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:23.221121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:23.228081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:23.228548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:23.229336 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:23.229789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:23.269145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-fdff29eb-faa6-4841-9e03-29161e59f68a req-21ff7bd1-905b-46b3-bf04-2a68c76ff8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e18e44-fa67-48e5-b85b-a9ef227c9ac1", "name": "network-vif-plugged", "status": "completed", "tag": "c07e7b67-d5b2-4660-902b-031f2c21deae"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:23.279534 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fdff29eb-faa6-4841-9e03-29161e59f68a req-21ff7bd1-905b-46b3-bf04-2a68c76ff8bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:23.279988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-fdff29eb-faa6-4841-9e03-29161e59f68a req-21ff7bd1-905b-46b3-bf04-2a68c76ff8bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:23.292873 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-fdff29eb-faa6-4841-9e03-29161e59f68a req-21ff7bd1-905b-46b3-bf04-2a68c76ff8bb service nova] Creating event network-vif-plugged:c07e7b67-d5b2-4660-902b-031f2c21deae for instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 on n-h2-851368-1 Jul 28 12:39:23.298294 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-fdff29eb-faa6-4841-9e03-29161e59f68a req-21ff7bd1-905b-46b3-bf04-2a68c76ff8bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Jul 28 12:39:23.298986 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3548/7093] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:39:23.368298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:23.376466 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-544fe4c4-9ef0-448c-a9f8-271ea7380d62 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.159950 Jul 28 12:39:23.377044 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3546/7094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:23 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:24.399369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:24.400084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:24.406311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:24.406770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:24.407574 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:24.408022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:24.537890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:24.547191 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-18a5ec63-94c1-4e7b-a98f-0e34e39946ec tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1361 microversion: 2.1 time: 0.152714 Jul 28 12:39:24.548110 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3549/7095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:24 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:25.569619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:25.570250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:25.577340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:25.577808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:25.578599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:25.579050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:25.716056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:25.724374 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b5f8df89-456b-4e70-98bf-9bda8fc819bc tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1553 microversion: 2.1 time: 0.158765 Jul 28 12:39:25.724957 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3547/7096] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:25 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:25.744675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:25.745293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:25.752248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:25.752703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:25.753503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:25.754436 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:25.884353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:25.891873 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8ba36b3-3c85-4ee1-bca0-fc38375ca1f3 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1553 microversion: 2.1 time: 0.151040 Jul 28 12:39:25.892446 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3550/7097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:25 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:27.385027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81935062-9f6b-459c-b55e-0e8ec5a5de19"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:27.387470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:27.389454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:27.390289 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:27.397356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:27.397820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:27.398602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:27.399056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:27.647394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:27.657055 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93a68f1d-d282-4930-a783-f216d79c386f tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "POST /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275802 Jul 28 12:39:27.657703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3548/7098] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:39:27 2022] POST /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:38.339447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:38.339957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:38.342187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:38.342985 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:38.343924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=66 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:38.350937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:38.351478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:38.352247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:38.352678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:38.434108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lazy-loading 'services' on Instance uuid 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:39:38.507198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7ef90524-cdc3-4cd6-ae70-3a7a9e683d41 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments/81935062-9f6b-459c-b55e-0e8ec5a5de19" status: 202 len: 0 microversion: 2.1 time: 0.171463 Jul 28 12:39:38.507778 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3551/7099] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:39:38 2022] DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments/81935062-9f6b-459c-b55e-0e8ec5a5de19 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:39:38.514222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:39:38.518854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:38.521339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:38.530339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:38.530812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:38.531643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:38.532101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:38.563875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-733791ba-826d-4dc4-b548-59e2b6d03b60 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051446 Jul 28 12:39:38.564444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3549/7100] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:38 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:39.577729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:39.580180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:39.587121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:39.587580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:39.588353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:39.588793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:39.618982 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-11471cc4-136c-44ae-8384-7765d2e10858 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Jul 28 12:39:39.619888 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3552/7101] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:39 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:39:40.631456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:40.633820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:40.640935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:40.641404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:40.642232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:40.642681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:40.674443 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0d056b1e-48a7-4232-88ce-218f134bf749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047038 Jul 28 12:39:40.675300 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3550/7102] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:40 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:41.686120 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:41.688390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:41.697186 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:41.697640 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:41.698424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:41.698867 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:41.729079 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c069cd86-24a8-46f1-87be-0bce92ed817e tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Jul 28 12:39:41.729641 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3553/7103] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:41 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:42.742061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:42.744439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:42.751431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:42.751895 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:42.752749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:42.753211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:42.782766 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abcd9d2e-994a-4742-b9cf-b698213d8aa4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Jul 28 12:39:42.783361 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3551/7104] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:42 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:43.795247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:43.797512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:43.805050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:43.805502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:43.806274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:43.806716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:43.839571 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37de7cb9-2605-405d-ba6b-9d2f35880749 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048349 Jul 28 12:39:43.840139 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3554/7105] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:39:43 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 12:39:43.851240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:43.851744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:43.859208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:43.859699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:43.860470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:43.860925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:43.935410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 is not attached to volume 81935062-9f6b-459c-b55e-0e8ec5a5de19 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: request: DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments/81935062-9f6b-459c-b55e-0e8ec5a5de19 HTTP/1.1 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 is not attached to volume 81935062-9f6b-459c-b55e-0e8ec5a5de19 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'server_id': '36e18e44-fa67-48e5-b85b-a9ef227c9ac1', 'id': '81935062-9f6b-459c-b55e-0e8ec5a5de19'} Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 81935062-9f6b-459c-b55e-0e8ec5a5de19. Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 is not attached to volume 81935062-9f6b-459c-b55e-0e8ec5a5de19 Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:43.937014 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 is not attached to volume 81935062-9f6b-459c-b55e-0e8ec5a5de19 Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 is not attached to volume 81935062-9f6b-459c-b55e-0e8ec5a5de19 {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-98b15407-b10d-4468-8f4b-9360038b3bc4 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments/81935062-9f6b-459c-b55e-0e8ec5a5de19" status: 404 len: 154 microversion: 2.1 time: 0.091899 Jul 28 12:39:43.940888 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3552/7106] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:39:43 2022] DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1/os-volume_attachments/81935062-9f6b-459c-b55e-0e8ec5a5de19 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:39:47.272865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:47.273384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:47.280901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:47.281340 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:47.282116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:47.282553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:47.310316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:39:47.390115 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ec505e2b-ea9f-441d-9a05-1b4038bc9383 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 204 len: 0 microversion: 2.1 time: 0.121326 Jul 28 12:39:47.394861 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3555/7107] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:39:47 2022] DELETE /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:39:47.400066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:47.400691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:47.410443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:47.411501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:47.412288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:47.412775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:47.808787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:47.816225 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a266d036-62c2-4be5-b71a-00a419e2bb31 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1559 microversion: 2.1 time: 0.420067 Jul 28 12:39:47.816777 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3553/7108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:47 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1559 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:39:48.838914 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:48.839592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:48.846669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:48.847155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:48.847932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:48.848993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:48.978277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:48.986204 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-05be464f-12e7-4628-ad94-dc69a93f1ba0 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1559 microversion: 2.1 time: 0.151650 Jul 28 12:39:48.986774 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3556/7109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:48 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:39:49.533967 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-49d9373a-6b67-4bce-9f29-e41f586eb208 req-c2989b6f-0636-4247-a3c8-1b6c1ce9f0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e18e44-fa67-48e5-b85b-a9ef227c9ac1", "name": "network-vif-deleted", "tag": "c07e7b67-d5b2-4660-902b-031f2c21deae"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:39:49.547626 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-49d9373a-6b67-4bce-9f29-e41f586eb208 req-c2989b6f-0636-4247-a3c8-1b6c1ce9f0d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:49.549357 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-49d9373a-6b67-4bce-9f29-e41f586eb208 req-c2989b6f-0636-4247-a3c8-1b6c1ce9f0d0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:49.561003 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-49d9373a-6b67-4bce-9f29-e41f586eb208 req-c2989b6f-0636-4247-a3c8-1b6c1ce9f0d0 service nova] Creating event network-vif-deleted:c07e7b67-d5b2-4660-902b-031f2c21deae for instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 on n-h2-851368-1 Jul 28 12:39:49.566432 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-49d9373a-6b67-4bce-9f29-e41f586eb208 req-c2989b6f-0636-4247-a3c8-1b6c1ce9f0d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Jul 28 12:39:49.567632 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3554/7110] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:39:50.007090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:50.007706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:50.014816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:50.015300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:50.016069 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:50.016509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:50.050408 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:50.050855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:50.052013 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lazy-loading 'fault' on Instance uuid 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:39:50.093825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b3e5295fdb4edca1865bb45709d638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a38ec9bb1043f19a2aa75d897da00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:39:50.101472 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5e64798-8df9-4416-aa81-dcc7290b2233 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 200 len: 1351 microversion: 2.1 time: 0.098384 Jul 28 12:39:50.102053 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3557/7111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:50 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:39:51.124208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:51.124958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] [instance: 36e18e44-fa67-48e5-b85b-a9ef227c9ac1] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:39:51.131819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:51.132286 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:51.133063 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:39:51.133518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:39:51.146386 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] HTTP exception thrown: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Request method failure captured: Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 HTTP/1.1 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oMgVW1QkL7zR2vMqjb6ktLOox7fO0PVKSmWunaceWVlYj3HBJ1SUgsGibRiyPi3jK46RXj1tgEaIOjzDrpQj9kb0m7973DDEK18p0UDODoKaP4rKyEUlqnbIXliY5XhlKwjlyiuFqtme98-pWV_iRR_V7_haqLkCII1zpE_NWRGuSM Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2a38ec9bb1043f19a2aa75d897da00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2a38ec9bb1043f19a2aa75d897da00b"}]}] Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: e2a38ec9bb1043f19a2aa75d897da00b Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1968297460 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 09b3e5295fdb4edca1865bb45709d638 Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestEncryptedCinderVolumes-1968297460-project Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '36e18e44-fa67-48e5-b85b-a9ef227c9ac1'} Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:39:51.148027 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Returning 404 to user: Instance 36e18e44-fa67-48e5-b85b-a9ef227c9ac1 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e6c43aeb-b9f9-4b2c-96be-a82c6d000e44 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1" status: 404 len: 111 microversion: 2.1 time: 0.030543 Jul 28 12:39:51.154874 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3555/7112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:39:51 2022] GET /compute/v2.1/servers/36e18e44-fa67-48e5-b85b-a9ef227c9ac1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:39:51.158189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1f337d22-84f2-4451-b9a3-3d2a09494533 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] Calling method '.version_select at 0x7f2ebbea9280>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:39:51.179978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1f337d22-84f2-4451-b9a3-3d2a09494533 tempest-TestEncryptedCinderVolumes-1968297460 tempest-TestEncryptedCinderVolumes-1968297460-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-759917834" status: 202 len: 0 microversion: 2.1 time: 0.024150 Jul 28 12:39:51.179978 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3558/7113] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Jul 28 12:39:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-759917834 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:40:18.275633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-82a21f40-c390-4ed0-a148-c4a549ab5891 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: .version_select at 0x7f2eb007aaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1324166618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxNY9gF3/2Fumm9NtfiTy7os8H5fqqlz7PZPLaGF4dPfG1jL95CGfOIvIz6DP9obaRyUGi5JLwUjKp0cKxXNffWNn7KpF3kVZRwept6Z/YsDohMcPQl05uh12I8JyeUQg=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:18.281023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=14 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:18.281693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=34 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:18.294140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-82a21f40-c390-4ed0-a148-c4a549ab5891 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for project 39357a60cd5745418569284c2eb44197. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:40:18.299180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-82a21f40-c390-4ed0-a148-c4a549ab5891 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for user e253cd75d76944828f7cddc4c76eafdb and project 39357a60cd5745418569284c2eb44197. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:40:18.321699 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-82a21f40-c390-4ed0-a148-c4a549ab5891 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050289 Jul 28 12:40:18.322279 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3556/7114] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:40:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:40:18.369683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:18.370443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:18.374991 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1090571289", "imageRef": "d49d8e83-6c90-4e72-b513-aed7a58ef84f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1324166618", "networks": [{"uuid": "51fd5111-b5c1-4e28-a051-1e1356ae0b27"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:18.429958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] validate_networks() for [('51fd5111-b5c1-4e28-a051-1e1356ae0b27', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:40:18.797882 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:40:18.798595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:40:18.798826 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:40:18.799348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:40:18.799745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:40:18.809747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:18.810239 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:18.811115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:18.811565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:18.830761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for project 39357a60cd5745418569284c2eb44197. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:40:18.836035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for user e253cd75d76944828f7cddc4c76eafdb and project 39357a60cd5745418569284c2eb44197. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:40:18.848280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:40:18.850497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d49d8e83-6c90-4e72-b513-aed7a58ef84f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:40:18.895320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe9d65a1-a31e-4c33-ae6b-4fbe54eec1d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527776 Jul 28 12:40:18.895980 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3559/7115] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:40:18.906727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6621e25-c4f1-434d-a8be-ad2224ed1f1e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:18.907488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6621e25-c4f1-434d-a8be-ad2224ed1f1e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:18.967131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6621e25-c4f1-434d-a8be-ad2224ed1f1e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:18.975667 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6621e25-c4f1-434d-a8be-ad2224ed1f1e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1259 microversion: 2.1 time: 0.072933 Jul 28 12:40:18.976316 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3557/7116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:18 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:19.997832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:19.998452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:20.006310 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:20.006566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:20.007569 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:20.007863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:20.074622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:20.082446 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22124cf8-e45e-4952-bd8e-fa73f6ced63a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1317 microversion: 2.1 time: 0.089388 Jul 28 12:40:20.083011 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3560/7117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:19 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1317 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:21.106294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:21.107105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:21.122317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:21.122781 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:21.123620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:21.124069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:21.291890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:21.300442 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d8341f9-bf74-45a7-a929-652ee01579de tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.199894 Jul 28 12:40:21.301610 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3558/7118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:21 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:22.323633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:22.324614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:22.331412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:22.331919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:22.332708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:22.333180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:22.486295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:22.495372 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eea06ff2-1f08-4201-873c-3d544b88f464 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.176006 Jul 28 12:40:22.496202 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3561/7119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:22 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:23.516928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:23.517702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:23.525419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:23.525884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:23.526674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:23.527146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:23.663253 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:23.671026 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-20d46491-0c4d-4598-84d5-00b698c6ff3b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.157889 Jul 28 12:40:23.671629 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3559/7120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:23 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:24.692975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:24.694755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:24.702479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:24.703280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:24.704466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:24.704902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:24.842757 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:24.850353 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6963f496-174a-4fbe-bd13-f8ae977a8b64 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.162444 Jul 28 12:40:24.850931 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3562/7121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:24 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:25.872121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:25.873758 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:25.881779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:25.882338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:25.883272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:25.883801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:26.041144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:26.049247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6fc34ef5-162a-4d59-b631-e1c57d9c01bb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.181346 Jul 28 12:40:26.050565 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3560/7122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:25 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:27.072097 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:27.072764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:27.079824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:27.080288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:27.081091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:27.082055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:27.224497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:27.232182 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-811bbe0c-f6b3-4a77-a56f-a7ffc7f83f02 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.163974 Jul 28 12:40:27.233040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3563/7123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:27 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:28.253302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:28.253880 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:28.261202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:28.261663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:28.262440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:28.262894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:28.393215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:28.401116 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df9ac165-867a-43ca-914f-47c109616cc4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.151924 Jul 28 12:40:28.401690 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3561/7124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:28 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:29.422241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:29.422854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:29.425563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:29.426380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:29.432104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:29.432557 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:29.433326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:29.433763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:29.572948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:29.580891 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-400f0f2e-d527-4138-9a55-5be1ffe35c6b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.162503 Jul 28 12:40:29.582117 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3564/7125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:29 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:30.602192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:30.602735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:30.604631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:30.610576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:30.611047 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:30.611860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:30.612319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:30.740334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:30.747841 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e0ce970-26ac-4fa6-9353-d2506e6ccf0f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.150616 Jul 28 12:40:30.748443 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3562/7126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:30 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:31.768702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:31.769357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:31.775660 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:31.776119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:31.776892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:31.777344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:31.903224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:31.911218 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aeaaaeb6-de3c-4244-ae2b-f9747ee69c18 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.146549 Jul 28 12:40:31.911806 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3565/7127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:31 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:32.679129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-10df0b3b-6ce9-49d4-910a-016fd52bf5fd req-9a1e2fa1-5d09-4749-ac57-61bec79d94f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:32.691393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10df0b3b-6ce9-49d4-910a-016fd52bf5fd req-9a1e2fa1-5d09-4749-ac57-61bec79d94f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:32.691858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-10df0b3b-6ce9-49d4-910a-016fd52bf5fd req-9a1e2fa1-5d09-4749-ac57-61bec79d94f7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:32.710603 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-10df0b3b-6ce9-49d4-910a-016fd52bf5fd req-9a1e2fa1-5d09-4749-ac57-61bec79d94f7 service nova] Creating event network-changed:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:40:32.715826 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-10df0b3b-6ce9-49d4-910a-016fd52bf5fd req-9a1e2fa1-5d09-4749-ac57-61bec79d94f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041722 Jul 28 12:40:32.716531 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3563/7128] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:40:32.931834 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:32.932457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:32.939401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:32.939855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:32.940789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:32.941564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:33.198296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:33.205851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c5a7beb0-0af1-4354-9d84-c5f1818ebdaf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.278086 Jul 28 12:40:33.207122 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3566/7129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:32 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:34.228908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:34.229539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:34.236133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:34.236620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:34.237997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:34.238465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:34.418178 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:34.425757 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-093d4a17-d286-4089-acef-7c4e40d77c06 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.202013 Jul 28 12:40:34.426317 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3564/7130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:34 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:35.447225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:35.447891 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:35.455174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:35.455631 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:35.456428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:35.456866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:35.593512 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:35.601813 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e869d527-5579-402a-aaea-fafd45642d89 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.158968 Jul 28 12:40:35.602408 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3567/7131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:35 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:36.623052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:36.624279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:36.631468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:36.631929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:36.632705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:36.633155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:36.766648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:36.774553 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4bef20e-442c-44ce-9f65-fa249cea06f7 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.155365 Jul 28 12:40:36.775129 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3565/7132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:36 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:37.794979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:37.795630 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:37.802572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:37.803025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:37.803824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:37.804264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:37.933019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:37.941011 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-824a785a-cc75-4305-989f-4be56ef5d544 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.149470 Jul 28 12:40:37.941583 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3568/7133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:37 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:38.961556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:38.962191 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:38.969377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:38.970362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:38.970628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:38.971107 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:39.099137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:39.106583 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-22df6981-0db7-43d1-a99f-8634f9753261 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.149012 Jul 28 12:40:39.107166 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3566/7134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:38 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:40.127384 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:40.128009 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:40.135064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:40.135551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:40.136321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:40.136800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:40.263425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:40.270874 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d4a97d3b-2a2d-47c9-93f4-d684bf68d4cb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.147472 Jul 28 12:40:40.271482 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3569/7135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:40 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:40.747802 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-753dc149-64a8-423c-bc22-b8fbc1693cb2 req-40cd6dcf-f775-4126-876c-5aa9c38ad148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "name": "network-vif-plugged", "status": "completed", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:40.759025 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-753dc149-64a8-423c-bc22-b8fbc1693cb2 req-40cd6dcf-f775-4126-876c-5aa9c38ad148 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:40.759520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-753dc149-64a8-423c-bc22-b8fbc1693cb2 req-40cd6dcf-f775-4126-876c-5aa9c38ad148 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:40.771527 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-753dc149-64a8-423c-bc22-b8fbc1693cb2 req-40cd6dcf-f775-4126-876c-5aa9c38ad148 service nova] Creating event network-vif-plugged:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:40:40.776555 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-753dc149-64a8-423c-bc22-b8fbc1693cb2 req-40cd6dcf-f775-4126-876c-5aa9c38ad148 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033016 Jul 28 12:40:40.777323 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3567/7136] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:40:41.291847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:41.292500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:41.299413 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:41.299868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:41.301146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:41.301586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:41.438932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:41.446574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a3f520d-28de-4398-afce-1cf7470d722b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1359 microversion: 2.1 time: 0.158658 Jul 28 12:40:41.447174 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3570/7137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:41 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:42.468069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:42.468784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:42.475460 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.475940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.476741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.477547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.606796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:42.615115 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c4c4d746-6cc9-4daa-84bd-1e530cb59440 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1548 microversion: 2.1 time: 0.152112 Jul 28 12:40:42.615701 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3568/7138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:42 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:42.635400 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:42.636020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:42.643220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.643698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.644488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.644935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.782244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:42.789785 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39565ebb-7099-4091-88e6-2efcdd8c59f6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1548 microversion: 2.1 time: 0.158329 Jul 28 12:40:42.790367 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3571/7139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:42 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:42.810376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:42.814962 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:42.816418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Searching by: {'deleted': False, 'project_id': '39357a60cd5745418569284c2eb44197'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 12:40:42.821777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.822245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.823104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.823565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.849211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 12:40:42.875731 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfca0faa-1b73-47e1-9612-d8128a328890 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069253 Jul 28 12:40:42.876312 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3569/7140] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 12:40:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:40:42.887965 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:42.888750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:42.894718 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.895202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:42.895964 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:42.896397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:43.028646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:43.036651 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d176508f-64a3-464a-857f-27c41165928f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1548 microversion: 2.1 time: 0.152507 Jul 28 12:40:43.037225 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3572/7141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:42 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:44.571233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b15c16ea-bd94-4e54-9d87-35f2906e76a4"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:44.573552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:44.580306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:44.580767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:44.581575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:44.582028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:44.836195 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6178723-9cc7-4530-80ff-3f5afd680e2b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268502 Jul 28 12:40:44.836985 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3570/7142] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:40:44 2022] POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:40:57.849897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:40:57.850575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:40:57.853475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:57.854274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=80 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:57.860260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:57.860711 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:57.861469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:57.861902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:57.990231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:40:57.998426 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d858a31c-9048-4a2f-b499-1899fced566d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1594 microversion: 2.1 time: 0.152293 Jul 28 12:40:57.998940 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3573/7143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:40:57 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:40:59.961701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-31723a6f-8557-4d0c-92ef-d145825333e1 req-5bbf7486-08be-4eec-ad3a-d67f4bf2bae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:40:59.971443 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:59.971642 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:59.974853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:40:59.982754 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-31723a6f-8557-4d0c-92ef-d145825333e1 req-5bbf7486-08be-4eec-ad3a-d67f4bf2bae2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:40:59.983759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-31723a6f-8557-4d0c-92ef-d145825333e1 req-5bbf7486-08be-4eec-ad3a-d67f4bf2bae2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:40:59.998871 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-31723a6f-8557-4d0c-92ef-d145825333e1 req-5bbf7486-08be-4eec-ad3a-d67f4bf2bae2 service nova] Creating event network-changed:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:41:00.005639 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-31723a6f-8557-4d0c-92ef-d145825333e1 req-5bbf7486-08be-4eec-ad3a-d67f4bf2bae2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054179 Jul 28 12:41:00.006257 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3571/7144] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:41:00.989761 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1223069961"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:41:00.990308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:41:00.996923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:41:00.997421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:41:00.998203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:41:00.998641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:41:01.130487 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Adding security group 99d1bdd2-1602-4386-aad1-ff545f43b22e to port 51893d33-c34b-460d-8b1c-78754dcb1648 Jul 28 12:41:01.474557 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-30fe6747-9ee1-49e4-9003-d1360011c81b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action" status: 202 len: 0 microversion: 2.1 time: 0.489341 Jul 28 12:41:01.478429 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3574/7145] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:41:00 2022] POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:41:01.493617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:41:01.494273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:41:01.500998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:41:01.501447 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:41:01.502220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:41:01.502856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:41:01.571554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-21e14638-b712-4f44-a092-bb7bd3662a24 req-e1343d64-d295-4d2c-b5a0-3645851123e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:41:01.582826 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-21e14638-b712-4f44-a092-bb7bd3662a24 req-e1343d64-d295-4d2c-b5a0-3645851123e5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:41:01.583682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-21e14638-b712-4f44-a092-bb7bd3662a24 req-e1343d64-d295-4d2c-b5a0-3645851123e5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:41:01.598032 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-21e14638-b712-4f44-a092-bb7bd3662a24 req-e1343d64-d295-4d2c-b5a0-3645851123e5 service nova] Creating event network-changed:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:41:01.612133 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-21e14638-b712-4f44-a092-bb7bd3662a24 req-e1343d64-d295-4d2c-b5a0-3645851123e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132426 Jul 28 12:41:01.613486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3572/7146] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:41:01.687357 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:41:01.700755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a3af7c1d-eb1a-4dc6-bc8c-807c6e154ff1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1760 microversion: 2.1 time: 0.214948 Jul 28 12:41:01.701363 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3575/7147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:41:01 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1760 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:42:05.882711 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:42:05.883445 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:43:11.577782 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:43:11.578391 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:43:13.661728 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:43:13.662198 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:43:14.297539 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 12:43:14.298384 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:43:14.298950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:43:14.299737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:43:14.304735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:43:14.307471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:43:14.315206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:14.315691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:14.316480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:14.316940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:14.388541 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-73f3e9f2-b248-4d3b-9a57-65811879c7a9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action" status: 202 len: 0 microversion: 2.1 time: 0.093275 Jul 28 12:43:14.391820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3573/7148] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:43:14 2022] POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:43:14.395512 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:43:14.396661 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:43:14.397168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:43:14.397912 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:43:14.402438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:43:14.403056 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:43:14.409933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:14.410383 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:14.411182 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:14.411619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:14.559742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:43:14.568073 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1dfcdc8d-d7d8-4593-90c9-62cf7011d9cd tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1762 microversion: 2.1 time: 0.174485 Jul 28 12:43:14.568650 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3576/7149] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:43:14 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1762 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:43:15.593678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:43:15.595368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:43:15.604501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:15.604976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:15.605774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:43:15.606232 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:43:15.613685 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 41984. Jul 28 12:43:15.625281 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 41986. Jul 28 12:43:15.757019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:43:15.765114 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-636873c3-4070-4eeb-a1aa-0790fd86f9c4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1760 microversion: 2.1 time: 0.179199 Jul 28 12:43:15.765683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3574/7150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:43:15 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:44:51.678115 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:44:51.678836 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:44:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:44:59.639256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:44:59.640014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:44:59.644600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1223069961"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:44:59.645144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:44:59.654874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:44:59.655347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:44:59.656105 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:44:59.656537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:44:59.660100 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42030. Jul 28 12:44:59.663631 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42032. Jul 28 12:44:59.789033 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Removing security group 99d1bdd2-1602-4386-aad1-ff545f43b22e from port 51893d33-c34b-460d-8b1c-78754dcb1648 Jul 28 12:45:00.127900 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cd5c59e5-d029-4370-a95d-a185c973e072 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action" status: 202 len: 0 microversion: 2.1 time: 0.491579 Jul 28 12:45:00.137417 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3577/7151] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:44:59 2022] POST /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:45:00.140415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:00.147510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:00.155136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-15cce057-637f-45b7-a7a0-6ec107a88104 req-96797885-8acd-4cba-9fe0-b7098259c385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:00.178101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15cce057-637f-45b7-a7a0-6ec107a88104 req-96797885-8acd-4cba-9fe0-b7098259c385 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:00.179124 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-15cce057-637f-45b7-a7a0-6ec107a88104 req-96797885-8acd-4cba-9fe0-b7098259c385 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:00.213090 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-15cce057-637f-45b7-a7a0-6ec107a88104 req-96797885-8acd-4cba-9fe0-b7098259c385 service nova] Creating event network-changed:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:45:00.220837 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-15cce057-637f-45b7-a7a0-6ec107a88104 req-96797885-8acd-4cba-9fe0-b7098259c385 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082049 Jul 28 12:45:00.222137 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3575/7152] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:01.654201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:01.654728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:01.660892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:01.661345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:01.662112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:01.662553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:01.764521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lazy-loading 'services' on Instance uuid 50a4ab95-3516-4ad4-a49c-d71405f0d691 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:45:01.840215 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-474e49f1-1185-4ab4-a04d-f913a729170e tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments/b15c16ea-bd94-4e54-9d87-35f2906e76a4" status: 202 len: 0 microversion: 2.1 time: 0.190751 Jul 28 12:45:01.840926 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3578/7153] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:45:01 2022] DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments/b15c16ea-bd94-4e54-9d87-35f2906e76a4 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:45:01.851192 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:01.853956 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:01.865717 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:01.866194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:01.866996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:01.867481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:01.903172 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ab74203b-652a-4e14-96a3-c96ca37eebdb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056875 Jul 28 12:45:01.903743 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3576/7154] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:01 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:45:02.236817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e81c1411-c9d8-49c1-9698-230cdc60bce6 req-d173d4b9-e7ff-4fbd-9f69-5bad15bdfb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:02.247249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e81c1411-c9d8-49c1-9698-230cdc60bce6 req-d173d4b9-e7ff-4fbd-9f69-5bad15bdfb66 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:02.247703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e81c1411-c9d8-49c1-9698-230cdc60bce6 req-d173d4b9-e7ff-4fbd-9f69-5bad15bdfb66 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:02.260112 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e81c1411-c9d8-49c1-9698-230cdc60bce6 req-d173d4b9-e7ff-4fbd-9f69-5bad15bdfb66 service nova] Creating event network-changed:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:45:02.265743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e81c1411-c9d8-49c1-9698-230cdc60bce6 req-d173d4b9-e7ff-4fbd-9f69-5bad15bdfb66 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 Jul 28 12:45:02.266347 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3579/7155] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:45:02.915411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:02.918249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:02.925083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:02.925545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:02.926322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:02.926773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:02.955133 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-459d3a5b-c36c-4d31-93ff-9f756dd46d46 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Jul 28 12:45:02.955901 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3577/7156] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:02 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:03.975324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:03.978355 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:03.987328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:03.987783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:03.988758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:03.989665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:04.026956 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-88f2c1b2-3b3b-4a41-8d3b-6fdf85267f6a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063099 Jul 28 12:45:04.028646 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3580/7157] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:03 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:05.040624 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:05.042909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:05.052716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:05.053196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:05.054004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:05.054819 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:05.088806 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-51eea2f1-74fd-42c3-b4a1-8235a0b3f098 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052257 Jul 28 12:45:05.089280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3578/7158] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:05 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:06.101265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:06.103519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:06.110798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:06.111288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:06.112067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:06.112506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:06.142387 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37b5933d-2a24-46b9-8c4c-b305108771ce tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Jul 28 12:45:06.142950 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3581/7159] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:06 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:07.155586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:07.157791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:07.164713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:07.165184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:07.165976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:07.166429 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:07.195606 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8ed848d4-7ffa-40d9-ac2e-a7e76462b6c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044817 Jul 28 12:45:07.196251 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3579/7160] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:45:07 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 12:45:07.207300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:07.207796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:07.215537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:07.215995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:07.216772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:07.217214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:07.299546 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] HTTP exception thrown: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 is not attached to volume b15c16ea-bd94-4e54-9d87-35f2906e76a4 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Request method failure captured: Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments/b15c16ea-bd94-4e54-9d87-35f2906e76a4 HTTP/1.1 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oOjYWSnkNBOIphIcsxa9ndsDAiyczIrIDqi3Q_G_reC8cu57oEBJTcgEpmNBz4FCj4hvKutlvJx0P0HL6dSdkLLV26su1dK8pXQIGWcZ1uNON9QMEV74lzVnOPxrm-wg7Ai5dv8ywHH1CRwjnuCN9MXbbmFOhBxAur8VdM2PYR0erY Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39357a60cd5745418569284c2eb44197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39357a60cd5745418569284c2eb44197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}] Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e253cd75d76944828f7cddc4c76eafdb Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 is not attached to volume b15c16ea-bd94-4e54-9d87-35f2906e76a4 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '50a4ab95-3516-4ad4-a49c-d71405f0d691', 'id': 'b15c16ea-bd94-4e54-9d87-35f2906e76a4'} Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b15c16ea-bd94-4e54-9d87-35f2906e76a4. Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 is not attached to volume b15c16ea-bd94-4e54-9d87-35f2906e76a4 Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:45:07.301161 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 is not attached to volume b15c16ea-bd94-4e54-9d87-35f2906e76a4 Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Returning 404 to user: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 is not attached to volume b15c16ea-bd94-4e54-9d87-35f2906e76a4 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a08a21be-32b3-4943-9b7f-f09ab8820c90 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments/b15c16ea-bd94-4e54-9d87-35f2906e76a4" status: 404 len: 154 microversion: 2.1 time: 0.099596 Jul 28 12:45:07.305798 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3582/7161] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:45:07 2022] DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691/os-volume_attachments/b15c16ea-bd94-4e54-9d87-35f2906e76a4 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:45:10.686306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:10.686838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:10.694223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:10.694703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:10.695533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:10.695998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:10.724211 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:45:10.801504 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d7153dd9-137f-4cd3-8dc2-f6a9c170a52d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 204 len: 0 microversion: 2.1 time: 0.119234 Jul 28 12:45:10.802345 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3580/7162] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:45:10 2022] DELETE /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:45:10.811484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:10.812094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:10.820168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:10.820624 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:10.821398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:10.821844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:10.954820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:10.962910 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe6574f7-c29a-4c40-926a-fa61fcc83522 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1554 microversion: 2.1 time: 0.155475 Jul 28 12:45:10.964795 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3583/7163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:10 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:11.987525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:11.988250 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:11.995896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:11.996369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:11.997155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:11.997612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:12.126386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:12.134162 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-010df7f7-028e-4778-bffa-d665dfb5ea19 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1554 microversion: 2.1 time: 0.151344 Jul 28 12:45:12.134733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3581/7164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:11 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:13.155343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:13.156202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:13.164869 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:13.165560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:13.166645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:13.167940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:13.196315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e513e97a-04b3-4391-b6f5-998b2495ff8d req-020063a5-eb4b-4dd8-8572-af02978f0610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4ab95-3516-4ad4-a49c-d71405f0d691", "name": "network-vif-deleted", "tag": "51893d33-c34b-460d-8b1c-78754dcb1648"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:13.204635 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:13.205408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:13.206082 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lazy-loading 'fault' on Instance uuid 50a4ab95-3516-4ad4-a49c-d71405f0d691 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:45:13.206422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e513e97a-04b3-4391-b6f5-998b2495ff8d req-020063a5-eb4b-4dd8-8572-af02978f0610 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:13.206926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e513e97a-04b3-4391-b6f5-998b2495ff8d req-020063a5-eb4b-4dd8-8572-af02978f0610 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:13.222846 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e513e97a-04b3-4391-b6f5-998b2495ff8d req-020063a5-eb4b-4dd8-8572-af02978f0610 service nova] Creating event network-vif-deleted:51893d33-c34b-460d-8b1c-78754dcb1648 for instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 on n-h1-851368-1 Jul 28 12:45:13.228369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e513e97a-04b3-4391-b6f5-998b2495ff8d req-020063a5-eb4b-4dd8-8572-af02978f0610 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149843 Jul 28 12:45:13.229082 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3584/7165] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:13.252953 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:13.260590 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e95f369d-2747-430a-8a0b-c2d78d54db5a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 200 len: 1349 microversion: 2.1 time: 0.109469 Jul 28 12:45:13.261815 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3582/7166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:13 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:45:14.284093 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:14.284715 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 50a4ab95-3516-4ad4-a49c-d71405f0d691] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:14.292837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:14.293306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:14.294079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:14.294516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:14.307787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] HTTP exception thrown: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Request method failure captured: Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 HTTP/1.1 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oOjYWSnkNBOIphIcsxa9ndsDAiyczIrIDqi3Q_G_reC8cu57oEBJTcgEpmNBz4FCj4hvKutlvJx0P0HL6dSdkLLV26su1dK8pXQIGWcZ1uNON9QMEV74lzVnOPxrm-wg7Ai5dv8ywHH1CRwjnuCN9MXbbmFOhBxAur8VdM2PYR0erY Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39357a60cd5745418569284c2eb44197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39357a60cd5745418569284c2eb44197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}] Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e253cd75d76944828f7cddc4c76eafdb Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '50a4ab95-3516-4ad4-a49c-d71405f0d691'} Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:45:14.309403 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Returning 404 to user: Instance 50a4ab95-3516-4ad4-a49c-d71405f0d691 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f1db65ea-0361-481f-b1ab-ae9c0393c6c1 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691" status: 404 len: 111 microversion: 2.1 time: 0.031481 Jul 28 12:45:14.313978 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3585/7167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:14 2022] GET /compute/v2.1/servers/50a4ab95-3516-4ad4-a49c-d71405f0d691 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:45:14.319442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4764eb15-a14d-4652-9720-8dec6da63eb0 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '.version_select at 0x7f2ebbee6d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:14.343389 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4764eb15-a14d-4652-9720-8dec6da63eb0 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1324166618" status: 202 len: 0 microversion: 2.1 time: 0.027620 Jul 28 12:45:14.344033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3583/7168] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Jul 28 12:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1324166618 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:45:23.183211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: .version_select at 0x7f2eb314b940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-876191666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEDUawvGo/FlSrPMY222bujPBq4h6VFMh2DzOjISRbuD54oGxXI6LIWpXpw3UDRjHSaKJSTgqqIwJKJowyQl9EVy1yvNbFs4673nW/NqzO1LXRmJQNkRQ914zTfpa98dA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:23.202231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for project 39357a60cd5745418569284c2eb44197. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:45:23.210094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for user e253cd75d76944828f7cddc4c76eafdb and project 39357a60cd5745418569284c2eb44197. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:45:23.223632 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [e7c4b8a2-1dc5-4070-a163-1f98b998c1fe] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:45:24.230019 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [e7c4b8a2-1dc5-4070-a163-1f98b998c1fe] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42190. Jul 28 12:45:24.244966 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e33943f3-bcd8-489d-a7ff-6d1c24d7e992 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.066206 Jul 28 12:45:24.245566 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3586/7169] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:45:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:24.292867 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:24.297866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-729926953", "imageRef": "dd341da9-6fe6-4de0-aa81-cb832dec15c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-876191666", "networks": [{"uuid": "51fd5111-b5c1-4e28-a051-1e1356ae0b27"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:24.350129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] validate_networks() for [('51fd5111-b5c1-4e28-a051-1e1356ae0b27', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:45:25.122349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:45:25.122796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:45:25.123337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:45:25.123765 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:45:25.124199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:45:25.133134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:25.133600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:25.134419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:25.134873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:25.152426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for project 39357a60cd5745418569284c2eb44197. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:45:25.157580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Getting quotas for user e253cd75d76944828f7cddc4c76eafdb and project 39357a60cd5745418569284c2eb44197. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:45:25.170056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:45:25.172330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd341da9-6fe6-4de0-aa81-cb832dec15c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:45:25.218679 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3464ece7-bc57-48ca-854a-8a7ab105c09a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927754 Jul 28 12:45:25.219418 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3584/7170] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:45:25.227283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:25.232462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3acc369c-cbfd-43fa-af92-8ac72ee53788 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:25.235058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3acc369c-cbfd-43fa-af92-8ac72ee53788 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:25.292950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3acc369c-cbfd-43fa-af92-8ac72ee53788 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:25.299789 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3acc369c-cbfd-43fa-af92-8ac72ee53788 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1257 microversion: 2.1 time: 0.073634 Jul 28 12:45:25.300353 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3587/7171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:25 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:26.321658 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:26.322293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:26.329470 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:26.329954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:26.330797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:26.331290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:26.431321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:26.439267 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2d7ab3fc-bcc5-4268-a6a8-39803a5d19a2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1327 microversion: 2.1 time: 0.122426 Jul 28 12:45:26.440037 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3585/7172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:26 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:27.461018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:27.461836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:27.469831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:27.470372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:27.471441 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:27.471954 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:27.613361 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:27.622854 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c7070060-66f2-4874-ad10-f36ef661b26d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.165689 Jul 28 12:45:27.623857 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3588/7173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:27 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:28.645710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:28.646328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:28.655437 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:28.655914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:28.656723 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:28.657334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:28.801313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:28.809788 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-48f0ec23-a70b-4746-b827-2b1b7c5831df tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.168585 Jul 28 12:45:28.825465 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3586/7174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:28 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:29.830012 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:29.830632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:29.832688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:29.838728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:29.839232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:29.840635 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:29.841189 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:29.987045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:29.995308 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e8397892-b53a-4b43-b447-cfb0eda33d96 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.169291 Jul 28 12:45:29.995947 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3589/7175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:29 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:31.017020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:31.017655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:31.025214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:31.025522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:31.026296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:31.026785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:31.174634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:31.182529 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9f007675-7e86-4d64-8175-966a85f6e950 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.169357 Jul 28 12:45:31.183706 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3587/7176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:31 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:32.205213 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:32.206558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:32.213865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:32.214359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:32.215218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:32.215742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:32.374960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:32.383827 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-804a5a8d-5588-4823-8b8b-3a4b6ec31ee5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.182790 Jul 28 12:45:32.384422 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3590/7177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:32 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:33.404570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:33.405938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:33.408985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:33.414779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:33.415599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:33.416712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:33.417889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:33.586013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:33.613093 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d7a38e5-6918-46dd-bef2-5ae3f1840232 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.212298 Jul 28 12:45:33.614521 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3588/7178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:33 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:34.639396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:34.640049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:34.647052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:34.647536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:34.648324 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:34.648771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:34.951343 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:34.959040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-41825517-d06c-4543-9bd8-4a981a996cf2 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.324207 Jul 28 12:45:34.959672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3591/7179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:34 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:35.065542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-21241b0e-bfac-4c48-aeb7-08d318257d93 req-b20125d2-c348-402a-a1a8-4efd00e8634e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:35.077714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-21241b0e-bfac-4c48-aeb7-08d318257d93 req-b20125d2-c348-402a-a1a8-4efd00e8634e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:35.078195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-21241b0e-bfac-4c48-aeb7-08d318257d93 req-b20125d2-c348-402a-a1a8-4efd00e8634e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:35.098198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-21241b0e-bfac-4c48-aeb7-08d318257d93 req-b20125d2-c348-402a-a1a8-4efd00e8634e service nova] Creating event network-changed:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:45:35.104576 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-21241b0e-bfac-4c48-aeb7-08d318257d93 req-b20125d2-c348-402a-a1a8-4efd00e8634e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043256 Jul 28 12:45:35.106051 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3589/7180] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:45:35.980156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:35.980781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:35.982672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:35.989007 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:35.989521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:35.990291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:35.990728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:36.116755 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:36.124787 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e2f3335-9ff1-4f06-a225-ebdfe40244e6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.148562 Jul 28 12:45:36.125360 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3592/7181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:35 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:37.143151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:37.144045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:37.149639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:37.150396 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:37.157959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:37.158438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:37.159275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:37.159738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:37.341449 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:37.349150 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-58834913-4cb9-4ce4-bc7a-a8bfa5847ba5 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.206979 Jul 28 12:45:37.349757 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3590/7182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:37 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:38.370095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:38.371159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:38.378049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:38.378499 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:38.379287 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:38.379723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:38.511032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:38.518594 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-afefb70c-0f57-4b1d-b24c-7116a3615925 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.152471 Jul 28 12:45:38.519194 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3593/7183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:38 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:39.224582 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0465090b-e3c3-4b52-a15e-867f7a2331eb req-af4a0a5a-2a3c-4423-9d34-c33bd0439130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "name": "network-vif-plugged", "status": "completed", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:39.234903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0465090b-e3c3-4b52-a15e-867f7a2331eb req-af4a0a5a-2a3c-4423-9d34-c33bd0439130 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:39.235416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0465090b-e3c3-4b52-a15e-867f7a2331eb req-af4a0a5a-2a3c-4423-9d34-c33bd0439130 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:39.249100 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0465090b-e3c3-4b52-a15e-867f7a2331eb req-af4a0a5a-2a3c-4423-9d34-c33bd0439130 service nova] Creating event network-vif-plugged:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:45:39.254203 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0465090b-e3c3-4b52-a15e-867f7a2331eb req-af4a0a5a-2a3c-4423-9d34-c33bd0439130 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087571 Jul 28 12:45:39.254811 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3591/7184] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:39.539249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:39.539866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:39.546892 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:39.547380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:39.548155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:39.548598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:39.679763 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:39.687770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a7519f80-dddd-47a4-ac4f-b10bac671a84 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1357 microversion: 2.1 time: 0.152484 Jul 28 12:45:39.688340 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3594/7185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:39 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:45:40.710505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:40.711270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:40.719151 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:40.719633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:40.720510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:40.720943 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:40.853976 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:40.861908 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3d23c677-03b9-49a0-b8bf-99ec54c748f9 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1546 microversion: 2.1 time: 0.156618 Jul 28 12:45:40.862482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3592/7186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:40 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:40.881723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:40.882280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:40.889773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:40.890226 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:40.890993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:40.891462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:41.029829 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:41.037462 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-812114f0-1617-420b-8615-1d6e74836e3a tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1546 microversion: 2.1 time: 0.159707 Jul 28 12:45:41.038042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3595/7187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:40 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:41.056678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:41.061873 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:41.062667 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Searching by: {'deleted': False, 'project_id': '39357a60cd5745418569284c2eb44197'} {{(pid=119235) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 12:45:41.068017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:41.068488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:41.069306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:41.069767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:41.093386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.multi_cell_list [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 12:45:41.120131 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3f530b04-d904-4eff-936f-b1ae90e4e37d tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067317 Jul 28 12:45:41.120713 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3593/7188] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Jul 28 12:45:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:41.132380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:41.132934 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:41.139615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:41.140067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:41.140832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:41.141282 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:41.269703 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:41.277198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3e5c7a00-0887-4c0c-89e9-f916276c08cf tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1546 microversion: 2.1 time: 0.148751 Jul 28 12:45:41.277769 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3596/7189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:41 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:42.767497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4b2203d-2255-42b5-9b1e-1c1eb5984961"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:42.769885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:42.776824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:42.777294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:42.778084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:42.778545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:43.024185 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6e88c6e-0da4-4491-b55f-3323315ec64b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261223 Jul 28 12:45:43.024799 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3594/7190] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Jul 28 12:45:42 2022] POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:53.773741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:53.774367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:53.777326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=15 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:53.778135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=54 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:53.784633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:53.785104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:53.785877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:53.786317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:53.915258 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:53.924047 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-21c7affb-4b6f-4d77-a415-324c2cdab3d4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1592 microversion: 2.1 time: 0.154214 Jul 28 12:45:53.924621 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3597/7191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:53 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1592 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:56.210160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:56.212519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=13 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:56.214196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:45:56.221142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-44c4132a-3532-4453-8e4d-a6dfef6d335c req-42344a15-723a-432d-b41a-12e0dd09a1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:56.236070 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-44c4132a-3532-4453-8e4d-a6dfef6d335c req-42344a15-723a-432d-b41a-12e0dd09a1f6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:56.236655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-44c4132a-3532-4453-8e4d-a6dfef6d335c req-42344a15-723a-432d-b41a-12e0dd09a1f6 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:56.255000 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-44c4132a-3532-4453-8e4d-a6dfef6d335c req-42344a15-723a-432d-b41a-12e0dd09a1f6 service nova] Creating event network-changed:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:45:56.260312 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-44c4132a-3532-4453-8e4d-a6dfef6d335c req-42344a15-723a-432d-b41a-12e0dd09a1f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051963 Jul 28 12:45:56.261370 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3595/7192] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:45:57.296638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-351028219"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:57.297195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:57.304111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:57.304568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:57.305403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:57.305921 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:57.512165 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.network.security_group_api [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Adding security group 6e568a54-0c3c-4691-a763-5e262eb02fd5 to port 55123a67-a654-46fa-8ba4-d8a12701f76d Jul 28 12:45:57.845269 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f07dfafd-6052-4ef7-b7ac-30de75c55355 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action" status: 202 len: 0 microversion: 2.1 time: 0.552644 Jul 28 12:45:57.849342 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3598/7193] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:45:57 2022] POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:45:57.856295 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:45:57.858885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:45:57.866157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:57.866619 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:57.868318 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:57.869214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:58.053002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:45:58.061759 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04c8468e-acac-4e9c-94b4-fe912aa964ea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1757 microversion: 2.1 time: 0.211195 Jul 28 12:45:58.062731 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3596/7194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:45:57 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:45:58.291156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-bd2f6e6f-6d1f-42c6-8b47-a979131d1a61 req-dc1931d1-5764-409d-a5d4-f4cce04cda56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:45:58.302334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd2f6e6f-6d1f-42c6-8b47-a979131d1a61 req-dc1931d1-5764-409d-a5d4-f4cce04cda56 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:45:58.302940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-bd2f6e6f-6d1f-42c6-8b47-a979131d1a61 req-dc1931d1-5764-409d-a5d4-f4cce04cda56 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:45:58.315192 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-bd2f6e6f-6d1f-42c6-8b47-a979131d1a61 req-dc1931d1-5764-409d-a5d4-f4cce04cda56 service nova] Creating event network-changed:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:45:58.320273 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-bd2f6e6f-6d1f-42c6-8b47-a979131d1a61 req-dc1931d1-5764-409d-a5d4-f4cce04cda56 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033358 Jul 28 12:45:58.320899 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3599/7195] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:46:14.889927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:46:14.892112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:14.895312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:14.895985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:14.902365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:14.902836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:14.903692 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:14.904710 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:14.983599 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b961b28-29eb-4132-864f-7a928f620e47 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action" status: 202 len: 0 microversion: 2.1 time: 0.096485 Jul 28 12:46:14.984255 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3597/7196] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:46:14 2022] POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:46:14.992664 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:14.994034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:14.996937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:14.997599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:15.002284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:15.002831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:15.003750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:15.004163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:15.238948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:15.246928 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bb4d7c7c-b330-4639-a2b0-62643b378035 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1749 microversion: 2.1 time: 0.258376 Jul 28 12:46:15.249024 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3600/7197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:14 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:46:16.270898 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:16.271565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:16.277878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:16.278345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:16.279159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:16.279614 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:16.425789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:16.434014 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-56f94590-3085-4a93-a675-b1c38d019a8b tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.168431 Jul 28 12:46:16.434592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3598/7198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:16 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:17.456418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:17.457041 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:17.464435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:17.464890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:17.465665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:17.466107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:17.607508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:17.616045 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dbacf9c4-4158-4103-8ae1-9163b7906384 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.163265 Jul 28 12:46:17.616625 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3601/7199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:17 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:18.637126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:18.637762 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:18.644623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:18.645085 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:18.645862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:18.646312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:18.786841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:18.795530 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-378d1010-de8b-4ac4-b4e4-0acc1cf85231 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.162336 Jul 28 12:46:18.796114 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3599/7200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:18 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:19.817227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:19.817847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:19.824652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:19.825128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:19.825893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:19.826334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:19.971646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:19.979658 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2d57c7d4-b33b-4cb7-9f63-7f7a1f20c362 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.166322 Jul 28 12:46:19.980232 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3602/7201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:19 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:21.003157 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:21.003945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:21.011815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:21.012457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:21.013486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:21.013952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:21.161093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:21.169215 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-69e3233a-796e-4bd1-95a4-56edc4ef85af tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.171629 Jul 28 12:46:21.169812 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3600/7202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:20 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:22.190836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:22.191506 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:22.198353 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:22.198802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:22.199594 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:22.200033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:22.348259 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:22.356297 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d8cd09ea-603b-4e51-a39c-398b54550030 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.169341 Jul 28 12:46:22.357533 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3603/7203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:22 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:23.379001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:23.379670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:23.386563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:23.387032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:23.387847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:23.388307 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:23.527517 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:23.535514 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fef7c784-7e93-4bc4-b57c-db6b754813e8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.160412 Jul 28 12:46:23.536095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3601/7204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:23 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:24.556693 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:24.557317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:24.564836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:24.565292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:24.566062 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:24.566503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:24.715183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:24.723306 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c332a4b1-356a-4dfa-9ae1-1312c0e086ec tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.170569 Jul 28 12:46:24.723900 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3604/7205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:24 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:25.744755 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:25.745386 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:25.753117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:25.753583 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:25.754360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:25.754810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:25.897794 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:25.906178 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d23046c5-b0fc-40c9-9c65-2c9d0cd368a4 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1754 microversion: 2.1 time: 0.164903 Jul 28 12:46:25.906748 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3602/7206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:25 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:26.926406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:46:26.927026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:26.934043 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:26.934493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:26.935292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:26.935735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:27.076198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:46:27.084183 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-340eddff-e690-42d9-b88b-7766575eb5aa tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1757 microversion: 2.1 time: 0.161703 Jul 28 12:46:27.084759 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3605/7207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:46:26 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:46:33.670036 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:46:33.670686 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:46:59.458680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-351028219"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:46:59.459308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:46:59.461434 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:59.462237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:59.467632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:59.468093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:59.468871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:46:59.469322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:46:59.603230 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.network.security_group_api [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Removing security group 6e568a54-0c3c-4691-a763-5e262eb02fd5 from port 55123a67-a654-46fa-8ba4-d8a12701f76d Jul 28 12:46:59.940932 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-721e37e7-6989-4b60-855e-63e52dfa4588 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action" status: 202 len: 0 microversion: 2.1 time: 0.486388 Jul 28 12:46:59.947058 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3603/7208] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:46:59 2022] POST /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:46:59.962260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:46:59.963450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=36 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:00.046649 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d48ce60f-e2cd-4d2b-b356-c06c1d140d80 req-d86b6ff6-b91a-42c0-aac1-b6cbfbed6eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:00.059448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d48ce60f-e2cd-4d2b-b356-c06c1d140d80 req-d86b6ff6-b91a-42c0-aac1-b6cbfbed6eef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:00.060285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d48ce60f-e2cd-4d2b-b356-c06c1d140d80 req-d86b6ff6-b91a-42c0-aac1-b6cbfbed6eef service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:00.073482 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d48ce60f-e2cd-4d2b-b356-c06c1d140d80 req-d86b6ff6-b91a-42c0-aac1-b6cbfbed6eef service nova] Creating event network-changed:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:47:00.079798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d48ce60f-e2cd-4d2b-b356-c06c1d140d80 req-d86b6ff6-b91a-42c0-aac1-b6cbfbed6eef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129091 Jul 28 12:47:00.081090 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3606/7209] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:01.045225 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:01.045756 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:01.052745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:01.053351 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:01.054194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:01.054657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:01.055878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a710b801-0d5f-417d-81c0-a1ec020062e5 req-0421d0de-09f5-4974-ace9-04c6f8be1383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:01.066864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a710b801-0d5f-417d-81c0-a1ec020062e5 req-0421d0de-09f5-4974-ace9-04c6f8be1383 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:01.067692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a710b801-0d5f-417d-81c0-a1ec020062e5 req-0421d0de-09f5-4974-ace9-04c6f8be1383 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:01.078675 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a710b801-0d5f-417d-81c0-a1ec020062e5 req-0421d0de-09f5-4974-ace9-04c6f8be1383 service nova] Creating event network-changed:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:47:01.083781 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a710b801-0d5f-417d-81c0-a1ec020062e5 req-0421d0de-09f5-4974-ace9-04c6f8be1383 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033301 Jul 28 12:47:01.084377 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3607/7210] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:01.142024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lazy-loading 'services' on Instance uuid 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:47:01.223509 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be960025-5d33-4658-ab59-7da86502a5fe tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments/c4b2203d-2255-42b5-9b1e-1c1eb5984961" status: 202 len: 0 microversion: 2.1 time: 0.183244 Jul 28 12:47:01.224273 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3604/7211] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:47:01 2022] DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments/c4b2203d-2255-42b5-9b1e-1c1eb5984961 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:47:01.236911 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:01.239820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:01.248619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:01.248838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:01.249686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:01.250218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:01.283832 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e069dd7e-8240-430d-899e-1e35ecf0194f tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053772 Jul 28 12:47:01.284676 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3608/7212] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:01 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:02.300432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:02.302838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:02.310377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:02.310850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:02.311695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:02.312155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:02.343344 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-09b75679-b89b-4ae2-8b42-76f46267604c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049997 Jul 28 12:47:02.343914 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3605/7213] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:02 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:03.356158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:03.358655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:03.365890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:03.366352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:03.367158 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:03.367602 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:03.398357 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc12f5a0-330e-4529-a730-5b8582212ecc tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Jul 28 12:47:03.399047 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3609/7214] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:03 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:04.411339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:04.413512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:04.420267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:04.421102 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:04.422842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:04.423328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:04.452797 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a8398229-9924-41b3-bbcf-64c397302022 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 Jul 28 12:47:04.454086 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3606/7215] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:04 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:05.465509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:05.467798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:05.474736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:05.475222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:05.475993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:05.476429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:05.506693 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-54c27ec6-5560-4cf0-9cab-7745f34485fb tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jul 28 12:47:05.507506 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3610/7216] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:05 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:06.518982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:06.521213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:06.528195 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:06.528666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:06.529487 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:06.529944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:06.558650 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c9f966e0-45fd-418d-854b-d3c9b49f6a97 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043706 Jul 28 12:47:06.559229 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3607/7217] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Jul 28 12:47:06 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 12:47:06.569545 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:06.570055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:06.577103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:06.577562 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:06.578336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:06.578785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:06.651968 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] HTTP exception thrown: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 is not attached to volume c4b2203d-2255-42b5-9b1e-1c1eb5984961 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Request method failure captured: Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: request: DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments/c4b2203d-2255-42b5-9b1e-1c1eb5984961 HTTP/1.1 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oOjYWSnkNBOIphIcsxa9ndsDAiyczIrIDqi3Q_G_reC8cu57oEBJTcgEpmNBz4FCj4hvKutlvJx0P0HL6dSdkLLV26su1dK8pXQIGWcZ1uNON9QMEV74lzVnOPxrm-wg7Ai5dv8ywHH1CRwjnuCN9MXbbmFOhBxAur8VdM2PYR0erY Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39357a60cd5745418569284c2eb44197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39357a60cd5745418569284c2eb44197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}] Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e253cd75d76944828f7cddc4c76eafdb Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 is not attached to volume c4b2203d-2255-42b5-9b1e-1c1eb5984961 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'server_id': '09c1e20b-2ac9-4309-bc0b-6f0a570b1b31', 'id': 'c4b2203d-2255-42b5-9b1e-1c1eb5984961'} Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c4b2203d-2255-42b5-9b1e-1c1eb5984961. Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 is not attached to volume c4b2203d-2255-42b5-9b1e-1c1eb5984961 Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:47:06.653575 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 is not attached to volume c4b2203d-2255-42b5-9b1e-1c1eb5984961 Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Returning 404 to user: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 is not attached to volume c4b2203d-2255-42b5-9b1e-1c1eb5984961 {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9fe383a2-c235-4ad9-9955-6e30055f7989 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments/c4b2203d-2255-42b5-9b1e-1c1eb5984961" status: 404 len: 154 microversion: 2.1 time: 0.089524 Jul 28 12:47:06.660388 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3611/7218] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Jul 28 12:47:06 2022] DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31/os-volume_attachments/c4b2203d-2255-42b5-9b1e-1c1eb5984961 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:47:09.897576 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:09.898101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:09.905180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:09.905663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:09.906441 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:09.906904 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:09.936117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:47:10.018234 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f6eb615-5565-4a20-a9ba-48010f6c3c4c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 204 len: 0 microversion: 2.1 time: 0.124187 Jul 28 12:47:10.018843 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3608/7219] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:47:09 2022] DELETE /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:47:10.027046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:10.027705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:10.038710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:10.039191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:10.039972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:10.040633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:10.173500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:10.181421 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0c5ccf7a-4759-42b7-a6c4-658691fd073c tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1552 microversion: 2.1 time: 0.158244 Jul 28 12:47:10.182008 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3612/7220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:10 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:47:11.203045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:11.203800 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:11.210663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:11.211176 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:11.211963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:11.212417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:11.349408 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:11.357057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-86ee86ab-e6ed-415a-998b-e0a06fa278d8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1552 microversion: 2.1 time: 0.158313 Jul 28 12:47:11.357627 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3609/7221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:11 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:12.244576 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-70db8566-4fc0-42c6-9408-db01e177e849 req-20305d50-7cad-4bad-9af0-05c53de24d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c1e20b-2ac9-4309-bc0b-6f0a570b1b31", "name": "network-vif-deleted", "tag": "55123a67-a654-46fa-8ba4-d8a12701f76d"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:12.255799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-70db8566-4fc0-42c6-9408-db01e177e849 req-20305d50-7cad-4bad-9af0-05c53de24d19 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:12.256234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-70db8566-4fc0-42c6-9408-db01e177e849 req-20305d50-7cad-4bad-9af0-05c53de24d19 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:12.267851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-70db8566-4fc0-42c6-9408-db01e177e849 req-20305d50-7cad-4bad-9af0-05c53de24d19 service nova] Creating event network-vif-deleted:55123a67-a654-46fa-8ba4-d8a12701f76d for instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 on n-h2-851368-1 Jul 28 12:47:12.273203 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-70db8566-4fc0-42c6-9408-db01e177e849 req-20305d50-7cad-4bad-9af0-05c53de24d19 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Jul 28 12:47:12.273964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3613/7222] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:12.378056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:12.378707 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:12.386252 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:12.386724 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:12.387549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:12.388010 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:12.422200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:12.422666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:12.423156 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lazy-loading 'fault' on Instance uuid 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:47:12.463344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e253cd75d76944828f7cddc4c76eafdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39357a60cd5745418569284c2eb44197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:12.471428 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-886286e2-503c-4ec4-982a-fcc5009afaea tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 200 len: 1347 microversion: 2.1 time: 0.097501 Jul 28 12:47:12.472037 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3610/7223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:12 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:13.495081 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:13.495799 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] [instance: 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:13.502861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:13.503429 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:13.504250 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:13.504692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:13.517832 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] HTTP exception thrown: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Request method failure captured: Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 HTTP/1.1 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oOjYWSnkNBOIphIcsxa9ndsDAiyczIrIDqi3Q_G_reC8cu57oEBJTcgEpmNBz4FCj4hvKutlvJx0P0HL6dSdkLLV26su1dK8pXQIGWcZ1uNON9QMEV74lzVnOPxrm-wg7Ai5dv8ywHH1CRwjnuCN9MXbbmFOhBxAur8VdM2PYR0erY Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39357a60cd5745418569284c2eb44197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39357a60cd5745418569284c2eb44197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39357a60cd5745418569284c2eb44197"}]}] Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 39357a60cd5745418569284c2eb44197 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2146662016 Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: e253cd75d76944828f7cddc4c76eafdb Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestMinimumBasicScenario-2146662016-project Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '09c1e20b-2ac9-4309-bc0b-6f0a570b1b31'} Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:47:13.519478 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Returning 404 to user: Instance 09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3f245eb2-76ee-446c-a1e7-2c8de779ebb8 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jul 28 12:47:13.523807 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3614/7224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:13 2022] GET /compute/v2.1/servers/09c1e20b-2ac9-4309-bc0b-6f0a570b1b31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:47:13.529788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-df81dae6-c6c9-4d50-b385-591aff5045c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] Calling method '.version_select at 0x7f2e9c759d30>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:13.550476 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-df81dae6-c6c9-4d50-b385-591aff5045c6 tempest-TestMinimumBasicScenario-2146662016 tempest-TestMinimumBasicScenario-2146662016-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-876191666" status: 202 len: 0 microversion: 2.1 time: 0.024530 Jul 28 12:47:13.551045 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3611/7225] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Jul 28 12:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-876191666 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:47:22.778255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9d3d5516-e5a7-4d2c-a3ec-877f86f81e26 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: .version_select at 0x7f2eb29961f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-106374974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3rObYDmOqPXOyLBGMxQsmRU8Wup06TtJZKeBU6fm6xDdNFJpUlnUHhEl07EeQXncHT4zrN8M0KfM2FcyuN2u/y2CB566/4Xb6LvYB/4PDQPMnI0Xnne7ySekjCu3F0YA=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:22.793920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9d3d5516-e5a7-4d2c-a3ec-877f86f81e26 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:47:22.799940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-9d3d5516-e5a7-4d2c-a3ec-877f86f81e26 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:47:22.823855 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9d3d5516-e5a7-4d2c-a3ec-877f86f81e26 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.223270 Jul 28 12:47:22.824492 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3615/7226] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:47:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:28.506266 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:28.507046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:28.511202 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2103708893", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "35afdf13-c39f-4f1f-b9da-8310e0b7cabe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-106374974", "security_groups": [{"name": "tempest-secgroup-smoke-1032561136"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:28.627534 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] validate_networks() for [('35afdf13-c39f-4f1f-b9da-8310e0b7cabe', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:47:29.070504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:47:29.071645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:47:29.072382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:47:29.073059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:47:29.073711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:47:29.083905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:29.085714 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:29.086663 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:29.087268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:29.113846 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:47:29.120249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:47:29.140528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:47:29.143149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:47:29.205756 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e4eecee-8c75-40b6-bb2e-a62889b5a149 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701476 Jul 28 12:47:29.207152 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3612/7227] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:47:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:47:29.214956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=38 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:29.220899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f84febe-ec6e-459c-a131-2d9f3a595dc4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:29.221742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f84febe-ec6e-459c-a131-2d9f3a595dc4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:29.340421 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8f84febe-ec6e-459c-a131-2d9f3a595dc4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:29.357379 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f84febe-ec6e-459c-a131-2d9f3a595dc4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1266 microversion: 2.1 time: 0.143144 Jul 28 12:47:29.357988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3616/7228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:29 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:30.379888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:30.380529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:30.388999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:30.389549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:30.390842 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:30.391537 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:30.475348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:30.487217 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1b33627a-11c9-4752-97a5-62f1253b6910 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1318 microversion: 2.1 time: 0.111229 Jul 28 12:47:30.487820 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3613/7229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:30 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:31.509862 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:31.510599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:31.512619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:31.520434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:31.521943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:31.522792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:31.527341 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:31.675319 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:31.683655 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-997636d8-9108-4e61-8e17-0e1a16adda1f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.178301 Jul 28 12:47:31.684248 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3617/7230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:31 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:32.101670 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6acaf6c8-0319-443a-aa74-52a03bfb58ff req-a76787c3-ebaa-4d0a-a23a-ae551dbd7a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a23edd3-f89e-4c26-903c-0e0f3b456000", "tag": "14c85ea3-e047-4f41-b595-72017f19728a"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:32.122378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6acaf6c8-0319-443a-aa74-52a03bfb58ff req-a76787c3-ebaa-4d0a-a23a-ae551dbd7a43 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:32.122780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6acaf6c8-0319-443a-aa74-52a03bfb58ff req-a76787c3-ebaa-4d0a-a23a-ae551dbd7a43 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:32.136188 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6acaf6c8-0319-443a-aa74-52a03bfb58ff req-a76787c3-ebaa-4d0a-a23a-ae551dbd7a43 service nova] Creating event network-changed:14c85ea3-e047-4f41-b595-72017f19728a for instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 on n-h1-851368-1 Jul 28 12:47:32.142393 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6acaf6c8-0319-443a-aa74-52a03bfb58ff req-a76787c3-ebaa-4d0a-a23a-ae551dbd7a43 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053444 Jul 28 12:47:32.143207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3614/7231] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:47:32.707542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:32.708153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:32.715240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:32.715692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:32.716458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:32.716890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:32.846493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:32.854301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d25fa353-3c0e-45d0-acad-cb6c51e9b3d1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.150675 Jul 28 12:47:32.854878 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3618/7232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:32 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:33.877862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:33.878489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:33.885011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:33.885483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:33.886277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:33.886738 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:34.023303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:34.031458 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a85b1372-ec3b-4024-a617-c1c86cdd59db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.159654 Jul 28 12:47:34.032038 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3615/7233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:33 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:35.051951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:35.052571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:35.059587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:35.060042 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:35.060816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:35.061816 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:35.197456 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:35.205555 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ebf99ecd-bdc2-4e4c-9af4-550876615a0f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.157643 Jul 28 12:47:35.206126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3619/7234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:35 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:36.226262 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:36.226814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:36.234752 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:36.235256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:36.236045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:36.236508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:36.373501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:36.381326 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5864cf40-b0d1-455c-bb64-17e013a71b70 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.159111 Jul 28 12:47:36.381916 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3616/7235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:36 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:47:37.401772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:37.402390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:37.409317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:37.409767 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:37.410536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:37.410974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:37.544276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:37.552455 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-84dc2f0b-5b42-4d40-8be8-fb83e7579eea tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.154584 Jul 28 12:47:37.553042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3620/7236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:37 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:38.573814 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:38.574457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:38.581669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:38.582141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:38.582966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:38.583450 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:38.621369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d915f51f-bada-4ee3-aea9-b125842b0044 req-6793a358-feba-4701-aead-043a989dcad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a23edd3-f89e-4c26-903c-0e0f3b456000", "name": "network-vif-plugged", "status": "completed", "tag": "14c85ea3-e047-4f41-b595-72017f19728a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:38.632947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d915f51f-bada-4ee3-aea9-b125842b0044 req-6793a358-feba-4701-aead-043a989dcad0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:38.633503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d915f51f-bada-4ee3-aea9-b125842b0044 req-6793a358-feba-4701-aead-043a989dcad0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:38.645375 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d915f51f-bada-4ee3-aea9-b125842b0044 req-6793a358-feba-4701-aead-043a989dcad0 service nova] Creating event network-vif-plugged:14c85ea3-e047-4f41-b595-72017f19728a for instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 on n-h1-851368-1 Jul 28 12:47:38.650739 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d915f51f-bada-4ee3-aea9-b125842b0044 req-6793a358-feba-4701-aead-043a989dcad0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Jul 28 12:47:38.651571 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3621/7237] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:47:38.722661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:38.730636 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-61ad0c48-2d0a-4ada-9c4e-cd3bf00af8ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.160753 Jul 28 12:47:38.731265 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3617/7238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:38 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:39.748318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:39.753540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:39.754292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:39.760844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:39.761306 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:39.762074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:39.762524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:39.900802 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:39.909002 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f4fa5e1-1983-46ef-876c-cbd6348bf07c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1392 microversion: 2.1 time: 0.161685 Jul 28 12:47:39.909576 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3622/7239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:39 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:40.930360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:40.930998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:40.933019 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:40.933791 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:47:40.941308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:40.941776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:40.942558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:40.943014 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:41.074020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:41.082352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-84f26d81-c82a-4137-8511-7c1428420d37 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1564 microversion: 2.1 time: 0.155901 Jul 28 12:47:41.082923 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3618/7240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:40 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:41.102039 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:41.102659 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:41.109913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:41.110366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:41.111160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:41.111606 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:41.245835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:41.254107 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ffcc2226-4f0b-494a-9297-0a1fe58bcddc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1564 microversion: 2.1 time: 0.155916 Jul 28 12:47:41.254684 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3623/7241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:41 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:47:43.121502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-636b7800-a320-4cd3-bf8f-18a962b9e6a4 req-0d2e1655-1e06-40dc-8347-2dadc57d6fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a23edd3-f89e-4c26-903c-0e0f3b456000", "tag": "14c85ea3-e047-4f41-b595-72017f19728a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:47:43.129159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:47:43.130340 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:47:43.137964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:43.138439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:43.139279 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:43.139767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:43.141639 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-636b7800-a320-4cd3-bf8f-18a962b9e6a4 req-0d2e1655-1e06-40dc-8347-2dadc57d6fd7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:47:43.142098 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-636b7800-a320-4cd3-bf8f-18a962b9e6a4 req-0d2e1655-1e06-40dc-8347-2dadc57d6fd7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:47:43.158755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-636b7800-a320-4cd3-bf8f-18a962b9e6a4 req-0d2e1655-1e06-40dc-8347-2dadc57d6fd7 service nova] Creating event network-changed:14c85ea3-e047-4f41-b595-72017f19728a for instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 on n-h1-851368-1 Jul 28 12:47:43.164131 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-636b7800-a320-4cd3-bf8f-18a962b9e6a4 req-0d2e1655-1e06-40dc-8347-2dadc57d6fd7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046258 Jul 28 12:47:43.164939 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3624/7242] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:47:43.290308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:47:43.298835 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e2525476-d3a5-45e6-8ee8-b3c97e44ddee tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1564 microversion: 2.1 time: 0.184353 Jul 28 12:47:43.299460 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3619/7243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:47:43 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:48:16.608788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=15 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:16.609473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=40 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:16.613854 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:16.616148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:16.623175 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:16.624267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:16.625036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:16.625477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:16.686806 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d33f83ac-709c-4db3-96cc-c4535432febf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action" status: 200 len: 24568 microversion: 2.1 time: 0.080011 Jul 28 12:48:16.687568 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3625/7244] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:48:16 2022] POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:48:46.930862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:46.931678 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=40 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:46.936712 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:46.937402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:46.945419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:46.945894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:46.946694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:46.947180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:47.017629 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd535836-c678-4684-be14-0b07563df899 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action" status: 202 len: 0 microversion: 2.1 time: 0.088416 Jul 28 12:48:47.018275 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3620/7245] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:48:46 2022] POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:48:47.028673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:47.029927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:47.036963 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:47.037637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:48:47.042511 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:47.043130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:47.043936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:47.045066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:47.186587 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:47.194211 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4c39348c-9ce5-4c22-9b9a-08c898152d65 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1688 microversion: 2.1 time: 0.169909 Jul 28 12:48:47.194787 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3626/7246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:47 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:48.218183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:48.218900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:48.225249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:48.225653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:48.226426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:48.226877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:48.360305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:48.367938 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e95322be-5334-4ff3-bc36-0b69971aedcb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1668 microversion: 2.1 time: 0.155755 Jul 28 12:48:48.368505 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3621/7247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:48 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:49.457359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:49.459730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:49.468272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.468730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.469508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.469958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.532972 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-40001db0-a85a-487a-a4c0-a9ac6e4af068 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action" status: 200 len: 32638 microversion: 2.1 time: 0.079475 Jul 28 12:48:49.533619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3627/7248] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:48:49 2022] POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action => generated 32638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:48:49.545326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:49.545894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:49.552832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.553310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.554104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.554566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.622915 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-050246c4-4cfa-43e2-bd90-16972525178a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action" status: 202 len: 0 microversion: 2.1 time: 0.081339 Jul 28 12:48:49.623592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3622/7249] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:48:49 2022] POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:48:49.632502 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:49.633210 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:49.641107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.641678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.642458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:49.642901 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:49.779378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:49.786890 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4266f427-0899-4c3d-b845-f51a50a9568c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1675 microversion: 2.1 time: 0.158661 Jul 28 12:48:49.787496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3628/7250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:49 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:50.809891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:50.810611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:50.816964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:50.817436 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:50.818218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:50.818675 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:50.948138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:50.956444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2be61f82-8ae9-403c-9e66-bf7efe6029dd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1683 microversion: 2.1 time: 0.151643 Jul 28 12:48:50.957016 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3623/7251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:50 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:51.052620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:51.057084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:51.063194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:51.063646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:51.064617 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:51.065052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:51.126153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ede5f297-a38b-42a1-a5a8-6774d1c9864d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action" status: 200 len: 38478 microversion: 2.1 time: 0.077523 Jul 28 12:48:51.126800 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3629/7252] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:48:51 2022] POST /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000/action => generated 38478 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:48:52.130575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:52.131592 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:52.133348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5e35474c-bcf0-46b6-aebc-63f11e4aaa27 req-e8756b3f-6c3f-449c-b0ae-302f8b0894bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a23edd3-f89e-4c26-903c-0e0f3b456000", "tag": "14c85ea3-e047-4f41-b595-72017f19728a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:52.138884 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:52.139679 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:52.140706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:52.141815 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:52.144487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5e35474c-bcf0-46b6-aebc-63f11e4aaa27 req-e8756b3f-6c3f-449c-b0ae-302f8b0894bf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:52.145197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5e35474c-bcf0-46b6-aebc-63f11e4aaa27 req-e8756b3f-6c3f-449c-b0ae-302f8b0894bf service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:52.157316 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5e35474c-bcf0-46b6-aebc-63f11e4aaa27 req-e8756b3f-6c3f-449c-b0ae-302f8b0894bf service nova] Creating event network-changed:14c85ea3-e047-4f41-b595-72017f19728a for instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 on n-h1-851368-1 Jul 28 12:48:52.162490 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5e35474c-bcf0-46b6-aebc-63f11e4aaa27 req-e8756b3f-6c3f-449c-b0ae-302f8b0894bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033150 Jul 28 12:48:52.163501 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3630/7253] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:48:52.172221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:48:52.252837 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92446a23-c036-47ea-96cf-bc988756581d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 204 len: 0 microversion: 2.1 time: 0.125928 Jul 28 12:48:52.253786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3624/7254] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:48:52 2022] DELETE /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:48:52.263434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:52.264225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:52.271130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:52.271682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:52.272745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:52.273072 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:52.408193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:52.415948 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd401e5d-967f-4ef9-81fb-190afc9b9490 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1689 microversion: 2.1 time: 0.157389 Jul 28 12:48:52.416526 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3631/7255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:52 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:48:53.438974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:53.439720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:53.446484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:53.446946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:53.447757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:53.448215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:53.583991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:53.591666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3c8878b6-1b4c-42ce-9124-72790ccf46bd tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1689 microversion: 2.1 time: 0.156977 Jul 28 12:48:53.592280 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3625/7256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:53 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:54.557415 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-17665d07-b049-44c9-83e9-97fcd8a5feab req-48e27c9d-e26e-4ce1-9fe2-53d224c75ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a23edd3-f89e-4c26-903c-0e0f3b456000", "name": "network-vif-deleted", "tag": "14c85ea3-e047-4f41-b595-72017f19728a"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:54.568359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-17665d07-b049-44c9-83e9-97fcd8a5feab req-48e27c9d-e26e-4ce1-9fe2-53d224c75ac2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:54.568881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-17665d07-b049-44c9-83e9-97fcd8a5feab req-48e27c9d-e26e-4ce1-9fe2-53d224c75ac2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:54.580442 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-17665d07-b049-44c9-83e9-97fcd8a5feab req-48e27c9d-e26e-4ce1-9fe2-53d224c75ac2 service nova] Creating event network-vif-deleted:14c85ea3-e047-4f41-b595-72017f19728a for instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 on n-h1-851368-1 Jul 28 12:48:54.585449 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-17665d07-b049-44c9-83e9-97fcd8a5feab req-48e27c9d-e26e-4ce1-9fe2-53d224c75ac2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Jul 28 12:48:54.586049 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3632/7257] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:48:54.613639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:54.614277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:54.621263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:54.621742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:54.622544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:54.623001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:54.693229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:48:54.703309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a6915e1d-3286-47f6-a66c-19202e460ee0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 200 len: 1351 microversion: 2.1 time: 0.093467 Jul 28 12:48:54.704135 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3626/7258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:54 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:48:55.725032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:55.725760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 3a23edd3-f89e-4c26-903c-0e0f3b456000] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:48:55.732020 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:55.732465 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:55.733969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:48:55.734406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:48:55.747391 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] HTTP exception thrown: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Request method failure captured: Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 HTTP/1.1 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oVafrcKkNF8QKPkopcQ4nuBIwfcDBe4YIwefbf4P7CY1XDFE2E_ptVjZLOROROW4aMnYQ6PoZFMRex_NI0BiUzkbuaaIEKyNwfjbdAMyflBLO6as6pgNbSBKTjEE4Mg43kOHB1JoIA11sVCtx1W19bdzVRW7zydHm4G5PCOYrpaqk4 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22ed509631c54f2984945fda783b3539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22ed509631c54f2984945fda783b3539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}] Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a1cd522c87347969a4dea633fafef7d Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': '3a23edd3-f89e-4c26-903c-0e0f3b456000'} Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:48:55.749656 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Returning 404 to user: Instance 3a23edd3-f89e-4c26-903c-0e0f3b456000 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3bd6c596-d6d7-4d47-8fea-0ab531062bda tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000" status: 404 len: 111 microversion: 2.1 time: 0.031028 Jul 28 12:48:55.754031 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3633/7259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:48:55 2022] GET /compute/v2.1/servers/3a23edd3-f89e-4c26-903c-0e0f3b456000 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:48:58.995193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec978eaf-ed48-48d7-a490-e10f51977dd2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '.version_select at 0x7f2eb1a6c430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:48:59.016948 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec978eaf-ed48-48d7-a490-e10f51977dd2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-106374974" status: 202 len: 0 microversion: 2.1 time: 0.027416 Jul 28 12:48:59.017765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3627/7260] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Jul 28 12:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-106374974 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:48:59.046779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-53b9080a-47e3-4ca7-8bd9-06917b859408 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: .version_select at 0x7f2eb2480670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1618019191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObqbg5Qx/Ey/gUnt56A5JPjFu/iCycy3zY1BrjACFDY5k/ys5UEI7P65tG8yVf5KM904IsTjmAT4SMNN0/dcuMW6HyKTW4z0DJ98k2kiPT2zvlKx6bn73FNMpfxm2MR+g=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:48:59.064030 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-53b9080a-47e3-4ca7-8bd9-06917b859408 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:48:59.069178 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-53b9080a-47e3-4ca7-8bd9-06917b859408 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:48:59.091833 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-53b9080a-47e3-4ca7-8bd9-06917b859408 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049658 Jul 28 12:48:59.092945 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3634/7261] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:48:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:49:04.974850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:04.979796 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1513144187", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "1409f188-e501-426f-9796-bd5e55d06051"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1618019191", "security_groups": [{"name": "tempest-secgroup-smoke-575327202"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:05.132715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] validate_networks() for [('1409f188-e501-426f-9796-bd5e55d06051', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:49:05.548337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:49:05.549027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:49:05.549636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:49:05.550079 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:49:05.550522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:49:05.559580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:05.560059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:05.561388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:05.561854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:05.583562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:49:05.588952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:49:05.601497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:49:05.603840 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:49:05.653930 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-efa51df1-65ef-4e6c-9bc2-20f0df9ace5e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.680765 Jul 28 12:49:05.655020 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3628/7262] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:49:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:49:05.667086 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7a3f9571-2bf8-4d00-8956-6e6eb814fe8a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:05.667904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7a3f9571-2bf8-4d00-8956-6e6eb814fe8a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:05.728984 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7a3f9571-2bf8-4d00-8956-6e6eb814fe8a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:05.736612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7a3f9571-2bf8-4d00-8956-6e6eb814fe8a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1267 microversion: 2.1 time: 0.074501 Jul 28 12:49:05.737668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3635/7263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:05 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:06.757935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:06.758588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:06.766379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:06.767050 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:06.768066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:06.768683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:06.878777 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:06.888161 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-684c9c5e-a551-49f2-9e82-303d4da1d97c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1327 microversion: 2.1 time: 0.134094 Jul 28 12:49:06.888759 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3629/7264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:06 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:07.910121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:07.910817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:07.912779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=32 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:07.921170 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:07.921633 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:07.922427 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:07.922932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:08.178527 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:08.199291 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2816927c-a895-4d27-a59f-6450d09711a9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.292984 Jul 28 12:49:08.202500 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3636/7265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:07 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:08.419125 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-59249ca8-e556-4b0c-b7cb-5b5c8bc62645 req-c1bca54c-5cf7-4454-9fa1-4e1ab36fa010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8451455-946a-44da-9a9b-bf5288655076", "tag": "92a82430-b838-48dd-a5e6-dc9314960585"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:08.432343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-59249ca8-e556-4b0c-b7cb-5b5c8bc62645 req-c1bca54c-5cf7-4454-9fa1-4e1ab36fa010 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:08.432673 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-59249ca8-e556-4b0c-b7cb-5b5c8bc62645 req-c1bca54c-5cf7-4454-9fa1-4e1ab36fa010 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:08.450026 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-59249ca8-e556-4b0c-b7cb-5b5c8bc62645 req-c1bca54c-5cf7-4454-9fa1-4e1ab36fa010 service nova] Creating event network-changed:92a82430-b838-48dd-a5e6-dc9314960585 for instance f8451455-946a-44da-9a9b-bf5288655076 on n-h2-851368-1 Jul 28 12:49:08.459435 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-59249ca8-e556-4b0c-b7cb-5b5c8bc62645 req-c1bca54c-5cf7-4454-9fa1-4e1ab36fa010 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044005 Jul 28 12:49:08.460406 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3630/7266] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:49:09.221292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:09.221944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:09.229177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:09.230016 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:09.231046 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:09.231524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:09.362428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:09.369847 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe464071-296a-4ae4-b517-a478508f19df tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.152505 Jul 28 12:49:09.370411 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3637/7267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:09 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:10.393008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:10.393732 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:10.400297 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:10.400772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:10.401567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:10.402027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:10.533650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:10.541333 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-13f106c7-b4f6-488f-8293-83dc715a645b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.154259 Jul 28 12:49:10.541910 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3631/7268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:10 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:11.562916 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:11.563560 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:11.570423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:11.570880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:11.571679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:11.572125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:11.706050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:11.713537 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37b436e4-ae2c-44ae-adf4-16a84fabf8dc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.155056 Jul 28 12:49:11.714103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3638/7269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:11 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:12.734230 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:12.734868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:12.742112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:12.742539 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:12.743360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:12.743823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:12.875223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:12.882764 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-97da82cc-c8ed-4837-b2ae-4559deaab6d6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.152782 Jul 28 12:49:12.883377 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3632/7270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:12 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:13.825742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b52fe56f-8e5a-4a19-ada7-d0327d8281f9 req-89220321-5657-46ec-90e5-1f910bf64922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8451455-946a-44da-9a9b-bf5288655076", "name": "network-vif-plugged", "status": "completed", "tag": "92a82430-b838-48dd-a5e6-dc9314960585"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:13.836445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b52fe56f-8e5a-4a19-ada7-d0327d8281f9 req-89220321-5657-46ec-90e5-1f910bf64922 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:13.836982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b52fe56f-8e5a-4a19-ada7-d0327d8281f9 req-89220321-5657-46ec-90e5-1f910bf64922 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:13.848735 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b52fe56f-8e5a-4a19-ada7-d0327d8281f9 req-89220321-5657-46ec-90e5-1f910bf64922 service nova] Creating event network-vif-plugged:92a82430-b838-48dd-a5e6-dc9314960585 for instance f8451455-946a-44da-9a9b-bf5288655076 on n-h2-851368-1 Jul 28 12:49:13.853662 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b52fe56f-8e5a-4a19-ada7-d0327d8281f9 req-89220321-5657-46ec-90e5-1f910bf64922 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Jul 28 12:49:13.854263 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3639/7271] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:49:13.903985 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:13.904631 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:13.912486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:13.912966 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:13.913771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:13.914240 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:14.106813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:14.115129 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4f83a529-3479-4a78-ba36-252d42e7f7fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1392 microversion: 2.1 time: 0.215075 Jul 28 12:49:14.115703 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3633/7272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:13 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:15.137360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:15.138044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:15.144464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:15.144908 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:15.145677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:15.146112 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:15.284622 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:15.292072 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-de71be7b-332e-4935-b2ee-fa56e39a4ca6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1564 microversion: 2.1 time: 0.159987 Jul 28 12:49:15.292663 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3640/7273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:15 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:15.312908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:15.313552 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:15.320484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:15.320955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:15.321744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:15.322204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:15.454133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:15.461665 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e27e9ec1-9af8-4cba-aac3-9419b140a70e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1564 microversion: 2.1 time: 0.152746 Jul 28 12:49:15.462249 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3634/7274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:15 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:17.395580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:17.396205 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:17.398460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:17.399905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-5da8ff75-0b89-4844-bdac-ba553e9ad8a3 req-585763f1-24b0-485f-8fcf-e92c648beb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8451455-946a-44da-9a9b-bf5288655076", "tag": "92a82430-b838-48dd-a5e6-dc9314960585"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:17.400877 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:17.405374 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:17.406721 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:17.406923 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:17.407300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:17.407788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:17.408507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:17.409216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:17.417222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5da8ff75-0b89-4844-bdac-ba553e9ad8a3 req-585763f1-24b0-485f-8fcf-e92c648beb80 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:17.417929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-5da8ff75-0b89-4844-bdac-ba553e9ad8a3 req-585763f1-24b0-485f-8fcf-e92c648beb80 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:17.434713 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-5da8ff75-0b89-4844-bdac-ba553e9ad8a3 req-585763f1-24b0-485f-8fcf-e92c648beb80 service nova] Creating event network-changed:92a82430-b838-48dd-a5e6-dc9314960585 for instance f8451455-946a-44da-9a9b-bf5288655076 on n-h2-851368-1 Jul 28 12:49:17.440808 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-5da8ff75-0b89-4844-bdac-ba553e9ad8a3 req-585763f1-24b0-485f-8fcf-e92c648beb80 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045406 Jul 28 12:49:17.441945 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3635/7275] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:49:17.623798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:17.632935 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-3257cf7b-a955-4f84-89ff-85a16ffb9962 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1564 microversion: 2.1 time: 0.241218 Jul 28 12:49:17.633877 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3641/7276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:17 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:40.877715 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=36 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:40.882158 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:40.884499 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:40.892500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:40.892963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:40.893741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:40.894190 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:40.957371 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7e808a21-38c9-4a45-bf57-f38f144c015a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action" status: 200 len: 24562 microversion: 2.1 time: 0.081364 Jul 28 12:49:40.958061 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3636/7277] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:49:40 2022] POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action => generated 24562 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:49:47.293430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:49:47.296248 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:47.298461 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:47.299651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=32 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:49:47.305686 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:47.306137 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:47.306904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:47.307370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:47.382430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8d0404da-1a17-488a-9ada-19f0aaa79c07 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action" status: 202 len: 0 microversion: 2.1 time: 0.093349 Jul 28 12:49:47.383084 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3642/7278] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:49:47 2022] POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 12:49:47.392648 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:47.393385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:47.400954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:47.401567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:47.402404 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:47.402872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:47.625215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:47.633070 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43f506f3-7b99-4c8d-bc1e-67b2ae0d1128 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1674 microversion: 2.1 time: 0.245279 Jul 28 12:49:47.633994 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3637/7279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:47 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:48.654729 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:48.655459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:48.663273 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:48.663727 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:48.664496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:48.664933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:48.797561 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:48.805581 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7036c69b-c392-45aa-9a2f-2130f5747be5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.155125 Jul 28 12:49:48.806155 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3643/7280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:48 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:49.826979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:49.827645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:49.834622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:49.835122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:49.835914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:49.836377 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:49.965589 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:49.973714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7a245cb0-0f88-4e52-941c-117a67c2292e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.150656 Jul 28 12:49:49.974286 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3638/7281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:49 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:50.996695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:50.997315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:51.005031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:51.005395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:51.006231 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:51.006798 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:51.140950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:51.148403 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dca92ff8-0282-4ef4-ad82-d80d67f9fa43 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.155645 Jul 28 12:49:51.148988 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3644/7282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:50 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:52.169949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:52.170617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:52.177726 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:52.178203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:52.178994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:52.179482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:52.310951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:52.319224 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-acde0e89-9975-4543-81f3-936233c2f056 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.153259 Jul 28 12:49:52.319791 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3639/7283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:52 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:53.340174 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:53.340801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:53.348500 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:53.348956 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:53.349730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:53.350206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:53.488694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:53.497198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-47645854-796b-4793-a8f0-3977331c7ff0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.161014 Jul 28 12:49:53.497771 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3645/7284] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:53 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:53.679144 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:49:53.679378 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:49:54.523878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:54.524544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:54.531498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:54.531968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:54.532750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:54.533205 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:54.666344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:54.673977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b82ab360-b468-4d8e-8f5e-7b4bc0fd7a63 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.154089 Jul 28 12:49:54.674553 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3640/7285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:54 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:55.694106 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:55.694731 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:55.701735 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:55.702188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:55.702957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:55.703426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:55.834641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:55.842259 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f59765e9-69c3-4896-a6cc-5b22b30d2d5c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.152086 Jul 28 12:49:55.842841 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3646/7286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:55 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:56.865387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:56.866074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:56.873854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:56.874326 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:56.875141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:56.875601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:57.009865 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:57.018008 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4a9fc24b-debb-4a48-9d06-8c97e07531ae tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.157635 Jul 28 12:49:57.018647 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3641/7287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:56 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:58.039936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:58.040552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:58.047586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:58.048033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:58.048800 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:58.049348 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:58.188860 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:58.196713 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7cb9b1e0-7beb-442f-9383-641a19132b3b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1679 microversion: 2.1 time: 0.160671 Jul 28 12:49:58.197299 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3647/7288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:58 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:49:59.218860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:49:59.219557 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:49:59.226655 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:59.227149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:59.227945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:49:59.228397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:49:59.434786 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:49:59.442774 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6161fe3f-3420-4601-b458-ca4eb91691db tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1682 microversion: 2.1 time: 0.227746 Jul 28 12:49:59.443441 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3642/7289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:49:59 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:23.630002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:23.632220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:23.634548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=12 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:23.635245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:23.640856 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:23.641338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:23.642111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:23.642552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:23.705545 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e86d2a34-9287-40fd-8a5c-3e3f67c5fa6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action" status: 200 len: 68896 microversion: 2.1 time: 0.079942 Jul 28 12:50:23.706263 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3648/7290] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:50:23 2022] POST /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076/action => generated 68896 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:50:30.712521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:30.718519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-921ac2f0-9cc2-4efb-86cf-a4977bc87f3f req-70e0c882-3667-4d69-b263-7e48a2b14b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8451455-946a-44da-9a9b-bf5288655076", "tag": "92a82430-b838-48dd-a5e6-dc9314960585"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:30.723218 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:30.725512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=15 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:30.726288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=40 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:30.732578 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:30.733065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:30.734164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-921ac2f0-9cc2-4efb-86cf-a4977bc87f3f req-70e0c882-3667-4d69-b263-7e48a2b14b31 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:30.734288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:30.734613 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-921ac2f0-9cc2-4efb-86cf-a4977bc87f3f req-70e0c882-3667-4d69-b263-7e48a2b14b31 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:30.734737 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:30.749134 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-921ac2f0-9cc2-4efb-86cf-a4977bc87f3f req-70e0c882-3667-4d69-b263-7e48a2b14b31 service nova] Creating event network-changed:92a82430-b838-48dd-a5e6-dc9314960585 for instance f8451455-946a-44da-9a9b-bf5288655076 on n-h2-851368-1 Jul 28 12:50:30.755175 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-921ac2f0-9cc2-4efb-86cf-a4977bc87f3f req-70e0c882-3667-4d69-b263-7e48a2b14b31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040265 Jul 28 12:50:30.755679 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3649/7291] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:50:30.765095 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:50:30.849847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8057263-62c3-4ca1-bd82-e35e4df69752 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 204 len: 0 microversion: 2.1 time: 0.141396 Jul 28 12:50:30.850457 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3643/7292] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:50:30 2022] DELETE /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:50:30.862079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:30.862694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:30.869346 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:30.870191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:30.870982 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:30.871598 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:31.036066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:31.043740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-61cfa7a4-ed0b-409c-804c-06a7bdcc5c3d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1688 microversion: 2.1 time: 0.188555 Jul 28 12:50:31.044313 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3650/7293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:30 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:32.067481 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:32.068209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:32.075339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:32.075812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:32.076639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:32.077133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:32.241691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:32.249313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-990dc179-366a-4411-84d3-2ee9ff147925 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1688 microversion: 2.1 time: 0.186668 Jul 28 12:50:32.249895 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3644/7294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:32 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:32.990021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1f1bbeb0-6323-4ed4-a689-adf2a9e9b611 req-18400d79-8b06-4c3c-9361-87e5a8ee7140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8451455-946a-44da-9a9b-bf5288655076", "name": "network-vif-deleted", "tag": "92a82430-b838-48dd-a5e6-dc9314960585"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:32.999672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1f1bbeb0-6323-4ed4-a689-adf2a9e9b611 req-18400d79-8b06-4c3c-9361-87e5a8ee7140 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:33.000129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1f1bbeb0-6323-4ed4-a689-adf2a9e9b611 req-18400d79-8b06-4c3c-9361-87e5a8ee7140 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:33.011601 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1f1bbeb0-6323-4ed4-a689-adf2a9e9b611 req-18400d79-8b06-4c3c-9361-87e5a8ee7140 service nova] Creating event network-vif-deleted:92a82430-b838-48dd-a5e6-dc9314960585 for instance f8451455-946a-44da-9a9b-bf5288655076 on n-h2-851368-1 Jul 28 12:50:33.016830 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1f1bbeb0-6323-4ed4-a689-adf2a9e9b611 req-18400d79-8b06-4c3c-9361-87e5a8ee7140 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089965 Jul 28 12:50:33.017435 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3651/7295] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:50:33.270493 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:33.271160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:33.278639 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:33.279222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:33.280037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:33.280510 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:33.318427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:33.319784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:33.320287 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lazy-loading 'fault' on Instance uuid f8451455-946a-44da-9a9b-bf5288655076 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:50:33.367625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:33.375247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0c48858a-e9cd-4f5d-92d4-49cc058a89ac tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 200 len: 1357 microversion: 2.1 time: 0.109199 Jul 28 12:50:33.375823 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3645/7296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:33 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:34.397695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:34.398344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: f8451455-946a-44da-9a9b-bf5288655076] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:34.404628 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:34.405075 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:34.405838 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:34.406274 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:34.419736 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] HTTP exception thrown: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Request method failure captured: Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 HTTP/1.1 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oVafrcKkNF8QKPkopcQ4nuBIwfcDBe4YIwefbf4P7CY1XDFE2E_ptVjZLOROROW4aMnYQ6PoZFMRex_NI0BiUzkbuaaIEKyNwfjbdAMyflBLO6as6pgNbSBKTjEE4Mg43kOHB1JoIA11sVCtx1W19bdzVRW7zydHm4G5PCOYrpaqk4 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22ed509631c54f2984945fda783b3539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22ed509631c54f2984945fda783b3539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}] Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a1cd522c87347969a4dea633fafef7d Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'f8451455-946a-44da-9a9b-bf5288655076'} Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:50:34.421329 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Returning 404 to user: Instance f8451455-946a-44da-9a9b-bf5288655076 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f838e5ef-dd1d-411a-828f-388d33476a7d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076" status: 404 len: 111 microversion: 2.1 time: 0.030265 Jul 28 12:50:34.426843 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3652/7297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:34 2022] GET /compute/v2.1/servers/f8451455-946a-44da-9a9b-bf5288655076 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:50:37.368032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-307ba388-61b1-4db1-b803-a320d425f986 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '.version_select at 0x7f2ebbf6f4c0>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:37.389957 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-307ba388-61b1-4db1-b803-a320d425f986 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618019191" status: 202 len: 0 microversion: 2.1 time: 0.025583 Jul 28 12:50:37.390561 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3646/7298] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618019191 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:50:37.415688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa072480-889d-46d7-9365-5aa8a9f37c12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: .version_select at 0x7f2eb322af70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1825177131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrHJwNkt44idnFF9aBYzFHS5xwRWCa/u2+4qNDMSjR0FtXfu0YbYab+9O/CLhcCOEFPPZ9iGr5CrfVmq16jvlI5QhmQFqVj2MlZ98yjn0twf0lDLY2QzqLgwrcWgg3Aqg=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:37.432518 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fa072480-889d-46d7-9365-5aa8a9f37c12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:50:37.437743 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-fa072480-889d-46d7-9365-5aa8a9f37c12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:50:37.462056 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa072480-889d-46d7-9365-5aa8a9f37c12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050287 Jul 28 12:50:37.462668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3653/7299] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:50:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:50:42.867611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-670985165", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "be391efb-bd42-45a0-856f-f9a297294006"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1825177131", "security_groups": [{"name": "tempest-secgroup-smoke-1195680419"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:43.154008 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] validate_networks() for [('be391efb-bd42-45a0-856f-f9a297294006', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:50:43.372329 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:43.632053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:50:43.632808 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:50:43.633115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:50:43.633567 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:50:43.634012 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:50:43.648519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:43.648992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:43.649813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:43.650402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:43.669553 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:50:43.675801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:50:43.697206 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:50:43.700229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:50:43.756787 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c0bc971b-86b1-4e97-99c3-64fda7422d0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.893456 Jul 28 12:50:43.768638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39a31c9d-1de8-4cb7-9d6e-cce73bac91fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:43.769895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39a31c9d-1de8-4cb7-9d6e-cce73bac91fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:43.775102 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3647/7300] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:50:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:50:43.934706 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39a31c9d-1de8-4cb7-9d6e-cce73bac91fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:43.944289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39a31c9d-1de8-4cb7-9d6e-cce73bac91fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1266 microversion: 2.1 time: 0.179604 Jul 28 12:50:43.945153 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3654/7301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:43 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:44.968554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:44.970979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:44.982347 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:44.983098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:44.984385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:44.985772 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:45.146077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:45.154795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7240f2b2-ed60-4b8d-846d-0408e00e0010 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1326 microversion: 2.1 time: 0.192761 Jul 28 12:50:45.160738 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3648/7302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:44 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:46.178377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:46.179625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:46.185592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:46.189047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:46.189565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:46.190472 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:46.192022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:46.480038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:46.492755 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-43153f78-3c07-4f19-a6f7-67f11045e966 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.317641 Jul 28 12:50:46.493511 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3655/7303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:46 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:47.184291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-28ca6d9d-d78a-4e49-ad98-5d6688e82528 req-bfc24383-f4b4-41d4-b3c2-2b64c9849ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:47.196804 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-28ca6d9d-d78a-4e49-ad98-5d6688e82528 req-bfc24383-f4b4-41d4-b3c2-2b64c9849ff0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:47.197613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-28ca6d9d-d78a-4e49-ad98-5d6688e82528 req-bfc24383-f4b4-41d4-b3c2-2b64c9849ff0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:47.214502 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-28ca6d9d-d78a-4e49-ad98-5d6688e82528 req-bfc24383-f4b4-41d4-b3c2-2b64c9849ff0 service nova] Creating event network-changed:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h1-851368-1 Jul 28 12:50:47.221793 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-28ca6d9d-d78a-4e49-ad98-5d6688e82528 req-bfc24383-f4b4-41d4-b3c2-2b64c9849ff0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041452 Jul 28 12:50:47.222432 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3649/7304] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:50:47.514979 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:47.516931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:47.525156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:47.525619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:47.526403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:47.526924 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:47.708604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:47.716300 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46a7b60d-ff53-4562-8896-148783ba188b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.205299 Jul 28 12:50:47.716873 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3656/7305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:47 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:48.738129 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:48.738849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:48.746101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:48.746565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:48.747379 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:48.747834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:48.879623 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:48.887058 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d89c8973-1b1a-44c4-b973-24dc17d8add9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.153474 Jul 28 12:50:48.887646 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3650/7306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:48 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:49.908474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:49.909389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:49.917059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:49.917515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:49.918298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:49.918745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:50.123172 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:50.131628 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9781d1ba-56ad-46cc-9763-ed6903bff127 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.227173 Jul 28 12:50:50.132217 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3657/7307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:49 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:51.152345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:51.152909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:51.159776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:51.160251 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:51.161045 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:51.161502 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:51.291049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:51.299050 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a79d9b7-4c65-4390-b75f-2ae2adb54a04 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.150437 Jul 28 12:50:51.299647 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3651/7308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:51 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:52.320063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:52.320603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:52.327684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:52.328161 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:52.328929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:52.329363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:52.461191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:52.468742 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fe7c6da6-e320-45d3-b45f-b50487605348 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.152628 Jul 28 12:50:52.469319 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3658/7309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:52 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:53.490850 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:53.491521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:53.499465 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:53.499941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:53.500778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:53.501278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:53.647335 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:53.656723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-442b31d6-bd48-42b1-ab2d-5a470e94f10f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.170521 Jul 28 12:50:53.657444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3652/7310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:53 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:53.660889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-dee2b270-bc09-4efa-9934-e162ca95e466 req-ed8c5200-28b5-4998-88f6-ba6155c8f086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "name": "network-vif-plugged", "status": "completed", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:53.668377 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:53.672691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dee2b270-bc09-4efa-9934-e162ca95e466 req-ed8c5200-28b5-4998-88f6-ba6155c8f086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:53.673153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-dee2b270-bc09-4efa-9934-e162ca95e466 req-ed8c5200-28b5-4998-88f6-ba6155c8f086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:53.686121 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-dee2b270-bc09-4efa-9934-e162ca95e466 req-ed8c5200-28b5-4998-88f6-ba6155c8f086 service nova] Creating event network-vif-plugged:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h1-851368-1 Jul 28 12:50:53.691132 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-dee2b270-bc09-4efa-9934-e162ca95e466 req-ed8c5200-28b5-4998-88f6-ba6155c8f086 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096678 Jul 28 12:50:53.691734 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3659/7311] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:50:54.682393 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:54.683054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:54.685037 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:54.685719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:54.693052 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:54.693522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:54.694339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:54.694798 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:54.837995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:54.845660 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74046f97-4427-4b4c-bd87-06827946d31c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1392 microversion: 2.1 time: 0.167282 Jul 28 12:50:54.846237 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3653/7312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:54 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:55.864055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:50:55.869371 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:55.870078 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:55.876584 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:55.877654 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:55.878426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:55.878866 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:56.010407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:56.017904 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-80cb564f-2cc9-4fd5-bdaf-ac82ca96c808 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1564 microversion: 2.1 time: 0.154898 Jul 28 12:50:56.018467 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3660/7313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:55 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:56.038376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:56.039017 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:56.045940 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:56.046414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:56.047239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:56.047703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:56.177750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:56.185265 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d5a44126-3757-42a6-a28a-a7c93c8218e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1564 microversion: 2.1 time: 0.150826 Jul 28 12:50:56.185866 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3654/7314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:56 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:50:57.775329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:50:57.775830 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-f5db12c8-79af-4edb-9384-00de39210b55 req-a2a554de-34c7-415d-850a-77a08a2a0d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:50:57.776203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:50:57.784458 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:57.785257 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:57.786148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:57.786663 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:57.786782 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5db12c8-79af-4edb-9384-00de39210b55 req-a2a554de-34c7-415d-850a-77a08a2a0d5c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:50:57.787162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-f5db12c8-79af-4edb-9384-00de39210b55 req-a2a554de-34c7-415d-850a-77a08a2a0d5c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:50:57.799770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-f5db12c8-79af-4edb-9384-00de39210b55 req-a2a554de-34c7-415d-850a-77a08a2a0d5c service nova] Creating event network-changed:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h1-851368-1 Jul 28 12:50:57.804980 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-f5db12c8-79af-4edb-9384-00de39210b55 req-a2a554de-34c7-415d-850a-77a08a2a0d5c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Jul 28 12:50:57.806801 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3655/7315] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:50:58.024933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:50:58.032762 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-786fbca0-89b2-499b-8f85-fcbc0e26a219 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1564 microversion: 2.1 time: 0.261999 Jul 28 12:50:58.034339 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3661/7316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:50:57 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:51:31.362792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:51:31.365160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:51:31.367620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:51:31.368284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=42 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:51:31.375233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:51:31.375705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:51:31.377015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:51:31.377473 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:51:31.444174 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fca8ebd1-0979-494e-a068-70afbfc72780 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action" status: 200 len: 24565 microversion: 2.1 time: 0.085915 Jul 28 12:51:31.445078 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3656/7317] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:51:31 2022] POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action => generated 24565 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:52:01.898556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=5 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:01.899336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=38 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:01.903366 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:01.905705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:01.913095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:01.913546 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:01.914313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:01.914753 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:01.997198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:02.005487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119236) resize /opt/stack/nova/nova/compute/api.py:4169}} Jul 28 12:52:02.011915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:52:02.012344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:52:02.012823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:52:02.013243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:52:02.013658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:52:02.079632 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-42808805-956d-47ae-8634-74b15f5d6dfa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action" status: 202 len: 0 microversion: 2.1 time: 0.182741 Jul 28 12:52:02.081041 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3662/7318] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:52:01 2022] POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:52:02.091793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:02.092305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:02.094974 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:02.095774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:02.101651 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:02.102101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:02.102896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:02.103388 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:02.241226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:02.248887 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2e2a0b22-cdd8-450f-8801-6edf18db8991 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1692 microversion: 2.1 time: 0.162466 Jul 28 12:52:02.249458 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3657/7319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:02 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:03.275173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:03.275889 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:03.282750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:03.283289 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:03.284076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:03.284520 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:03.425554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:03.435447 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2a9e1498-d314-4347-adf2-c5fb9f28fbfb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1692 microversion: 2.1 time: 0.165507 Jul 28 12:52:03.436042 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3663/7320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:03 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:04.459617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:04.460305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:04.467330 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:04.467803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:04.468630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:04.469088 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:04.606223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:04.614714 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2673deeb-b508-48ad-b4c1-1f934861e0fb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1692 microversion: 2.1 time: 0.158970 Jul 28 12:52:04.615419 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3658/7321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:04 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:05.636331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:05.636948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:05.644452 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:05.644904 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:05.645673 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:05.646110 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:05.787188 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:05.795140 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-87be05c0-73d9-49f8-b169-acf4927e82a2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.162662 Jul 28 12:52:05.795724 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3664/7322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:05 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:06.817652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:06.818284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:06.825167 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:06.825636 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:06.826457 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:06.826868 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:06.964308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:06.972528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2022b872-4420-4b68-ab61-9b9cca9539ec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.158763 Jul 28 12:52:06.973110 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3659/7323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:06 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:07.994336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:07.994949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:08.002349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:08.002805 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:08.003605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:08.004047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:08.139704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:08.147740 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-79708b11-ef29-4f72-b711-cefde6585ed8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.157483 Jul 28 12:52:08.148330 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3665/7324] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:07 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:09.169193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:09.169832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:09.177375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:09.177844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:09.178632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:09.179149 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:09.309780 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:09.317444 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d04a3803-98e0-4988-98eb-751e2220f936 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.152284 Jul 28 12:52:09.318032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3660/7325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:09 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:10.337896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:10.338544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:10.347000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:10.347476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:10.348243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:10.348682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:10.477091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:10.484797 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cff65036-100a-4093-a3ca-7b39009b1e13 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.150957 Jul 28 12:52:10.485362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3666/7326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:10 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:52:11.505694 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:11.506325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:11.513233 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:11.513695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:11.514468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:11.514921 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:11.648073 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:11.655704 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dcc102ff-4e66-4dc9-a3c4-cccc09f1bcbc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.153931 Jul 28 12:52:11.656934 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3661/7327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:11 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:12.678255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:12.678875 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:12.686018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:12.686483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:12.687897 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:12.688337 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:12.818322 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:12.825743 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-83556343-1f55-433f-ab37-c465c2d9fe99 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.151483 Jul 28 12:52:12.826330 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3667/7328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:12 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:13.847727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:13.848359 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:13.855512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:13.855984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:13.856768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:13.857226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:13.994074 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:14.002027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-29b7a287-ee67-459e-b912-fc1b04ab289a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.158762 Jul 28 12:52:14.002612 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3662/7329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:13 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:15.023227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:15.023846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:15.031550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:15.032005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:15.032777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:15.033221 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:15.161844 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:15.169296 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-77e7d9bf-5449-4f85-9ae0-36ec58e660f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.149973 Jul 28 12:52:15.169872 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3668/7330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:15 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:16.191971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:16.192601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:16.198701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:16.199204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:16.199996 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:16.200458 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:16.337879 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:16.345534 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-162accd3-5b3d-4a89-835c-065ed08d8b0b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1697 microversion: 2.1 time: 0.158345 Jul 28 12:52:16.346108 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3663/7331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:16 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:17.366044 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:17.366665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:17.373565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:17.374023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:17.375327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:17.375777 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:17.418888 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "name": "network-vif-unplugged", "status": "completed", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:17.430744 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:17.431258 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:17.444454 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] Creating event network-vif-unplugged:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h2-851368-1 Jul 28 12:52:17.450370 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119235) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:52:17.462125 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-6ef0fcb4-807c-4e00-8be7-0073135aeb15 req-6c7494ce-3b26-4b2a-83e5-7ed2aba2db39 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047546 Jul 28 12:52:17.462742 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3664/7332] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:52:17.531260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:17.543380 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e71f456-d971-4434-b429-e74a8b95a93b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1696 microversion: 2.1 time: 0.181079 Jul 28 12:52:17.559812 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3669/7333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:17 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:18.570735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:18.571492 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:18.578209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:18.578674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:18.579488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:18.579945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:18.714693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:18.722352 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2a62c996-5ad0-4454-9257-c0b1ee893583 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1694 microversion: 2.1 time: 0.156751 Jul 28 12:52:18.722865 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3665/7334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:18 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:19.476791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:19.488076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:19.488593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:19.503896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] Creating event network-changed:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h2-851368-1 Jul 28 12:52:19.509338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851368-1', 'n-h1-851368-1'} {{(pid=119236) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5889}} Jul 28 12:52:19.520866 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1edad084-92f1-4857-9bfb-9242031f3c4b req-e95c20f0-c180-4807-890a-339927a0879b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047670 Jul 28 12:52:19.521726 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3670/7335] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:52:19.743983 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:19.744610 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:19.752180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:19.752646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:19.753430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:19.753885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:19.989951 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:19.998977 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e4c06e0f-8ee5-45eb-965b-ba6c80c1af48 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1694 microversion: 2.1 time: 0.258686 Jul 28 12:52:19.999545 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3666/7336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:19 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:21.022507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:21.023237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:21.029487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.029946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.030717 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.031194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.168262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:21.176518 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-735184dc-9fa8-49ca-a1f3-0f11b01923f2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1691 microversion: 2.1 time: 0.159112 Jul 28 12:52:21.177099 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3671/7337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:21 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:21.198695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:21.199285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:21.206136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.206601 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.207401 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.207861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.266524 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-55d49b26-35cc-4b3e-84b4-4b27cf1da5f1 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action" status: 204 len: 0 microversion: 2.1 time: 0.071465 Jul 28 12:52:21.267195 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3667/7338] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:52:21 2022] POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:52:21.326554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:21.327255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:21.334092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.334549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.335358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.335808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.528358 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:21.536540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-568ad1bd-207e-4994-a9b2-12594bbf1df4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1691 microversion: 2.1 time: 0.265025 Jul 28 12:52:21.537125 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3672/7339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:21 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:21.556910 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:21.557640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:21.564105 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.564573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.565375 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:21.565841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:21.785718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:21.793472 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f20ca266-7fe1-4d69-8d60-80e6232d8284 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1691 microversion: 2.1 time: 0.240829 Jul 28 12:52:21.794050 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3668/7340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:21 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:22.814420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:22.815040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:22.822131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:22.822592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:22.823399 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:22.823846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:22.957993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:22.965649 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5fc5cf76-856b-4e09-a3fe-0c4569423612 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1683 microversion: 2.1 time: 0.155682 Jul 28 12:52:22.966434 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3673/7341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:22 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:52:24.696609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-ba7fb14d-4a59-4a78-ba7b-0e2c311dc9d0 req-603e5b51-be18-4568-af4f-ccad6735e6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "name": "network-vif-plugged", "status": "completed", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:24.711219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ba7fb14d-4a59-4a78-ba7b-0e2c311dc9d0 req-603e5b51-be18-4568-af4f-ccad6735e6f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:24.711508 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-ba7fb14d-4a59-4a78-ba7b-0e2c311dc9d0 req-603e5b51-be18-4568-af4f-ccad6735e6f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:24.724987 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-ba7fb14d-4a59-4a78-ba7b-0e2c311dc9d0 req-603e5b51-be18-4568-af4f-ccad6735e6f1 service nova] Creating event network-vif-plugged:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h2-851368-1 Jul 28 12:52:24.730540 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-ba7fb14d-4a59-4a78-ba7b-0e2c311dc9d0 req-603e5b51-be18-4568-af4f-ccad6735e6f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037769 Jul 28 12:52:24.731353 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3669/7342] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:52:45.144679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:45.147142 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:45.149294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=28 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:45.149996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:45.155890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:45.156345 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:45.157153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:45.157599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:45.224897 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-10f25719-95df-44e5-9afb-3e701169e341 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action" status: 200 len: 24580 microversion: 2.1 time: 0.085288 Jul 28 12:52:45.225447 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3674/7343] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:52:45 2022] POST /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9/action => generated 24580 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:52:52.226126 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:52.226745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:52.227316 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7984302b-ff02-4a1c-92e2-330a070dd2cb req-c461e7a3-a22b-47a4-b35c-9ce1da793086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:52.229312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=26 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:52.230164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:52:52.239376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:52.239784 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7984302b-ff02-4a1c-92e2-330a070dd2cb req-c461e7a3-a22b-47a4-b35c-9ce1da793086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:52.239988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:52.240847 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7984302b-ff02-4a1c-92e2-330a070dd2cb req-c461e7a3-a22b-47a4-b35c-9ce1da793086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:52.240973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:52.241243 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:52.252253 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7984302b-ff02-4a1c-92e2-330a070dd2cb req-c461e7a3-a22b-47a4-b35c-9ce1da793086 service nova] Creating event network-changed:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h2-851368-1 Jul 28 12:52:52.257540 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7984302b-ff02-4a1c-92e2-330a070dd2cb req-c461e7a3-a22b-47a4-b35c-9ce1da793086 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Jul 28 12:52:52.258437 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3675/7344] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:52:52.273843 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:52:52.364294 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-92955a32-310a-493c-8073-e5478d2d0f1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 204 len: 0 microversion: 2.1 time: 0.142975 Jul 28 12:52:52.368376 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3670/7345] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:52:52 2022] DELETE /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:52:52.375100 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:52.376266 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:52.382817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:52.383433 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:52.384318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:52.384939 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:52.529203 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:52.540039 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fbe40f11-4668-4186-9c93-aabd7fc3dcd3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1689 microversion: 2.1 time: 0.170157 Jul 28 12:52:52.540632 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3676/7346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:52 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:53.561978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:53.562709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:53.569979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:53.570454 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:53.571270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:53.571743 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:53.712181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:52:53.720308 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-11288760-d4e3-4d0c-b68f-9f1b74ebcdca tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 200 len: 1689 microversion: 2.1 time: 0.162704 Jul 28 12:52:53.720890 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3671/7347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:53 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:52:54.360607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d6412eff-3cbb-4da6-aa9a-f888526993d7 req-ff163ee8-d533-466e-8168-ddcbde55677e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa08755-d852-48ec-8544-8c5f4fdfc3c9", "name": "network-vif-deleted", "tag": "2b9e111f-7b69-4104-99b6-4a8b54f72b79"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:54.370271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6412eff-3cbb-4da6-aa9a-f888526993d7 req-ff163ee8-d533-466e-8168-ddcbde55677e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:54.370705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d6412eff-3cbb-4da6-aa9a-f888526993d7 req-ff163ee8-d533-466e-8168-ddcbde55677e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:54.382915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d6412eff-3cbb-4da6-aa9a-f888526993d7 req-ff163ee8-d533-466e-8168-ddcbde55677e service nova] Creating event network-vif-deleted:2b9e111f-7b69-4104-99b6-4a8b54f72b79 for instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 on n-h2-851368-1 Jul 28 12:52:54.388689 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d6412eff-3cbb-4da6-aa9a-f888526993d7 req-ff163ee8-d533-466e-8168-ddcbde55677e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088038 Jul 28 12:52:54.390162 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3677/7348] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:52:54.823497 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:54.824029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: 6aa08755-d852-48ec-8544-8c5f4fdfc3c9] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:52:54.832084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:54.832856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:54.834181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:52:54.834845 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:52:54.848309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] HTTP exception thrown: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Request method failure captured: Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 HTTP/1.1 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oVafrcKkNF8QKPkopcQ4nuBIwfcDBe4YIwefbf4P7CY1XDFE2E_ptVjZLOROROW4aMnYQ6PoZFMRex_NI0BiUzkbuaaIEKyNwfjbdAMyflBLO6as6pgNbSBKTjEE4Mg43kOHB1JoIA11sVCtx1W19bdzVRW7zydHm4G5PCOYrpaqk4 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22ed509631c54f2984945fda783b3539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22ed509631c54f2984945fda783b3539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}] Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3a1cd522c87347969a4dea633fafef7d Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '6aa08755-d852-48ec-8544-8c5f4fdfc3c9'} Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:52:54.850119 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Returning 404 to user: Instance 6aa08755-d852-48ec-8544-8c5f4fdfc3c9 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4576e285-0422-41da-bc92-7a872210b1fa tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9" status: 404 len: 111 microversion: 2.1 time: 0.032226 Jul 28 12:52:54.855549 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3672/7349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:52:54 2022] GET /compute/v2.1/servers/6aa08755-d852-48ec-8544-8c5f4fdfc3c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:52:58.115265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-dd00a230-6174-4aed-b76b-b099fa4ae137 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '.version_select at 0x7f2eb24883a0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:52:58.135969 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-dd00a230-6174-4aed-b76b-b099fa4ae137 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1825177131" status: 202 len: 0 microversion: 2.1 time: 0.024882 Jul 28 12:52:58.136890 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3678/7350] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Jul 28 12:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1825177131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:52:58.161565 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9e7056b0-ee6b-491d-aca9-024a676e883e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: .version_select at 0x7f2eb30b3430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-329179838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEFF+ebact1fYSUYDQfain951ZK+e7sTZks9AHwYlOYYe/0g6VThq+Io/AGkQ3pY8B3lq2BCIeptf/BR7doxzNcClLMemeCBreAb65awucnHmqNUbR0mJRtzwfVcmgYww=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:52:58.177627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9e7056b0-ee6b-491d-aca9-024a676e883e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:52:58.183562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-9e7056b0-ee6b-491d-aca9-024a676e883e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:52:58.207199 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9e7056b0-ee6b-491d-aca9-024a676e883e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049586 Jul 28 12:52:58.207790 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3673/7351] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:52:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:53:03.797884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1281937208", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "dde6aaa9-69de-4121-ab30-27356b4a8ef8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-329179838", "security_groups": [{"name": "tempest-secgroup-smoke-1138230931"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:53:03.915360 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] validate_networks() for [('dde6aaa9-69de-4121-ab30-27356b4a8ef8', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:53:04.353746 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:53:04.354166 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:53:04.354642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:53:04.355055 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:53:04.355498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:53:04.365680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:04.366234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:04.367599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:04.368489 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:04.390913 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:53:04.400625 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:53:04.420136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:53:04.423644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:53:04.474197 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-98526efe-b5d6-4183-8308-06b062042e39 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681420 Jul 28 12:53:04.480750 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3679/7352] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:53:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:53:04.487535 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8d43652e-ec5a-4e24-b999-7458dd0b129d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:04.488699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8d43652e-ec5a-4e24-b999-7458dd0b129d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:04.542605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8d43652e-ec5a-4e24-b999-7458dd0b129d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:04.550136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8d43652e-ec5a-4e24-b999-7458dd0b129d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1266 microversion: 2.1 time: 0.067862 Jul 28 12:53:04.550913 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3674/7353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:04 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:05.574295 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e3185682-0343-4a75-81a1-267c75abc61d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:05.575658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e3185682-0343-4a75-81a1-267c75abc61d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:05.648242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e3185682-0343-4a75-81a1-267c75abc61d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:05.662157 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e3185682-0343-4a75-81a1-267c75abc61d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1266 microversion: 2.1 time: 0.093100 Jul 28 12:53:05.673556 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3680/7354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:05 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:06.682440 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-632edd83-da52-46d1-8da7-3b1767c8141a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:06.683214 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-632edd83-da52-46d1-8da7-3b1767c8141a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:06.689905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:06.750422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-632edd83-da52-46d1-8da7-3b1767c8141a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:06.757490 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-632edd83-da52-46d1-8da7-3b1767c8141a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1266 microversion: 2.1 time: 0.078924 Jul 28 12:53:06.758292 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3675/7355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:06 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:07.777773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9f9a0174-5f07-4c61-96da-357245ddc2cc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:07.778398 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9f9a0174-5f07-4c61-96da-357245ddc2cc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:07.832253 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9f9a0174-5f07-4c61-96da-357245ddc2cc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:07.838926 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9f9a0174-5f07-4c61-96da-357245ddc2cc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1266 microversion: 2.1 time: 0.065061 Jul 28 12:53:07.839527 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3681/7356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:07 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1266 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:08.861076 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:08.861716 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:08.869077 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:08.869547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:08.870346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:08.870807 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:08.931759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:08.941610 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-38944271-1286-47bd-8527-02d79b6ff65a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1270 microversion: 2.1 time: 0.085967 Jul 28 12:53:08.942210 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3676/7357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:08 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:09.963463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:09.964759 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:09.973296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:09.973764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:09.974603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:09.975008 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:10.065551 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:10.073006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e670ea7-4aa9-4a19-b8ef-411dcbd185bc tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1324 microversion: 2.1 time: 0.113919 Jul 28 12:53:10.073587 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3682/7358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:09 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:53:11.094571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:11.095877 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:11.110163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:11.110668 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:11.111543 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:11.111982 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:11.117083 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1364da7e-c4f9-4de4-8a64-fbb8dba58ec2 req-7037a0ff-3811-4361-abcf-0edfa70ca086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfe272-7585-432b-9c0f-7287bd7b2185", "tag": "34938d37-d04d-41e5-b93c-f06edfe0f423"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:53:11.142779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1364da7e-c4f9-4de4-8a64-fbb8dba58ec2 req-7037a0ff-3811-4361-abcf-0edfa70ca086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:11.143271 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1364da7e-c4f9-4de4-8a64-fbb8dba58ec2 req-7037a0ff-3811-4361-abcf-0edfa70ca086 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:11.156676 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1364da7e-c4f9-4de4-8a64-fbb8dba58ec2 req-7037a0ff-3811-4361-abcf-0edfa70ca086 service nova] Creating event network-changed:34938d37-d04d-41e5-b93c-f06edfe0f423 for instance ebdfe272-7585-432b-9c0f-7287bd7b2185 on n-h1-851368-1 Jul 28 12:53:11.161889 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1364da7e-c4f9-4de4-8a64-fbb8dba58ec2 req-7037a0ff-3811-4361-abcf-0edfa70ca086 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050024 Jul 28 12:53:11.162721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3683/7359] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:53:11.340545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:11.348733 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-acae0f51-94f7-4e24-9de4-84eea10745e3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.258683 Jul 28 12:53:11.349252 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3677/7360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:11 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:11.691374 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:53:11.691613 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:53:12.370510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:12.371237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:12.378023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:12.378470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:12.379277 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:12.379698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:12.509556 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:12.517430 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6a1551a7-20a3-43e6-b5fe-b5688c4deba2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.152160 Jul 28 12:53:12.518103 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3684/7361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:12 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:13.540020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:13.540653 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:13.547625 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:13.548100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:13.548892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:13.549353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:13.687645 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:13.696221 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cfd2db19-e2b6-4a6c-ad32-1d88328227c0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.160156 Jul 28 12:53:13.696831 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3678/7362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:13 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:14.718298 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:14.719119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:14.722002 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:14.727793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:14.728252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:14.729031 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:14.729475 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:14.861810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:14.870535 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5d3c61ae-97a7-49a3-9cbc-dfa5a931e00d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.156805 Jul 28 12:53:14.871143 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3685/7363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:14 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:15.891600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:15.892148 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:15.898641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:15.899144 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:15.899928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:15.900382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:16.028183 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:16.036284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f521a36-4c81-4309-b2dc-3994ea0abee2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.148719 Jul 28 12:53:16.036870 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3679/7364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:15 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:16.355401 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8a768435-c60e-47c1-a7e5-233a869afbf4 req-458963df-431b-48f0-aca9-845c2adb2df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfe272-7585-432b-9c0f-7287bd7b2185", "name": "network-vif-plugged", "status": "completed", "tag": "34938d37-d04d-41e5-b93c-f06edfe0f423"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:53:16.362260 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:16.367971 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8a768435-c60e-47c1-a7e5-233a869afbf4 req-458963df-431b-48f0-aca9-845c2adb2df9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:16.368380 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8a768435-c60e-47c1-a7e5-233a869afbf4 req-458963df-431b-48f0-aca9-845c2adb2df9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:16.373969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=37 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:16.382275 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8a768435-c60e-47c1-a7e5-233a869afbf4 req-458963df-431b-48f0-aca9-845c2adb2df9 service nova] Creating event network-vif-plugged:34938d37-d04d-41e5-b93c-f06edfe0f423 for instance ebdfe272-7585-432b-9c0f-7287bd7b2185 on n-h1-851368-1 Jul 28 12:53:16.387363 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8a768435-c60e-47c1-a7e5-233a869afbf4 req-458963df-431b-48f0-aca9-845c2adb2df9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035669 Jul 28 12:53:16.388052 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3686/7365] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:53:17.057055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:17.057696 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:17.059590 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=8 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:17.066056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:17.066526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:17.067348 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:17.067811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:17.204938 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:17.212522 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0f859206-02c1-4ec5-95b3-4b83f23c6e10 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1392 microversion: 2.1 time: 0.159413 Jul 28 12:53:17.213112 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3680/7366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:17 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:18.232391 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:18.237297 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:18.238058 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:18.245462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:18.245917 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:18.246681 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:18.247156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:18.381634 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:18.389311 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6abe2330-b1a3-4677-b24c-0d73820f867e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1564 microversion: 2.1 time: 0.159379 Jul 28 12:53:18.389915 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3687/7367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:18 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:18.409832 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:18.410455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:18.417273 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:18.417741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:18.418579 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:18.419032 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:18.553220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:18.560870 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-489fa977-544e-4dd6-815b-6936a350d245 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1564 microversion: 2.1 time: 0.154911 Jul 28 12:53:18.561443 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3681/7368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:18 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:20.185416 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:53:20.186308 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:20.191263 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-87a9bf6b-e340-4b78-85e2-a32ac5b42ccc req-6e6ed47f-ba8f-4865-b42e-f6b5f6e9c019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfe272-7585-432b-9c0f-7287bd7b2185", "tag": "34938d37-d04d-41e5-b93c-f06edfe0f423"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:53:20.203191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:20.203642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:20.204422 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:20.204863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:20.205242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-87a9bf6b-e340-4b78-85e2-a32ac5b42ccc req-6e6ed47f-ba8f-4865-b42e-f6b5f6e9c019 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:20.205844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-87a9bf6b-e340-4b78-85e2-a32ac5b42ccc req-6e6ed47f-ba8f-4865-b42e-f6b5f6e9c019 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:20.220818 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-87a9bf6b-e340-4b78-85e2-a32ac5b42ccc req-6e6ed47f-ba8f-4865-b42e-f6b5f6e9c019 service nova] Creating event network-changed:34938d37-d04d-41e5-b93c-f06edfe0f423 for instance ebdfe272-7585-432b-9c0f-7287bd7b2185 on n-h1-851368-1 Jul 28 12:53:20.228198 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-87a9bf6b-e340-4b78-85e2-a32ac5b42ccc req-6e6ed47f-ba8f-4865-b42e-f6b5f6e9c019 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040556 Jul 28 12:53:20.231433 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3682/7369] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:53:20.429477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:53:20.437408 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c3945996-3f09-4d51-a942-44349b20915d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1564 microversion: 2.1 time: 0.256037 Jul 28 12:53:20.438132 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3688/7370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:53:20 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1564 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:53:53.731935 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:53:53.734256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:53:53.736753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:53.737419 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=38 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:53:53.744456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:53.744932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:53.745733 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:53:53.746197 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:53:53.810834 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-12d3955a-cc97-4f90-919d-3d93a53546b2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action" status: 200 len: 24567 microversion: 2.1 time: 0.083848 Jul 28 12:53:53.811527 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3683/7371] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:53:53 2022] POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action => generated 24567 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:54:24.256995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=5 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:54:24.257658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=13 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:54:24.262050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-438a2e6e-1d58-48e3-8db2-0b12eaa1a4f5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:54:24.268810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438a2e6e-1d58-48e3-8db2-0b12eaa1a4f5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:24.269264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-438a2e6e-1d58-48e3-8db2-0b12eaa1a4f5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:24.290978 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-438a2e6e-1d58-48e3-8db2-0b12eaa1a4f5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Going to try to stop instance {{(pid=119236) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 12:54:24.332888 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-438a2e6e-1d58-48e3-8db2-0b12eaa1a4f5 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action" status: 202 len: 0 microversion: 2.1 time: 0.077588 Jul 28 12:54:24.333672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3689/7372] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:54:24 2022] POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:54:24.343322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:24.344055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:24.346753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:54:24.347664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:54:24.354657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:24.355162 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:24.356632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:24.357131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:24.495320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:24.502926 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6478b7b6-2066-4a68-9816-ec5ea1314680 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.164526 Jul 28 12:54:24.503555 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3684/7373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:24 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:25.526976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:25.528312 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:25.534764 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:25.535359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:25.536153 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:25.536604 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:25.672225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:25.679798 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-75dadef6-4c95-4878-9050-1fae616cd17d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.158274 Jul 28 12:54:25.680376 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3690/7374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:25 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:26.701971 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:26.702602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:26.710748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:26.711277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:26.712057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:26.712511 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:26.844384 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:26.851897 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-351cd7a9-4407-43d6-ac33-3d9537ad8e12 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.154434 Jul 28 12:54:26.852472 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3685/7375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:26 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:27.874407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:27.875023 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:27.881880 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:27.882329 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:27.883095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:27.883544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:28.017837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:28.026080 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-66ccec86-4044-4afb-a9a7-c4e7ccf66958 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.156132 Jul 28 12:54:28.026667 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3691/7376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:27 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:29.047417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:29.048058 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:29.055256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:29.055729 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:29.056520 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:29.056979 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:29.190305 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:29.197892 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4c802890-d9bf-4fbc-9146-59fc79e077bf tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.154483 Jul 28 12:54:29.198484 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3686/7377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:29 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:30.219529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:30.220224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:30.226390 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:30.226848 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:30.227647 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:30.228089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:30.361136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:30.368635 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8b6fad2a-f2a0-4ce9-8410-710d92c9e763 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.153186 Jul 28 12:54:30.369217 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3692/7378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:30 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:31.390857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:31.391518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:31.398426 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:31.398900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:31.399713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:31.400173 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:31.530485 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:31.538619 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7f56f0da-d73a-4c1a-94b2-d89d665a91e7 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.152214 Jul 28 12:54:31.539225 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3687/7379] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:31 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:32.559704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:32.560233 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:32.567242 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:32.567702 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:32.568479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:32.568928 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:32.701359 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:32.708885 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f4db99b9-0abf-4924-8736-c9a372bed7ff tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.153145 Jul 28 12:54:32.709463 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3693/7380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:32 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:33.729924 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:33.731104 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:33.738475 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:33.738942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:33.739748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:33.740200 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:33.877901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:33.885593 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e57e660a-65de-4233-8f1e-3aa7fc6e9e6a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.159615 Jul 28 12:54:33.886179 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3688/7381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:33 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:34.906704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:34.907344 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:34.914280 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:34.914725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:34.915507 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:34.915944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:35.047328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:35.054877 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2dd798f7-d58c-4e68-9526-7f0d2b99563e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.152631 Jul 28 12:54:35.055551 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3694/7382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:34 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:36.076529 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:36.077163 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:36.084254 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:36.084722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:36.085507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:36.085961 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:36.220043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:36.227455 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba984af7-fe74-4cf8-bd79-79b93113eccb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.155420 Jul 28 12:54:36.228023 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3689/7383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:36 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:37.248171 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:37.248796 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:37.255769 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:37.256230 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:37.257000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:37.257443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:37.390272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:37.398320 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9cba6dc3-de5f-4ea9-afc6-d2c73eefdd1e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.153877 Jul 28 12:54:37.399172 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3695/7384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:37 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:38.421304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:38.422054 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:38.429317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:38.429787 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:38.430570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:38.431020 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:38.560430 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:38.567914 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6fc7baa4-f562-4732-bbdb-a722291f3a5b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.150982 Jul 28 12:54:38.568482 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3690/7385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:38 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:39.589014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:39.590232 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:39.597261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:39.597721 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:39.598497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:39.598943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:39.733986 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:39.741994 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7386e53b-28d9-4be9-affc-61be16db9be4 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1692 microversion: 2.1 time: 0.156878 Jul 28 12:54:39.742862 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3696/7386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:39 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:40.764522 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:40.765153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:40.771260 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:40.771725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:40.772498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:40.772946 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:40.903349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:40.910863 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f14288c6-655f-4da7-bb69-9b8903de788e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1669 microversion: 2.1 time: 0.151450 Jul 28 12:54:40.911462 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3691/7387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:40 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:54:42.005650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:54:42.007955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:42.016252 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:42.016687 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:42.017459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:42.017895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:42.071688 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4a95bbb4-3a25-44cd-9430-d3027dc40440 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action" status: 200 len: 35373 microversion: 2.1 time: 0.070035 Jul 28 12:54:42.072622 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3697/7388] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:54:42 2022] POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action => generated 35373 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:54:42.084203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-90378cc7-f11c-4043-bf09-4dbad60d07f3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:54:42.091332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90378cc7-f11c-4043-bf09-4dbad60d07f3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:42.091801 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-90378cc7-f11c-4043-bf09-4dbad60d07f3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:42.117009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-90378cc7-f11c-4043-bf09-4dbad60d07f3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Going to try to start instance {{(pid=119235) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 12:54:42.160698 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-90378cc7-f11c-4043-bf09-4dbad60d07f3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action" status: 202 len: 0 microversion: 2.1 time: 0.080205 Jul 28 12:54:42.164427 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3692/7389] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:54:42 2022] POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:54:42.170812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:42.171541 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:42.178740 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:42.179173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:42.179938 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:42.180374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:42.398119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:42.405851 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e2b75398-b69a-41ae-9540-e928117ee45c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1678 microversion: 2.1 time: 0.239987 Jul 28 12:54:42.406510 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3698/7390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:42 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:54:43.428538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:54:43.429431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:54:43.436491 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:43.436945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:43.437954 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:54:43.438410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:54:43.576960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:54:43.584455 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0f47c85-8db0-43be-affc-b6986e239210 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1682 microversion: 2.1 time: 0.160246 Jul 28 12:54:43.585035 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3693/7391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:54:43 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:17.806334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:17.808549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:17.811331 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=20 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:17.812000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:17.818683 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:17.819159 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:17.819932 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:17.820372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:17.903515 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ac6dcc23-256b-47c7-9c8c-7169e758f513 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action" status: 200 len: 59935 microversion: 2.1 time: 0.100893 Jul 28 12:55:17.904216 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3699/7392] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:55:17 2022] POST /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185/action => generated 59935 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:55:35.452153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:35.459356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:35.459839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:35.462387 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=20 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:35.463022 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:35.463526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:35.465021 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:55:35.465554 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.93) !!! Jul 28 12:55:35.471231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:35.471994 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:35.473872 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:35.475024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:35.503489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:55:35.583647 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4e24b9c2-98ef-4764-bfe3-35200bb79cb3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 204 len: 0 microversion: 2.1 time: 0.135625 Jul 28 12:55:35.584616 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3694/7393] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:55:35 2022] DELETE /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:55:35.584770 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-ddb31c8a-2ffc-461f-9cc8-d684db553f2c req-aa9933a6-7076-4ca0-b1f8-45a9e4b071bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfe272-7585-432b-9c0f-7287bd7b2185", "tag": "34938d37-d04d-41e5-b93c-f06edfe0f423"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:35.594376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:35.595194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:35.601400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:35.601871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:35.602674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:35.603154 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:35.611585 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ddb31c8a-2ffc-461f-9cc8-d684db553f2c req-aa9933a6-7076-4ca0-b1f8-45a9e4b071bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:35.613052 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-ddb31c8a-2ffc-461f-9cc8-d684db553f2c req-aa9933a6-7076-4ca0-b1f8-45a9e4b071bb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:35.625299 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-ddb31c8a-2ffc-461f-9cc8-d684db553f2c req-aa9933a6-7076-4ca0-b1f8-45a9e4b071bb service nova] Creating event network-changed:34938d37-d04d-41e5-b93c-f06edfe0f423 for instance ebdfe272-7585-432b-9c0f-7287bd7b2185 on n-h1-851368-1 Jul 28 12:55:35.630541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-ddb31c8a-2ffc-461f-9cc8-d684db553f2c req-aa9933a6-7076-4ca0-b1f8-45a9e4b071bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176456 Jul 28 12:55:35.631409 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3700/7394] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:55:35.747165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:35.754727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a86b11d3-5a37-469e-b2f5-7932606a4cd9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1688 microversion: 2.1 time: 0.164533 Jul 28 12:55:35.755340 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3695/7395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:35 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:36.776881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:36.777591 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:36.785327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:36.785868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:36.786870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:36.787428 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:36.953940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:36.961510 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7641fafe-f260-4a5e-ba4a-add8d2b6aec9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1688 microversion: 2.1 time: 0.188928 Jul 28 12:55:36.962073 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3701/7396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:36 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:37.796301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-c13c14c2-0dd8-4085-8f18-11b6c65e93eb req-9984a89e-cfa4-4bb9-9db6-b6f067407798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfe272-7585-432b-9c0f-7287bd7b2185", "name": "network-vif-deleted", "tag": "34938d37-d04d-41e5-b93c-f06edfe0f423"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:37.807588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c13c14c2-0dd8-4085-8f18-11b6c65e93eb req-9984a89e-cfa4-4bb9-9db6-b6f067407798 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:37.808722 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-c13c14c2-0dd8-4085-8f18-11b6c65e93eb req-9984a89e-cfa4-4bb9-9db6-b6f067407798 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:37.820219 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-c13c14c2-0dd8-4085-8f18-11b6c65e93eb req-9984a89e-cfa4-4bb9-9db6-b6f067407798 service nova] Creating event network-vif-deleted:34938d37-d04d-41e5-b93c-f06edfe0f423 for instance ebdfe272-7585-432b-9c0f-7287bd7b2185 on n-h1-851368-1 Jul 28 12:55:37.825873 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-c13c14c2-0dd8-4085-8f18-11b6c65e93eb req-9984a89e-cfa4-4bb9-9db6-b6f067407798 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Jul 28 12:55:37.826444 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3696/7397] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:55:37.983694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:37.984318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:37.991578 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:37.992029 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:37.992804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:37.993247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:38.025017 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:38.025375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:38.025835 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lazy-loading 'fault' on Instance uuid ebdfe272-7585-432b-9c0f-7287bd7b2185 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:55:38.068543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:38.076379 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0d754858-5821-4b69-aec6-98ffb553d145 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 200 len: 1356 microversion: 2.1 time: 0.097094 Jul 28 12:55:38.076964 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3702/7398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:37 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 1356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:39.099284 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:39.100011 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: ebdfe272-7585-432b-9c0f-7287bd7b2185] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:39.106400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:39.106874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:39.107688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:39.108153 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:39.122219 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] HTTP exception thrown: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Request method failure captured: Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 HTTP/1.1 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oVafrcKkNF8QKPkopcQ4nuBIwfcDBe4YIwefbf4P7CY1XDFE2E_ptVjZLOROROW4aMnYQ6PoZFMRex_NI0BiUzkbuaaIEKyNwfjbdAMyflBLO6as6pgNbSBKTjEE4Mg43kOHB1JoIA11sVCtx1W19bdzVRW7zydHm4G5PCOYrpaqk4 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22ed509631c54f2984945fda783b3539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22ed509631c54f2984945fda783b3539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}] Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 3a1cd522c87347969a4dea633fafef7d Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'ebdfe272-7585-432b-9c0f-7287bd7b2185'} Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:55:39.123932 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Returning 404 to user: Instance ebdfe272-7585-432b-9c0f-7287bd7b2185 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f6572016-e75f-4b54-afd6-40c0bd0bd16d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185" status: 404 len: 111 microversion: 2.1 time: 0.031240 Jul 28 12:55:39.128699 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3697/7399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:39 2022] GET /compute/v2.1/servers/ebdfe272-7585-432b-9c0f-7287bd7b2185 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:55:42.131032 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eeba7b49-0ea2-4c04-86c0-4bf0139504d0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '.version_select at 0x7f2eb26271f0>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:42.156845 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eeba7b49-0ea2-4c04-86c0-4bf0139504d0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-329179838" status: 202 len: 0 microversion: 2.1 time: 0.029656 Jul 28 12:55:42.157813 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3703/7400] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Jul 28 12:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-329179838 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:55:42.190863 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8060ffc0-612e-4639-a1df-a09b15a35c68 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: .version_select at 0x7f2ebc009430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-887117006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7ItZk8BW7REM+qYsmF6WS63i/OkxKu0uZCgLDTfJRj5fiz8WxHyAd84TSImJFriTwTDgpvQIkcgRb7ZSySaEbgRlreDkuVyj2d17WPN23iGBiZqpRAgT8Gp17BWTFQQA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:42.207049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8060ffc0-612e-4639-a1df-a09b15a35c68 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:55:42.212171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-8060ffc0-612e-4639-a1df-a09b15a35c68 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:55:42.237819 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8060ffc0-612e-4639-a1df-a09b15a35c68 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052081 Jul 28 12:55:42.238424 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3698/7401] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:55:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:55:48.271424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:48.277168 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1381668326", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "networks": [{"uuid": "7587c6ae-ab3c-4317-a0b5-7bb9eb156a03"}], "key_name": "tempest-TestNetworkAdvancedServerOps-887117006", "security_groups": [{"name": "tempest-secgroup-smoke-656610828"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:48.458666 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] validate_networks() for [('7587c6ae-ab3c-4317-a0b5-7bb9eb156a03', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:55:48.881679 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:55:48.882129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:55:48.882646 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:55:48.883064 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:55:48.883509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:55:48.892521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:48.892981 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:48.893785 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:48.894227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:48.912791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:55:48.919183 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Getting quotas for user 3a1cd522c87347969a4dea633fafef7d and project 22ed509631c54f2984945fda783b3539. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:55:48.934825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:55:48.937138 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:55:49.002963 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-22e433dd-ce4b-40a8-92dd-ef986857c508 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733457 Jul 28 12:55:49.007169 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3704/7402] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:55:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:55:49.016133 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e980ed99-6563-42fe-8e1a-b03dfa1a3c54 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:49.017480 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e980ed99-6563-42fe-8e1a-b03dfa1a3c54 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:49.114620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:49.199968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e980ed99-6563-42fe-8e1a-b03dfa1a3c54 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:49.207501 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e980ed99-6563-42fe-8e1a-b03dfa1a3c54 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1266 microversion: 2.1 time: 0.196606 Jul 28 12:55:49.221109 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3699/7403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:49 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:50.228626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:50.230328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:50.238397 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:50.238858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:50.239695 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:50.240134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:50.322094 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:50.331040 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-97119722-5d81-4425-8229-2689a0504bec tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1336 microversion: 2.1 time: 0.106332 Jul 28 12:55:50.331850 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3705/7404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:50 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:51.352697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:51.353239 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:51.361544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:51.362022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:51.362891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:51.363566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:51.562871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:51.570737 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6db6d6c0-34dc-47a8-90b6-b8ad84b4a48c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.222118 Jul 28 12:55:51.571337 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3700/7405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:51 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:51.873544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8db434e0-4388-42b1-9562-99f8b56209f4 req-343e0739-c964-4d9a-97d4-6c4e50c56b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d578e-d331-47c8-ae68-006a174f9fe5", "tag": "81541345-a0d0-47af-a83a-4b02d0999b72"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:51.887524 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8db434e0-4388-42b1-9562-99f8b56209f4 req-343e0739-c964-4d9a-97d4-6c4e50c56b42 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:51.888946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8db434e0-4388-42b1-9562-99f8b56209f4 req-343e0739-c964-4d9a-97d4-6c4e50c56b42 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:51.902815 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8db434e0-4388-42b1-9562-99f8b56209f4 req-343e0739-c964-4d9a-97d4-6c4e50c56b42 service nova] Creating event network-changed:81541345-a0d0-47af-a83a-4b02d0999b72 for instance c47d578e-d331-47c8-ae68-006a174f9fe5 on n-h2-851368-1 Jul 28 12:55:51.909517 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8db434e0-4388-42b1-9562-99f8b56209f4 req-343e0739-c964-4d9a-97d4-6c4e50c56b42 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044204 Jul 28 12:55:51.910135 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3706/7406] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:55:52.592385 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:52.593009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:52.599932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:52.600390 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:52.601168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:52.601622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:52.732137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:52.739801 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-46a44642-32d4-41d3-ae78-2b72ac0500c3 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.151898 Jul 28 12:55:52.740374 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3701/7407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:52 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:53.761160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:53.761872 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:53.769003 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:53.769464 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:53.770240 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:53.770685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:53.906783 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:53.917185 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bf170c5c-7f2e-41de-b562-392428da031e tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.159571 Jul 28 12:55:53.917185 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3707/7408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:53 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:54.940803 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:54.941444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:54.951876 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:54.952703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:54.954060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:54.954788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:55.093991 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:55.101622 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1c13d80f-4203-490b-a64f-bf04fde6c02a tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.164854 Jul 28 12:55:55.102196 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3702/7409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:54 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:56.122197 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:56.122812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:56.129697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:56.130154 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:56.130927 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:56.131434 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:56.260059 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:56.268070 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5198b9fb-6342-42e0-a3fe-99dc2aa4e19d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.149785 Jul 28 12:55:56.268649 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3708/7410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:56 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:57.289064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:57.289622 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:57.304313 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:57.304779 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:57.305586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:57.306049 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:57.438231 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:57.445723 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f8012109-6302-43b6-a5cb-b494a2a004c9 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.160662 Jul 28 12:55:57.446303 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3703/7411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:57 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:57.689552 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8bfb5514-8730-42f7-8e74-45e60dd718ac req-3349f03c-7e28-4584-b342-d67cab909130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d578e-d331-47c8-ae68-006a174f9fe5", "name": "network-vif-plugged", "status": "completed", "tag": "81541345-a0d0-47af-a83a-4b02d0999b72"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:55:57.700068 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8bfb5514-8730-42f7-8e74-45e60dd718ac req-3349f03c-7e28-4584-b342-d67cab909130 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:57.700601 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8bfb5514-8730-42f7-8e74-45e60dd718ac req-3349f03c-7e28-4584-b342-d67cab909130 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:57.711780 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8bfb5514-8730-42f7-8e74-45e60dd718ac req-3349f03c-7e28-4584-b342-d67cab909130 service nova] Creating event network-vif-plugged:81541345-a0d0-47af-a83a-4b02d0999b72 for instance c47d578e-d331-47c8-ae68-006a174f9fe5 on n-h2-851368-1 Jul 28 12:55:57.716664 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8bfb5514-8730-42f7-8e74-45e60dd718ac req-3349f03c-7e28-4584-b342-d67cab909130 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081485 Jul 28 12:55:57.717270 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3709/7412] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:55:58.466365 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:58.467024 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:58.474002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:58.474477 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:58.475302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:58.475763 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:58.605605 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:58.613410 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-efbcceec-b2fb-4415-b349-49654009899f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1391 microversion: 2.1 time: 0.151567 Jul 28 12:55:58.613990 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3704/7413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:58 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:59.636571 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:59.637342 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:59.641870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:59.642568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:59.649944 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:59.650394 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:59.651179 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:59.651615 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:59.787101 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:59.795293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4f3f1ac1-c94a-4df4-a3c0-f07a5663ed35 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1563 microversion: 2.1 time: 0.161048 Jul 28 12:55:59.795884 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3710/7414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:59 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:55:59.815562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:55:59.816201 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:55:59.818121 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:55:59.824210 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:59.824681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:59.825461 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:55:59.825925 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:55:59.960568 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:55:59.968318 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6d3efe82-05ea-4ab4-872e-c40073966f6f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1563 microversion: 2.1 time: 0.156517 Jul 28 12:55:59.969095 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3705/7415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:55:59 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:01.553609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:01.554395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:01.556447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-1830fe1c-896e-469f-b22c-27e379cc94bd req-466f30d6-f700-4300-ba22-2d1e54a6e1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d578e-d331-47c8-ae68-006a174f9fe5", "tag": "81541345-a0d0-47af-a83a-4b02d0999b72"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:01.562025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:01.562863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:01.563680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:01.564363 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:01.568706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1830fe1c-896e-469f-b22c-27e379cc94bd req-466f30d6-f700-4300-ba22-2d1e54a6e1e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:01.569186 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-1830fe1c-896e-469f-b22c-27e379cc94bd req-466f30d6-f700-4300-ba22-2d1e54a6e1e0 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:01.582103 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-1830fe1c-896e-469f-b22c-27e379cc94bd req-466f30d6-f700-4300-ba22-2d1e54a6e1e0 service nova] Creating event network-changed:81541345-a0d0-47af-a83a-4b02d0999b72 for instance c47d578e-d331-47c8-ae68-006a174f9fe5 on n-h2-851368-1 Jul 28 12:56:01.588019 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-1830fe1c-896e-469f-b22c-27e379cc94bd req-466f30d6-f700-4300-ba22-2d1e54a6e1e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034997 Jul 28 12:56:01.588849 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3706/7416] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:56:02.134842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:02.143640 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ca106193-2bea-4515-8f5b-158c4703dff2 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1563 microversion: 2.1 time: 0.594276 Jul 28 12:56:02.144397 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3711/7417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:01 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1563 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:23.435748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:23.438194 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:23.440569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:23.441246 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=38 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:23.449378 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:23.449853 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:23.450672 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:23.451180 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:23.525033 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-12805a89-1551-4f87-9691-74ddbbc492b8 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action" status: 200 len: 24574 microversion: 2.1 time: 0.094193 Jul 28 12:56:23.525719 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3707/7418] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:56:23 2022] POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:56:31.699988 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:56:31.700664 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:56:34.548697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:34.549296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:34.551283 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:34.551947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=36 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:34.558596 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:34.559051 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:34.559869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:34.560313 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:34.583946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lazy-loading 'flavor' on Instance uuid c47d578e-d331-47c8-ae68-006a174f9fe5 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:56:34.648068 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0548160e-cb7c-44bb-8d92-2197018882e6 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action" status: 202 len: 0 microversion: 2.1 time: 0.103932 Jul 28 12:56:34.649077 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3712/7419] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:56:34 2022] POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:56:34.658478 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:34.659500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:34.663917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:34.664734 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:34.671051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:34.671538 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:34.672331 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:34.672813 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:34.812256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:34.819875 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2789f86b-9058-4281-8e5c-cbafc9522a1c tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1689 microversion: 2.1 time: 0.166351 Jul 28 12:56:34.820446 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3708/7420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:34 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:35.845820 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:35.846526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:35.852814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:35.853354 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:35.854129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:35.854572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:35.985698 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:35.993187 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-075f0a1a-2d09-487f-9c35-3fce7e348343 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1672 microversion: 2.1 time: 0.153693 Jul 28 12:56:35.993761 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3713/7421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:35 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:37.087968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:37.090410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:37.098468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.098942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.099767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.100235 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.156094 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-be5238e9-7f74-456f-82df-ebb8a56b88f0 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action" status: 200 len: 38425 microversion: 2.1 time: 0.072567 Jul 28 12:56:37.156781 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3709/7422] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:56:37 2022] POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action => generated 38425 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:56:37.169533 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:37.170076 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:37.176974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.177424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.178191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.178632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.247938 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8f6afeb4-8192-4b82-9f7a-8838b456e448 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action" status: 202 len: 0 microversion: 2.1 time: 0.082831 Jul 28 12:56:37.248619 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3714/7423] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:56:37 2022] POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:56:37.257498 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:37.258247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:37.265933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.266634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.267657 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:37.268325 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:37.461051 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:37.469362 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a5059cf4-bc3a-429e-b477-f3582002a458 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1678 microversion: 2.1 time: 0.216218 Jul 28 12:56:37.469941 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3710/7424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:37 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:38.492516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:38.493208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:38.499555 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:38.500006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:38.500758 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:38.501192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:38.642206 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:38.650820 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-350954b0-993d-4812-8e1f-33dec73fb484 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1678 microversion: 2.1 time: 0.163442 Jul 28 12:56:38.651778 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3715/7425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:38 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:39.672768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:39.673394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:39.681427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:39.681896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:39.682676 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:39.683166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:39.815261 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:39.823491 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ac45a0f-77c4-4bbd-aebf-ba270025ec8d tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1681 microversion: 2.1 time: 0.154580 Jul 28 12:56:39.824063 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3711/7426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:39 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:39.917836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:39.920176 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:39.927065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:39.927509 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:39.928276 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:39.928720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:39.984541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2af1a693-19cf-4a6b-9b0e-ab35b1687a50 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action" status: 200 len: 38425 microversion: 2.1 time: 0.070474 Jul 28 12:56:39.985193 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3716/7427] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:56:39 2022] POST /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5/action => generated 38425 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 12:56:40.962093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:40.964137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:40.972132 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-939edd29-d616-49a4-a931-6515b3f73b45 req-e95084f8-9769-464e-a8ec-71cb0065717f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47d578e-d331-47c8-ae68-006a174f9fe5", "tag": "81541345-a0d0-47af-a83a-4b02d0999b72"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:40.975770 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:40.976439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:40.977321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:40.978043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:40.985323 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-939edd29-d616-49a4-a931-6515b3f73b45 req-e95084f8-9769-464e-a8ec-71cb0065717f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:40.986018 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-939edd29-d616-49a4-a931-6515b3f73b45 req-e95084f8-9769-464e-a8ec-71cb0065717f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:40.997757 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-939edd29-d616-49a4-a931-6515b3f73b45 req-e95084f8-9769-464e-a8ec-71cb0065717f service nova] Creating event network-changed:81541345-a0d0-47af-a83a-4b02d0999b72 for instance c47d578e-d331-47c8-ae68-006a174f9fe5 on n-h2-851368-1 Jul 28 12:56:41.010123 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-939edd29-d616-49a4-a931-6515b3f73b45 req-e95084f8-9769-464e-a8ec-71cb0065717f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049375 Jul 28 12:56:41.010721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3717/7428] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:56:41.017891 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 12:56:41.114284 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-770de63d-8b43-4cbd-8dd9-6c7586fbf0eb tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 204 len: 0 microversion: 2.1 time: 0.156007 Jul 28 12:56:41.115030 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3712/7429] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 12:56:40 2022] DELETE /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 12:56:41.124951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:41.125929 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:41.132857 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:41.133439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:41.134859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:41.135460 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:41.298710 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:41.307133 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a0fe44c7-3e3b-40bc-9f76-3cf73308af7b tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1687 microversion: 2.1 time: 0.186510 Jul 28 12:56:41.307716 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3718/7430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:41 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:42.330571 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:42.331345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:42.338720 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:42.339219 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:42.340022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:42.340494 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:42.555175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:42.562795 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c7213e7f-97e3-444b-8d05-6eed9ff7ab92 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1687 microversion: 2.1 time: 0.236609 Jul 28 12:56:42.563410 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3713/7431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:42 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:43.218247 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-8e3b5249-ddaf-4859-af1f-632e4abd195e req-13aaa7fe-c98a-496d-8d6d-9229ff3c4f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47d578e-d331-47c8-ae68-006a174f9fe5", "name": "network-vif-deleted", "tag": "81541345-a0d0-47af-a83a-4b02d0999b72"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:43.232090 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8e3b5249-ddaf-4859-af1f-632e4abd195e req-13aaa7fe-c98a-496d-8d6d-9229ff3c4f28 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:43.232851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-8e3b5249-ddaf-4859-af1f-632e4abd195e req-13aaa7fe-c98a-496d-8d6d-9229ff3c4f28 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:43.244794 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-8e3b5249-ddaf-4859-af1f-632e4abd195e req-13aaa7fe-c98a-496d-8d6d-9229ff3c4f28 service nova] Creating event network-vif-deleted:81541345-a0d0-47af-a83a-4b02d0999b72 for instance c47d578e-d331-47c8-ae68-006a174f9fe5 on n-h2-851368-1 Jul 28 12:56:43.249770 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-8e3b5249-ddaf-4859-af1f-632e4abd195e req-13aaa7fe-c98a-496d-8d6d-9229ff3c4f28 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Jul 28 12:56:43.250373 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3719/7432] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:56:43.584896 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:43.585575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:43.592750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:43.593223 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:43.594027 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:43.594482 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:43.629138 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:43.629612 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:43.630127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.objects.instance [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lazy-loading 'fault' on Instance uuid c47d578e-d331-47c8-ae68-006a174f9fe5 {{(pid=119235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:56:43.672926 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1cd522c87347969a4dea633fafef7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed509631c54f2984945fda783b3539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:56:43.681346 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-083ca815-75c7-4877-ab0b-5fa45f83f05f tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 200 len: 1356 microversion: 2.1 time: 0.100019 Jul 28 12:56:43.682131 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3714/7433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:43 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:56:44.703837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:44.704543 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] [instance: c47d578e-d331-47c8-ae68-006a174f9fe5] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:56:44.710694 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:44.711180 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:44.711941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:56:44.712374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:56:44.725717 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.wsgi [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] HTTP exception thrown: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Request method failure captured: Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: request: GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 HTTP/1.1 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Accept: application/json Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Accept-Encoding: identity Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Connection: close Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Content-Length: 0 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Content-Type: application/json Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Host: 10.222.0.93 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: Openstack-System-Scope: None Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: User-Agent: python-urllib3/1.26.10 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Auth-Token: gAAAAABi4oVafrcKkNF8QKPkopcQ4nuBIwfcDBe4YIwefbf4P7CY1XDFE2E_ptVjZLOROROW4aMnYQ6PoZFMRex_NI0BiUzkbuaaIEKyNwfjbdAMyflBLO6as6pgNbSBKTjEE4Mg43kOHB1JoIA11sVCtx1W19bdzVRW7zydHm4G5PCOYrpaqk4 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Id: None Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Domain-Name: None Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Identity-Status: Confirmed Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Is-Admin-Project: True Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Id: default Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Domain-Name: Default Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Role: member,reader Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Roles: member,reader Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22ed509631c54f2984945fda783b3539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22ed509631c54f2984945fda783b3539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22ed509631c54f2984945fda783b3539"}]}] Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Id: 22ed509631c54f2984945fda783b3539 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-679308675 Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-User: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Id: default Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-User-Domain-Name: Default Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-User-Id: 3a1cd522c87347969a4dea633fafef7d Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: X-User-Name: tempest-TestNetworkAdvancedServerOps-679308675-project Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: method: > Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: exception: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: action_args: {'id': 'c47d578e-d331-47c8-ae68-006a174f9fe5'} Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 12:56:44.727655 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: ERROR nova.api.openstack.wsgi Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Returning 404 to user: Instance c47d578e-d331-47c8-ae68-006a174f9fe5 could not be found. {{(pid=119236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-34c83a63-0247-4189-9bcf-4c194f417e17 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5" status: 404 len: 111 microversion: 2.1 time: 0.030955 Jul 28 12:56:44.732198 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3720/7434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:56:44 2022] GET /compute/v2.1/servers/c47d578e-d331-47c8-ae68-006a174f9fe5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 12:56:48.065591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ba7e98df-bd41-405d-866e-8b8eb8949765 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] Calling method '.version_select at 0x7f2ebbe60430>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:56:48.090799 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ba7e98df-bd41-405d-866e-8b8eb8949765 tempest-TestNetworkAdvancedServerOps-679308675 tempest-TestNetworkAdvancedServerOps-679308675-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-887117006" status: 202 len: 0 microversion: 2.1 time: 0.029111 Jul 28 12:56:48.091602 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3715/7435] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Jul 28 12:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-887117006 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:56:59.425831 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=18 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:59.427364 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:56:59.651351 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-46d8e72d-f74a-4bb9-bc45-8a72580a86ab tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'create', calling method: .version_select at 0x7f2eb25bf040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1136866624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgMpIODccG7ih9pEr3OP5QlFgW5cG1KACWhJScAQykBF1ROKvvIBV29IZP2RotJJJgrdBnCJsiVO+kI//EADGPHrTPKJVCYfuvStzpfeb6WCOJHA1llfS0WbGVEflRvrw=="}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:56:59.668772 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-46d8e72d-f74a-4bb9-bc45-8a72580a86ab tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for project 2d6ab116813148efbe970906aa7d6562. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:56:59.674514 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-46d8e72d-f74a-4bb9-bc45-8a72580a86ab tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for user 30c7f91736da41f09e676bd8ebb9558e and project 2d6ab116813148efbe970906aa7d6562. Resources: {'key_pairs'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:56:59.702343 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-46d8e72d-f74a-4bb9-bc45-8a72580a86ab tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.283659 Jul 28 12:56:59.702953 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3721/7436] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 12:56:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:57:00.672081 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:57:00.673046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:57:00.676968 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1464262142", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1136866624", "security_groups": [{"name": "tempest-secgroup-smoke-997548465"}], "networks": [{"uuid": "960df5e3-27a2-4174-afa9-a446b7344353"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:57:00.787693 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] validate_networks() for [('960df5e3-27a2-4174-afa9-a446b7344353', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 12:57:01.299617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 12:57:01.300055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 12:57:01.300671 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 12:57:01.301100 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 12:57:01.301527 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 12:57:01.310823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:01.311328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:01.312204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:01.312662 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:01.330558 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for project 2d6ab116813148efbe970906aa7d6562. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 12:57:01.335820 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for user 30c7f91736da41f09e676bd8ebb9558e and project 2d6ab116813148efbe970906aa7d6562. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 12:57:01.348972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 12:57:01.351322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 12:57:01.400501 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-1e04bbfc-8e6d-4000-9742-9c236be71249 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729156 Jul 28 12:57:01.407033 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3716/7437] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 12:57:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 12:57:01.412167 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-719010af-9547-4e26-bbf8-dae5ae5df3c0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:01.413675 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-719010af-9547-4e26-bbf8-dae5ae5df3c0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:01.477378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-719010af-9547-4e26-bbf8-dae5ae5df3c0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:01.485005 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-719010af-9547-4e26-bbf8-dae5ae5df3c0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1247 microversion: 2.1 time: 0.076727 Jul 28 12:57:01.485830 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3722/7438] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:01 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:02.512414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:02.514053 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:02.523099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:02.523899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:02.525255 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:02.525713 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:02.622901 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:02.631482 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-aed2ac01-c9be-4fb7-bd9f-1c1ae85b1d46 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1317 microversion: 2.1 time: 0.129427 Jul 28 12:57:02.632293 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3717/7439] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:02 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1317 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:57:03.653375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:03.654128 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:03.664966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:03.665446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:03.666294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:03.666760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:03.812108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:03.827469 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9e728292-5f74-47ad-9a58-597bc6ae4eb6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.178422 Jul 28 12:57:03.828625 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3723/7440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:03 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:03.990416 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-e0d4a63a-59b3-4468-aeca-acbd781fccb8 req-ab0936e4-ad3d-4606-8085-dff7b5b5d75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:57:04.011858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e0d4a63a-59b3-4468-aeca-acbd781fccb8 req-ab0936e4-ad3d-4606-8085-dff7b5b5d75f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:04.012570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-e0d4a63a-59b3-4468-aeca-acbd781fccb8 req-ab0936e4-ad3d-4606-8085-dff7b5b5d75f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:04.025272 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-e0d4a63a-59b3-4468-aeca-acbd781fccb8 req-ab0936e4-ad3d-4606-8085-dff7b5b5d75f service nova] Creating event network-changed:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h1-851368-1 Jul 28 12:57:04.030770 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-e0d4a63a-59b3-4468-aeca-acbd781fccb8 req-ab0936e4-ad3d-4606-8085-dff7b5b5d75f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045089 Jul 28 12:57:04.031776 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3718/7441] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:57:04.848656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:04.849272 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:04.856920 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:04.857309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:04.858070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:04.858531 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:04.990949 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:04.998527 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2c5f2c2c-fdd2-40c2-bf4b-b2cfac722efc tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.153929 Jul 28 12:57:04.999111 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3724/7442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:04 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:06.029919 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:06.030706 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:06.037338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:06.037812 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:06.038604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:06.039064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:06.174187 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:06.182266 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-17a4e498-bfd0-439f-9d08-eb36cb0f01b2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.159290 Jul 28 12:57:06.182846 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3719/7443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:06 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:07.202451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:07.203082 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:07.210034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:07.210486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:07.211286 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:07.212373 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:07.346565 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:07.354724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bd793832-fb3c-474f-a80f-efdd622f37fb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.156181 Jul 28 12:57:07.355731 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3725/7444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:07 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:08.376420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:08.376992 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:08.384686 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:08.385165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:08.385957 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:08.386420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:08.519098 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:08.527108 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-8f7edfa7-43cc-4db7-b4c0-371f05f3d8f2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.154666 Jul 28 12:57:08.527698 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3720/7445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:08 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:09.465462 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-a1e51197-ef8b-4dae-859a-5f277f7dc42d req-ae4d5b44-36e8-4cdf-b7fc-b02cfaa52a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "name": "network-vif-plugged", "status": "completed", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:57:09.477437 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a1e51197-ef8b-4dae-859a-5f277f7dc42d req-ae4d5b44-36e8-4cdf-b7fc-b02cfaa52a5e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:09.478033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-a1e51197-ef8b-4dae-859a-5f277f7dc42d req-ae4d5b44-36e8-4cdf-b7fc-b02cfaa52a5e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:09.490148 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-a1e51197-ef8b-4dae-859a-5f277f7dc42d req-ae4d5b44-36e8-4cdf-b7fc-b02cfaa52a5e service nova] Creating event network-vif-plugged:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h1-851368-1 Jul 28 12:57:09.495574 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-a1e51197-ef8b-4dae-859a-5f277f7dc42d req-ae4d5b44-36e8-4cdf-b7fc-b02cfaa52a5e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034434 Jul 28 12:57:09.496329 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3726/7446] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:57:09.554448 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:09.555160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:09.562177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:09.562650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:09.563523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:09.563978 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:09.701131 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:09.708696 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-93afd0ab-5e73-4d93-89ba-21d8fb752310 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.160527 Jul 28 12:57:09.709285 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3721/7447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:09 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:10.730869 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:10.731623 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:10.738999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:10.739490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:10.740270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:10.740712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:10.875722 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:10.883721 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b8d1cab3-4083-49ea-abf5-b5b0d15f1488 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1372 microversion: 2.1 time: 0.157632 Jul 28 12:57:10.884624 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3727/7448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:10 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:11.906111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:11.906735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:11.909773 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:57:11.910573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:57:11.917184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:11.917652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:11.918445 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:11.918899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:12.059793 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:12.067395 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-64cf44fe-ce83-4fe6-9e95-6258979af69e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1555 microversion: 2.1 time: 0.165180 Jul 28 12:57:12.067993 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3722/7449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:11 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:12.087638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:57:12.088245 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:57:12.090218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:57:12.096450 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:12.096902 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:12.097671 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:12.098108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:12.256457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:57:12.264666 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8e7b1378-9107-4be2-a209-3965b570214a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1555 microversion: 2.1 time: 0.181371 Jul 28 12:57:12.265238 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3728/7450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:57:12 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:57:13.982827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-62526727-7512-4981-9368-068d332f43c8 req-89babcdb-9368-4584-88ec-dd207b6d1c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:57:13.994545 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-62526727-7512-4981-9368-068d332f43c8 req-89babcdb-9368-4584-88ec-dd207b6d1c9b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:57:13.995015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-62526727-7512-4981-9368-068d332f43c8 req-89babcdb-9368-4584-88ec-dd207b6d1c9b service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:57:14.006403 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-62526727-7512-4981-9368-068d332f43c8 req-89babcdb-9368-4584-88ec-dd207b6d1c9b service nova] Creating event network-changed:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h1-851368-1 Jul 28 12:57:14.012041 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-62526727-7512-4981-9368-068d332f43c8 req-89babcdb-9368-4584-88ec-dd207b6d1c9b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032848 Jul 28 12:57:14.013041 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3723/7451] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 12:58:13.692901 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:58:13.693502 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 12:58:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:59:40.890314 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:59:40.891382 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 12:59:40.892156 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:59:40.893038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=32 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:59:40.896955 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:59:40.897493 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:40.904815 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:40.905268 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:40.906033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:40.906469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:40.929515 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lazy-loading 'flavor' on Instance uuid 243b4bac-b11b-46d9-a891-d02c4d185715 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 12:59:41.112315 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3687d1d-5ce8-4d94-a45c-8ee9b6d411b1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715/action" status: 202 len: 0 microversion: 2.1 time: 0.223297 Jul 28 12:59:41.112921 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3729/7452] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 12:59:40 2022] POST /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 12:59:41.120627 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:59:41.121442 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 12:59:41.122056 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:59:41.122810 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=36 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 12:59:41.127930 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:41.128838 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:41.137849 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:41.138311 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:41.139120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:41.139572 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:41.272435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:41.280594 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6242eddf-8e55-443f-9121-0c12971cf9c8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.162388 Jul 28 12:59:41.281169 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3724/7453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:41 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:42.306589 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:42.307737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:42.316320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:42.316773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:42.317568 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:42.318006 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:42.323553 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 43886. Jul 28 12:59:42.324278 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 43888. Jul 28 12:59:42.458780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:42.467223 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-61d62ba5-ffa0-4a37-9a92-f810448b1721 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.168944 Jul 28 12:59:42.467805 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3730/7454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:42 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:59:43.488468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:43.489080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:43.499531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:43.499998 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:43.500776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:43.501228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:43.505078 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 43894. Jul 28 12:59:43.505789 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 43892. Jul 28 12:59:43.633688 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:43.641217 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e9b3fff4-e2f7-4852-900d-8eaba05b9220 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.156909 Jul 28 12:59:43.641786 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3725/7455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:43 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:44.662061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:44.662707 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:44.669632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:44.670087 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:44.670859 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:44.671328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:44.805317 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:44.813369 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7d5f53d2-b9a5-4d22-92eb-c56e02d846f9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.155250 Jul 28 12:59:44.813951 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3731/7456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:44 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:45.834594 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:45.835257 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:45.842771 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:45.843276 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:45.844062 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:45.844526 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:45.978749 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:45.987769 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2985e3ac-e27e-4589-af43-1b4c14f46ebe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.157122 Jul 28 12:59:45.988728 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3726/7457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:45 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:47.010878 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:47.011535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:47.018296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:47.018739 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:47.019540 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:47.019974 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:47.149632 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:47.157153 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5f2b1f9-4fd2-47cc-b185-542aa6259acd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.151422 Jul 28 12:59:47.157720 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3732/7458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:47 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:48.178742 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:48.179439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:48.186844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:48.187352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:48.188142 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:48.188603 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:48.325681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:48.333235 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f5e4c989-a63c-461f-92e5-d47b9daac391 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.158447 Jul 28 12:59:48.333808 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3727/7459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:48 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 12:59:49.353943 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:49.354995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:49.362237 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:49.362690 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:49.363497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:49.363940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:49.492851 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:49.500992 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5db085fa-1bdf-4e29-952e-71efd43f964d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.151092 Jul 28 12:59:49.501602 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3733/7460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:49 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:50.522420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:50.523046 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:50.530501 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:50.530959 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:50.531764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:50.532215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:50.667208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:50.674735 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bf3d1e07-17a6-4dc7-a7f0-f662cbb14f51 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.156243 Jul 28 12:59:50.675355 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3728/7461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:50 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:51.598723 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:59:51.599444 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:59:51.696730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:51.697335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:51.704893 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:51.705335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:51.706091 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:51.706526 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:51.708082 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 12:59:51.708228 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 12:59:51.841103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:51.848597 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-eba855b9-ccb5-4b4f-baea-0a8253b359c2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.155815 Jul 28 12:59:51.849211 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3734/7462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:51 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:52.869665 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:52.870302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:52.878034 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:52.878504 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:52.879332 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:52.879799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:53.015043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:53.022653 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-3813f02f-14a8-437c-8909-156eaffd3a2c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1700 microversion: 2.1 time: 0.156880 Jul 28 12:59:53.023226 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3729/7463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:52 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:54.045293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:54.045900 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:54.052808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:54.053254 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:54.054015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:54.054454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:54.192065 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:54.199556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8c2bfc0f-bb72-436e-b101-856d45d4fb4e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1700 microversion: 2.1 time: 0.158778 Jul 28 12:59:54.200128 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3735/7464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:54 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:55.220818 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:55.221376 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:55.228337 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:55.228797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:55.229575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:55.230031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:55.360140 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:55.368087 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e93af5cc-3064-464e-8f56-e16032a70f10 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1700 microversion: 2.1 time: 0.151083 Jul 28 12:59:55.368765 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3730/7465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:55 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:56.385823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-c703d9e9-4c5b-4b02-ae76-54160a8cf163 req-6f44bcf1-666f-4d0c-8ee1-a8b1da0e12be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "name": "network-vif-plugged", "status": "completed", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 12:59:56.389581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:56.390268 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:56.402548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:56.402903 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:56.403704 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:56.404319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:56.405558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c703d9e9-4c5b-4b02-ae76-54160a8cf163 req-6f44bcf1-666f-4d0c-8ee1-a8b1da0e12be service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:56.406372 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-c703d9e9-4c5b-4b02-ae76-54160a8cf163 req-6f44bcf1-666f-4d0c-8ee1-a8b1da0e12be service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:56.418239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-c703d9e9-4c5b-4b02-ae76-54160a8cf163 req-6f44bcf1-666f-4d0c-8ee1-a8b1da0e12be service nova] Creating event network-vif-plugged:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h1-851368-1 Jul 28 12:59:56.423619 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-c703d9e9-4c5b-4b02-ae76-54160a8cf163 req-6f44bcf1-666f-4d0c-8ee1-a8b1da0e12be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041463 Jul 28 12:59:56.424464 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3736/7466] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 12:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 12:59:56.540018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:56.549011 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0d254b5-3423-415f-97af-6bd475991d4b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1700 microversion: 2.1 time: 0.163183 Jul 28 12:59:56.549733 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3731/7467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:56 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:57.570941 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:57.571685 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:57.579255 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:57.579712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:57.580486 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:57.580926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:57.717861 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:57.727472 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-bc9994ab-25f5-411b-bb4e-947e0781a183 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.160635 Jul 28 12:59:57.728061 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3737/7468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:57 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:58.749275 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:58.751241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:58.761999 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:58.762550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:58.763604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:58.764256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:58.924607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 12:59:58.936605 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a75783bf-f7a2-40ad-a5bf-5a2652c796c3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.190727 Jul 28 12:59:58.951582 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3732/7469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:58 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 12:59:59.971148 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 12:59:59.973144 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 12:59:59.980311 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:59.980948 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 12:59:59.981725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 12:59:59.985887 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:00.130886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:00.139263 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9a21ba1d-3406-4078-b929-0bd3e56b2ecd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.179529 Jul 28 13:00:00.139868 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3738/7470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 12:59:59 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:01.166061 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:01.166768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:01.174792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:01.175566 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:01.176103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:01.181406 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:01.336923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:01.344953 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dd97c3be-e146-4e05-8aaa-2a24b0d12275 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.183580 Jul 28 13:00:01.360022 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3733/7471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:01 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:02.372600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:02.373129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:02.383034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:02.383593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:02.384375 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:02.384792 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:02.535285 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:02.545587 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-64941df3-8c15-4ec6-b303-84610b6a8cbd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.182971 Jul 28 13:00:02.563721 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3739/7472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:02 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:03.576698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:03.577304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:03.584168 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:03.584854 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:03.585774 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:03.586432 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:03.739343 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:03.747751 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-33ca2acb-d776-466b-8d81-a808e9010646 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.177538 Jul 28 13:00:03.748426 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3734/7473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:03 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:00:04.769599 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:04.770871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:04.778544 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:04.779294 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:04.780296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:04.780999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:04.934111 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:04.942541 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-550fd604-2b6b-4d21-a5eb-f757fd94b817 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.177389 Jul 28 13:00:04.951156 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3740/7474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:04 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:05.969177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:05.969177 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:05.975822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:05.976293 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:05.977324 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:05.977776 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:06.123356 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:06.132288 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7c9b6076-62e0-4ffe-9096-b123e657f95e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1695 microversion: 2.1 time: 0.172153 Jul 28 13:00:06.146421 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3735/7475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:05 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:07.154227 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:07.154836 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:07.162146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:07.162593 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:07.163403 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:07.163839 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:07.299152 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:07.306708 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7e40ff82-924f-4b90-a0e4-1634e547864e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1677 microversion: 2.1 time: 0.156792 Jul 28 13:00:07.307321 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3741/7476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:07 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:08.329711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:08.330316 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:08.337242 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:08.337697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:08.338471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:08.339320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:08.467411 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:08.474893 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-f07aa450-0307-464a-a4f2-2d30f4ef3848 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1677 microversion: 2.1 time: 0.149931 Jul 28 13:00:08.475498 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3736/7477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:08 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:08.858882 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:00:08.859136 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:00:09.497014 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:09.497688 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:09.505300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.505736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.506510 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.506950 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.643234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:09.650765 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ae844f62-8c8f-4096-bf56-ef3f78972743 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1680 microversion: 2.1 time: 0.157755 Jul 28 13:00:09.651385 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3742/7478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:09 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:09.672627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:00:09.673490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:09.680272 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.680748 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.682023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.682484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.725417 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119235) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 13:00:09.791554 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-31905d73-2238-469a-b599-ee02031b9213 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715/action" status: 202 len: 0 microversion: 2.1 time: 0.124039 Jul 28 13:00:09.792161 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3737/7479] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 13:00:09 2022] POST /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 13:00:09.801263 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:09.802027 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:09.807935 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.808389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.809165 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:09.809742 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:09.954135 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:09.961915 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d7f38ecf-bd93-4e89-abf7-1286918b4f59 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1628 microversion: 2.1 time: 0.165482 Jul 28 13:00:09.962503 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3743/7480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:09 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1628 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:00:10.393746 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4aa6fc30-383f-4c66-840d-dcce50568aad req-854c5115-aea7-43f1-88b3-c884716c0f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "name": "network-vif-unplugged", "status": "completed", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:00:10.405018 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4aa6fc30-383f-4c66-840d-dcce50568aad req-854c5115-aea7-43f1-88b3-c884716c0f1f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:10.405573 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4aa6fc30-383f-4c66-840d-dcce50568aad req-854c5115-aea7-43f1-88b3-c884716c0f1f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:10.418488 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.compute.server_external_events [req-4aa6fc30-383f-4c66-840d-dcce50568aad req-854c5115-aea7-43f1-88b3-c884716c0f1f service nova] Unable to find a host for instance 243b4bac-b11b-46d9-a891-d02c4d185715. Dropping event network-vif-unplugged {{(pid=119235) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 13:00:10.419877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4aa6fc30-383f-4c66-840d-dcce50568aad req-854c5115-aea7-43f1-88b3-c884716c0f1f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031428 Jul 28 13:00:10.420628 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3738/7481] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 13:00:10.983744 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:10.984382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:10.987474 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=31 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:00:10.993426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:10.993997 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:10.994780 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:10.995284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:10.999553 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:00:11.134684 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:11.143361 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b557d5a0-dc13-4f5b-9d43-1783c8e3e997 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.163421 Jul 28 13:00:11.143960 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3744/7482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:10 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:11.967650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-65fa1511-b4e4-45fb-9e0c-9fa06e91bb1d req-5b4a62e9-db3c-4ee7-8936-fd7408fc971e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:00:11.974442 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:00:11.981503 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-65fa1511-b4e4-45fb-9e0c-9fa06e91bb1d req-5b4a62e9-db3c-4ee7-8936-fd7408fc971e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:11.981958 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-65fa1511-b4e4-45fb-9e0c-9fa06e91bb1d req-5b4a62e9-db3c-4ee7-8936-fd7408fc971e service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:11.993700 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:00:11.995847 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-65fa1511-b4e4-45fb-9e0c-9fa06e91bb1d req-5b4a62e9-db3c-4ee7-8936-fd7408fc971e service nova] Creating event network-changed:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h2-851368-1 Jul 28 13:00:12.006205 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-65fa1511-b4e4-45fb-9e0c-9fa06e91bb1d req-5b4a62e9-db3c-4ee7-8936-fd7408fc971e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042865 Jul 28 13:00:12.007810 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3739/7483] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:00:12.164737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:12.165473 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:12.172580 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:12.173035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:12.173814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:12.174261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:12.318535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:12.326307 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-74b36a83-b369-4bcb-b1d8-48a1d2987952 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.165302 Jul 28 13:00:12.326826 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3745/7484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:12 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:13.351308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:13.352055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:13.360044 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:13.360514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:13.361308 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:13.362057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:13.513871 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:13.525215 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a1d2030d-6088-4135-8400-fa20abb9bc4a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.180139 Jul 28 13:00:13.525816 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3740/7485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:13 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:14.545760 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:14.546504 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:14.553906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:14.554469 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:14.555019 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:14.555773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:14.699517 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:14.710274 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c579ca35-e6ba-49d6-ac05-ebd8e945a835 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.168294 Jul 28 13:00:14.710863 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3746/7486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:14 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:15.732889 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:15.733518 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:15.741394 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:15.741862 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:15.742650 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:15.743115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:15.899130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:15.907436 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ff65826c-afb6-4bea-942a-982b80ae33ac tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.178593 Jul 28 13:00:15.908032 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3741/7487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:15 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:16.930126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:16.930749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:16.937808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:16.938267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:16.939049 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:16.939525 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:17.198021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:17.208265 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f6803381-991c-4b9a-ac82-b6999dca39f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.282029 Jul 28 13:00:17.209158 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3747/7488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:16 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:18.235600 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:18.236203 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:18.243608 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:18.244083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:18.244883 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:18.245344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:18.401392 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:18.410057 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-59828191-e9cb-4529-a1a4-a7885477175c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.179118 Jul 28 13:00:18.420838 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3742/7489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:18 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:19.455303 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:19.456000 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:19.468125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:19.468586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:19.469374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:19.469810 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:19.626638 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:19.635107 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-e779a1b8-be5c-4eca-b926-34962551b214 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.184080 Jul 28 13:00:19.639040 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3748/7490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:19 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:20.657078 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:20.657634 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:20.664630 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:20.665101 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:20.665885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:20.666344 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:20.802425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:20.809962 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d275b313-51ce-4bac-a374-513a6580a830 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.157706 Jul 28 13:00:20.810531 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3743/7491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:20 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:21.831209 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:21.831855 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:21.838730 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:21.839208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:21.839972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:21.840405 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:21.971314 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:21.978946 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-126a3955-83cf-4b4f-a627-48199bc4e9a8 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.152210 Jul 28 13:00:21.979553 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3749/7492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:21 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:23.001181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:23.001834 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:23.010453 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:23.010931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:23.011753 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:23.012397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:23.150900 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:23.158887 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-03d8d9ee-e077-4d5c-ada8-df9cca37e3a3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.162294 Jul 28 13:00:23.159488 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3744/7493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:22 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:24.181116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:24.181863 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:24.189479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:24.189931 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:24.190691 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:24.191150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:24.324107 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:24.331549 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d2142509-0b84-4f7a-a227-9df86507bafb tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.154788 Jul 28 13:00:24.332118 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3750/7494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:24 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:24.842761 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-7f8cc4d7-b661-4ac8-a9ec-11fa2f5781a5 req-6425598d-ba48-4acd-b5e7-401671ea174f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "name": "network-vif-plugged", "status": "completed", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:00:24.854346 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7f8cc4d7-b661-4ac8-a9ec-11fa2f5781a5 req-6425598d-ba48-4acd-b5e7-401671ea174f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:24.854824 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-7f8cc4d7-b661-4ac8-a9ec-11fa2f5781a5 req-6425598d-ba48-4acd-b5e7-401671ea174f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:24.867215 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-7f8cc4d7-b661-4ac8-a9ec-11fa2f5781a5 req-6425598d-ba48-4acd-b5e7-401671ea174f service nova] Creating event network-vif-plugged:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h2-851368-1 Jul 28 13:00:24.872273 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-7f8cc4d7-b661-4ac8-a9ec-11fa2f5781a5 req-6425598d-ba48-4acd-b5e7-401671ea174f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033316 Jul 28 13:00:24.872885 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3745/7495] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:00:25.352626 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:25.353199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:25.360374 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:25.360832 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:25.361609 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:25.362309 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:25.491241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:25.498795 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f5e34406-8d3a-4143-bc9b-701e904dc61f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.150139 Jul 28 13:00:25.499890 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3751/7496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:25 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:00:26.522092 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:26.522866 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:26.530560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:26.531701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:26.532489 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:26.532945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:26.678099 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:26.685726 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32936e6d-9e80-496e-83c8-c0531dda96be tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1686 microversion: 2.1 time: 0.168324 Jul 28 13:00:26.686313 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3746/7497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:26 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:00:27.707281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:00:27.707899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:00:27.714871 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:27.715352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:27.716122 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:00:27.716563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:00:27.860184 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:00:27.868792 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-23280354-fc01-4ea0-a5e1-b166db59edc3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1673 microversion: 2.1 time: 0.165457 Jul 28 13:00:27.869376 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3752/7498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:00:27 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:01:33.701851 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:01:33.702524 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:01:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:01:37.902681 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:37.903226 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:37.905680 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=15 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:37.906427 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=39 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:37.911164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=17 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:37.911922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=53 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:37.926372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:37.926372 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:37.927112 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:37.927570 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:37.954204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 13:01:37.979680 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-1043b250-445e-45ca-ae5b-7293d46b742a req-af2f90db-f277-4982-83a3-648d60c8634c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:01:37.990163 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1043b250-445e-45ca-ae5b-7293d46b742a req-af2f90db-f277-4982-83a3-648d60c8634c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:37.990925 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-1043b250-445e-45ca-ae5b-7293d46b742a req-af2f90db-f277-4982-83a3-648d60c8634c service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:38.003730 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-1043b250-445e-45ca-ae5b-7293d46b742a req-af2f90db-f277-4982-83a3-648d60c8634c service nova] Creating event network-changed:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h2-851368-1 Jul 28 13:01:38.009317 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-1043b250-445e-45ca-ae5b-7293d46b742a req-af2f90db-f277-4982-83a3-648d60c8634c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100732 Jul 28 13:01:38.010214 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3753/7499] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:01:38.039727 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d73130a-3edd-44f2-9323-bef0807e5d09 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 204 len: 0 microversion: 2.1 time: 0.141328 Jul 28 13:01:38.040683 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3747/7500] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 13:01:37 2022] DELETE /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 13:01:38.053185 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:38.053806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:38.063326 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:38.063790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:38.065103 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:38.065741 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:38.259653 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:01:38.267242 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-27baa216-dd89-4f83-98a6-4b8704143df3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.218756 Jul 28 13:01:38.267968 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3754/7501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:01:38 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:01:39.288908 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:39.289632 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:39.296972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:39.297439 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:39.298220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:39.298677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:39.491431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:01:39.499247 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b56ac318-625c-4828-ab7c-2ab4c6b16f41 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 200 len: 1679 microversion: 2.1 time: 0.214679 Jul 28 13:01:39.499917 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3748/7502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:01:39 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:01:40.025015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-6a7b6506-bd78-4365-897b-e65921aec284 req-ebb4332b-e61b-407f-8350-6ce667b6dab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243b4bac-b11b-46d9-a891-d02c4d185715", "name": "network-vif-deleted", "tag": "c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:01:40.035249 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6a7b6506-bd78-4365-897b-e65921aec284 req-ebb4332b-e61b-407f-8350-6ce667b6dab5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:40.035692 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-6a7b6506-bd78-4365-897b-e65921aec284 req-ebb4332b-e61b-407f-8350-6ce667b6dab5 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:40.046309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-6a7b6506-bd78-4365-897b-e65921aec284 req-ebb4332b-e61b-407f-8350-6ce667b6dab5 service nova] Creating event network-vif-deleted:c35f1b9f-038b-44a9-b4d0-0ca38aa09fdf for instance 243b4bac-b11b-46d9-a891-d02c4d185715 on n-h2-851368-1 Jul 28 13:01:40.053134 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-6a7b6506-bd78-4365-897b-e65921aec284 req-ebb4332b-e61b-407f-8350-6ce667b6dab5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Jul 28 13:01:40.054221 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3755/7503] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:01:40.521474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:40.522001 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 243b4bac-b11b-46d9-a891-d02c4d185715] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:40.528533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:40.529004 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:40.529783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:40.530237 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:40.543919 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] HTTP exception thrown: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Request method failure captured: Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 HTTP/1.1 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oeWSCrlrJf6iwh8DHq9ttuZJ-Hm-tgTA72B4YSRf0qMj4zS0a9JIfeX7aSP5FL2wVBrw5KPFKVO8E04GZ8zPZAaS5_C753_3kgG-plCWjaz4Ji1ZcZ8wKg5OwKssBMc4IIbIJTtW1wl36WefzDBQXIuyKoB9B1AjRYgKuMvYRdHW1A Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 2d6ab116813148efbe970906aa7d6562 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestShelveInstance-67024389 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2d6ab116813148efbe970906aa7d6562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2d6ab116813148efbe970906aa7d6562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2d6ab116813148efbe970906aa7d6562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2d6ab116813148efbe970906aa7d6562"}]}] Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestShelveInstance-67024389 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 2d6ab116813148efbe970906aa7d6562 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestShelveInstance-67024389 Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestShelveInstance-67024389-project Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 30c7f91736da41f09e676bd8ebb9558e Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestShelveInstance-67024389-project Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '243b4bac-b11b-46d9-a891-d02c4d185715'} Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:01:40.545580 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Returning 404 to user: Instance 243b4bac-b11b-46d9-a891-d02c4d185715 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85bded5a-71dd-42f0-bd1a-aed375ef4713 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715" status: 404 len: 111 microversion: 2.1 time: 0.029660 Jul 28 13:01:40.551136 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3749/7504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:01:40 2022] GET /compute/v2.1/servers/243b4bac-b11b-46d9-a891-d02c4d185715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 13:01:40.711235 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f7119df3-7154-4776-a158-3d298510475a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '.version_select at 0x7f2eb3166550>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:40.718061 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7119df3-7154-4776-a158-3d298510475a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [e7c4b8a2-1dc5-4070-a163-1f98b998c1fe] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 13:01:41.725391 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7119df3-7154-4776-a158-3d298510475a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [e7c4b8a2-1dc5-4070-a163-1f98b998c1fe] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44172. Jul 28 13:01:41.743050 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f7119df3-7154-4776-a158-3d298510475a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1136866624" status: 202 len: 0 microversion: 2.1 time: 1.036562 Jul 28 13:01:41.743669 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3756/7505] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Jul 28 13:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1136866624 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 13:01:41.768141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-b1e26865-3208-491b-b71b-dcea2b82579e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'create', calling method: .version_select at 0x7f2eb37ec040>, body: {"keypair": {"name": "tempest-TestShelveInstance-710503325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdCnysuGQhUBZEnQtLHAmoKgMXnWMxDil9CQKWiTEBtuYT/Vp4PVXim/dB5DQuqQUKDW51Z0DD01gomU2FXDZpnpGUou19JYpr8vntTU0UTacOGOHwIW8HtjSzHoKX1PA=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:01:41.785064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b1e26865-3208-491b-b71b-dcea2b82579e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for project 2d6ab116813148efbe970906aa7d6562. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 13:01:41.790220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-b1e26865-3208-491b-b71b-dcea2b82579e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for user 30c7f91736da41f09e676bd8ebb9558e and project 2d6ab116813148efbe970906aa7d6562. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 13:01:41.816584 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-b1e26865-3208-491b-b71b-dcea2b82579e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052876 Jul 28 13:01:41.817434 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3750/7506] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 13:01:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 13:01:57.924191 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=10 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:57.924940 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:57.930050 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-244172282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-710503325", "security_groups": [{"name": "tempest-secgroup-smoke-1717309515"}], "networks": [{"uuid": "960df5e3-27a2-4174-afa9-a446b7344353"}], "block_device_mapping_v2": [{"uuid": "bfc29caf-2ca7-4026-b9c3-85b00afeecdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:01:58.044123 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] validate_networks() for [('960df5e3-27a2-4174-afa9-a446b7344353', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 13:01:58.456350 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 13:01:58.456781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 13:01:58.457264 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 13:01:58.457682 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 13:01:58.458108 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 13:01:58.467455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:58.467910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:58.468724 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:58.469164 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:58.486321 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for project 2d6ab116813148efbe970906aa7d6562. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 13:01:58.492302 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Getting quotas for user 30c7f91736da41f09e676bd8ebb9558e and project 2d6ab116813148efbe970906aa7d6562. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 13:01:58.549455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 13:01:58.551774 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfc29caf-2ca7-4026-b9c3-85b00afeecdb',volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 13:01:58.678293 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-28128168-7b84-4896-a0bb-a2d543608a84 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756403 Jul 28 13:01:58.678935 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3757/7507] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 13:01:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 13:01:58.687797 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:58.688563 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=4 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:58.689922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:01:58.694247 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6dafc27d-2ee3-4f66-95f3-85c66e99d116 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:58.694878 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6dafc27d-2ee3-4f66-95f3-85c66e99d116 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:58.758369 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6dafc27d-2ee3-4f66-95f3-85c66e99d116 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:01:58.765282 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6dafc27d-2ee3-4f66-95f3-85c66e99d116 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1087 microversion: 2.1 time: 0.079367 Jul 28 13:01:58.765846 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3751/7508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:01:58 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:01:59.793347 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:01:59.794841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:01:59.802788 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:59.803292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:59.804092 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:01:59.804538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:01:59.870704 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:01:59.879970 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fff1ffa6-6439-4bf3-a2dd-6d6e0dac0069 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1203 microversion: 2.1 time: 0.098142 Jul 28 13:01:59.880773 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3758/7509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:01:59 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1203 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:00.903022 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:00.904831 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:00.918339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:00.919682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:00.920703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:00.921165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:01.085905 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:01.093537 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c911cc53-9b05-438a-bb08-e06a2e5955b0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1271 microversion: 2.1 time: 0.195289 Jul 28 13:02:01.106314 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3752/7510] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:00 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:01.584607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-011d568a-b3a5-4cf9-bcb0-5c98a5b8b63c req-db46202e-7bea-4085-a2df-746e82d194dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:02:01.595516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-011d568a-b3a5-4cf9-bcb0-5c98a5b8b63c req-db46202e-7bea-4085-a2df-746e82d194dd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:01.595888 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-011d568a-b3a5-4cf9-bcb0-5c98a5b8b63c req-db46202e-7bea-4085-a2df-746e82d194dd service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:01.607838 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-011d568a-b3a5-4cf9-bcb0-5c98a5b8b63c req-db46202e-7bea-4085-a2df-746e82d194dd service nova] Creating event network-changed:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:02:01.614289 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-011d568a-b3a5-4cf9-bcb0-5c98a5b8b63c req-db46202e-7bea-4085-a2df-746e82d194dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130096 Jul 28 13:02:01.615475 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3759/7511] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:02:02.115093 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:02.115939 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:02.123456 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:02.124069 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:02.124995 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:02.125564 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:02.274882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:02.283364 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-abca2383-217e-48f3-80e1-c6f1eff0a766 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1271 microversion: 2.1 time: 0.172746 Jul 28 13:02:02.291258 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3753/7512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:02 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:03.306823 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:03.307454 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:03.314446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:03.315216 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:03.315995 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:03.316439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:03.449969 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:03.457814 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-8372e659-82b7-4fbc-94e2-f41f9bb7b6e4 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1271 microversion: 2.1 time: 0.156179 Jul 28 13:02:03.458411 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3760/7513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:03 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:04.478768 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:04.479422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:04.486515 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:04.486981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:04.488055 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:04.488521 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:04.629128 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:04.637084 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-6dfa2ade-f28a-4bcc-9da2-cfb3abccbd82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1271 microversion: 2.1 time: 0.162035 Jul 28 13:02:04.638071 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3754/7514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:04 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:05.658542 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:05.659214 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:05.666204 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:05.666672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:05.667477 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:05.667919 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:05.795644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:05.803287 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9532c1b9-efdd-46bf-a8b2-ac4c02650558 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.149235 Jul 28 13:02:05.803861 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3761/7515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:05 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:06.824932 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:06.825569 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:06.833208 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:06.833705 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:06.834490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:06.834949 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:06.977418 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:06.984911 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-32d23d8c-2f84-4355-affc-14c0e2a5ae53 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.163936 Jul 28 13:02:06.985972 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3755/7516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:06 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:08.006370 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:08.006993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:08.013952 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:08.014411 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:08.015218 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:08.015665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:08.151503 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:08.159362 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d6cd3c66-6eaa-4e9b-865f-5da39fb00561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.156768 Jul 28 13:02:08.160178 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3762/7517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:08 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:09.179788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:09.180425 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:09.183213 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:02:09.189702 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:09.190171 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:09.190960 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:09.191455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:09.329864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:09.337340 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-39e5467b-191b-4e42-84fe-13ffccfeb5da tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.161498 Jul 28 13:02:09.337903 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3756/7518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:09 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:10.357894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:10.358490 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:10.361063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:02:10.361899 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:02:10.368825 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:10.369291 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:10.370053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:10.370491 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:10.503725 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:10.511554 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6c17fe97-d822-4a73-96dd-0c2a759c4009 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.157588 Jul 28 13:02:10.512126 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3763/7519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:10 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:11.532002 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:11.533278 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:11.540228 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:11.540695 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:11.541474 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:11.541928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:11.675229 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:11.683165 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-0b9c608b-4099-4b2e-ae43-f2ffadbcc561 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.155027 Jul 28 13:02:11.683743 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3757/7520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:11 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:12.703846 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:12.705079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:12.711208 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:12.711665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:12.712446 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:12.712886 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:12.844414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:12.853239 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-151de761-3d29-4cb3-8342-94123fd31e33 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.153536 Jul 28 13:02:12.853813 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3764/7521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:12 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:13.875031 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:13.875701 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:13.882296 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:13.882767 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:13.883611 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:13.884068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:14.014505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:14.023137 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2ba18bc6-e1ae-434b-97a5-4be56cae7396 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.152216 Jul 28 13:02:14.023717 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3758/7522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:13 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:14.954292 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-3d9e3198-b1ef-4a29-aa16-ab61821c06a0 req-e9cec830-7b54-4291-922b-c7bf78e80bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "name": "network-vif-plugged", "status": "completed", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:02:14.976508 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3d9e3198-b1ef-4a29-aa16-ab61821c06a0 req-e9cec830-7b54-4291-922b-c7bf78e80bfb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:14.976999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-3d9e3198-b1ef-4a29-aa16-ab61821c06a0 req-e9cec830-7b54-4291-922b-c7bf78e80bfb service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:14.989975 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-3d9e3198-b1ef-4a29-aa16-ab61821c06a0 req-e9cec830-7b54-4291-922b-c7bf78e80bfb service nova] Creating event network-vif-plugged:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:02:14.995098 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-3d9e3198-b1ef-4a29-aa16-ab61821c06a0 req-e9cec830-7b54-4291-922b-c7bf78e80bfb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116090 Jul 28 13:02:14.995729 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3765/7523] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:02:15.043909 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:15.044536 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:15.053096 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:15.053621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:15.054413 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:15.054864 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:15.199516 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:15.207602 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-830d7f61-3218-41b2-b773-72744c39292d tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.167628 Jul 28 13:02:15.208175 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3759/7524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:15 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:16.230199 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:16.230906 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:16.238035 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:16.238538 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:16.239338 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:16.239781 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:16.369728 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:16.377556 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-6b265ea3-7a21-49b8-94a5-37845302b673 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1259 microversion: 2.1 time: 0.152457 Jul 28 13:02:16.378131 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3766/7525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:16 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:17.398683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:17.399269 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:17.406301 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:17.406783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:17.408215 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:17.408669 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:17.543719 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:17.551316 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-80659e4d-24c9-4b1c-9aae-fb030aa0017b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1442 microversion: 2.1 time: 0.156598 Jul 28 13:02:17.551894 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3760/7526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:17 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:17.571463 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:02:17.572085 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:02:17.578957 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:17.579936 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:17.580708 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:17.581150 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:17.709791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:02:17.717301 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fefa678a-2b98-4f6e-b1d7-c3d1750ebdf3 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1442 microversion: 2.1 time: 0.149728 Jul 28 13:02:17.717875 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3767/7527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:02:17 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:02:19.359969 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-00ed4e9c-4254-41b5-9678-7b2e70da3106 req-cfb47d28-43fa-47d0-93c3-6bd04b8c94f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:02:19.371028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00ed4e9c-4254-41b5-9678-7b2e70da3106 req-cfb47d28-43fa-47d0-93c3-6bd04b8c94f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:02:19.371607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-00ed4e9c-4254-41b5-9678-7b2e70da3106 req-cfb47d28-43fa-47d0-93c3-6bd04b8c94f1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:02:19.383060 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-00ed4e9c-4254-41b5-9678-7b2e70da3106 req-cfb47d28-43fa-47d0-93c3-6bd04b8c94f1 service nova] Creating event network-changed:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:02:19.389449 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-00ed4e9c-4254-41b5-9678-7b2e70da3106 req-cfb47d28-43fa-47d0-93c3-6bd04b8c94f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 Jul 28 13:02:19.390141 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3761/7528] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:03:11.715827 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:03:11.716506 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:04:14.547623 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:04:14.548766 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:04:14.549336 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:14.550146 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=54 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:14.554896 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:04:14.555536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:14.563736 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:14.564193 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:14.564960 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:14.565393 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:14.589439 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lazy-loading 'flavor' on Instance uuid 83afda2d-d25b-45d1-839b-c03682bcc862 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 13:04:14.662896 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-aacbf2f6-a34b-4a05-8717-1122f9c3a1fe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862/action" status: 202 len: 0 microversion: 2.1 time: 0.116931 Jul 28 13:04:14.663584 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3768/7529] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 13:04:14 2022] POST /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 13:04:14.670062 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:04:14.671233 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:04:14.671874 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=24 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:14.672654 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=56 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:14.677175 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:14.677912 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:14.685468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:14.685933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:14.687241 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:14.687697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:14.831009 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:14.838832 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bc2bac8d-815f-4acb-902e-2c9688472bfe tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.170788 Jul 28 13:04:14.839455 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3762/7530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:14 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:15.861804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:15.862513 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:15.874996 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:15.875481 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:15.876261 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:15.876709 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:15.877931 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44444. Jul 28 13:04:15.883317 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44446. Jul 28 13:04:16.015251 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:16.022754 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fd0d679f-f1a1-4e6d-aaea-861f04af031c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.165877 Jul 28 13:04:16.023351 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3769/7531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:15 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:17.044500 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:17.045130 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:17.054185 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:17.054656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:17.055468 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:17.055928 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:17.073269 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44452. Jul 28 13:04:17.077225 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44450. Jul 28 13:04:17.194507 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:17.202127 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a95c05c2-f479-47d2-9b77-1239707d220a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.161611 Jul 28 13:04:17.202697 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3763/7532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:17 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:18.223933 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:18.224470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:18.232300 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:18.232976 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:18.234833 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:18.235457 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:18.375021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:18.382778 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4858f75d-36c8-4358-99f0-5055ee405457 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.163199 Jul 28 13:04:18.383387 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3770/7533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:18 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:19.403858 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:19.404484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:19.411617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:19.412080 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:19.412857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:19.413310 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:19.550373 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:19.557895 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-43bbd205-b6cb-4a7e-93da-4764ad132dfd tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.158004 Jul 28 13:04:19.558458 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3764/7534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:19 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:20.580194 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:20.580804 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:20.588592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:20.589053 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:20.589837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:20.590284 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:20.722808 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:20.730420 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-fa4cf324-2db7-4c52-a9b3-213d44c3d732 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.154767 Jul 28 13:04:20.731012 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3771/7535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:20 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:21.751371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:21.752013 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:21.758915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:21.759415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:21.760204 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:21.760664 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:21.896972 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:21.904662 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9b284346-d017-42cf-85c1-d8f9ce79374f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.157296 Jul 28 13:04:21.905241 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3765/7536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:21 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:22.926376 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:22.926993 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:22.933972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:22.934425 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:22.935224 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:22.935667 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:23.077745 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:23.085834 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-03f6766d-9d85-47de-b3d9-bccea8becb62 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.163410 Jul 28 13:04:23.086403 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3772/7537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:22 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:24.106805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:24.107455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:24.115294 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:24.115759 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:24.116531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:24.116981 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:24.250164 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:24.257837 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a0870074-6e30-4c01-9a3d-a04c5192c89c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.154896 Jul 28 13:04:24.258414 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3766/7538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:24 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:25.279559 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:25.280937 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:25.288420 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:25.288864 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:25.289642 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:25.290079 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:25.422883 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:25.430571 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cfdacd40-ad0f-43d9-a59c-c43debf99b71 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.155292 Jul 28 13:04:25.431164 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3773/7539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:25 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:26.452931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:26.453556 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:26.460620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:26.461084 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:26.461857 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:26.462306 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:26.597641 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:26.606528 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-5d2322a0-f04e-4205-ae25-dc50cbb6e1f1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.158117 Jul 28 13:04:26.607115 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3767/7540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:26 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:04:27.628563 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:27.629099 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:27.636129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:27.636581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:27.637352 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:27.637791 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:27.774327 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:27.782172 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d3271446-bd31-4a0e-ae1a-2d8536904df1 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.158684 Jul 28 13:04:27.782773 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3774/7541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:27 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:28.803560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:28.804196 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:28.811944 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:28.812410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:28.813221 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:28.813674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:28.956885 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:28.964626 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-017bfa4f-c311-4e75-aaba-61708e4e23bf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1567 microversion: 2.1 time: 0.165041 Jul 28 13:04:28.965207 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3768/7542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:28 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:28.985712 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:04:28.986396 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:28.993586 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:28.994047 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:28.994812 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:28.995288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:29.040389 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119236) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 13:04:29.105433 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-328c9263-6377-4a01-a078-7567fba74e82 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "POST /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862/action" status: 202 len: 0 microversion: 2.1 time: 0.124090 Jul 28 13:04:29.106062 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3775/7543] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 13:04:28 2022] POST /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 13:04:29.114698 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:29.115363 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:29.121560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:29.122023 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:29.122975 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:29.123304 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:29.264115 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:29.272277 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fd3331af-84e4-42cd-b3e9-ce2531880dd0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1575 microversion: 2.1 time: 0.162056 Jul 28 13:04:29.272892 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3769/7544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:29 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:30.294677 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:30.295566 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:30.304288 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:30.304747 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:30.305516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:30.305958 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:30.445033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:30.452703 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b2633532-7d30-4ff8-9ab7-9f84957c732a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1517 microversion: 2.1 time: 0.162875 Jul 28 13:04:30.453798 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3776/7545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:30 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:31.469345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-be00a70f-d7b9-44c3-beff-754441595a93 req-fcc06465-53dc-4834-9667-51f6867ee4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:04:31.475895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:31.476496 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:31.489656 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:31.490115 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:31.490903 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:31.491378 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:31.499483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-be00a70f-d7b9-44c3-beff-754441595a93 req-fcc06465-53dc-4834-9667-51f6867ee4c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:31.499950 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-be00a70f-d7b9-44c3-beff-754441595a93 req-fcc06465-53dc-4834-9667-51f6867ee4c8 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:31.520931 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.compute.server_external_events [req-be00a70f-d7b9-44c3-beff-754441595a93 req-fcc06465-53dc-4834-9667-51f6867ee4c8 service nova] Unable to find a host for instance 83afda2d-d25b-45d1-839b-c03682bcc862. Dropping event network-vif-unplugged {{(pid=119235) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 13:04:31.523023 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-be00a70f-d7b9-44c3-beff-754441595a93 req-fcc06465-53dc-4834-9667-51f6867ee4c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058247 Jul 28 13:04:31.524453 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3770/7546] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 13:04:31.647293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:31.655020 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-436d6e58-8704-4066-9882-9adefe5148a2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1517 microversion: 2.1 time: 0.183914 Jul 28 13:04:31.655626 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3777/7547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:31 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:32.677506 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:32.678141 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:32.685784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:32.686256 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:32.687060 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:32.688109 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:32.825160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:32.832934 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-a72e84d8-5614-4f43-99cb-a147f73a2a35 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1517 microversion: 2.1 time: 0.159404 Jul 28 13:04:32.833514 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3771/7548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:32 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:33.854448 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:33.854966 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:33.862497 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:33.862946 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:33.864025 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:33.864466 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:33.997177 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:34.004844 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1b93be60-9735-4925-b6e2-e94f0a4fd6a0 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1517 microversion: 2.1 time: 0.154405 Jul 28 13:04:34.005496 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3778/7549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:33 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:35.026778 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:35.028137 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:35.035447 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:35.035915 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:35.036711 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:35.037165 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:35.171542 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:35.179671 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9a80c098-126f-4312-833f-d08dc7b31771 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.157782 Jul 28 13:04:35.180250 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3772/7550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:35 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:36.201143 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:36.201754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:36.209279 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:36.209723 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:36.210480 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:36.210915 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:36.339669 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:36.347161 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c55f1cd0-f6b9-4b80-9ba8-1e9b59941e60 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.149850 Jul 28 13:04:36.347734 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3779/7551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:36 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:37.367790 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:37.368410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:37.375415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:37.375882 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:37.376643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:37.377087 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:37.513562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:37.521903 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-c19ef79c-934b-4923-9319-4f9c7ad8553a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.158386 Jul 28 13:04:37.522479 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3773/7552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:37 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:38.542339 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:38.542988 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:38.549894 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:38.550349 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:38.551140 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:38.551581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:38.700063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:38.707636 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-638ff84a-ae94-473b-99e2-28031a08fccf tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.169159 Jul 28 13:04:38.708207 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3780/7553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:38 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:39.728697 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:39.729353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:39.736288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:39.736750 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:39.737523 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:39.737973 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:39.871562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:39.879784 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-06256745-e52f-4a8a-984f-0b2361d7100b tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.155069 Jul 28 13:04:39.880365 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3774/7554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:39 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:40.901038 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:40.901644 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:40.908528 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:40.908975 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:40.909765 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:40.910202 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:40.931754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:41.064910 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:41.072321 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-c436e9b6-b56b-44bd-81d1-1b4dffb71b48 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.175166 Jul 28 13:04:41.072922 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3781/7555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:40 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:42.093764 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:42.094400 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:42.101300 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:42.101775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:42.102560 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:42.103015 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:42.233166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:42.240964 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-237abb73-edad-40d8-a976-60312c1ee630 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.151181 Jul 28 13:04:42.241540 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3775/7556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:42 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:43.261837 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:43.262455 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:43.269430 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:43.269884 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:43.270652 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:43.271119 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:43.409270 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:43.416883 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ef393b84-ac47-4243-9f69-dfa255d59ac9 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.158932 Jul 28 13:04:43.417657 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3782/7557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:43 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:44.437788 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:44.438941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:44.445893 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:44.446360 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:44.447184 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:44.447646 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:44.576811 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:44.585027 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-23579b37-14da-4f6d-ade0-bcd98e7e585c tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.151199 Jul 28 13:04:44.585698 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3776/7558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:44 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:45.556918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-9a5a67b9-9616-4e2c-8c37-0f0291878aa1 req-a5fd2e40-28b5-4442-b92b-6d09ca8b39f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "name": "network-vif-plugged", "status": "completed", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:04:45.564365 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:45.571870 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9a5a67b9-9616-4e2c-8c37-0f0291878aa1 req-a5fd2e40-28b5-4442-b92b-6d09ca8b39f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:45.572318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-9a5a67b9-9616-4e2c-8c37-0f0291878aa1 req-a5fd2e40-28b5-4442-b92b-6d09ca8b39f9 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:45.584871 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-9a5a67b9-9616-4e2c-8c37-0f0291878aa1 req-a5fd2e40-28b5-4442-b92b-6d09ca8b39f9 service nova] Creating event network-vif-plugged:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:04:45.590741 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-9a5a67b9-9616-4e2c-8c37-0f0291878aa1 req-a5fd2e40-28b5-4442-b92b-6d09ca8b39f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037554 Jul 28 13:04:45.591730 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3783/7559] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:04:45.611703 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:45.612490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:45.619160 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=31 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:45.621398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:45.622083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:45.624120 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:45.625299 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:45.631505 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=87 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:04:45.777627 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:45.786317 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ae4e7513-a576-4e27-bc14-f9f164cc6755 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.179054 Jul 28 13:04:45.786906 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3777/7560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:45 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:46.809290 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:46.809890 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:46.816670 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:46.817126 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:46.817895 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:46.818335 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:46.957536 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:46.966065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-39727119-6503-4aca-a29b-7fa0055cf6e2 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1573 microversion: 2.1 time: 0.162308 Jul 28 13:04:46.966655 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3784/7561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:46 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:47.990677 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:04:47.991397 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:04:47.997528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:47.997989 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:47.998792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:04:47.999277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:04:48.127822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:04:48.135277 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d6be18cd-334b-4d02-a60c-d4e7acd97880 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1560 microversion: 2.1 time: 0.149186 Jul 28 13:04:48.135855 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3778/7562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:04:47 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:04:51.609520 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:04:51.610151 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:05:08.868930 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:05:08.869618 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:05:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:06:02.204725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:02.206406 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:02.206933 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=11 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:02.207665 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=16 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:02.215535 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:02.216045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:02.216751 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-0ee1387e-5693-46d2-a909-5afeff7b6851 req-d53a620c-aff8-4c17-a233-8bde9a9a44d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:02.223262 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:02.223650 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:02.224426 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:02.224865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:02.227172 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0ee1387e-5693-46d2-a909-5afeff7b6851 req-d53a620c-aff8-4c17-a233-8bde9a9a44d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:02.227643 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-0ee1387e-5693-46d2-a909-5afeff7b6851 req-d53a620c-aff8-4c17-a233-8bde9a9a44d1 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:02.239506 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-0ee1387e-5693-46d2-a909-5afeff7b6851 req-d53a620c-aff8-4c17-a233-8bde9a9a44d1 service nova] Creating event network-changed:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:06:02.245666 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-0ee1387e-5693-46d2-a909-5afeff7b6851 req-d53a620c-aff8-4c17-a233-8bde9a9a44d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 Jul 28 13:06:02.246473 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3779/7563] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:06:02.252548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 13:06:02.336883 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cc22ecd1-7cb3-4710-ada0-7d941f05710f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 204 len: 0 microversion: 2.1 time: 0.136033 Jul 28 13:06:02.337668 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3785/7564] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 13:06:02 2022] DELETE /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 13:06:02.346546 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:02.347338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:02.354644 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:02.355139 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:02.355942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:02.356399 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:02.494727 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:02.502409 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-920378d9-701c-43c8-aa4e-e8eed4f26a5f tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.160114 Jul 28 13:06:02.502983 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3780/7565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:02 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:03.525318 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:03.526026 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:03.533036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:03.533488 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:03.534265 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:03.534705 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:03.666537 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:03.674099 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-59fa784f-5917-4555-8717-0147fefeea0e tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1566 microversion: 2.1 time: 0.153542 Jul 28 13:06:03.674672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3786/7566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:03 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:04.586371 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-a0a842b4-8c36-466a-b4ca-cf83f3078044 req-6bd1e0c3-f2df-462d-9c39-6369855e6db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afda2d-d25b-45d1-839b-c03682bcc862", "name": "network-vif-deleted", "tag": "fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:04.597220 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a0a842b4-8c36-466a-b4ca-cf83f3078044 req-6bd1e0c3-f2df-462d-9c39-6369855e6db4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:04.597682 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-a0a842b4-8c36-466a-b4ca-cf83f3078044 req-6bd1e0c3-f2df-462d-9c39-6369855e6db4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:04.612158 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-a0a842b4-8c36-466a-b4ca-cf83f3078044 req-6bd1e0c3-f2df-462d-9c39-6369855e6db4 service nova] Creating event network-vif-deleted:fcc6a14e-4141-44b2-bc5d-5e7aaa01ca13 for instance 83afda2d-d25b-45d1-839b-c03682bcc862 on n-h1-851368-1 Jul 28 13:06:04.617967 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-a0a842b4-8c36-466a-b4ca-cf83f3078044 req-6bd1e0c3-f2df-462d-9c39-6369855e6db4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 Jul 28 13:06:04.618573 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3781/7567] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 13:06:04.695999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:04.696629 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:04.703395 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:04.703842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:04.704600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:04.705033 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:04.777790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:04.786593 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d196693f-bbab-46d2-ab1e-63f9fba2f2a5 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1218 microversion: 2.1 time: 0.094462 Jul 28 13:06:04.787097 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3787/7568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:04 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:05.809291 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:05.809914 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:05.816320 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:05.816792 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:05.817581 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:05.818040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:05.880274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:05.888034 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-14fc5ce7-3fa7-4161-9e41-e5bd6def6a23 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1218 microversion: 2.1 time: 0.084575 Jul 28 13:06:05.888807 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3782/7569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:05 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:06.908145 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:06.908876 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:06.916160 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:06.916697 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:06.917549 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:06.918070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:06.985858 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:06.994727 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-d145219d-36cd-4ca8-8634-3f345c2cc1ff tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1218 microversion: 2.1 time: 0.090492 Jul 28 13:06:06.995345 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3788/7570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:06 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:08.016259 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:08.017003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:08.024562 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:08.025029 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:08.025825 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:08.026285 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:08.089290 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:08.096920 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-85ff2bd5-1db4-425c-ac54-effe821c877a tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1218 microversion: 2.1 time: 0.084613 Jul 28 13:06:08.097496 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3783/7571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:08 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:09.118581 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:09.119868 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:09.130522 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:09.134104 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:09.135141 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:09.135754 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:09.179243 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:09.179947 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:09.180558 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.objects.instance [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lazy-loading 'fault' on Instance uuid 83afda2d-d25b-45d1-839b-c03682bcc862 {{(pid=119236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 13:06:09.230438 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7f91736da41f09e676bd8ebb9558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ab116813148efbe970906aa7d6562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:09.239839 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-f0e7ffce-6aac-427a-8fae-b54f70ae07ca tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 200 len: 1177 microversion: 2.1 time: 0.126196 Jul 28 13:06:09.240637 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3789/7572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:09 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 1177 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:10.261193 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:10.261745 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] [instance: 83afda2d-d25b-45d1-839b-c03682bcc862] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:10.268809 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:10.269277 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:10.270064 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:10.270519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:10.284456 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] HTTP exception thrown: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Request method failure captured: Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 HTTP/1.1 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4oeWSCrlrJf6iwh8DHq9ttuZJ-Hm-tgTA72B4YSRf0qMj4zS0a9JIfeX7aSP5FL2wVBrw5KPFKVO8E04GZ8zPZAaS5_C753_3kgG-plCWjaz4Ji1ZcZ8wKg5OwKssBMc4IIbIJTtW1wl36WefzDBQXIuyKoB9B1AjRYgKuMvYRdHW1A Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 2d6ab116813148efbe970906aa7d6562 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestShelveInstance-67024389 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2d6ab116813148efbe970906aa7d6562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2d6ab116813148efbe970906aa7d6562"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2d6ab116813148efbe970906aa7d6562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2d6ab116813148efbe970906aa7d6562"}]}] Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestShelveInstance-67024389 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 2d6ab116813148efbe970906aa7d6562 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestShelveInstance-67024389 Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestShelveInstance-67024389-project Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 30c7f91736da41f09e676bd8ebb9558e Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestShelveInstance-67024389-project Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': '83afda2d-d25b-45d1-839b-c03682bcc862'} Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:06:10.286159 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Returning 404 to user: Instance 83afda2d-d25b-45d1-839b-c03682bcc862 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-18bdbaa6-5642-4cf3-8f70-f7952c228ca6 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862" status: 404 len: 111 microversion: 2.1 time: 0.030468 Jul 28 13:06:10.292309 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3784/7573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:10 2022] GET /compute/v2.1/servers/83afda2d-d25b-45d1-839b-c03682bcc862 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 13:06:10.458293 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ede34490-05eb-46b3-bb11-2b4f0709c631 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] Calling method '.version_select at 0x7f2eb351d670>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:10.480152 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ede34490-05eb-46b3-bb11-2b4f0709c631 tempest-TestShelveInstance-67024389 tempest-TestShelveInstance-67024389-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-710503325" status: 202 len: 0 microversion: 2.1 time: 0.025752 Jul 28 13:06:10.481028 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3790/7574] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Jul 28 13:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-710503325 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 13:06:27.836412 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=12 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:27.841775 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=24 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:28.055117 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2907e05a-a314-4e52-97f5-f488529cd43b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Action: 'create', calling method: .version_select at 0x7f2eb243b8b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1544185726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTCK01kxD4tbcUEiiV5Pxc1JhukAU296lIOwQ4vGRC3T6PT7Kowe68a7/B/NTGGxJ3dQ3DtY1WztTs83Wqsh9TldCxIBHCt9B+ZR9ScMw1pS8p29Ya+xPhoYEdkmIBNCQ=="}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:28.071927 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2907e05a-a314-4e52-97f5-f488529cd43b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for project 8f6b92c286d34c3a901975bac442ed72. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 13:06:28.077383 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-2907e05a-a314-4e52-97f5-f488529cd43b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for user 4327f3e082ba4110b2be2ff92872299a and project 8f6b92c286d34c3a901975bac442ed72. Resources: {'key_pairs'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 13:06:28.103785 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2907e05a-a314-4e52-97f5-f488529cd43b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.280545 Jul 28 13:06:28.104386 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3785/7575] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Jul 28 13:06:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:06:29.101121 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:29.102470 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:29.106865 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-775423060", "imageRef": "d754ca4d-54f2-4b37-ac95-af6564180b9e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1544185726", "security_groups": [{"name": "tempest-secgroup-smoke-1346657111"}], "networks": [{"uuid": "d38ed198-e82c-4cf2-adb5-ce7031e113b4"}]}} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:29.223089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.network.neutron [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] validate_networks() for [('d38ed198-e82c-4cf2-adb5-ce7031e113b4', None, None, None, None, None)] {{(pid=119236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 13:06:29.670151 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Flavor limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 13:06:29.670600 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Image limits 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 13:06:29.671130 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Flavor pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 13:06:29.671790 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Image pref 0:0:0 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 13:06:29.672212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.virt.hardware [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 13:06:29.681961 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:29.682414 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:29.683241 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:29.683678 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:29.710779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for project 8f6b92c286d34c3a901975bac442ed72. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 13:06:29.716592 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.quota [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for user 4327f3e082ba4110b2be2ff92872299a and project 8f6b92c286d34c3a901975bac442ed72. Resources: {'instances', 'cores', 'ram'} {{(pid=119236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 13:06:29.730658 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Going to run 1 instances... {{(pid=119236) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 13:06:29.733005 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d754ca4d-54f2-4b37-ac95-af6564180b9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 13:06:29.779695 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-a5915c74-3139-41cb-9c6c-e73482692af7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681217 Jul 28 13:06:29.786053 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3791/7576] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 13:06:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 13:06:29.792922 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-04987be3-c5ff-4e10-90a5-7dbf99daf335 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:29.793661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-04987be3-c5ff-4e10-90a5-7dbf99daf335 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:29.863249 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-04987be3-c5ff-4e10-90a5-7dbf99daf335 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:29.870380 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-04987be3-c5ff-4e10-90a5-7dbf99daf335 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1248 microversion: 2.1 time: 0.082956 Jul 28 13:06:29.870953 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3786/7577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:29 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:30.892771 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:30.894011 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:30.905824 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:30.906487 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:30.908131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:30.908750 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:30.977779 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:30.985772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-b4a08fac-103f-4098-b654-841b6c60ed3f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1318 microversion: 2.1 time: 0.097935 Jul 28 13:06:30.986585 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3792/7578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:30 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:31.724456 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:06:31.725602 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:06:32.009740 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:32.010718 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:32.018555 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:32.019026 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:32.019860 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:32.020496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:32.205402 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:32.217163 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-79d056cd-4585-471e-9790-74d3813fcf89 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.211455 Jul 28 13:06:32.233829 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3787/7579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:32 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:32.391672 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-cac27775-4f92-4a02-ad72-70c3d8a80fd0 req-63c34f4d-dbc9-48db-823b-a6eb66586eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:32.402999 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cac27775-4f92-4a02-ad72-70c3d8a80fd0 req-63c34f4d-dbc9-48db-823b-a6eb66586eb4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:32.403564 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-cac27775-4f92-4a02-ad72-70c3d8a80fd0 req-63c34f4d-dbc9-48db-823b-a6eb66586eb4 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:32.422724 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-cac27775-4f92-4a02-ad72-70c3d8a80fd0 req-63c34f4d-dbc9-48db-823b-a6eb66586eb4 service nova] Creating event network-changed:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:06:32.427677 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-cac27775-4f92-4a02-ad72-70c3d8a80fd0 req-63c34f4d-dbc9-48db-823b-a6eb66586eb4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039808 Jul 28 13:06:32.429519 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3793/7580] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:06:33.237984 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:33.238613 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:33.246591 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:33.247059 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:33.247892 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:33.248352 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:33.395455 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:33.403430 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-581a1872-4ff2-4afe-9844-bbc0d325c99f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.169342 Jul 28 13:06:33.404037 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3788/7581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:33 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:06:34.424478 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:34.425187 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:34.431498 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:34.431951 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:34.432720 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:34.433162 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:34.566021 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:34.574092 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-cea8b8e6-161d-4b85-8e60-522521115d01 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.154771 Jul 28 13:06:34.574672 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3794/7582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:34 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:35.595837 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:35.596519 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:35.604620 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:35.605083 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:35.605856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:35.606303 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:35.737902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:35.745510 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9ca200e9-1302-4dcc-bd85-69d3d4f8d5f5 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.154000 Jul 28 13:06:35.746100 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3789/7583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:35 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:36.765945 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:36.766554 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:36.774155 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:36.774611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:36.775412 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:36.775850 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:36.908637 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:36.916746 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-37cc9cc4-fb9e-46d2-a77f-a262cad1bcc9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.154711 Jul 28 13:06:36.917334 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3795/7584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:36 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:37.937785 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:37.938531 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:37.946955 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:37.947486 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:37.948322 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:37.948823 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:38.087512 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:38.094992 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-4ee4507d-d64c-485e-9140-e1aedcc6108b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.161077 Jul 28 13:06:38.095689 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3790/7585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:37 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:39.116801 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:39.117424 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:39.124484 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:39.124881 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:39.125651 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:39.126095 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:39.354015 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:39.361454 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-65c06ead-8151-4586-ad61-dce5139e55cf tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.248809 Jul 28 13:06:39.362025 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3796/7586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:39 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:40.041317 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [req-4a085205-dc4c-4fc0-924d-98235f13c15c req-2b79d044-1389-47ee-9cb2-e561b85e2103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "name": "network-vif-plugged", "status": "completed", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:40.046836 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=6 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:40.054415 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4a085205-dc4c-4fc0-924d-98235f13c15c req-2b79d044-1389-47ee-9cb2-e561b85e2103 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:40.054997 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [req-4a085205-dc4c-4fc0-924d-98235f13c15c req-2b79d044-1389-47ee-9cb2-e561b85e2103 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:40.066241 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.compute.server_external_events [req-4a085205-dc4c-4fc0-924d-98235f13c15c req-2b79d044-1389-47ee-9cb2-e561b85e2103 service nova] Creating event network-vif-plugged:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:06:40.071719 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [req-4a085205-dc4c-4fc0-924d-98235f13c15c req-2b79d044-1389-47ee-9cb2-e561b85e2103 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034555 Jul 28 13:06:40.072337 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3791/7587] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:06:40.382641 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:40.384040 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:40.386244 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:40.387131 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=6 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:06:40.394089 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:40.394550 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:40.395369 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:40.395814 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:40.539926 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:40.547772 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-733e7141-cbfa-468b-95ea-a191e07f4d69 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.169670 Jul 28 13:06:40.548359 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3797/7588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:40 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:41.569617 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:41.570345 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:41.576640 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:41.577103 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:41.577875 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:41.578368 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:41.760338 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:41.767991 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-445f35bd-6ef0-4167-9264-df7b02073d7e tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1374 microversion: 2.1 time: 0.203442 Jul 28 13:06:41.768565 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3792/7589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:41 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:42.789806 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:42.790423 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:42.797382 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:42.797842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:42.798620 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:42.799063 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:42.927987 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:42.935595 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-4aba808f-b6c4-428e-99e4-ee9e3a7854af tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1558 microversion: 2.1 time: 0.150255 Jul 28 13:06:42.936176 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3798/7590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:42 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:42.955321 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:06:42.955945 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:06:42.963339 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:42.963805 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:42.964585 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:42.965033 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:43.097783 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:06:43.105890 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-198c92b9-20eb-4f47-a885-29e3c3e03d9a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1558 microversion: 2.1 time: 0.154420 Jul 28 13:06:43.106486 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3793/7591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:06:42 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:06:45.154225 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5ad5c114-224e-4c3a-9bec-952b9afeca7e req-8d132b07-8a09-4f77-8e39-e028a77b22b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:06:45.164036 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5ad5c114-224e-4c3a-9bec-952b9afeca7e req-8d132b07-8a09-4f77-8e39-e028a77b22b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:06:45.164548 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5ad5c114-224e-4c3a-9bec-952b9afeca7e req-8d132b07-8a09-4f77-8e39-e028a77b22b7 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:06:45.175637 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5ad5c114-224e-4c3a-9bec-952b9afeca7e req-8d132b07-8a09-4f77-8e39-e028a77b22b7 service nova] Creating event network-changed:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:06:45.181227 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5ad5c114-224e-4c3a-9bec-952b9afeca7e req-8d132b07-8a09-4f77-8e39-e028a77b22b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092610 Jul 28 13:06:45.181849 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3799/7592] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:08:55.488257 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:08:55.488873 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:09:11.874786 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:09:11.875999 n-d-851368-1 devstack@n-api.service[119235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 13:09:11.876595 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:11.877358 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=38 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:11.881621 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1497436431"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:11.883963 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:11.892155 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:11.892628 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:11.893414 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:11.893870 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:12.082350 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d1f041c2-72e7-416e-962b-81ffa84dc081 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "POST /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713/action" status: 202 len: 0 microversion: 2.1 time: 0.209284 Jul 28 13:09:12.082992 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3794/7593] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 13:09:11 2022] POST /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 13:09:18.789384 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 13:09:18.790225 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 13:09:18.790841 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:18.792195 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=42 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:18.852918 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-7c4bbbf8-5642-4b74-b91a-5b0805df7660 req-a7480561-51e4-4406-b0ce-917566250e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "name": "network-vif-plugged", "status": "completed", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:18.864045 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7c4bbbf8-5642-4b74-b91a-5b0805df7660 req-a7480561-51e4-4406-b0ce-917566250e26 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:18.864494 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-7c4bbbf8-5642-4b74-b91a-5b0805df7660 req-a7480561-51e4-4406-b0ce-917566250e26 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:18.875006 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-7c4bbbf8-5642-4b74-b91a-5b0805df7660 req-a7480561-51e4-4406-b0ce-917566250e26 service nova] Creating event network-vif-plugged:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:09:18.880065 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-7c4bbbf8-5642-4b74-b91a-5b0805df7660 req-a7480561-51e4-4406-b0ce-917566250e26 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092439 Jul 28 13:09:18.880656 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3800/7594] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 13:09:30.730934 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:30.731784 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:30.737709 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-331556456", "imageRef": "2477df11-9640-4649-8358-ac961ff6ccb7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1544185726", "security_groups": [{"name": "tempest-secgroup-smoke-1346657111"}], "networks": [{"uuid": "d38ed198-e82c-4cf2-adb5-ce7031e113b4"}]}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:30.769082 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [a732dd0a-6dd0-4373-aa91-35765c442af8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44978. Jul 28 13:09:30.770700 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] [7991eef3-bf99-4d70-a41d-a31baf4534ec] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44976. Jul 28 13:09:30.852666 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.network.neutron [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] validate_networks() for [('d38ed198-e82c-4cf2-adb5-ce7031e113b4', None, None, None, None, None)] {{(pid=119235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 13:09:31.279661 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Flavor limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 13:09:31.280111 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Image limits 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 13:09:31.280609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Flavor pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 13:09:31.281043 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Image pref 0:0:0 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 13:09:31.281476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.virt.hardware [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 13:09:31.290533 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:31.291607 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:31.292435 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:31.292894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:31.310334 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for project 8f6b92c286d34c3a901975bac442ed72. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 13:09:31.315525 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.quota [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Getting quotas for user 4327f3e082ba4110b2be2ff92872299a and project 8f6b92c286d34c3a901975bac442ed72. Resources: {'instances', 'cores', 'ram'} {{(pid=119235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 13:09:31.328274 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Going to run 1 instances... {{(pid=119235) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 13:09:31.330725 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2477df11-9640-4649-8358-ac961ff6ccb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 13:09:31.381877 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-10f95a56-40e4-488d-9345-96095582f16c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654397 Jul 28 13:09:31.382609 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3795/7595] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Jul 28 13:09:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 13:09:31.392523 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:31.393269 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=2 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:31.397459 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-999a1293-c289-4046-abd5-4851fbce94b9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:31.398173 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-999a1293-c289-4046-abd5-4851fbce94b9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:31.412545 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44996. Jul 28 13:09:31.413483 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 44994. Jul 28 13:09:31.458315 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-999a1293-c289-4046-abd5-4851fbce94b9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:31.466219 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-999a1293-c289-4046-abd5-4851fbce94b9 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1248 microversion: 2.1 time: 0.075930 Jul 28 13:09:31.466772 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3801/7596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:31 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:32.486988 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-27da48e0-4555-4885-83c0-9e49b0e911b7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:32.487652 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-27da48e0-4555-4885-83c0-9e49b0e911b7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:32.540799 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-27da48e0-4555-4885-83c0-9e49b0e911b7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:32.547626 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-27da48e0-4555-4885-83c0-9e49b0e911b7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1248 microversion: 2.1 time: 0.065346 Jul 28 13:09:32.548201 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3796/7597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:32 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1248 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:32.830529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-b1467573-b535-4f82-b0b7-6a493315e4f9 req-e63fd7aa-9eae-4348-9e70-4d5866ed2937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "name": "network-vif-unplugged", "status": "completed", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:32.842057 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b1467573-b535-4f82-b0b7-6a493315e4f9 req-e63fd7aa-9eae-4348-9e70-4d5866ed2937 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:32.842595 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-b1467573-b535-4f82-b0b7-6a493315e4f9 req-e63fd7aa-9eae-4348-9e70-4d5866ed2937 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:32.855007 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-b1467573-b535-4f82-b0b7-6a493315e4f9 req-e63fd7aa-9eae-4348-9e70-4d5866ed2937 service nova] Creating event network-vif-unplugged:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:09:32.860395 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-b1467573-b535-4f82-b0b7-6a493315e4f9 req-e63fd7aa-9eae-4348-9e70-4d5866ed2937 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033590 Jul 28 13:09:32.860994 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3802/7598] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:09:33.568224 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-9010fa14-6509-432a-8a19-dbee571d5683 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:33.568848 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-9010fa14-6509-432a-8a19-dbee571d5683 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:33.626471 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-9010fa14-6509-432a-8a19-dbee571d5683 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:33.633152 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-9010fa14-6509-432a-8a19-dbee571d5683 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1248 microversion: 2.1 time: 0.068847 Jul 28 13:09:33.633708 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3797/7599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:33 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:34.654004 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9220686e-47f9-4c48-b972-2a3ac20aea75 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:34.654749 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-9220686e-47f9-4c48-b972-2a3ac20aea75 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:34.716530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-9220686e-47f9-4c48-b972-2a3ac20aea75 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:34.727283 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9220686e-47f9-4c48-b972-2a3ac20aea75 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1248 microversion: 2.1 time: 0.077485 Jul 28 13:09:34.727868 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3803/7600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:34 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:35.748977 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:35.749604 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:35.756844 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:35.757312 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:35.758094 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:35.758548 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:35.819894 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:35.827842 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-57c3a58d-c599-494c-94f3-fa8c1e6c8220 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1252 microversion: 2.1 time: 0.082809 Jul 28 13:09:35.828420 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3798/7601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:35 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:36.850212 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:36.850990 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:36.861773 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:36.862516 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:36.863572 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:36.864234 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:36.968967 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:36.979218 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-5b4216ca-9039-4319-9084-fe41b554d192 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1306 microversion: 2.1 time: 0.134259 Jul 28 13:09:36.979838 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3804/7602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:36 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1306 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:38.000689 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:38.001913 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:38.009451 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:38.010182 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:38.011212 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:38.011829 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:38.153833 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:38.161607 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-eff28ec3-5543-4808-910d-66e6d151afcd tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.164802 Jul 28 13:09:38.162192 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3799/7603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:37 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:39.183821 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:39.184451 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:39.191655 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:39.192034 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:39.192811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:39.193435 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:39.354116 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:39.362613 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7ad21052-534f-401f-987c-2b94f7f9a2a2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.183443 Jul 28 13:09:39.363430 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3805/7604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:39 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:40.384929 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:40.385490 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:40.393057 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:40.393532 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:40.394328 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:40.394789 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:40.552122 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:40.560159 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-e654894d-c946-4da0-b58a-501fceb957e0 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.179135 Jul 28 13:09:40.568391 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3800/7605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:40 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:41.582061 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:41.583619 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:41.592479 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:41.593519 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:41.594605 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:41.595334 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:41.740445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:41.748601 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-0e2d0096-d01a-48a8-acb6-a8079247891f tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.170460 Jul 28 13:09:41.749559 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3806/7606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:41 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:42.769028 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:42.770593 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:42.772841 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:42.780362 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:42.781209 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:42.782245 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:42.782917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:42.941609 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:42.950925 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-223fa4ad-69f5-474f-9339-99f7557ed0e1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.185713 Jul 28 13:09:42.951764 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3801/7607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:42 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:43.972367 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:43.973074 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:43.980789 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:43.981256 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:43.982211 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:43.982648 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:44.129998 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:44.138170 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-7ced27bb-7839-49a1-8c6e-10e67f354678 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.170119 Jul 28 13:09:44.139131 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3807/7608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:43 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:45.158586 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:45.159349 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:45.161554 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell0:SELECT=10 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:45.168580 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:45.169048 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:45.169851 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:45.170302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:45.406066 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:45.414009 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-867543f1-c885-449a-bda2-be3e35b9b8d2 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.259354 Jul 28 13:09:45.414821 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3802/7609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:45 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:45.922817 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-89ae81a0-633f-420c-a0ca-67e68dabf699 req-b9c2099d-589e-434c-8965-a3ade059d329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:45.944842 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell0:SELECT=4 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:09:45.950136 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-89ae81a0-633f-420c-a0ca-67e68dabf699 req-b9c2099d-589e-434c-8965-a3ade059d329 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:45.951529 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-89ae81a0-633f-420c-a0ca-67e68dabf699 req-b9c2099d-589e-434c-8965-a3ade059d329 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:45.981612 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-89ae81a0-633f-420c-a0ca-67e68dabf699 req-b9c2099d-589e-434c-8965-a3ade059d329 service nova] Creating event network-changed:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:09:45.988458 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-89ae81a0-633f-420c-a0ca-67e68dabf699 req-b9c2099d-589e-434c-8965-a3ade059d329 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070372 Jul 28 13:09:45.989224 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3808/7610] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:09:46.434902 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:46.435741 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:46.442964 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:46.443550 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:46.444422 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:46.444952 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:46.592674 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:46.600323 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-fc019d26-6c9c-48bb-81bb-356612d1d65b tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.169468 Jul 28 13:09:46.601051 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3803/7611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:46 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:47.625418 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:47.626139 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:47.632607 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:47.633070 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:47.633853 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:47.634296 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:47.792443 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:47.800255 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-1ed70291-4737-4a8d-95e6-19cf9865d8ee tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.182034 Jul 28 13:09:47.800836 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3809/7612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:47 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:48.820683 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:48.821314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:48.828496 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:48.829127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:48.829923 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:48.830382 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:48.967647 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:48.975545 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-dffe996c-6744-4a50-bec2-d1da81527e77 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.158742 Jul 28 13:09:48.976142 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3804/7613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:48 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:49.643125 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-76f80f7b-5825-4031-870c-87b541272fb8 req-2d11344e-3635-4789-9d22-8458aa739806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "name": "network-vif-plugged", "status": "completed", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:49.653874 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-76f80f7b-5825-4031-870c-87b541272fb8 req-2d11344e-3635-4789-9d22-8458aa739806 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:49.654320 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-76f80f7b-5825-4031-870c-87b541272fb8 req-2d11344e-3635-4789-9d22-8458aa739806 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:49.668405 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-76f80f7b-5825-4031-870c-87b541272fb8 req-2d11344e-3635-4789-9d22-8458aa739806 service nova] Creating event network-vif-plugged:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:09:49.673309 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-76f80f7b-5825-4031-870c-87b541272fb8 req-2d11344e-3635-4789-9d22-8458aa739806 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033961 Jul 28 13:09:49.674086 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3810/7614] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:09:49.997314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:49.997942 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:50.004886 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:50.005353 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:50.006134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:50.006588 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:50.139514 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:50.151321 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-ec3d1d6b-e1e2-4c10-b269-02de823ceb0c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1374 microversion: 2.1 time: 0.156202 Jul 28 13:09:50.154184 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3805/7615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:49 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:51.176521 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:51.177379 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:51.184611 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:51.185066 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:51.186905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:51.186905 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:51.322719 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:51.331322 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-2feec00b-c065-4217-bc36-5eb4ab9af907 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1558 microversion: 2.1 time: 0.161154 Jul 28 13:09:51.331935 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3811/7616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:51 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:51.352899 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:09:51.353528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:09:51.360599 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:51.361068 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:51.361847 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:51.362302 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:51.493333 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:09:51.501313 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-bfe0983f-43d8-449c-ae54-e296a2b97a43 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1558 microversion: 2.1 time: 0.152381 Jul 28 13:09:51.501897 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3806/7617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:09:51 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:09:53.089407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d0ef6883-ad22-473e-9d9f-d95af4184146 req-23f3f61d-e4ff-4e28-b27e-bd16b4bff228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:09:53.100169 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d0ef6883-ad22-473e-9d9f-d95af4184146 req-23f3f61d-e4ff-4e28-b27e-bd16b4bff228 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:09:53.100614 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d0ef6883-ad22-473e-9d9f-d95af4184146 req-23f3f61d-e4ff-4e28-b27e-bd16b4bff228 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:09:53.111604 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d0ef6883-ad22-473e-9d9f-d95af4184146 req-23f3f61d-e4ff-4e28-b27e-bd16b4bff228 service nova] Creating event network-changed:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:09:53.116991 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d0ef6883-ad22-473e-9d9f-d95af4184146 req-23f3f61d-e4ff-4e28-b27e-bd16b4bff228 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Jul 28 13:09:53.117599 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3812/7618] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:11:31.622346 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:11:31.622898 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:11:31.738875 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:11:31.739041 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:11:32.002420 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:32.003134 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=56 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:32.060757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-569145358"}} {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:32.063222 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:32.069288 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:32.069760 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:32.070544 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:32.071003 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:32.259299 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-cc7eeff4-d737-4485-8d6c-244b5c5f409c tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "POST /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b/action" status: 202 len: 0 microversion: 2.1 time: 0.258536 Jul 28 13:11:32.259899 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3807/7619] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Jul 28 13:11:31 2022] POST /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 13:11:33.717307 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:11:33.717851 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:11:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:11:36.165783 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 13:11:36.166526 n-d-851368-1 devstack@n-api.service[119236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 13:11:36.167476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_api:SELECT=30 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:36.169222 n-d-851368-1 devstack@n-api.service[119236]: DEBUG dbcounter [-] [119236] Writing DB stats nova_cell1:SELECT=44 {{(pid=119236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:36.174067 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-95925eed-497b-49d3-89b7-446fd7e2696a req-b9ff6808-cd2b-43c5-9000-741605129352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "name": "network-vif-plugged", "status": "completed", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:36.185407 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-95925eed-497b-49d3-89b7-446fd7e2696a req-b9ff6808-cd2b-43c5-9000-741605129352 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:36.186220 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-95925eed-497b-49d3-89b7-446fd7e2696a req-b9ff6808-cd2b-43c5-9000-741605129352 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:36.200800 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-95925eed-497b-49d3-89b7-446fd7e2696a req-b9ff6808-cd2b-43c5-9000-741605129352 service nova] Creating event network-vif-plugged:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:11:36.206460 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-95925eed-497b-49d3-89b7-446fd7e2696a req-b9ff6808-cd2b-43c5-9000-741605129352 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042881 Jul 28 13:11:36.207926 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3813/7620] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:11:45.885861 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_api:SELECT=2 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:45.886656 n-d-851368-1 devstack@n-api.service[119235]: DEBUG dbcounter [-] [119235] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 13:11:45.891528 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:45.895483 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:45.906702 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b573768-6dc9-450a-8d0a-38c9856ab8bc] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 45308. Jul 28 13:11:45.911034 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccf3e684-0a01-475a-9f7b-1e5fe4c62134] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 45306. Jul 28 13:11:45.928438 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:45.928917 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:45.929728 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:45.930181 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:45.950567 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-5d7ea86c-0f64-4f3b-8481-722cbd6986e7 req-d8a776f7-ba19-4850-bd4c-0dca56a4856f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:45.962267 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d7ea86c-0f64-4f3b-8481-722cbd6986e7 req-d8a776f7-ba19-4850-bd4c-0dca56a4856f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:45.963080 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-5d7ea86c-0f64-4f3b-8481-722cbd6986e7 req-d8a776f7-ba19-4850-bd4c-0dca56a4856f service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:45.963575 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Going to try to terminate instance {{(pid=119235) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 13:11:45.975334 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-5d7ea86c-0f64-4f3b-8481-722cbd6986e7 req-d8a776f7-ba19-4850-bd4c-0dca56a4856f service nova] Creating event network-changed:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:11:45.981523 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-5d7ea86c-0f64-4f3b-8481-722cbd6986e7 req-d8a776f7-ba19-4850-bd4c-0dca56a4856f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095411 Jul 28 13:11:45.982362 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3814/7621] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:11:46.091899 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-212ee367-b6fb-46ec-a7c0-7d22cdd32fa1 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 204 len: 0 microversion: 2.1 time: 0.208145 Jul 28 13:11:46.092497 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3808/7622] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 13:11:45 2022] DELETE /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 13:11:46.103811 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:46.104530 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:46.111737 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:46.112201 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:46.113192 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:46.113793 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:46.374114 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.policy [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119236) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:11:46.382097 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-31caf082-42c9-444b-a38b-7de12692d989 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1681 microversion: 2.1 time: 0.284209 Jul 28 13:11:46.383268 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3815/7623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:46 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 13:11:47.403687 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:47.404410 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:47.416005 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:47.416476 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:47.417267 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:47.417757 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:47.652822 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:11:47.661083 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-74462b82-1d6c-49cf-a25b-04570e633b15 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 200 len: 1681 microversion: 2.1 time: 0.261611 Jul 28 13:11:47.661592 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3809/7624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:47 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:11:48.274129 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-20649b30-cfb5-4b3f-aa54-93c58e7845c9 req-4f460960-ab07-497c-a7ce-ac1f16730a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a75581-e347-4f92-bee5-716582b6fb1b", "name": "network-vif-deleted", "tag": "9b1e81c0-4503-4db5-ac7b-752d90098dd6"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:48.284084 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20649b30-cfb5-4b3f-aa54-93c58e7845c9 req-4f460960-ab07-497c-a7ce-ac1f16730a02 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:48.284532 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-20649b30-cfb5-4b3f-aa54-93c58e7845c9 req-4f460960-ab07-497c-a7ce-ac1f16730a02 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:48.295526 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-20649b30-cfb5-4b3f-aa54-93c58e7845c9 req-4f460960-ab07-497c-a7ce-ac1f16730a02 service nova] Creating event network-vif-deleted:9b1e81c0-4503-4db5-ac7b-752d90098dd6 for instance e1a75581-e347-4f92-bee5-716582b6fb1b on n-h2-851368-1 Jul 28 13:11:48.300124 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-20649b30-cfb5-4b3f-aa54-93c58e7845c9 req-4f460960-ab07-497c-a7ce-ac1f16730a02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102204 Jul 28 13:11:48.300707 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3816/7625] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:11:48.682444 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:48.683795 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: e1a75581-e347-4f92-bee5-716582b6fb1b] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:48.691597 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:48.692065 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:48.692859 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:48.693314 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:48.707779 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] HTTP exception thrown: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Request method failure captured: Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b HTTP/1.1 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4onOr0cu1-2ANfovF2iyV57zsiOPTsb7peZU2rapYMMBJRymtzpnK1xrOZEhGyYjhLe3ythl7dm9jGQ44MMF_csE_4Oc8ainspkhdJXeea59Uorlm7kDnpx0y9A5x_liEuyBWFwDBKPN8L5KcguBGzHpp0OkBcGzDoLwDRBItP5cTRU Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f6b92c286d34c3a901975bac442ed72 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f6b92c286d34c3a901975bac442ed72"}]}] Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f6b92c286d34c3a901975bac442ed72 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestSnapshotPattern-2007213608-project Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4327f3e082ba4110b2be2ff92872299a Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestSnapshotPattern-2007213608-project Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'e1a75581-e347-4f92-bee5-716582b6fb1b'} Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:11:48.709431 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. Jul 28 13:11:48.714924 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:48.716166 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Returning 404 to user: Instance e1a75581-e347-4f92-bee5-716582b6fb1b could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 13:11:48.717070 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-7aced793-e8cb-40eb-a564-dbc29f8917a3 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b" status: 404 len: 111 microversion: 2.1 time: 0.039169 Jul 28 13:11:48.717822 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3810/7626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:48 2022] GET /compute/v2.1/servers/e1a75581-e347-4f92-bee5-716582b6fb1b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 13:11:50.016608 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:50.017281 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119236) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:50.023603 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:50.024134 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:50.024972 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:50.025485 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:50.050716 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.compute.api [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Going to try to terminate instance {{(pid=119236) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 13:11:50.125622 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-ff0c4a39-4a9e-40ad-9be2-22e17206f053 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 204 len: 0 microversion: 2.1 time: 0.114315 Jul 28 13:11:50.126794 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3817/7627] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Jul 28 13:11:50 2022] DELETE /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 13:11:50.137547 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:50.138198 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:50.145127 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:50.145602 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:50.146398 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:50.146856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:50.285298 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:11:50.293139 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-d59190de-ec21-4a05-b073-e2391180128d tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1683 microversion: 2.1 time: 0.161798 Jul 28 13:11:50.293719 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3811/7628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:50 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:11:50.316328 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-d3edda37-c917-47c4-b464-8f33aa74e600 req-e380b699-9568-4b99-8523-7071b7b0ba1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:50.326223 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d3edda37-c917-47c4-b464-8f33aa74e600 req-e380b699-9568-4b99-8523-7071b7b0ba1a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:50.326797 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-d3edda37-c917-47c4-b464-8f33aa74e600 req-e380b699-9568-4b99-8523-7071b7b0ba1a service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:50.340608 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-d3edda37-c917-47c4-b464-8f33aa74e600 req-e380b699-9568-4b99-8523-7071b7b0ba1a service nova] Creating event network-changed:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:11:50.345444 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-d3edda37-c917-47c4-b464-8f33aa74e600 req-e380b699-9568-4b99-8523-7071b7b0ba1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Jul 28 13:11:50.346028 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3818/7629] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 13:11:51.314040 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:51.314890 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:51.323146 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:51.324319 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:51.325199 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:51.325827 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:51.570856 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.policy [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327f3e082ba4110b2be2ff92872299a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6b92c286d34c3a901975bac442ed72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119235) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 13:11:51.578922 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-504ec28b-95dc-45c5-9768-4bc275a60fc7 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 200 len: 1683 microversion: 2.1 time: 0.268694 Jul 28 13:11:51.579838 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3812/7630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:51 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 1683 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 13:11:51.609476 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [req-e22bdf2b-cb39-4359-8e9a-8b38dc4c9648 req-a8bebb60-5a0e-48d2-9393-7f214336f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4393004-9d93-4873-86ef-732b74fc6713", "name": "network-vif-deleted", "tag": "06c31f0f-4592-49e8-8385-aa6fde8112d0"}]} {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 13:11:51.619483 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e22bdf2b-cb39-4359-8e9a-8b38dc4c9648 req-a8bebb60-5a0e-48d2-9393-7f214336f4d2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:51.619922 n-d-851368-1 devstack@n-api.service[119236]: DEBUG oslo_concurrency.lockutils [req-e22bdf2b-cb39-4359-8e9a-8b38dc4c9648 req-a8bebb60-5a0e-48d2-9393-7f214336f4d2 service nova] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:51.631550 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.compute.server_external_events [req-e22bdf2b-cb39-4359-8e9a-8b38dc4c9648 req-a8bebb60-5a0e-48d2-9393-7f214336f4d2 service nova] Creating event network-vif-deleted:06c31f0f-4592-49e8-8385-aa6fde8112d0 for instance f4393004-9d93-4873-86ef-732b74fc6713 on n-h1-851368-1 Jul 28 13:11:51.636547 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [req-e22bdf2b-cb39-4359-8e9a-8b38dc4c9648 req-a8bebb60-5a0e-48d2-9393-7f214336f4d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Jul 28 13:11:51.637127 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3819/7631] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 28 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 13:11:52.600633 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '>' {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:52.601270 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.compute.api [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] [instance: f4393004-9d93-4873-86ef-732b74fc6713] Fetching instance by UUID {{(pid=119235) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 13:11:52.608217 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:52.608691 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:52.609484 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 13:11:52.609941 n-d-851368-1 devstack@n-api.service[119235]: DEBUG oslo_concurrency.lockutils [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Lock "db04e563-931a-4431-85d3-7168847bf9eb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 13:11:52.624188 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.wsgi [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] HTTP exception thrown: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Request method failure captured: Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: request: GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 HTTP/1.1 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Accept: application/json Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Accept-Encoding: identity Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Connection: close Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Content-Length: 0 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Content-Type: application/json Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Host: 10.222.0.93 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: Openstack-System-Scope: None Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: User-Agent: python-urllib3/1.26.10 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Auth-Token: gAAAAABi4onOr0cu1-2ANfovF2iyV57zsiOPTsb7peZU2rapYMMBJRymtzpnK1xrOZEhGyYjhLe3ythl7dm9jGQ44MMF_csE_4Oc8ainspkhdJXeea59Uorlm7kDnpx0y9A5x_liEuyBWFwDBKPN8L5KcguBGzHpp0OkBcGzDoLwDRBItP5cTRU Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Id: None Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Domain-Name: None Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Identity-Status: Confirmed Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Is-Admin-Project: True Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Id: default Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Domain-Name: Default Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Id: 8f6b92c286d34c3a901975bac442ed72 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Project-Name: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Role: member,reader Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Roles: member,reader Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8f6b92c286d34c3a901975bac442ed72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8f6b92c286d34c3a901975bac442ed72"}]}] Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Id: 8f6b92c286d34c3a901975bac442ed72 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-Tenant-Name: tempest-TestSnapshotPattern-2007213608 Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-User: tempest-TestSnapshotPattern-2007213608-project Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Id: default Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Domain-Name: Default Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Id: 4327f3e082ba4110b2be2ff92872299a Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: X-User-Name: tempest-TestSnapshotPattern-2007213608-project Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: method: > Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: exception: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: action_args: {'id': 'f4393004-9d93-4873-86ef-732b74fc6713'} Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: {{(pid=119235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 13:11:52.625735 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: ERROR nova.api.openstack.wsgi Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: DEBUG nova.api.openstack.wsgi [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Returning 404 to user: Instance f4393004-9d93-4873-86ef-732b74fc6713 could not be found. {{(pid=119235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: INFO nova.api.openstack.requestlog [None req-2bc79c0c-3dc7-47b2-b42a-4c14c7ce373a tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713" status: 404 len: 111 microversion: 2.1 time: 0.030461 Jul 28 13:11:52.630463 n-d-851368-1 devstack@n-api.service[119235]: [pid: 119235|app: 0|req: 3813/7632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Jul 28 13:11:52 2022] GET /compute/v2.1/servers/f4393004-9d93-4873-86ef-732b74fc6713 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 13:11:52.789445 n-d-851368-1 devstack@n-api.service[119236]: DEBUG nova.api.openstack.wsgi [None req-9ccaf338-800d-41cf-aa81-507684ea9f34 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] Calling method '.version_select at 0x7f2eb18b5b80>' {{(pid=119236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 13:11:52.823190 n-d-851368-1 devstack@n-api.service[119236]: INFO nova.api.openstack.requestlog [None req-9ccaf338-800d-41cf-aa81-507684ea9f34 tempest-TestSnapshotPattern-2007213608 tempest-TestSnapshotPattern-2007213608-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1544185726" status: 202 len: 0 microversion: 2.1 time: 0.038728 Jul 28 13:11:52.824397 n-d-851368-1 devstack@n-api.service[119236]: [pid: 119236|app: 0|req: 3820/7633] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Jul 28 13:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1544185726 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 13:13:55.500492 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:13:55.501210 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:14:51.630566 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:14:51.631333 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:14:51.746397 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:14:51.746584 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:14:53.725573 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:14:53.726100 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:14:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:16:48.886221 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:16:48.886837 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:17:05.921831 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:17:05.922400 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:17:15.509555 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:17:15.510266 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:18:11.640459 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:18:11.640904 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:18:11.754747 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:18:11.754926 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:18:13.733759 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:18:13.734272 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:20:08.895290 n-d-851368-1 devstack@n-api.service[119235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:20:08.895899 n-d-851368-1 devstack@n-api.service[119235]: Thu Jul 28 13:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:20:25.929781 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:20:25.930967 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 13:20:35.517490 n-d-851368-1 devstack@n-api.service[119236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 13:20:35.518131 n-d-851368-1 devstack@n-api.service[119236]: Thu Jul 28 13:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!